2023-10-06T01:25:16.067 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-06T01:25:16.067 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}} --archive /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412094 --owner scheduled_yuriw@teuthology --verbose -- /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412094/orig.config.yaml 2023-10-06T01:25:16.113 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T01:25:16.187 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412094 branch: wip-yuri-testing-2023-10-05-0730-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}} email: yweinste@redhat.com first_in_suite: false job_id: '7412094' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri-testing-2023-10-05-0730-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 kclient: syntax: v2 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-10-05-0730-quincy sha1: f1e315a9732d36c05ec316678e2397dc58561c7f owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 7519 sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 sleep_before_teardown: 0 subset: 111/12000 suite: fs suite_branch: wip-yuri-testing-2023-10-05-0730-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: f1e315a9732d36c05ec316678e2397dc58561c7f targets: smithi069.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBowBKOLIpyipqFpD3/v7Yj0n5BMVMwAyKP5FFD/+0wS7K/ftkOtxWGpWHhdt032Y7/PG9/qTK4oKf9dlL8Pe7U= smithi088.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE0WqH0gRmlxyp8SlhsxOCEwnRt2oa83IfsFqZYkOxEWUH0tdXtupPuhn7MMwD/PxOS4dZhixw1qoUf9f++llto= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - check-counter: counters: mgr: - min: 4 name: finisher-volumes.complete_latency.avgcount - expected_val: 0 name: finisher-volumes.queue_len - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestPerModuleFinsherThread teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-05_23:52:50 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-06T01:25:16.188 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa; will attempt to use it 2023-10-06T01:25:16.188 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa/tasks 2023-10-06T01:25:16.189 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-06T01:25:16.190 INFO:teuthology.task.internal:Checking packages... 2023-10-06T01:25:16.212 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2' 2023-10-06T01:25:16.212 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-06T01:25:16.212 INFO:teuthology.packaging:ref: None 2023-10-06T01:25:16.212 INFO:teuthology.packaging:tag: None 2023-10-06T01:25:16.212 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T01:25:16.212 INFO:teuthology.packaging:sha1: 736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T01:25:16.212 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-10-05-0730-quincy 2023-10-06T01:25:16.447 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1296.g736ac5ba 2023-10-06T01:25:16.447 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-06T01:25:16.454 INFO:teuthology.task.internal:no buildpackages task found 2023-10-06T01:25:16.454 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-06T01:25:16.460 INFO:teuthology.task.internal:Saving configuration 2023-10-06T01:25:16.476 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-06T01:25:16.482 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T01:25:16.511 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412094', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 01:19:34.315778', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBowBKOLIpyipqFpD3/v7Yj0n5BMVMwAyKP5FFD/+0wS7K/ftkOtxWGpWHhdt032Y7/PG9/qTK4oKf9dlL8Pe7U='} 2023-10-06T01:25:16.537 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412094', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 01:19:34.317380', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE0WqH0gRmlxyp8SlhsxOCEwnRt2oa83IfsFqZYkOxEWUH0tdXtupPuhn7MMwD/PxOS4dZhixw1qoUf9f++llto='} 2023-10-06T01:25:16.537 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-06T01:25:16.544 INFO:teuthology.task.internal:roles: ubuntu@smithi069.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-06T01:25:16.544 INFO:teuthology.task.internal:roles: ubuntu@smithi088.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-06T01:25:16.544 INFO:teuthology.run_tasks:Running task console_log... 2023-10-06T01:25:16.617 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2be2e05b80>, signals=[15]) 2023-10-06T01:25:16.618 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-06T01:25:16.624 INFO:teuthology.task.internal:Opening connections... 2023-10-06T01:25:16.624 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi069.front.sepia.ceph.com 2023-10-06T01:25:16.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:25:16.696 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi088.front.sepia.ceph.com 2023-10-06T01:25:16.697 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:25:16.764 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-06T01:25:16.770 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2023-10-06T01:25:16.788 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2023-10-06T01:25:16.788 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2023-10-06T01:25:16.844 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T01:25:16.844 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T01:25:16.844 INFO:teuthology.orchestra.run.smithi069.stdout:ID="rhel" 2023-10-06T01:25:16.844 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="fedora" 2023-10-06T01:25:16.844 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="8.4" 2023-10-06T01:25:16.844 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el8" 2023-10-06T01:25:16.844 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T01:25:16.844 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2023-10-06T01:25:16.844 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T01:25:16.845 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T01:25:16.845 INFO:teuthology.orchestra.run.smithi069.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T01:25:16.845 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T01:25:16.845 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:25:16.845 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T01:25:16.845 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T01:25:16.845 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T01:25:16.845 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T01:25:16.846 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2023-10-06T01:25:16.876 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2023-10-06T01:25:16.893 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2023-10-06T01:25:16.893 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2023-10-06T01:25:16.950 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="Red Hat Enterprise Linux" 2023-10-06T01:25:16.950 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="8.4 (Ootpa)" 2023-10-06T01:25:16.950 INFO:teuthology.orchestra.run.smithi088.stdout:ID="rhel" 2023-10-06T01:25:16.950 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="fedora" 2023-10-06T01:25:16.950 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="8.4" 2023-10-06T01:25:16.950 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el8" 2023-10-06T01:25:16.950 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-06T01:25:16.950 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2023-10-06T01:25:16.950 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-06T01:25:16.951 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://www.redhat.com/" 2023-10-06T01:25:16.951 INFO:teuthology.orchestra.run.smithi088.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-06T01:25:16.951 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-06T01:25:16.951 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:25:16.951 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-06T01:25:16.951 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-06T01:25:16.951 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-06T01:25:16.951 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-06T01:25:16.951 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2023-10-06T01:25:16.976 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-06T01:25:16.985 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-06T01:25:16.991 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-06T01:25:16.991 DEBUG:teuthology.orchestra.run.smithi069:> test '!' -e /home/ubuntu/cephtest 2023-10-06T01:25:16.994 DEBUG:teuthology.orchestra.run.smithi088:> test '!' -e /home/ubuntu/cephtest 2023-10-06T01:25:17.009 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-06T01:25:17.015 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-06T01:25:17.015 DEBUG:teuthology.orchestra.run.smithi069:> test -z $(ls -A /var/lib/ceph) 2023-10-06T01:25:17.049 DEBUG:teuthology.orchestra.run.smithi088:> test -z $(ls -A /var/lib/ceph) 2023-10-06T01:25:17.063 INFO:teuthology.orchestra.run.smithi069.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T01:25:17.066 INFO:teuthology.orchestra.run.smithi088.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-06T01:25:17.067 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-06T01:25:17.123 INFO:teuthology.run_tasks:Running task kernel... 2023-10-06T01:25:17.137 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2023-10-06T01:25:17.137 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-06T01:25:17.137 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-06T01:25:17.138 DEBUG:teuthology.orchestra.run.smithi069:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T01:25:17.138 DEBUG:teuthology.orchestra.run.smithi088:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-06T01:25:17.153 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:25:17.154 DEBUG:teuthology.orchestra.run.smithi069:> uname -r 2023-10-06T01:25:17.154 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:25:17.155 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2023-10-06T01:25:17.209 INFO:teuthology.orchestra.run.smithi069.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T01:25:17.209 INFO:teuthology.task.kernel:Running kernel on smithi069: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T01:25:17.209 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum install -y kernel 2023-10-06T01:25:17.211 INFO:teuthology.orchestra.run.smithi088.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-06T01:25:17.211 INFO:teuthology.task.kernel:Running kernel on smithi088: 4.18.0-305.25.1.el8_4.x86_64 2023-10-06T01:25:17.211 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum install -y kernel 2023-10-06T01:25:18.642 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-10-06T01:25:18.642 INFO:teuthology.orchestra.run.smithi088.stdout:Unable to read consumer identity 2023-10-06T01:25:18.643 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-10-06T01:25:18.644 INFO:teuthology.orchestra.run.smithi069.stdout:Unable to read consumer identity 2023-10-06T01:25:19.988 INFO:teuthology.orchestra.run.smithi088.stdout:Copr repo for python3-asyncssh owned by ceph 35 kB/s | 3.5 kB 00:00 2023-10-06T01:25:20.008 INFO:teuthology.orchestra.run.smithi069.stdout:Copr repo for python3-asyncssh owned by ceph 38 kB/s | 3.5 kB 00:00 2023-10-06T01:25:20.609 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 27 MB/s | 16 MB 00:00 2023-10-06T01:25:21.117 INFO:teuthology.orchestra.run.smithi069.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2023-10-06T01:25:23.931 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 3.8 MB/s | 24 kB 00:00 2023-10-06T01:25:24.010 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:01 ago on Fri 06 Oct 2023 01:25:23 AM UTC. 2023-10-06T01:25:24.547 INFO:teuthology.orchestra.run.smithi069.stdout:lab-extras 2.3 MB/s | 24 kB 00:00 2023-10-06T01:25:24.660 INFO:teuthology.orchestra.run.smithi088.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T01:25:24.660 INFO:teuthology.orchestra.run.smithi088.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T01:25:24.660 INFO:teuthology.orchestra.run.smithi088.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T01:25:24.831 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-10-06T01:25:24.832 INFO:teuthology.orchestra.run.smithi088.stdout:Nothing to do. 2023-10-06T01:25:24.832 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-10-06T01:25:24.968 DEBUG:teuthology.orchestra.run.smithi088:> echo no | sudo yum reinstall kernel || true 2023-10-06T01:25:25.280 INFO:teuthology.orchestra.run.smithi069.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-06T01:25:25.280 INFO:teuthology.orchestra.run.smithi069.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-06T01:25:25.280 INFO:teuthology.orchestra.run.smithi069.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-06T01:25:25.311 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-10-06T01:25:25.311 INFO:teuthology.orchestra.run.smithi088.stdout:Unable to read consumer identity 2023-10-06T01:25:25.432 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-10-06T01:25:25.433 INFO:teuthology.orchestra.run.smithi069.stdout:Nothing to do. 2023-10-06T01:25:25.434 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-10-06T01:25:25.562 DEBUG:teuthology.orchestra.run.smithi069:> echo no | sudo yum reinstall kernel || true 2023-10-06T01:25:25.598 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 01:25:23 AM UTC. 2023-10-06T01:25:25.761 INFO:teuthology.orchestra.run.smithi088.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T01:25:25.761 INFO:teuthology.orchestra.run.smithi088.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T01:25:25.761 INFO:teuthology.orchestra.run.smithi088.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T01:25:25.791 INFO:teuthology.orchestra.run.smithi088.stderr:Error: No packages marked for reinstall. 2023-10-06T01:25:25.840 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum reinstall -y kernel || true 2023-10-06T01:25:25.946 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-10-06T01:25:25.946 INFO:teuthology.orchestra.run.smithi069.stdout:Unable to read consumer identity 2023-10-06T01:25:26.183 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-10-06T01:25:26.183 INFO:teuthology.orchestra.run.smithi088.stdout:Unable to read consumer identity 2023-10-06T01:25:26.235 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:00:02 ago on Fri 06 Oct 2023 01:25:24 AM UTC. 2023-10-06T01:25:26.385 INFO:teuthology.orchestra.run.smithi069.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T01:25:26.385 INFO:teuthology.orchestra.run.smithi069.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T01:25:26.385 INFO:teuthology.orchestra.run.smithi069.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T01:25:26.418 INFO:teuthology.orchestra.run.smithi069.stderr:Error: No packages marked for reinstall. 2023-10-06T01:25:26.463 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:00:03 ago on Fri 06 Oct 2023 01:25:23 AM UTC. 2023-10-06T01:25:26.467 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum reinstall -y kernel || true 2023-10-06T01:25:26.635 INFO:teuthology.orchestra.run.smithi088.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T01:25:26.635 INFO:teuthology.orchestra.run.smithi088.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T01:25:26.635 INFO:teuthology.orchestra.run.smithi088.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T01:25:26.648 INFO:teuthology.orchestra.run.smithi088.stderr:Error: No packages marked for reinstall. 2023-10-06T01:25:26.703 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T01:25:26.807 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-10-06T01:25:26.807 INFO:teuthology.orchestra.run.smithi069.stdout:Unable to read consumer identity 2023-10-06T01:25:26.826 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T01:25:26.826 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T01:25:26.826 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T01:25:26.827 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T01:25:26.827 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T01:25:26.827 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-10-06T01:25:26.827 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi088.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T01:25:26.827 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T01:25:26.951 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T01:25:26.951 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T01:25:26.951 DEBUG:teuthology.orchestra.run.smithi088:> sudo rpm -qi grub2-tools 2023-10-06T01:25:26.978 INFO:teuthology.orchestra.run.smithi088.stdout:Name : grub2-tools 2023-10-06T01:25:26.978 INFO:teuthology.orchestra.run.smithi088.stdout:Epoch : 1 2023-10-06T01:25:26.978 INFO:teuthology.orchestra.run.smithi088.stdout:Version : 2.02 2023-10-06T01:25:26.978 INFO:teuthology.orchestra.run.smithi088.stdout:Release : 99.el8_4.1 2023-10-06T01:25:26.979 INFO:teuthology.orchestra.run.smithi088.stdout:Architecture: x86_64 2023-10-06T01:25:26.979 INFO:teuthology.orchestra.run.smithi088.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T01:25:26.979 INFO:teuthology.orchestra.run.smithi088.stdout:Group : System Environment/Base 2023-10-06T01:25:26.979 INFO:teuthology.orchestra.run.smithi088.stdout:Size : 9264631 2023-10-06T01:25:26.979 INFO:teuthology.orchestra.run.smithi088.stdout:License : GPLv3+ 2023-10-06T01:25:26.979 INFO:teuthology.orchestra.run.smithi088.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T01:25:26.979 INFO:teuthology.orchestra.run.smithi088.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T01:25:26.979 INFO:teuthology.orchestra.run.smithi088.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T01:25:26.980 INFO:teuthology.orchestra.run.smithi088.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T01:25:26.980 INFO:teuthology.orchestra.run.smithi088.stdout:Relocations : (not relocatable) 2023-10-06T01:25:26.980 INFO:teuthology.orchestra.run.smithi088.stdout:Packager : Red Hat, Inc. 2023-10-06T01:25:26.980 INFO:teuthology.orchestra.run.smithi088.stdout:Vendor : Red Hat, Inc. 2023-10-06T01:25:26.980 INFO:teuthology.orchestra.run.smithi088.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T01:25:26.980 INFO:teuthology.orchestra.run.smithi088.stdout:Summary : Support tools for GRUB. 2023-10-06T01:25:26.980 INFO:teuthology.orchestra.run.smithi088.stdout:Description : 2023-10-06T01:25:26.981 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:25:26.981 INFO:teuthology.orchestra.run.smithi088.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T01:25:26.981 INFO:teuthology.orchestra.run.smithi088.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T01:25:26.981 INFO:teuthology.orchestra.run.smithi088.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T01:25:26.981 INFO:teuthology.orchestra.run.smithi088.stdout:hardware devices. 2023-10-06T01:25:26.981 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:25:26.981 INFO:teuthology.orchestra.run.smithi088.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T01:25:26.982 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T01:25:26.982 INFO:teuthology.task.kernel:Updating grub on smithi088 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T01:25:26.983 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T01:25:27.099 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:00:03 ago on Fri 06 Oct 2023 01:25:24 AM UTC. 2023-10-06T01:25:27.231 INFO:teuthology.orchestra.run.smithi069.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-06T01:25:27.231 INFO:teuthology.orchestra.run.smithi069.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T01:25:27.231 INFO:teuthology.orchestra.run.smithi069.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-06T01:25:27.243 INFO:teuthology.orchestra.run.smithi069.stderr:Error: No packages marked for reinstall. 2023-10-06T01:25:27.296 DEBUG:teuthology.orchestra.run.smithi069:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T01:25:27.420 INFO:teuthology.orchestra.run.smithi069.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T01:25:27.420 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T01:25:27.420 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-06T01:25:27.420 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-06T01:25:27.420 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-06T01:25:27.420 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-06T01:25:27.421 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi069.front.sepia.ceph.com, path=None, version=distro) 2023-10-06T01:25:27.421 DEBUG:teuthology.orchestra.run.smithi069:> rpm -q kernel | sort -rV | head -n 1 2023-10-06T01:25:27.546 INFO:teuthology.orchestra.run.smithi069.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-06T01:25:27.546 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-06T01:25:27.546 DEBUG:teuthology.orchestra.run.smithi069:> sudo rpm -qi grub2-tools 2023-10-06T01:25:27.573 INFO:teuthology.orchestra.run.smithi069.stdout:Name : grub2-tools 2023-10-06T01:25:27.573 INFO:teuthology.orchestra.run.smithi069.stdout:Epoch : 1 2023-10-06T01:25:27.573 INFO:teuthology.orchestra.run.smithi069.stdout:Version : 2.02 2023-10-06T01:25:27.573 INFO:teuthology.orchestra.run.smithi069.stdout:Release : 99.el8_4.1 2023-10-06T01:25:27.573 INFO:teuthology.orchestra.run.smithi069.stdout:Architecture: x86_64 2023-10-06T01:25:27.573 INFO:teuthology.orchestra.run.smithi069.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-06T01:25:27.573 INFO:teuthology.orchestra.run.smithi069.stdout:Group : System Environment/Base 2023-10-06T01:25:27.573 INFO:teuthology.orchestra.run.smithi069.stdout:Size : 9264631 2023-10-06T01:25:27.574 INFO:teuthology.orchestra.run.smithi069.stdout:License : GPLv3+ 2023-10-06T01:25:27.574 INFO:teuthology.orchestra.run.smithi069.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-06T01:25:27.574 INFO:teuthology.orchestra.run.smithi069.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-06T01:25:27.574 INFO:teuthology.orchestra.run.smithi069.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-06T01:25:27.574 INFO:teuthology.orchestra.run.smithi069.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-06T01:25:27.574 INFO:teuthology.orchestra.run.smithi069.stdout:Relocations : (not relocatable) 2023-10-06T01:25:27.574 INFO:teuthology.orchestra.run.smithi069.stdout:Packager : Red Hat, Inc. 2023-10-06T01:25:27.574 INFO:teuthology.orchestra.run.smithi069.stdout:Vendor : Red Hat, Inc. 2023-10-06T01:25:27.575 INFO:teuthology.orchestra.run.smithi069.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-06T01:25:27.575 INFO:teuthology.orchestra.run.smithi069.stdout:Summary : Support tools for GRUB. 2023-10-06T01:25:27.575 INFO:teuthology.orchestra.run.smithi069.stdout:Description : 2023-10-06T01:25:27.575 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:25:27.575 INFO:teuthology.orchestra.run.smithi069.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-06T01:25:27.575 INFO:teuthology.orchestra.run.smithi069.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-06T01:25:27.575 INFO:teuthology.orchestra.run.smithi069.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-06T01:25:27.576 INFO:teuthology.orchestra.run.smithi069.stdout:hardware devices. 2023-10-06T01:25:27.576 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:25:27.576 INFO:teuthology.orchestra.run.smithi069.stdout:This subpackage provides tools for support of all platforms. 2023-10-06T01:25:27.577 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-06T01:25:27.577 INFO:teuthology.task.kernel:Updating grub on smithi069 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-06T01:25:27.577 DEBUG:teuthology.orchestra.run.smithi069:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-06T01:25:28.425 INFO:teuthology.orchestra.run.smithi088.stderr:Generating grub configuration file ... 2023-10-06T01:25:28.904 INFO:teuthology.orchestra.run.smithi069.stderr:Generating grub configuration file ... 2023-10-06T01:25:30.261 INFO:teuthology.orchestra.run.smithi088.stderr:done 2023-10-06T01:25:30.263 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2023-10-06T01:25:30.280 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.HwdQZ7RIWz 2023-10-06T01:25:30.280 DEBUG:teuthology.orchestra.run.smithi088:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.HwdQZ7RIWz 2023-10-06T01:25:30.363 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.HwdQZ7RIWz 2023-10-06T01:25:30.519 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.HwdQZ7RIWz is 6KB 2023-10-06T01:25:30.567 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.HwdQZ7RIWz 2023-10-06T01:25:30.581 DEBUG:teuthology.orchestra.run.smithi088:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T01:25:30.646 INFO:teuthology.orchestra.run.smithi088.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T01:25:30.646 INFO:teuthology.orchestra.run.smithi088.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T01:25:30.646 INFO:teuthology.orchestra.run.smithi088.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T01:25:30.646 INFO:teuthology.orchestra.run.smithi088.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T01:25:30.647 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T01:25:30.798 DEBUG:teuthology.orchestra.run.smithi088:> sudo shutdown -r now 2023-10-06T01:25:31.088 INFO:teuthology.orchestra.run.smithi069.stderr:done 2023-10-06T01:25:31.089 DEBUG:teuthology.orchestra.run.smithi069:> mktemp 2023-10-06T01:25:31.103 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/tmp.3WB3qRMtLM 2023-10-06T01:25:31.103 DEBUG:teuthology.orchestra.run.smithi069:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.3WB3qRMtLM 2023-10-06T01:25:31.172 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0666 /tmp/tmp.3WB3qRMtLM 2023-10-06T01:25:31.323 DEBUG:teuthology.orchestra.remote:smithi069:/tmp/tmp.3WB3qRMtLM is 6KB 2023-10-06T01:25:31.341 DEBUG:teuthology.orchestra.run.smithi069:> rm -fr /tmp/tmp.3WB3qRMtLM 2023-10-06T01:25:31.354 DEBUG:teuthology.orchestra.run.smithi069:> sudo /bin/ls /boot/loader/entries || true 2023-10-06T01:25:31.436 INFO:teuthology.orchestra.run.smithi069.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-06T01:25:31.437 INFO:teuthology.orchestra.run.smithi069.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-06T01:25:31.437 INFO:teuthology.orchestra.run.smithi069.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-06T01:25:31.437 INFO:teuthology.orchestra.run.smithi069.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-06T01:25:31.438 DEBUG:teuthology.orchestra.run.smithi069:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-06T01:25:31.601 DEBUG:teuthology.orchestra.run.smithi069:> sudo shutdown -r now 2023-10-06T01:26:00.826 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-06T01:26:00.826 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-10-06T01:26:00.827 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:26:01.604 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-06T01:26:01.605 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-10-06T01:26:01.605 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:26:19.258 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-10-06T01:26:20.030 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-10-06T01:26:28.266 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-10-06T01:26:28.267 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:26:29.032 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-10-06T01:26:29.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:26:31.322 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-10-06T01:26:32.090 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-10-06T01:26:43.330 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-10-06T01:26:43.331 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:26:44.092 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-10-06T01:26:44.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:26:46.394 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-10-06T01:27:01.408 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-10-06T01:27:01.409 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:27:02.522 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.69 2023-10-06T01:27:17.534 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-10-06T01:27:17.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:27:18.067 DEBUG:teuthology.orchestra.run.smithi069:> true 2023-10-06T01:27:18.359 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-10-06T01:27:18.359 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T01:27:18.359 DEBUG:teuthology.orchestra.run.smithi069:> uname -r 2023-10-06T01:27:18.418 INFO:teuthology.orchestra.run.smithi069.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T01:27:18.418 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T01:27:18.418 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T01:27:18.418 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T01:27:19.419 DEBUG:teuthology.parallel:result is None 2023-10-06T01:27:19.930 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2023-10-06T01:27:37.931 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-10-06T01:27:37.932 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:27:38.316 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-10-06T01:27:38.565 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-10-06T01:27:38.565 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-06T01:27:38.565 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2023-10-06T01:27:38.580 INFO:teuthology.orchestra.run.smithi088.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-06T01:27:38.580 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-06T01:27:38.581 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-06T01:27:38.581 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-06T01:27:39.581 DEBUG:teuthology.parallel:result is None 2023-10-06T01:27:39.581 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-06T01:27:39.593 INFO:teuthology.task.internal:Creating test directory... 2023-10-06T01:27:39.593 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T01:27:39.597 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-06T01:27:39.614 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-06T01:27:39.621 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-06T01:27:39.628 INFO:teuthology.task.internal:Creating archive directory... 2023-10-06T01:27:39.628 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T01:27:39.658 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-06T01:27:39.699 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-06T01:27:39.706 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-06T01:27:39.707 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T01:27:39.719 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-06T01:27:39.835 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T01:27:39.836 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T01:27:39.850 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T01:27:39.857 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-06T01:27:39.858 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-06T01:27:39.866 INFO:teuthology.task.internal:Configuring sudo... 2023-10-06T01:27:39.866 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T01:27:39.868 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-06T01:27:39.896 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-06T01:27:39.905 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-06T01:27:39.905 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T01:27:39.935 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-06T01:27:39.952 DEBUG:teuthology.orchestra.run.smithi069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T01:27:40.031 DEBUG:teuthology.orchestra.run.smithi069:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T01:27:40.090 DEBUG:teuthology.orchestra.run.smithi069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T01:27:40.128 DEBUG:teuthology.orchestra.run.smithi069:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T01:27:40.170 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-10-06T01:27:40.170 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T01:27:40.233 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T01:27:40.279 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-06T01:27:40.321 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T01:27:40.402 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-06T01:27:40.446 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-06T01:27:40.446 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-06T01:27:40.512 DEBUG:teuthology.orchestra.run.smithi069:> sudo service rsyslog restart 2023-10-06T01:27:40.515 DEBUG:teuthology.orchestra.run.smithi088:> sudo service rsyslog restart 2023-10-06T01:27:40.575 INFO:teuthology.orchestra.run.smithi069.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T01:27:40.616 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T01:27:40.882 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-06T01:27:40.890 INFO:teuthology.task.internal:Starting timer... 2023-10-06T01:27:40.890 INFO:teuthology.run_tasks:Running task pcp... 2023-10-06T01:27:40.903 INFO:teuthology.run_tasks:Running task selinux... 2023-10-06T01:27:40.915 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-10-06T01:27:40.915 DEBUG:teuthology.orchestra.run.smithi069:> sudo service auditd rotate 2023-10-06T01:27:40.980 INFO:teuthology.orchestra.run.smithi069.stdout:Rotating logs: [ OK ] 2023-10-06T01:27:40.981 DEBUG:teuthology.orchestra.run.smithi088:> sudo service auditd rotate 2023-10-06T01:27:41.029 INFO:teuthology.orchestra.run.smithi088.stdout:Rotating logs: [ OK ] 2023-10-06T01:27:41.030 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-06T01:27:41.030 DEBUG:teuthology.orchestra.run.smithi069:> /usr/sbin/getenforce 2023-10-06T01:27:41.051 INFO:teuthology.orchestra.run.smithi069.stdout:Permissive 2023-10-06T01:27:41.052 DEBUG:teuthology.orchestra.run.smithi088:> /usr/sbin/getenforce 2023-10-06T01:27:41.075 INFO:teuthology.orchestra.run.smithi088.stdout:Permissive 2023-10-06T01:27:41.076 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi069.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi088.front.sepia.ceph.com': 'permissive'} 2023-10-06T01:27:41.076 DEBUG:teuthology.orchestra.run.smithi069:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T01:27:41.117 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:27:41.117 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T01:27:41.142 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:27:41.143 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-06T01:27:41.143 DEBUG:teuthology.orchestra.run.smithi069:> sudo /usr/sbin/setenforce permissive 2023-10-06T01:27:41.183 DEBUG:teuthology.orchestra.run.smithi088:> sudo /usr/sbin/setenforce permissive 2023-10-06T01:27:41.208 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-06T01:27:41.218 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-10-06T01:27:41.224 INFO:teuthology.repo_utils:Fetching main from origin 2023-10-06T01:27:41.367 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-06T01:27:41.384 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-06T01:27:41.386 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi069.front.sepia.ceph.com,smithi088.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-06T01:35:48.787 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi069.front.sepia.ceph.com'), Remote(name='ubuntu@smithi088.front.sepia.ceph.com')] 2023-10-06T01:35:48.788 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-10-06T01:35:48.789 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:35:48.859 DEBUG:teuthology.orchestra.run.smithi069:> true 2023-10-06T01:35:48.929 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2023-10-06T01:35:48.929 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-10-06T01:35:48.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-06T01:35:48.999 DEBUG:teuthology.orchestra.run.smithi088:> true 2023-10-06T01:35:49.065 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2023-10-06T01:35:49.065 INFO:teuthology.run_tasks:Running task clock... 2023-10-06T01:35:49.081 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-06T01:35:49.081 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T01:35:49.081 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T01:35:49.083 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-06T01:35:49.084 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T01:35:49.110 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T01:35:49.124 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T01:35:49.134 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-06T01:35:49.148 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-06T01:35:49.157 INFO:teuthology.orchestra.run.smithi069.stderr:sudo: ntpd: command not found 2023-10-06T01:35:49.167 INFO:teuthology.orchestra.run.smithi069.stdout:506 Cannot talk to daemon 2023-10-06T01:35:49.181 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T01:35:49.187 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: ntpd: command not found 2023-10-06T01:35:49.194 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T01:35:49.197 INFO:teuthology.orchestra.run.smithi088.stdout:506 Cannot talk to daemon 2023-10-06T01:35:49.211 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-06T01:35:49.224 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-06T01:35:49.266 INFO:teuthology.orchestra.run.smithi069.stderr:bash: ntpq: command not found 2023-10-06T01:35:49.270 INFO:teuthology.orchestra.run.smithi069.stdout:210 Number of sources = 4 2023-10-06T01:35:49.270 INFO:teuthology.orchestra.run.smithi069.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T01:35:49.270 INFO:teuthology.orchestra.run.smithi069.stdout:=============================================================================== 2023-10-06T01:35:49.270 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:35:49.270 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:35:49.271 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:35:49.271 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:35:49.292 INFO:teuthology.orchestra.run.smithi088.stderr:bash: ntpq: command not found 2023-10-06T01:35:49.295 INFO:teuthology.orchestra.run.smithi088.stdout:210 Number of sources = 4 2023-10-06T01:35:49.296 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T01:35:49.296 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2023-10-06T01:35:49.296 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:35:49.296 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:35:49.296 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:35:49.296 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:35:49.297 INFO:teuthology.run_tasks:Running task install... 2023-10-06T01:35:49.305 DEBUG:teuthology.task.install:project ceph 2023-10-06T01:35:49.306 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}} 2023-10-06T01:35:49.306 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'} 2023-10-06T01:35:49.306 INFO:teuthology.task.install:Using flavor: default 2023-10-06T01:35:49.313 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-06T01:35:49.313 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-06T01:35:49.314 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'tag': None, 'wait_for_package': False} 2023-10-06T01:35:49.314 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T01:35:49.317 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'tag': None, 'wait_for_package': False} 2023-10-06T01:35:49.317 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T01:35:49.467 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/ 2023-10-06T01:35:49.468 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1296.g736ac5ba 2023-10-06T01:35:49.576 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/ 2023-10-06T01:35:49.576 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1296.g736ac5ba 2023-10-06T01:35:49.578 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T01:35:49.578 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-10-06T01:35:49.578 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T01:35:49.609 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T01:35:49.609 DEBUG:teuthology.orchestra.run.smithi069:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T01:35:49.675 DEBUG:teuthology.orchestra.run.smithi069:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T01:35:49.686 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-05-0730-quincy/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-06T01:35:49.687 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-06T01:35:49.687 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-06T01:35:49.712 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-06T01:35:49.712 DEBUG:teuthology.orchestra.run.smithi088:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/736ac5ba72cb47af7d6f6666b1e100f7e20a20e2/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-06T01:35:49.750 DEBUG:teuthology.orchestra.run.smithi069:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T01:35:49.777 DEBUG:teuthology.orchestra.run.smithi088:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-06T01:35:49.814 INFO:teuthology.orchestra.run.smithi069.stdout:check_obsoletes = 1 2023-10-06T01:35:49.815 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum clean all 2023-10-06T01:35:49.852 DEBUG:teuthology.orchestra.run.smithi088:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-06T01:35:49.916 INFO:teuthology.orchestra.run.smithi088.stdout:check_obsoletes = 1 2023-10-06T01:35:49.917 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum clean all 2023-10-06T01:35:50.206 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-10-06T01:35:50.306 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-10-06T01:35:50.553 INFO:teuthology.orchestra.run.smithi069.stdout:44 files removed 2023-10-06T01:35:50.610 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T01:35:50.728 INFO:teuthology.orchestra.run.smithi088.stdout:44 files removed 2023-10-06T01:35:50.779 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-06T01:35:50.959 INFO:teuthology.orchestra.run.smithi069.stdout:Updating Subscription Management repositories. 2023-10-06T01:35:51.127 INFO:teuthology.orchestra.run.smithi088.stdout:Updating Subscription Management repositories. 2023-10-06T01:35:51.915 INFO:teuthology.orchestra.run.smithi069.stdout:ceph packages for x86_64 243 kB/s | 78 kB 00:00 2023-10-06T01:35:51.953 INFO:teuthology.orchestra.run.smithi088.stdout:ceph packages for x86_64 343 kB/s | 78 kB 00:00 2023-10-06T01:35:52.198 INFO:teuthology.orchestra.run.smithi069.stdout:ceph noarch packages 38 kB/s | 9.2 kB 00:00 2023-10-06T01:35:52.298 INFO:teuthology.orchestra.run.smithi088.stdout:ceph noarch packages 30 kB/s | 9.2 kB 00:00 2023-10-06T01:35:52.474 INFO:teuthology.orchestra.run.smithi069.stdout:ceph source packages 5.9 kB/s | 1.4 kB 00:00 2023-10-06T01:35:52.513 INFO:teuthology.orchestra.run.smithi088.stdout:ceph source packages 7.8 kB/s | 1.4 kB 00:00 2023-10-06T01:35:52.606 INFO:teuthology.orchestra.run.smithi069.stdout:Copr repo for python3-asyncssh owned by ceph 34 kB/s | 3.5 kB 00:00 2023-10-06T01:35:52.649 INFO:teuthology.orchestra.run.smithi088.stdout:Copr repo for python3-asyncssh owned by ceph 32 kB/s | 3.5 kB 00:00 2023-10-06T01:35:53.552 INFO:teuthology.orchestra.run.smithi069.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2023-10-06T01:35:54.750 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 7.7 MB/s | 16 MB 00:02 2023-10-06T01:35:56.853 INFO:teuthology.orchestra.run.smithi069.stdout:lab-extras 5.1 MB/s | 24 kB 00:00 2023-10-06T01:35:57.218 INFO:teuthology.orchestra.run.smithi069.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 116 MB/s | 33 MB 00:00 2023-10-06T01:35:58.037 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 4.6 MB/s | 24 kB 00:00 2023-10-06T01:35:58.414 INFO:teuthology.orchestra.run.smithi088.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 129 MB/s | 38 MB 00:00 2023-10-06T01:36:02.316 INFO:teuthology.orchestra.run.smithi069.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 126 MB/s | 38 MB 00:00 2023-10-06T01:36:03.952 INFO:teuthology.orchestra.run.smithi088.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 121 MB/s | 33 MB 00:00 2023-10-06T01:36:10.726 INFO:teuthology.orchestra.run.smithi069.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T01:36:10.726 INFO:teuthology.orchestra.run.smithi069.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T01:36:10.737 INFO:teuthology.orchestra.run.smithi069.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T01:36:10.738 INFO:teuthology.orchestra.run.smithi069.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T01:36:10.739 INFO:teuthology.orchestra.run.smithi069.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T01:36:10.739 INFO:teuthology.orchestra.run.smithi069.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T01:36:10.741 INFO:teuthology.orchestra.run.smithi069.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T01:36:10.743 INFO:teuthology.orchestra.run.smithi069.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T01:36:10.744 INFO:teuthology.orchestra.run.smithi069.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T01:36:11.236 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2023-10-06T01:36:11.247 INFO:teuthology.orchestra.run.smithi069.stdout:====================================================================================================================== 2023-10-06T01:36:11.247 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2023-10-06T01:36:11.247 INFO:teuthology.orchestra.run.smithi069.stdout:====================================================================================================================== 2023-10-06T01:36:11.247 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2023-10-06T01:36:11.247 INFO:teuthology.orchestra.run.smithi069.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T01:36:11.248 INFO:teuthology.orchestra.run.smithi069.stdout: ceph x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 6.4 k 2023-10-06T01:36:11.248 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-base x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.2 M 2023-10-06T01:36:11.248 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 876 k 2023-10-06T01:36:11.248 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 162 k 2023-10-06T01:36:11.248 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 1.6 M 2023-10-06T01:36:11.248 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 121 k 2023-10-06T01:36:11.248 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 1.7 M 2023-10-06T01:36:11.248 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 7.4 M 2023-10-06T01:36:11.248 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-rook noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 47 k 2023-10-06T01:36:11.248 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-radosgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T01:36:11.248 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-test x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 52 M 2023-10-06T01:36:11.249 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-volume noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 267 k 2023-10-06T01:36:11.249 INFO:teuthology.orchestra.run.smithi069.stdout: cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 80 k 2023-10-06T01:36:11.249 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 255 k 2023-10-06T01:36:11.249 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-top noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 18 k 2023-10-06T01:36:11.249 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T01:36:11.249 INFO:teuthology.orchestra.run.smithi069.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T01:36:11.249 INFO:teuthology.orchestra.run.smithi069.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T01:36:11.249 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 25 k 2023-10-06T01:36:11.249 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 797 k 2023-10-06T01:36:11.249 INFO:teuthology.orchestra.run.smithi069.stdout: librados-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 130 k 2023-10-06T01:36:11.249 INFO:teuthology.orchestra.run.smithi069.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T01:36:11.250 INFO:teuthology.orchestra.run.smithi069.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T01:36:11.250 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T01:36:11.250 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cephfs x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 190 k 2023-10-06T01:36:11.250 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rados x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 371 k 2023-10-06T01:36:11.250 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 358 k 2023-10-06T01:36:11.250 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 107 k 2023-10-06T01:36:11.250 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 90 k 2023-10-06T01:36:11.250 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T01:36:11.250 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-nbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 173 k 2023-10-06T01:36:11.250 INFO:teuthology.orchestra.run.smithi069.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T01:36:11.250 INFO:teuthology.orchestra.run.smithi069.stdout:Upgrading: 2023-10-06T01:36:11.251 INFO:teuthology.orchestra.run.smithi069.stdout: librados2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T01:36:11.251 INFO:teuthology.orchestra.run.smithi069.stdout: librbd1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.6 M 2023-10-06T01:36:11.251 INFO:teuthology.orchestra.run.smithi069.stdout:Installing dependencies: 2023-10-06T01:36:11.251 INFO:teuthology.orchestra.run.smithi069.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T01:36:11.251 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 23 M 2023-10-06T01:36:11.251 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 23 k 2023-10-06T01:36:11.251 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mds x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 2.3 M 2023-10-06T01:36:11.251 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 238 k 2023-10-06T01:36:11.251 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mon x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.9 M 2023-10-06T01:36:11.251 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-osd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T01:36:11.252 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 14 k 2023-10-06T01:36:11.252 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-selinux x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 24 k 2023-10-06T01:36:11.252 INFO:teuthology.orchestra.run.smithi069.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T01:36:11.252 INFO:teuthology.orchestra.run.smithi069.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T01:36:11.252 INFO:teuthology.orchestra.run.smithi069.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T01:36:11.252 INFO:teuthology.orchestra.run.smithi069.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T01:36:11.252 INFO:teuthology.orchestra.run.smithi069.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T01:36:11.252 INFO:teuthology.orchestra.run.smithi069.stdout: libcephsqlite x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 174 k 2023-10-06T01:36:11.252 INFO:teuthology.orchestra.run.smithi069.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T01:36:11.252 INFO:teuthology.orchestra.run.smithi069.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T01:36:11.252 INFO:teuthology.orchestra.run.smithi069.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T01:36:11.253 INFO:teuthology.orchestra.run.smithi069.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T01:36:11.253 INFO:teuthology.orchestra.run.smithi069.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T01:36:11.253 INFO:teuthology.orchestra.run.smithi069.stdout: libradosstriper1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 507 k 2023-10-06T01:36:11.253 INFO:teuthology.orchestra.run.smithi069.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T01:36:11.253 INFO:teuthology.orchestra.run.smithi069.stdout: librgw2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.6 M 2023-10-06T01:36:11.253 INFO:teuthology.orchestra.run.smithi069.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T01:36:11.253 INFO:teuthology.orchestra.run.smithi069.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T01:36:11.253 INFO:teuthology.orchestra.run.smithi069.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T01:36:11.253 INFO:teuthology.orchestra.run.smithi069.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T01:36:11.253 INFO:teuthology.orchestra.run.smithi069.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T01:36:11.254 INFO:teuthology.orchestra.run.smithi069.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T01:36:11.254 INFO:teuthology.orchestra.run.smithi069.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T01:36:11.254 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T01:36:11.254 INFO:teuthology.orchestra.run.smithi069.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T01:36:11.254 INFO:teuthology.orchestra.run.smithi069.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T01:36:11.254 INFO:teuthology.orchestra.run.smithi069.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T01:36:11.254 INFO:teuthology.orchestra.run.smithi069.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T01:36:11.254 INFO:teuthology.orchestra.run.smithi069.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T01:36:11.254 INFO:teuthology.orchestra.run.smithi069.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T01:36:11.254 INFO:teuthology.orchestra.run.smithi069.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T01:36:11.255 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T01:36:11.255 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-argparse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 45 k 2023-10-06T01:36:11.255 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 115 k 2023-10-06T01:36:11.255 INFO:teuthology.orchestra.run.smithi069.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T01:36:11.255 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T01:36:11.255 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T01:36:11.255 INFO:teuthology.orchestra.run.smithi069.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T01:36:11.255 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T01:36:11.255 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T01:36:11.255 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T01:36:11.255 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T01:36:11.256 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T01:36:11.256 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T01:36:11.256 INFO:teuthology.orchestra.run.smithi069.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T01:36:11.256 INFO:teuthology.orchestra.run.smithi069.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T01:36:11.256 INFO:teuthology.orchestra.run.smithi069.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T01:36:11.256 INFO:teuthology.orchestra.run.smithi069.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T01:36:11.256 INFO:teuthology.orchestra.run.smithi069.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T01:36:11.256 INFO:teuthology.orchestra.run.smithi069.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T01:36:11.256 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T01:36:11.256 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T01:36:11.256 INFO:teuthology.orchestra.run.smithi069.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T01:36:11.257 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T01:36:11.257 INFO:teuthology.orchestra.run.smithi069.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T01:36:11.257 INFO:teuthology.orchestra.run.smithi069.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T01:36:11.257 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T01:36:11.257 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T01:36:11.257 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T01:36:11.257 INFO:teuthology.orchestra.run.smithi069.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T01:36:11.257 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T01:36:11.257 INFO:teuthology.orchestra.run.smithi069.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T01:36:11.257 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T01:36:11.257 INFO:teuthology.orchestra.run.smithi069.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T01:36:11.258 INFO:teuthology.orchestra.run.smithi069.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T01:36:11.258 INFO:teuthology.orchestra.run.smithi069.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T01:36:11.258 INFO:teuthology.orchestra.run.smithi069.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T01:36:11.258 INFO:teuthology.orchestra.run.smithi069.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T01:36:11.258 INFO:teuthology.orchestra.run.smithi069.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T01:36:11.258 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T01:36:11.258 INFO:teuthology.orchestra.run.smithi069.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T01:36:11.258 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T01:36:11.258 INFO:teuthology.orchestra.run.smithi069.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T01:36:11.258 INFO:teuthology.orchestra.run.smithi069.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T01:36:11.259 INFO:teuthology.orchestra.run.smithi069.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T01:36:11.259 INFO:teuthology.orchestra.run.smithi069.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T01:36:11.259 INFO:teuthology.orchestra.run.smithi069.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T01:36:11.259 INFO:teuthology.orchestra.run.smithi069.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T01:36:11.259 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:36:11.259 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2023-10-06T01:36:11.259 INFO:teuthology.orchestra.run.smithi069.stdout:====================================================================================================================== 2023-10-06T01:36:11.259 INFO:teuthology.orchestra.run.smithi069.stdout:Install 118 Packages 2023-10-06T01:36:11.259 INFO:teuthology.orchestra.run.smithi069.stdout:Upgrade 2 Packages 2023-10-06T01:36:11.259 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:36:11.260 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 201 M 2023-10-06T01:36:11.260 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2023-10-06T01:36:11.748 INFO:teuthology.orchestra.run.smithi069.stdout:(1/120): ceph-17.2.6-1296.g736ac5ba.el8.x86_64. 71 kB/s | 6.4 kB 00:00 2023-10-06T01:36:11.900 INFO:teuthology.orchestra.run.smithi069.stdout:(2/120): ceph-fuse-17.2.6-1296.g736ac5ba.el8.x8 5.7 MB/s | 876 kB 00:00 2023-10-06T01:36:11.922 INFO:teuthology.orchestra.run.smithi069.stdout:(3/120): ceph-immutable-object-cache-17.2.6-129 7.2 MB/s | 162 kB 00:00 2023-10-06T01:36:12.099 INFO:teuthology.orchestra.run.smithi069.stdout:(4/120): ceph-mds-17.2.6-1296.g736ac5ba.el8.x86 13 MB/s | 2.3 MB 00:00 2023-10-06T01:36:12.207 INFO:teuthology.orchestra.run.smithi069.stdout:(5/120): ceph-mgr-17.2.6-1296.g736ac5ba.el8.x86 15 MB/s | 1.6 MB 00:00 2023-10-06T01:36:12.457 INFO:teuthology.orchestra.run.smithi069.stdout:(6/120): ceph-mon-17.2.6-1296.g736ac5ba.el8.x86 16 MB/s | 3.9 MB 00:00 2023-10-06T01:36:12.477 INFO:teuthology.orchestra.run.smithi088.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T01:36:12.478 INFO:teuthology.orchestra.run.smithi088.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-06T01:36:12.488 INFO:teuthology.orchestra.run.smithi088.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-06T01:36:12.489 INFO:teuthology.orchestra.run.smithi088.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-06T01:36:12.490 INFO:teuthology.orchestra.run.smithi088.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-06T01:36:12.491 INFO:teuthology.orchestra.run.smithi088.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-06T01:36:12.493 INFO:teuthology.orchestra.run.smithi088.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-06T01:36:12.495 INFO:teuthology.orchestra.run.smithi088.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-06T01:36:12.496 INFO:teuthology.orchestra.run.smithi088.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-06T01:36:12.732 INFO:teuthology.orchestra.run.smithi069.stdout:(7/120): ceph-base-17.2.6-1296.g736ac5ba.el8.x8 4.8 MB/s | 5.2 MB 00:01 2023-10-06T01:36:12.981 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2023-10-06T01:36:12.992 INFO:teuthology.orchestra.run.smithi088.stdout:====================================================================================================================== 2023-10-06T01:36:12.992 INFO:teuthology.orchestra.run.smithi088.stdout: Package Arch Version Repository Size 2023-10-06T01:36:12.993 INFO:teuthology.orchestra.run.smithi088.stdout:====================================================================================================================== 2023-10-06T01:36:12.993 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2023-10-06T01:36:12.993 INFO:teuthology.orchestra.run.smithi088.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-06T01:36:12.994 INFO:teuthology.orchestra.run.smithi088.stdout: ceph x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 6.4 k 2023-10-06T01:36:12.994 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.2 M 2023-10-06T01:36:12.994 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 876 k 2023-10-06T01:36:12.994 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 162 k 2023-10-06T01:36:12.994 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 1.6 M 2023-10-06T01:36:12.995 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 121 k 2023-10-06T01:36:12.996 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 1.7 M 2023-10-06T01:36:12.996 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 7.4 M 2023-10-06T01:36:12.996 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 47 k 2023-10-06T01:36:12.996 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T01:36:12.996 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 52 M 2023-10-06T01:36:12.996 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-volume noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 267 k 2023-10-06T01:36:12.996 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 80 k 2023-10-06T01:36:12.996 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 255 k 2023-10-06T01:36:12.996 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-top noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 18 k 2023-10-06T01:36:12.997 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-06T01:36:12.997 INFO:teuthology.orchestra.run.smithi088.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-06T01:36:12.997 INFO:teuthology.orchestra.run.smithi088.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-06T01:36:12.997 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 25 k 2023-10-06T01:36:12.997 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 797 k 2023-10-06T01:36:12.997 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 130 k 2023-10-06T01:36:12.997 INFO:teuthology.orchestra.run.smithi088.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-06T01:36:12.997 INFO:teuthology.orchestra.run.smithi088.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-06T01:36:12.997 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-06T01:36:12.997 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 190 k 2023-10-06T01:36:12.997 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 371 k 2023-10-06T01:36:12.997 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 358 k 2023-10-06T01:36:12.998 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 107 k 2023-10-06T01:36:12.998 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 90 k 2023-10-06T01:36:12.998 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T01:36:12.998 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 173 k 2023-10-06T01:36:12.998 INFO:teuthology.orchestra.run.smithi088.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-06T01:36:12.998 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrading: 2023-10-06T01:36:12.998 INFO:teuthology.orchestra.run.smithi088.stdout: librados2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.5 M 2023-10-06T01:36:12.998 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.6 M 2023-10-06T01:36:12.998 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2023-10-06T01:36:12.998 INFO:teuthology.orchestra.run.smithi088.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-06T01:36:12.999 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 23 M 2023-10-06T01:36:12.999 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 23 k 2023-10-06T01:36:12.999 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 2.3 M 2023-10-06T01:36:12.999 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 238 k 2023-10-06T01:36:12.999 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 3.9 M 2023-10-06T01:36:12.999 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 17 M 2023-10-06T01:36:12.999 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1296.g736ac5ba.el8 ceph-noarch 14 k 2023-10-06T01:36:12.999 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 24 k 2023-10-06T01:36:12.999 INFO:teuthology.orchestra.run.smithi088.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-06T01:36:12.999 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-06T01:36:12.999 INFO:teuthology.orchestra.run.smithi088.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-06T01:36:12.999 INFO:teuthology.orchestra.run.smithi088.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-06T01:36:13.000 INFO:teuthology.orchestra.run.smithi088.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-06T01:36:13.000 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 174 k 2023-10-06T01:36:13.000 INFO:teuthology.orchestra.run.smithi088.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-06T01:36:13.000 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-06T01:36:13.000 INFO:teuthology.orchestra.run.smithi088.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-06T01:36:13.000 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-06T01:36:13.001 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-06T01:36:13.001 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 507 k 2023-10-06T01:36:13.001 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-06T01:36:13.001 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2 x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 5.6 M 2023-10-06T01:36:13.001 INFO:teuthology.orchestra.run.smithi088.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-06T01:36:13.001 INFO:teuthology.orchestra.run.smithi088.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-06T01:36:13.001 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-06T01:36:13.001 INFO:teuthology.orchestra.run.smithi088.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-06T01:36:13.001 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-06T01:36:13.001 INFO:teuthology.orchestra.run.smithi088.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-06T01:36:13.001 INFO:teuthology.orchestra.run.smithi088.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-06T01:36:13.001 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-06T01:36:13.002 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-06T01:36:13.002 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-06T01:36:13.002 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-06T01:36:13.002 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-06T01:36:13.002 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-06T01:36:13.002 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-06T01:36:13.002 INFO:teuthology.orchestra.run.smithi088.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-06T01:36:13.002 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-06T01:36:13.002 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 45 k 2023-10-06T01:36:13.002 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common x86_64 2:17.2.6-1296.g736ac5ba.el8 ceph 115 k 2023-10-06T01:36:13.002 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-06T01:36:13.003 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-06T01:36:13.003 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-06T01:36:13.003 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-06T01:36:13.003 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-06T01:36:13.003 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-06T01:36:13.003 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-06T01:36:13.003 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-06T01:36:13.003 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-06T01:36:13.003 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T01:36:13.003 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-06T01:36:13.003 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-06T01:36:13.004 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-06T01:36:13.004 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-06T01:36:13.004 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-06T01:36:13.004 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-06T01:36:13.004 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-06T01:36:13.004 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-06T01:36:13.004 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-06T01:36:13.004 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-06T01:36:13.004 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-06T01:36:13.004 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-06T01:36:13.004 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-06T01:36:13.004 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-06T01:36:13.005 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-06T01:36:13.005 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-06T01:36:13.005 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-06T01:36:13.005 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-06T01:36:13.005 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-06T01:36:13.005 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-06T01:36:13.005 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-06T01:36:13.005 INFO:teuthology.orchestra.run.smithi088.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-06T01:36:13.005 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-06T01:36:13.005 INFO:teuthology.orchestra.run.smithi088.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-06T01:36:13.005 INFO:teuthology.orchestra.run.smithi088.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-06T01:36:13.006 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-06T01:36:13.006 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-06T01:36:13.006 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-06T01:36:13.006 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-06T01:36:13.006 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-06T01:36:13.006 INFO:teuthology.orchestra.run.smithi088.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-06T01:36:13.006 INFO:teuthology.orchestra.run.smithi088.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-06T01:36:13.006 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-06T01:36:13.007 INFO:teuthology.orchestra.run.smithi088.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-06T01:36:13.007 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:36:13.007 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2023-10-06T01:36:13.007 INFO:teuthology.orchestra.run.smithi088.stdout:====================================================================================================================== 2023-10-06T01:36:13.007 INFO:teuthology.orchestra.run.smithi088.stdout:Install 118 Packages 2023-10-06T01:36:13.007 INFO:teuthology.orchestra.run.smithi088.stdout:Upgrade 2 Packages 2023-10-06T01:36:13.007 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:36:13.008 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 201 M 2023-10-06T01:36:13.008 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2023-10-06T01:36:13.378 INFO:teuthology.orchestra.run.smithi088.stdout:(1/120): ceph-17.2.6-1296.g736ac5ba.el8.x86_64. 20 kB/s | 6.4 kB 00:00 2023-10-06T01:36:13.623 INFO:teuthology.orchestra.run.smithi069.stdout:(8/120): ceph-osd-17.2.6-1296.g736ac5ba.el8.x86 14 MB/s | 17 MB 00:01 2023-10-06T01:36:13.681 INFO:teuthology.orchestra.run.smithi069.stdout:(9/120): ceph-selinux-17.2.6-1296.g736ac5ba.el8 417 kB/s | 24 kB 00:00 2023-10-06T01:36:13.766 INFO:teuthology.orchestra.run.smithi088.stdout:(2/120): ceph-fuse-17.2.6-1296.g736ac5ba.el8.x8 2.2 MB/s | 876 kB 00:00 2023-10-06T01:36:13.844 INFO:teuthology.orchestra.run.smithi088.stdout:(3/120): ceph-immutable-object-cache-17.2.6-129 2.0 MB/s | 162 kB 00:00 2023-10-06T01:36:14.933 INFO:teuthology.orchestra.run.smithi088.stdout:(4/120): ceph-mds-17.2.6-1296.g736ac5ba.el8.x86 2.1 MB/s | 2.3 MB 00:01 2023-10-06T01:36:15.063 INFO:teuthology.orchestra.run.smithi088.stdout:(5/120): ceph-base-17.2.6-1296.g736ac5ba.el8.x8 2.6 MB/s | 5.2 MB 00:01 2023-10-06T01:36:15.516 INFO:teuthology.orchestra.run.smithi069.stdout:(10/120): ceph-radosgw-17.2.6-1296.g736ac5ba.el 6.0 MB/s | 17 MB 00:02 2023-10-06T01:36:15.541 INFO:teuthology.orchestra.run.smithi088.stdout:(6/120): ceph-mgr-17.2.6-1296.g736ac5ba.el8.x86 2.6 MB/s | 1.6 MB 00:00 2023-10-06T01:36:15.589 INFO:teuthology.orchestra.run.smithi069.stdout:(11/120): cephfs-mirror-17.2.6-1296.g736ac5ba.e 3.4 MB/s | 255 kB 00:00 2023-10-06T01:36:15.654 INFO:teuthology.orchestra.run.smithi069.stdout:(12/120): libcephfs-devel-17.2.6-1296.g736ac5ba 385 kB/s | 25 kB 00:00 2023-10-06T01:36:15.808 INFO:teuthology.orchestra.run.smithi069.stdout:(13/120): libcephfs2-17.2.6-1296.g736ac5ba.el8. 5.1 MB/s | 797 kB 00:00 2023-10-06T01:36:15.884 INFO:teuthology.orchestra.run.smithi069.stdout:(14/120): libcephsqlite-17.2.6-1296.g736ac5ba.e 2.2 MB/s | 174 kB 00:00 2023-10-06T01:36:16.018 INFO:teuthology.orchestra.run.smithi069.stdout:(15/120): ceph-common-17.2.6-1296.g736ac5ba.el8 5.4 MB/s | 23 MB 00:04 2023-10-06T01:36:16.078 INFO:teuthology.orchestra.run.smithi069.stdout:(16/120): librados-devel-17.2.6-1296.g736ac5ba. 671 kB/s | 130 kB 00:00 2023-10-06T01:36:16.151 INFO:teuthology.orchestra.run.smithi088.stdout:(7/120): ceph-mon-17.2.6-1296.g736ac5ba.el8.x86 3.6 MB/s | 3.9 MB 00:01 2023-10-06T01:36:16.166 INFO:teuthology.orchestra.run.smithi069.stdout:(17/120): libradosstriper1-17.2.6-1296.g736ac5b 3.3 MB/s | 507 kB 00:00 2023-10-06T01:36:16.250 INFO:teuthology.orchestra.run.smithi069.stdout:(18/120): python3-ceph-argparse-17.2.6-1296.g73 534 kB/s | 45 kB 00:00 2023-10-06T01:36:16.337 INFO:teuthology.orchestra.run.smithi069.stdout:(19/120): python3-ceph-common-17.2.6-1296.g736a 1.3 MB/s | 115 kB 00:00 2023-10-06T01:36:16.423 INFO:teuthology.orchestra.run.smithi069.stdout:(20/120): python3-cephfs-17.2.6-1296.g736ac5ba. 2.2 MB/s | 190 kB 00:00 2023-10-06T01:36:16.517 INFO:teuthology.orchestra.run.smithi069.stdout:(21/120): python3-rados-17.2.6-1296.g736ac5ba.e 3.8 MB/s | 371 kB 00:00 2023-10-06T01:36:16.612 INFO:teuthology.orchestra.run.smithi069.stdout:(22/120): python3-rbd-17.2.6-1296.g736ac5ba.el8 3.7 MB/s | 358 kB 00:00 2023-10-06T01:36:16.696 INFO:teuthology.orchestra.run.smithi069.stdout:(23/120): python3-rgw-17.2.6-1296.g736ac5ba.el8 1.2 MB/s | 107 kB 00:00 2023-10-06T01:36:16.778 INFO:teuthology.orchestra.run.smithi069.stdout:(24/120): rbd-fuse-17.2.6-1296.g736ac5ba.el8.x8 1.1 MB/s | 90 kB 00:00 2023-10-06T01:36:16.853 INFO:teuthology.orchestra.run.smithi069.stdout:(25/120): librgw2-17.2.6-1296.g736ac5ba.el8.x86 7.2 MB/s | 5.6 MB 00:00 2023-10-06T01:36:16.930 INFO:teuthology.orchestra.run.smithi069.stdout:(26/120): rbd-nbd-17.2.6-1296.g736ac5ba.el8.x86 2.2 MB/s | 173 kB 00:00 2023-10-06T01:36:17.000 INFO:teuthology.orchestra.run.smithi069.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1296.g 329 kB/s | 23 kB 00:00 2023-10-06T01:36:17.079 INFO:teuthology.orchestra.run.smithi069.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1296.g736ac5b 1.5 MB/s | 121 kB 00:00 2023-10-06T01:36:17.356 INFO:teuthology.orchestra.run.smithi069.stdout:(29/120): ceph-mgr-dashboard-17.2.6-1296.g736ac 6.1 MB/s | 1.7 MB 00:00 2023-10-06T01:36:17.424 INFO:teuthology.orchestra.run.smithi088.stdout:(8/120): ceph-common-17.2.6-1296.g736ac5ba.el8. 5.4 MB/s | 23 MB 00:04 2023-10-06T01:36:17.460 INFO:teuthology.orchestra.run.smithi069.stdout:(30/120): rbd-mirror-17.2.6-1296.g736ac5ba.el8. 5.1 MB/s | 3.5 MB 00:00 2023-10-06T01:36:17.471 INFO:teuthology.orchestra.run.smithi088.stdout:(9/120): ceph-selinux-17.2.6-1296.g736ac5ba.el8 514 kB/s | 24 kB 00:00 2023-10-06T01:36:17.534 INFO:teuthology.orchestra.run.smithi069.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1296.g73 3.1 MB/s | 238 kB 00:00 2023-10-06T01:36:17.619 INFO:teuthology.orchestra.run.smithi069.stdout:(32/120): ceph-mgr-rook-17.2.6-1296.g736ac5ba.e 562 kB/s | 47 kB 00:00 2023-10-06T01:36:17.702 INFO:teuthology.orchestra.run.smithi069.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1296.g7 174 kB/s | 14 kB 00:00 2023-10-06T01:36:17.795 INFO:teuthology.orchestra.run.smithi069.stdout:(34/120): ceph-volume-17.2.6-1296.g736ac5ba.el8 2.8 MB/s | 267 kB 00:00 2023-10-06T01:36:17.878 INFO:teuthology.orchestra.run.smithi069.stdout:(35/120): cephadm-17.2.6-1296.g736ac5ba.el8.noa 966 kB/s | 80 kB 00:00 2023-10-06T01:36:17.961 INFO:teuthology.orchestra.run.smithi069.stdout:(36/120): cephfs-top-17.2.6-1296.g736ac5ba.el8. 217 kB/s | 18 kB 00:00 2023-10-06T01:36:18.121 INFO:teuthology.orchestra.run.smithi069.stdout:(37/120): gperftools-libs-2.7-9.el8.x86_64.rpm 1.9 MB/s | 306 kB 00:00 2023-10-06T01:36:18.138 INFO:teuthology.orchestra.run.smithi069.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 3.4 MB/s | 59 kB 00:00 2023-10-06T01:36:18.156 INFO:teuthology.orchestra.run.smithi069.stdout:(39/120): libunwind-1.3.1-3.el8.x86_64.rpm 4.2 MB/s | 75 kB 00:00 2023-10-06T01:36:18.195 INFO:teuthology.orchestra.run.smithi069.stdout:(40/120): python3-asyncssh-2.7.0-2.el8.noarch.r 12 MB/s | 476 kB 00:00 2023-10-06T01:36:18.215 INFO:teuthology.orchestra.run.smithi069.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 2.3 MB/s | 44 kB 00:00 2023-10-06T01:36:18.236 INFO:teuthology.orchestra.run.smithi069.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 8.6 MB/s | 185 kB 00:00 2023-10-06T01:36:18.255 INFO:teuthology.orchestra.run.smithi069.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 1.7 MB/s | 33 kB 00:00 2023-10-06T01:36:18.273 INFO:teuthology.orchestra.run.smithi069.stdout:(44/120): python3-certifi-2018.10.15-7.el8.noar 930 kB/s | 16 kB 00:00 2023-10-06T01:36:18.293 INFO:teuthology.orchestra.run.smithi069.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 8.7 MB/s | 173 kB 00:00 2023-10-06T01:36:18.315 INFO:teuthology.orchestra.run.smithi069.stdout:(46/120): ceph-mgr-diskprediction-local-17.2.6- 7.7 MB/s | 7.4 MB 00:00 2023-10-06T01:36:18.318 INFO:teuthology.orchestra.run.smithi069.stdout:(47/120): python3-cherrypy-18.4.0-1.el8.noarch. 15 MB/s | 384 kB 00:00 2023-10-06T01:36:18.337 INFO:teuthology.orchestra.run.smithi069.stdout:(48/120): python3-jaraco-6.2-6.el8.noarch.rpm 575 kB/s | 11 kB 00:00 2023-10-06T01:36:18.355 INFO:teuthology.orchestra.run.smithi069.stdout:(49/120): python3-jaraco-functools-2.0-4.el8.no 1.0 MB/s | 18 kB 00:00 2023-10-06T01:36:18.421 INFO:teuthology.orchestra.run.smithi069.stdout:(50/120): python3-kubernetes-11.0.0-6.el8.noarc 18 MB/s | 1.2 MB 00:00 2023-10-06T01:36:18.422 INFO:teuthology.orchestra.run.smithi069.stdout:(51/120): python3-google-auth-1.1.1-10.el8.noar 759 kB/s | 81 kB 00:00 2023-10-06T01:36:18.438 INFO:teuthology.orchestra.run.smithi069.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 2.9 MB/s | 49 kB 00:00 2023-10-06T01:36:18.439 INFO:teuthology.orchestra.run.smithi069.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 3.4 MB/s | 59 kB 00:00 2023-10-06T01:36:18.455 INFO:teuthology.orchestra.run.smithi069.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 3.5 MB/s | 60 kB 00:00 2023-10-06T01:36:18.473 INFO:teuthology.orchestra.run.smithi069.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 862 kB/s | 16 kB 00:00 2023-10-06T01:36:18.493 INFO:teuthology.orchestra.run.smithi069.stdout:(56/120): python3-pecan-1.3.2-9.el8.noarch.rpm 5.1 MB/s | 283 kB 00:00 2023-10-06T01:36:18.493 INFO:teuthology.orchestra.run.smithi069.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 1.6 MB/s | 34 kB 00:00 2023-10-06T01:36:18.511 INFO:teuthology.orchestra.run.smithi069.stdout:(58/120): python3-rsa-4.9-2.el8.noarch.rpm 3.6 MB/s | 64 kB 00:00 2023-10-06T01:36:18.514 INFO:teuthology.orchestra.run.smithi069.stdout:(59/120): python3-routes-2.4.1-12.el8.noarch.rp 9.2 MB/s | 196 kB 00:00 2023-10-06T01:36:18.530 INFO:teuthology.orchestra.run.smithi069.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 997 kB/s | 19 kB 00:00 2023-10-06T01:36:18.532 INFO:teuthology.orchestra.run.smithi069.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 1.3 MB/s | 24 kB 00:00 2023-10-06T01:36:18.547 INFO:teuthology.orchestra.run.smithi069.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 1.7 MB/s | 29 kB 00:00 2023-10-06T01:36:18.549 INFO:teuthology.orchestra.run.smithi069.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 1.6 MB/s | 27 kB 00:00 2023-10-06T01:36:18.568 INFO:teuthology.orchestra.run.smithi069.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 12 MB/s | 255 kB 00:00 2023-10-06T01:36:18.571 INFO:teuthology.orchestra.run.smithi069.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 11 MB/s | 251 kB 00:00 2023-10-06T01:36:18.587 INFO:teuthology.orchestra.run.smithi069.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 3.2 MB/s | 61 kB 00:00 2023-10-06T01:36:18.589 INFO:teuthology.orchestra.run.smithi069.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 4.6 MB/s | 85 kB 00:00 2023-10-06T01:36:18.606 INFO:teuthology.orchestra.run.smithi069.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 1.2 MB/s | 23 kB 00:00 2023-10-06T01:36:18.610 INFO:teuthology.orchestra.run.smithi069.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 19 MB/s | 70 kB 00:00 2023-10-06T01:36:18.680 INFO:teuthology.orchestra.run.smithi069.stdout:(70/120): thrift-0.13.0-2.el8.x86_64.rpm 19 MB/s | 1.7 MB 00:00 2023-10-06T01:36:18.711 INFO:teuthology.orchestra.run.smithi069.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 1.4 MB/s | 44 kB 00:00 2023-10-06T01:36:18.725 INFO:teuthology.orchestra.run.smithi069.stdout:(72/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.8 MB/s | 27 kB 00:00 2023-10-06T01:36:18.741 INFO:teuthology.orchestra.run.smithi069.stdout:(73/120): jq-1.5-12.el8.x86_64.rpm 10 MB/s | 161 kB 00:00 2023-10-06T01:36:18.759 INFO:teuthology.orchestra.run.smithi069.stdout:(74/120): flex-2.6.1-9.el8.x86_64.rpm 18 MB/s | 320 kB 00:00 2023-10-06T01:36:18.779 INFO:teuthology.orchestra.run.smithi069.stdout:(75/120): python3-werkzeug-0.12.2-4.el8.noarch. 23 MB/s | 457 kB 00:00 2023-10-06T01:36:18.887 INFO:teuthology.orchestra.run.smithi069.stdout:(76/120): python3-scipy-1.0.0-20.module+el8.1.0 52 MB/s | 15 MB 00:00 2023-10-06T01:36:18.902 INFO:teuthology.orchestra.run.smithi069.stdout:(77/120): python3-markupsafe-0.23-19.el8.x86_64 2.6 MB/s | 39 kB 00:00 2023-10-06T01:36:18.924 INFO:teuthology.orchestra.run.smithi069.stdout:(78/120): bison-3.0.4-10.el8.x86_64.rpm 32 MB/s | 688 kB 00:00 2023-10-06T01:36:18.949 INFO:teuthology.orchestra.run.smithi069.stdout:(79/120): python3-babel-2.5.1-5.el8.noarch.rpm 28 MB/s | 4.8 MB 00:00 2023-10-06T01:36:18.952 INFO:teuthology.orchestra.run.smithi069.stdout:(80/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 9.2 MB/s | 259 kB 00:00 2023-10-06T01:36:18.963 INFO:teuthology.orchestra.run.smithi069.stdout:(81/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 15 MB/s | 225 kB 00:00 2023-10-06T01:36:18.966 INFO:teuthology.orchestra.run.smithi069.stdout:(82/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 8.5 MB/s | 126 kB 00:00 2023-10-06T01:36:18.981 INFO:teuthology.orchestra.run.smithi069.stdout:(83/120): oniguruma-6.8.2-2.el8.x86_64.rpm 12 MB/s | 187 kB 00:00 2023-10-06T01:36:19.001 INFO:teuthology.orchestra.run.smithi069.stdout:(84/120): python3-jinja2-2.10.1-2.el8_0.noarch. 27 MB/s | 538 kB 00:00 2023-10-06T01:36:19.021 INFO:teuthology.orchestra.run.smithi069.stdout:(85/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 65 MB/s | 3.7 MB 00:00 2023-10-06T01:36:19.025 INFO:teuthology.orchestra.run.smithi069.stdout:(86/120): socat-1.7.3.3-2.el8.x86_64.rpm 12 MB/s | 302 kB 00:00 2023-10-06T01:36:19.034 INFO:teuthology.orchestra.run.smithi069.stdout:(87/120): python3-mako-1.0.6-13.el8.noarch.rpm 12 MB/s | 157 kB 00:00 2023-10-06T01:36:19.041 INFO:teuthology.orchestra.run.smithi069.stdout:(88/120): python3-pyasn1-modules-0.3.7-6.el8.no 6.7 MB/s | 110 kB 00:00 2023-10-06T01:36:19.052 INFO:teuthology.orchestra.run.smithi069.stdout:(89/120): librdkafka-0.11.4-1.el8.x86_64.rpm 20 MB/s | 353 kB 00:00 2023-10-06T01:36:19.054 INFO:teuthology.orchestra.run.smithi069.stdout:(90/120): python3-jsonpointer-1.10-11.el8.noarc 1.6 MB/s | 20 kB 00:00 2023-10-06T01:36:19.069 INFO:teuthology.orchestra.run.smithi069.stdout:(91/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.6 MB/s | 54 kB 00:00 2023-10-06T01:36:19.076 INFO:teuthology.orchestra.run.smithi069.stdout:(92/120): libtool-2.4.6-25.el8.x86_64.rpm 29 MB/s | 709 kB 00:00 2023-10-06T01:36:19.145 INFO:teuthology.orchestra.run.smithi069.stdout:(93/120): openblas-threads-0.3.12-1.el8.x86_64. 62 MB/s | 4.7 MB 00:00 2023-10-06T01:36:19.163 INFO:teuthology.orchestra.run.smithi069.stdout:(94/120): openblas-0.3.12-1.el8.x86_64.rpm 53 MB/s | 4.6 MB 00:00 2023-10-06T01:36:19.172 INFO:teuthology.orchestra.run.smithi069.stdout:(95/120): automake-1.16.1-7.el8.noarch.rpm 26 MB/s | 713 kB 00:00 2023-10-06T01:36:19.177 INFO:teuthology.orchestra.run.smithi069.stdout:(96/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 1.3 MB/s | 19 kB 00:00 2023-10-06T01:36:19.185 INFO:teuthology.orchestra.run.smithi069.stdout:(97/120): python3-jwt-1.6.1-2.el8.noarch.rpm 3.1 MB/s | 43 kB 00:00 2023-10-06T01:36:19.191 INFO:teuthology.orchestra.run.smithi069.stdout:(98/120): python3-oauthlib-2.1.0-1.el8.noarch.r 11 MB/s | 155 kB 00:00 2023-10-06T01:36:19.201 INFO:teuthology.orchestra.run.smithi069.stdout:(99/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 14 MB/s | 220 kB 00:00 2023-10-06T01:36:19.204 INFO:teuthology.orchestra.run.smithi069.stdout:(100/120): keyutils-libs-devel-1.5.10-6.el8.x86 3.4 MB/s | 48 kB 00:00 2023-10-06T01:36:19.215 INFO:teuthology.orchestra.run.smithi069.stdout:(101/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 15 MB/s | 229 kB 00:00 2023-10-06T01:36:19.216 INFO:teuthology.orchestra.run.smithi069.stdout:(102/120): python3-requests-oauthlib-1.0.0-1.el 3.6 MB/s | 43 kB 00:00 2023-10-06T01:36:19.230 INFO:teuthology.orchestra.run.smithi069.stdout:(103/120): libverto-devel-0.3.0-5.el8.x86_64.rp 1.4 MB/s | 18 kB 00:00 2023-10-06T01:36:19.250 INFO:teuthology.orchestra.run.smithi069.stdout:(104/120): pcre2-devel-10.32-2.el8.x86_64.rpm 30 MB/s | 605 kB 00:00 2023-10-06T01:36:19.259 INFO:teuthology.orchestra.run.smithi069.stdout:(105/120): openssl-devel-1.1.1g-15.el8_3.x86_64 54 MB/s | 2.3 MB 00:00 2023-10-06T01:36:19.262 INFO:teuthology.orchestra.run.smithi069.stdout:(106/120): fuse-2.9.7-12.el8.x86_64.rpm 6.5 MB/s | 83 kB 00:00 2023-10-06T01:36:19.273 INFO:teuthology.orchestra.run.smithi069.stdout:(107/120): elfutils-libelf-devel-0.182-3.el8.x8 4.1 MB/s | 59 kB 00:00 2023-10-06T01:36:19.278 INFO:teuthology.orchestra.run.smithi069.stdout:(108/120): libquadmath-8.4.1-1.el8.x86_64.rpm 11 MB/s | 169 kB 00:00 2023-10-06T01:36:19.286 INFO:teuthology.orchestra.run.smithi069.stdout:(109/120): libcom_err-devel-1.45.6-1.el8.x86_64 2.8 MB/s | 38 kB 00:00 2023-10-06T01:36:19.292 INFO:teuthology.orchestra.run.smithi069.stdout:(110/120): libsepol-devel-2.9-2.el8.x86_64.rpm 5.9 MB/s | 86 kB 00:00 2023-10-06T01:36:19.300 INFO:teuthology.orchestra.run.smithi069.stdout:(111/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 4.2 MB/s | 58 kB 00:00 2023-10-06T01:36:19.305 INFO:teuthology.orchestra.run.smithi069.stdout:(112/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.4 MB/s | 47 kB 00:00 2023-10-06T01:36:19.321 INFO:teuthology.orchestra.run.smithi069.stdout:(113/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 26 MB/s | 559 kB 00:00 2023-10-06T01:36:19.327 INFO:teuthology.orchestra.run.smithi069.stdout:(114/120): libgfortran-8.4.1-1.el8.x86_64.rpm 29 MB/s | 639 kB 00:00 2023-10-06T01:36:19.334 INFO:teuthology.orchestra.run.smithi069.stdout:(115/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 5.3 MB/s | 70 kB 00:00 2023-10-06T01:36:19.342 INFO:teuthology.orchestra.run.smithi069.stdout:(116/120): libselinux-devel-2.9-5.el8.x86_64.rp 13 MB/s | 200 kB 00:00 2023-10-06T01:36:19.347 INFO:teuthology.orchestra.run.smithi069.stdout:(117/120): libuuid-devel-2.32.1-27.el8.x86_64.r 7.5 MB/s | 97 kB 00:00 2023-10-06T01:36:20.042 INFO:teuthology.orchestra.run.smithi069.stdout:(118/120): librados2-17.2.6-1296.g736ac5ba.el8. 4.9 MB/s | 3.5 MB 00:00 2023-10-06T01:36:20.454 INFO:teuthology.orchestra.run.smithi069.stdout:(119/120): ceph-test-17.2.6-1296.g736ac5ba.el8. 7.6 MB/s | 52 MB 00:06 2023-10-06T01:36:20.504 INFO:teuthology.orchestra.run.smithi069.stdout:(120/120): librbd1-17.2.6-1296.g736ac5ba.el8.x8 3.1 MB/s | 3.6 MB 00:01 2023-10-06T01:36:20.510 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2023-10-06T01:36:20.510 INFO:teuthology.orchestra.run.smithi069.stdout:Total 22 MB/s | 201 MB 00:09 2023-10-06T01:36:20.518 INFO:teuthology.orchestra.run.smithi088.stdout:(10/120): ceph-radosgw-17.2.6-1296.g736ac5ba.el 3.8 MB/s | 17 MB 00:04 2023-10-06T01:36:20.560 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2023-10-06T01:36:20.585 INFO:teuthology.orchestra.run.smithi088.stdout:(11/120): cephfs-mirror-17.2.6-1296.g736ac5ba.e 3.8 MB/s | 255 kB 00:00 2023-10-06T01:36:20.610 INFO:teuthology.orchestra.run.smithi088.stdout:(12/120): libcephfs-devel-17.2.6-1296.g736ac5ba 1.0 MB/s | 25 kB 00:00 2023-10-06T01:36:20.673 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2023-10-06T01:36:20.673 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2023-10-06T01:36:20.717 INFO:teuthology.orchestra.run.smithi088.stdout:(13/120): ceph-osd-17.2.6-1296.g736ac5ba.el8.x8 3.2 MB/s | 17 MB 00:05 2023-10-06T01:36:20.754 INFO:teuthology.orchestra.run.smithi088.stdout:(14/120): libcephsqlite-17.2.6-1296.g736ac5ba.e 4.7 MB/s | 174 kB 00:00 2023-10-06T01:36:20.773 INFO:teuthology.orchestra.run.smithi088.stdout:(15/120): libcephfs2-17.2.6-1296.g736ac5ba.el8. 4.8 MB/s | 797 kB 00:00 2023-10-06T01:36:20.777 INFO:teuthology.orchestra.run.smithi088.stdout:(16/120): librados-devel-17.2.6-1296.g736ac5ba. 5.6 MB/s | 130 kB 00:00 2023-10-06T01:36:20.855 INFO:teuthology.orchestra.run.smithi088.stdout:(17/120): libradosstriper1-17.2.6-1296.g736ac5b 6.0 MB/s | 507 kB 00:00 2023-10-06T01:36:20.880 INFO:teuthology.orchestra.run.smithi088.stdout:(18/120): python3-ceph-argparse-17.2.6-1296.g73 1.8 MB/s | 45 kB 00:00 2023-10-06T01:36:20.907 INFO:teuthology.orchestra.run.smithi088.stdout:(19/120): python3-ceph-common-17.2.6-1296.g736a 4.2 MB/s | 115 kB 00:00 2023-10-06T01:36:20.938 INFO:teuthology.orchestra.run.smithi088.stdout:(20/120): python3-cephfs-17.2.6-1296.g736ac5ba. 6.1 MB/s | 190 kB 00:00 2023-10-06T01:36:20.998 INFO:teuthology.orchestra.run.smithi088.stdout:(21/120): python3-rados-17.2.6-1296.g736ac5ba.e 6.0 MB/s | 371 kB 00:00 2023-10-06T01:36:21.058 INFO:teuthology.orchestra.run.smithi088.stdout:(22/120): python3-rbd-17.2.6-1296.g736ac5ba.el8 5.9 MB/s | 358 kB 00:00 2023-10-06T01:36:21.086 INFO:teuthology.orchestra.run.smithi088.stdout:(23/120): python3-rgw-17.2.6-1296.g736ac5ba.el8 3.8 MB/s | 107 kB 00:00 2023-10-06T01:36:21.113 INFO:teuthology.orchestra.run.smithi088.stdout:(24/120): rbd-fuse-17.2.6-1296.g736ac5ba.el8.x8 3.3 MB/s | 90 kB 00:00 2023-10-06T01:36:21.563 INFO:teuthology.orchestra.run.smithi088.stdout:(25/120): librgw2-17.2.6-1296.g736ac5ba.el8.x86 7.1 MB/s | 5.6 MB 00:00 2023-10-06T01:36:21.621 INFO:teuthology.orchestra.run.smithi088.stdout:(26/120): rbd-mirror-17.2.6-1296.g736ac5ba.el8. 6.8 MB/s | 3.5 MB 00:00 2023-10-06T01:36:21.623 INFO:teuthology.orchestra.run.smithi088.stdout:(27/120): rbd-nbd-17.2.6-1296.g736ac5ba.el8.x86 2.8 MB/s | 173 kB 00:00 2023-10-06T01:36:21.643 INFO:teuthology.orchestra.run.smithi088.stdout:(28/120): ceph-grafana-dashboards-17.2.6-1296.g 1.1 MB/s | 23 kB 00:00 2023-10-06T01:36:21.645 INFO:teuthology.orchestra.run.smithi088.stdout:(29/120): ceph-mgr-cephadm-17.2.6-1296.g736ac5b 5.4 MB/s | 121 kB 00:00 2023-10-06T01:36:21.858 INFO:teuthology.orchestra.run.smithi088.stdout:(30/120): ceph-mgr-dashboard-17.2.6-1296.g736ac 7.9 MB/s | 1.7 MB 00:00 2023-10-06T01:36:21.892 INFO:teuthology.orchestra.run.smithi088.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1296.g73 6.9 MB/s | 238 kB 00:00 2023-10-06T01:36:21.918 INFO:teuthology.orchestra.run.smithi088.stdout:(32/120): ceph-mgr-rook-17.2.6-1296.g736ac5ba.e 1.8 MB/s | 47 kB 00:00 2023-10-06T01:36:21.943 INFO:teuthology.orchestra.run.smithi088.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1296.g7 595 kB/s | 14 kB 00:00 2023-10-06T01:36:22.000 INFO:teuthology.orchestra.run.smithi088.stdout:(34/120): ceph-volume-17.2.6-1296.g736ac5ba.el8 4.6 MB/s | 267 kB 00:00 2023-10-06T01:36:22.027 INFO:teuthology.orchestra.run.smithi088.stdout:(35/120): cephadm-17.2.6-1296.g736ac5ba.el8.noa 2.9 MB/s | 80 kB 00:00 2023-10-06T01:36:22.052 INFO:teuthology.orchestra.run.smithi088.stdout:(36/120): cephfs-top-17.2.6-1296.g736ac5ba.el8. 738 kB/s | 18 kB 00:00 2023-10-06T01:36:22.338 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2023-10-06T01:36:22.342 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2023-10-06T01:36:22.586 INFO:teuthology.orchestra.run.smithi088.stdout:(37/120): ceph-test-17.2.6-1296.g736ac5ba.el8.x 10 MB/s | 52 MB 00:05 2023-10-06T01:36:22.752 INFO:teuthology.orchestra.run.smithi088.stdout:(38/120): ceph-mgr-diskprediction-local-17.2.6- 6.7 MB/s | 7.4 MB 00:01 2023-10-06T01:36:22.836 INFO:teuthology.orchestra.run.smithi088.stdout:(39/120): liboath-2.6.2-3.el8.x86_64.rpm 236 kB/s | 59 kB 00:00 2023-10-06T01:36:22.841 INFO:teuthology.orchestra.run.smithi088.stdout:(40/120): gperftools-libs-2.7-9.el8.x86_64.rpm 388 kB/s | 306 kB 00:00 2023-10-06T01:36:22.896 INFO:teuthology.orchestra.run.smithi088.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 803 kB/s | 44 kB 00:00 2023-10-06T01:36:22.968 INFO:teuthology.orchestra.run.smithi088.stdout:(42/120): python3-beautifulsoup4-4.6.3-2.el8.1. 2.5 MB/s | 185 kB 00:00 2023-10-06T01:36:23.024 INFO:teuthology.orchestra.run.smithi088.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 590 kB/s | 33 kB 00:00 2023-10-06T01:36:23.032 INFO:teuthology.orchestra.run.smithi088.stdout:(44/120): libunwind-1.3.1-3.el8.x86_64.rpm 268 kB/s | 75 kB 00:00 2023-10-06T01:36:23.043 INFO:teuthology.orchestra.run.smithi088.stdout:(45/120): python3-asyncssh-2.7.0-2.el8.noarch.r 2.2 MB/s | 476 kB 00:00 2023-10-06T01:36:23.077 INFO:teuthology.orchestra.run.smithi088.stdout:(46/120): python3-certifi-2018.10.15-7.el8.noar 310 kB/s | 16 kB 00:00 2023-10-06T01:36:23.122 INFO:teuthology.orchestra.run.smithi088.stdout:(47/120): python3-cherrypy-18.4.0-1.el8.noarch. 4.8 MB/s | 384 kB 00:00 2023-10-06T01:36:23.134 INFO:teuthology.orchestra.run.smithi088.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 1.4 MB/s | 81 kB 00:00 2023-10-06T01:36:23.165 INFO:teuthology.orchestra.run.smithi088.stdout:(49/120): python3-cheroot-8.5.2-1.el8.noarch.rp 1.3 MB/s | 173 kB 00:00 2023-10-06T01:36:23.170 INFO:teuthology.orchestra.run.smithi088.stdout:(50/120): python3-jaraco-6.2-6.el8.noarch.rpm 227 kB/s | 11 kB 00:00 2023-10-06T01:36:23.185 INFO:teuthology.orchestra.run.smithi088.stdout:(51/120): python3-jaraco-functools-2.0-4.el8.no 349 kB/s | 18 kB 00:00 2023-10-06T01:36:23.222 INFO:teuthology.orchestra.run.smithi088.stdout:(52/120): python3-logutils-0.3.5-11.el8.noarch. 952 kB/s | 49 kB 00:00 2023-10-06T01:36:23.240 INFO:teuthology.orchestra.run.smithi088.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2023-10-06T01:36:23.275 INFO:teuthology.orchestra.run.smithi088.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 1.1 MB/s | 60 kB 00:00 2023-10-06T01:36:23.323 INFO:teuthology.orchestra.run.smithi088.stdout:(55/120): python3-pecan-1.3.2-9.el8.noarch.rpm 3.4 MB/s | 283 kB 00:00 2023-10-06T01:36:23.327 INFO:teuthology.orchestra.run.smithi088.stdout:(56/120): python3-portend-2.6-1.el8.noarch.rpm 299 kB/s | 16 kB 00:00 2023-10-06T01:36:23.363 INFO:teuthology.orchestra.run.smithi088.stdout:(57/120): python3-kubernetes-11.0.0-6.el8.noarc 5.9 MB/s | 1.2 MB 00:00 2023-10-06T01:36:23.387 INFO:teuthology.orchestra.run.smithi088.stdout:(58/120): python3-repoze-lru-0.7-6.el8.noarch.r 528 kB/s | 34 kB 00:00 2023-10-06T01:36:23.398 INFO:teuthology.orchestra.run.smithi088.stdout:(59/120): python3-routes-2.4.1-12.el8.noarch.rp 2.7 MB/s | 196 kB 00:00 2023-10-06T01:36:23.418 INFO:teuthology.orchestra.run.smithi088.stdout:(60/120): python3-rsa-4.9-2.el8.noarch.rpm 1.1 MB/s | 64 kB 00:00 2023-10-06T01:36:23.442 INFO:teuthology.orchestra.run.smithi088.stdout:(61/120): python3-simplegeneric-0.8.1-17.el8.no 341 kB/s | 19 kB 00:00 2023-10-06T01:36:23.453 INFO:teuthology.orchestra.run.smithi088.stdout:(62/120): python3-singledispatch-3.4.0.3-18.el8 441 kB/s | 24 kB 00:00 2023-10-06T01:36:23.473 INFO:teuthology.orchestra.run.smithi088.stdout:(63/120): python3-tempora-1.14.1-5.el8.noarch.r 539 kB/s | 29 kB 00:00 2023-10-06T01:36:23.496 INFO:teuthology.orchestra.run.smithi088.stdout:(64/120): python3-trustme-0.6.0-4.el8.noarch.rp 521 kB/s | 27 kB 00:00 2023-10-06T01:36:23.521 INFO:teuthology.orchestra.run.smithi088.stdout:(65/120): python3-waitress-1.4.3-1.el8.noarch.r 3.7 MB/s | 255 kB 00:00 2023-10-06T01:36:23.531 INFO:teuthology.orchestra.run.smithi088.stdout:(66/120): python3-webob-1.8.5-1.el8.1.noarch.rp 4.3 MB/s | 251 kB 00:00 2023-10-06T01:36:23.551 INFO:teuthology.orchestra.run.smithi088.stdout:(67/120): python3-websocket-client-0.56.0-5.el8 1.1 MB/s | 61 kB 00:00 2023-10-06T01:36:23.575 INFO:teuthology.orchestra.run.smithi088.stdout:(68/120): python3-webtest-2.0.33-1.el8.noarch.r 1.5 MB/s | 85 kB 00:00 2023-10-06T01:36:23.580 INFO:teuthology.orchestra.run.smithi088.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 15 MB/s | 70 kB 00:00 2023-10-06T01:36:23.580 INFO:teuthology.orchestra.run.smithi088.stdout:(70/120): python3-zc-lockfile-2.0-2.el8.noarch. 464 kB/s | 23 kB 00:00 2023-10-06T01:36:23.613 INFO:teuthology.orchestra.run.smithi088.stdout:(71/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 566 kB/s | 19 kB 00:00 2023-10-06T01:36:23.620 INFO:teuthology.orchestra.run.smithi088.stdout:(72/120): python3-jwt-1.6.1-2.el8.noarch.rpm 1.1 MB/s | 43 kB 00:00 2023-10-06T01:36:23.631 INFO:teuthology.orchestra.run.smithi088.stdout:(73/120): python3-oauthlib-2.1.0-1.el8.noarch.r 8.3 MB/s | 155 kB 00:00 2023-10-06T01:36:23.637 INFO:teuthology.orchestra.run.smithi088.stdout:(74/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 13 MB/s | 220 kB 00:00 2023-10-06T01:36:23.648 INFO:teuthology.orchestra.run.smithi088.stdout:(75/120): keyutils-libs-devel-1.5.10-6.el8.x86_ 2.8 MB/s | 48 kB 00:00 2023-10-06T01:36:23.656 INFO:teuthology.orchestra.run.smithi088.stdout:(76/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 12 MB/s | 229 kB 00:00 2023-10-06T01:36:23.663 INFO:teuthology.orchestra.run.smithi088.stdout:(77/120): python3-requests-oauthlib-1.0.0-1.el8 2.8 MB/s | 43 kB 00:00 2023-10-06T01:36:23.678 INFO:teuthology.orchestra.run.smithi088.stdout:(78/120): libverto-devel-0.3.0-5.el8.x86_64.rpm 1.2 MB/s | 18 kB 00:00 2023-10-06T01:36:23.703 INFO:teuthology.orchestra.run.smithi088.stdout:(79/120): openssl-devel-1.1.1g-15.el8_3.x86_64. 49 MB/s | 2.3 MB 00:00 2023-10-06T01:36:23.708 INFO:teuthology.orchestra.run.smithi088.stdout:(80/120): pcre2-devel-10.32-2.el8.x86_64.rpm 20 MB/s | 605 kB 00:00 2023-10-06T01:36:23.717 INFO:teuthology.orchestra.run.smithi088.stdout:(81/120): fuse-2.9.7-12.el8.x86_64.rpm 5.7 MB/s | 83 kB 00:00 2023-10-06T01:36:23.724 INFO:teuthology.orchestra.run.smithi088.stdout:(82/120): elfutils-libelf-devel-0.182-3.el8.x86 3.9 MB/s | 59 kB 00:00 2023-10-06T01:36:23.733 INFO:teuthology.orchestra.run.smithi088.stdout:(83/120): thrift-0.13.0-2.el8.x86_64.rpm 9.5 MB/s | 1.7 MB 00:00 2023-10-06T01:36:23.736 INFO:teuthology.orchestra.run.smithi088.stdout:(84/120): libquadmath-8.4.1-1.el8.x86_64.rpm 9.2 MB/s | 169 kB 00:00 2023-10-06T01:36:23.737 INFO:teuthology.orchestra.run.smithi088.stdout:(85/120): libcom_err-devel-1.45.6-1.el8.x86_64. 2.7 MB/s | 38 kB 00:00 2023-10-06T01:36:23.750 INFO:teuthology.orchestra.run.smithi088.stdout:(86/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 3.9 MB/s | 58 kB 00:00 2023-10-06T01:36:23.751 INFO:teuthology.orchestra.run.smithi088.stdout:(87/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 3.3 MB/s | 47 kB 00:00 2023-10-06T01:36:23.763 INFO:teuthology.orchestra.run.smithi088.stdout:(88/120): libsepol-devel-2.9-2.el8.x86_64.rpm 2.8 MB/s | 86 kB 00:00 2023-10-06T01:36:23.772 INFO:teuthology.orchestra.run.smithi088.stdout:(89/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.rp 25 MB/s | 559 kB 00:00 2023-10-06T01:36:23.776 INFO:teuthology.orchestra.run.smithi088.stdout:(90/120): libgfortran-8.4.1-1.el8.x86_64.rpm 26 MB/s | 639 kB 00:00 2023-10-06T01:36:23.777 INFO:teuthology.orchestra.run.smithi088.stdout:(91/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rpm 4.9 MB/s | 70 kB 00:00 2023-10-06T01:36:23.788 INFO:teuthology.orchestra.run.smithi088.stdout:(92/120): libselinux-devel-2.9-5.el8.x86_64.rpm 13 MB/s | 200 kB 00:00 2023-10-06T01:36:23.789 INFO:teuthology.orchestra.run.smithi088.stdout:(93/120): libuuid-devel-2.32.1-27.el8.x86_64.rp 7.0 MB/s | 97 kB 00:00 2023-10-06T01:36:23.803 INFO:teuthology.orchestra.run.smithi088.stdout:(94/120): python3-prettytable-0.7.2-14.el8.noar 2.9 MB/s | 44 kB 00:00 2023-10-06T01:36:23.804 INFO:teuthology.orchestra.run.smithi088.stdout:(95/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.8 MB/s | 27 kB 00:00 2023-10-06T01:36:23.820 INFO:teuthology.orchestra.run.smithi088.stdout:(96/120): jq-1.5-12.el8.x86_64.rpm 9.4 MB/s | 161 kB 00:00 2023-10-06T01:36:23.823 INFO:teuthology.orchestra.run.smithi088.stdout:(97/120): flex-2.6.1-9.el8.x86_64.rpm 16 MB/s | 320 kB 00:00 2023-10-06T01:36:23.841 INFO:teuthology.orchestra.run.smithi088.stdout:(98/120): python3-werkzeug-0.12.2-4.el8.noarch. 21 MB/s | 457 kB 00:00 2023-10-06T01:36:23.854 INFO:teuthology.orchestra.run.smithi088.stdout:(99/120): python3-markupsafe-0.23-19.el8.x86_64 2.8 MB/s | 39 kB 00:00 2023-10-06T01:36:23.878 INFO:teuthology.orchestra.run.smithi088.stdout:(100/120): bison-3.0.4-10.el8.x86_64.rpm 29 MB/s | 688 kB 00:00 2023-10-06T01:36:23.894 INFO:teuthology.orchestra.run.smithi088.stdout:(101/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 16 MB/s | 259 kB 00:00 2023-10-06T01:36:23.910 INFO:teuthology.orchestra.run.smithi088.stdout:(102/120): python3-babel-2.5.1-5.el8.noarch.rpm 55 MB/s | 4.8 MB 00:00 2023-10-06T01:36:23.913 INFO:teuthology.orchestra.run.smithi088.stdout:(103/120): python3-numpy-f2py-1.14.3-9.el8.x86_ 12 MB/s | 225 kB 00:00 2023-10-06T01:36:23.928 INFO:teuthology.orchestra.run.smithi088.stdout:(104/120): python3-pyasn1-0.3.7-6.el8.noarch.rp 7.1 MB/s | 126 kB 00:00 2023-10-06T01:36:23.943 INFO:teuthology.orchestra.run.smithi088.stdout:(105/120): oniguruma-6.8.2-2.el8.x86_64.rpm 12 MB/s | 187 kB 00:00 2023-10-06T01:36:23.963 INFO:teuthology.orchestra.run.smithi088.stdout:(106/120): python3-jinja2-2.10.1-2.el8_0.noarch 27 MB/s | 538 kB 00:00 2023-10-06T01:36:24.068 INFO:teuthology.orchestra.run.smithi088.stdout:(107/120): python3-scipy-1.0.0-20.module+el8.1. 50 MB/s | 15 MB 00:00 2023-10-06T01:36:24.072 INFO:teuthology.orchestra.run.smithi088.stdout:(108/120): socat-1.7.3.3-2.el8.x86_64.rpm 2.7 MB/s | 302 kB 00:00 2023-10-06T01:36:24.091 INFO:teuthology.orchestra.run.smithi088.stdout:(109/120): python3-numpy-1.14.3-9.el8.x86_64.rp 21 MB/s | 3.7 MB 00:00 2023-10-06T01:36:24.092 INFO:teuthology.orchestra.run.smithi088.stdout:(110/120): python3-mako-1.0.6-13.el8.noarch.rpm 6.4 MB/s | 157 kB 00:00 2023-10-06T01:36:24.093 INFO:teuthology.orchestra.run.smithi088.stdout:(111/120): python3-pyasn1-modules-0.3.7-6.el8.n 5.1 MB/s | 110 kB 00:00 2023-10-06T01:36:24.107 INFO:teuthology.orchestra.run.smithi088.stdout:(112/120): python3-jsonpointer-1.10-11.el8.noar 1.4 MB/s | 20 kB 00:00 2023-10-06T01:36:24.109 INFO:teuthology.orchestra.run.smithi088.stdout:(113/120): librdkafka-0.11.4-1.el8.x86_64.rpm 20 MB/s | 353 kB 00:00 2023-10-06T01:36:24.116 INFO:teuthology.orchestra.run.smithi088.stdout:(114/120): libtool-2.4.6-25.el8.x86_64.rpm 31 MB/s | 709 kB 00:00 2023-10-06T01:36:24.121 INFO:teuthology.orchestra.run.smithi088.stdout:(115/120): python3-pytz-2017.2-9.el8.noarch.rpm 3.8 MB/s | 54 kB 00:00 2023-10-06T01:36:24.148 INFO:teuthology.orchestra.run.smithi088.stdout:(116/120): automake-1.16.1-7.el8.noarch.rpm 26 MB/s | 713 kB 00:00 2023-10-06T01:36:24.186 INFO:teuthology.orchestra.run.smithi088.stdout:(117/120): openblas-threads-0.3.12-1.el8.x86_64 61 MB/s | 4.7 MB 00:00 2023-10-06T01:36:24.206 INFO:teuthology.orchestra.run.smithi088.stdout:(118/120): openblas-0.3.12-1.el8.x86_64.rpm 51 MB/s | 4.6 MB 00:00 2023-10-06T01:36:24.513 INFO:teuthology.orchestra.run.smithi088.stdout:(119/120): librados2-17.2.6-1296.g736ac5ba.el8. 9.5 MB/s | 3.5 MB 00:00 2023-10-06T01:36:24.550 INFO:teuthology.orchestra.run.smithi088.stdout:(120/120): librbd1-17.2.6-1296.g736ac5ba.el8.x8 9.9 MB/s | 3.6 MB 00:00 2023-10-06T01:36:24.554 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2023-10-06T01:36:24.555 INFO:teuthology.orchestra.run.smithi088.stdout:Total 17 MB/s | 201 MB 00:11 2023-10-06T01:36:24.601 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2023-10-06T01:36:24.715 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2023-10-06T01:36:24.715 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2023-10-06T01:36:26.418 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2023-10-06T01:36:26.423 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2023-10-06T01:36:27.073 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2023-10-06T01:36:27.264 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T01:36:27.482 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 2/122 2023-10-06T01:36:27.671 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T01:36:27.808 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-06T01:36:28.021 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T01:36:28.389 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-06T01:36:28.604 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T01:36:29.007 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T01:36:29.229 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T01:36:29.355 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T01:36:29.554 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T01:36:29.649 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T01:36:30.021 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T01:36:30.674 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T01:36:30.858 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2023-10-06T01:36:30.887 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T01:36:31.000 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T01:36:31.098 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-06T01:36:31.290 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T01:36:31.291 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T01:36:31.418 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 2/122 2023-10-06T01:36:31.469 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T01:36:31.607 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T01:36:31.645 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T01:36:31.740 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T01:36:31.918 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T01:36:31.968 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T01:36:31.987 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/122 2023-10-06T01:36:32.132 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-10-06T01:36:32.223 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T01:36:32.279 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T01:36:32.426 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-06T01:36:32.587 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T01:36:32.606 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T01:36:32.832 INFO:teuthology.orchestra.run.smithi088.stdout: Upgrading : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T01:36:32.962 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 5/122 2023-10-06T01:36:33.140 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T01:36:33.175 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-06T01:36:33.223 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T01:36:33.378 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T01:36:33.412 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T01:36:33.740 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 8/122 2023-10-06T01:36:33.903 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-06T01:36:34.136 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T01:36:34.409 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-06T01:36:34.598 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T01:36:34.708 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T01:36:34.858 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-10-06T01:36:34.927 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-06T01:36:35.088 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-06T01:36:35.148 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-10-06T01:36:35.290 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T01:36:35.343 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-10-06T01:36:35.397 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T01:36:35.490 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-10-06T01:36:35.608 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T01:36:35.684 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 14/122 2023-10-06T01:36:35.775 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-10-06T01:36:35.852 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 15/122 2023-10-06T01:36:36.098 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-10-06T01:36:36.129 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 16/122 2023-10-06T01:36:36.348 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T01:36:36.397 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 17/122 2023-10-06T01:36:36.561 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 18/122 2023-10-06T01:36:36.576 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 26/122 2023-10-06T01:36:36.698 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T01:36:36.733 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 27/122 2023-10-06T01:36:36.830 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 19/122 2023-10-06T01:36:36.993 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 28/122 2023-10-06T01:36:37.006 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T01:36:37.553 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 20/122 2023-10-06T01:36:37.706 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T01:36:38.010 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-10-06T01:36:38.218 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 21/122 2023-10-06T01:36:38.325 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-10-06T01:36:38.414 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T01:36:38.595 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-10-06T01:36:38.834 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-10-06T01:36:39.129 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-10-06T01:36:39.148 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 22/122 2023-10-06T01:36:39.386 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T01:36:39.434 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 23/122 2023-10-06T01:36:39.683 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 24/122 2023-10-06T01:36:39.926 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-06T01:36:40.145 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 26/122 2023-10-06T01:36:40.275 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 27/122 2023-10-06T01:36:40.515 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 28/122 2023-10-06T01:36:40.745 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 29/122 2023-10-06T01:36:40.989 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 30/122 2023-10-06T01:36:41.205 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T01:36:41.504 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-06T01:36:41.865 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-10-06T01:36:42.117 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T01:36:42.339 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T01:36:42.562 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 38/122 2023-10-06T01:36:42.733 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 39/122 2023-10-06T01:36:42.956 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 40/122 2023-10-06T01:36:43.134 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-10-06T01:36:43.290 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-10-06T01:36:43.303 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 31/122 2023-10-06T01:36:43.495 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-10-06T01:36:43.654 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-10-06T01:36:43.671 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 32/122 2023-10-06T01:36:43.814 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-10-06T01:36:44.022 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-10-06T01:36:44.187 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-10-06T01:36:44.520 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-10-06T01:36:44.720 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/122 2023-10-06T01:36:44.791 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-10-06T01:36:45.052 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-10-06T01:36:45.060 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/122 2023-10-06T01:36:45.300 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/122 2023-10-06T01:36:45.416 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-10-06T01:36:45.510 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-06T01:36:45.675 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-10-06T01:36:45.724 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-06T01:36:45.892 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-10-06T01:36:45.914 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 38/122 2023-10-06T01:36:46.070 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-10-06T01:36:46.109 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 39/122 2023-10-06T01:36:46.288 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-10-06T01:36:46.396 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 40/122 2023-10-06T01:36:46.477 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T01:36:46.545 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-06T01:36:46.636 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : automake-1.16.1-7.el8.noarch 41/122 2023-10-06T01:36:46.768 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-10-06T01:36:46.811 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 42/122 2023-10-06T01:36:46.945 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-10-06T01:36:46.988 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 43/122 2023-10-06T01:36:47.153 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T01:36:47.182 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/122 2023-10-06T01:36:47.337 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T01:36:47.366 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T01:36:47.473 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 45/122 2023-10-06T01:36:47.628 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T01:36:47.637 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : jq-1.5-12.el8.x86_64 46/122 2023-10-06T01:36:47.781 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 47/122 2023-10-06T01:36:47.852 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T01:36:47.961 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 48/122 2023-10-06T01:36:48.067 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T01:36:48.125 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 49/122 2023-10-06T01:36:48.287 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T01:36:48.331 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 50/122 2023-10-06T01:36:48.433 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T01:36:48.490 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : fuse-2.9.7-12.el8.x86_64 51/122 2023-10-06T01:36:48.642 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T01:36:48.649 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 52/122 2023-10-06T01:36:48.828 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 53/122 2023-10-06T01:36:48.885 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T01:36:48.998 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 54/122 2023-10-06T01:36:49.109 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T01:36:49.336 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 55/122 2023-10-06T01:36:49.347 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T01:36:49.542 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T01:36:49.584 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 56/122 2023-10-06T01:36:49.807 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T01:36:49.828 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 57/122 2023-10-06T01:36:50.007 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T01:36:50.122 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 58/122 2023-10-06T01:36:50.249 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T01:36:50.270 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-06T01:36:50.458 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-06T01:36:50.568 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T01:36:50.701 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-06T01:36:50.851 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T01:36:50.911 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-06T01:36:51.053 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T01:36:51.118 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-06T01:36:51.278 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-06T01:36:51.315 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T01:36:51.431 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-06T01:36:51.614 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-06T01:36:51.799 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-06T01:36:52.033 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-06T01:36:52.222 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-06T01:36:52.384 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-06T01:36:52.456 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T01:36:52.629 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-06T01:36:52.799 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T01:36:52.858 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-06T01:36:53.019 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T01:36:53.109 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-06T01:36:53.352 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T01:36:53.410 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-06T01:36:53.597 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T01:36:53.661 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-06T01:36:53.870 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-06T01:36:53.958 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T01:36:54.106 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-06T01:36:54.159 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T01:36:54.375 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T01:36:54.600 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T01:36:55.248 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-06T01:36:55.558 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-06T01:36:55.787 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-06T01:36:56.107 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-06T01:36:56.357 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-06T01:36:56.702 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-06T01:36:56.927 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-06T01:36:57.110 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-06T01:36:57.302 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-06T01:36:59.709 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T01:36:59.958 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T01:37:00.568 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T01:37:01.128 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T01:37:01.604 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T01:37:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T01:37:02.308 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T01:37:02.509 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T01:37:03.108 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 87/122 2023-10-06T01:37:03.373 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T01:37:03.460 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 88/122 2023-10-06T01:37:03.608 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T01:37:19.404 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T01:37:19.404 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /sys 2023-10-06T01:37:19.404 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /proc 2023-10-06T01:37:19.404 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /dev 2023-10-06T01:37:19.404 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /run 2023-10-06T01:37:19.404 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /mnt 2023-10-06T01:37:19.404 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /var/tmp 2023-10-06T01:37:19.404 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /home 2023-10-06T01:37:19.405 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /tmp 2023-10-06T01:37:19.405 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /dev 2023-10-06T01:37:19.405 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:19.780 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T01:37:21.188 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 89/122 2023-10-06T01:37:21.188 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /sys 2023-10-06T01:37:21.188 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /proc 2023-10-06T01:37:21.188 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /dev 2023-10-06T01:37:21.189 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /run 2023-10-06T01:37:21.189 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /mnt 2023-10-06T01:37:21.189 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /var/tmp 2023-10-06T01:37:21.189 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /home 2023-10-06T01:37:21.189 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /tmp 2023-10-06T01:37:21.189 INFO:teuthology.orchestra.run.smithi088.stdout:skipping the directory /dev 2023-10-06T01:37:21.189 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:21.263 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T01:37:21.458 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T01:37:21.563 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T01:37:21.681 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T01:37:21.830 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T01:37:22.239 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T01:37:22.396 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T01:37:22.414 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T01:37:23.055 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 90/122 2023-10-06T01:37:23.218 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T01:37:23.441 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 91/122 2023-10-06T01:37:23.580 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T01:37:24.000 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 92/122 2023-10-06T01:37:24.145 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T01:37:24.162 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 93/122 2023-10-06T01:37:25.329 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T01:37:25.460 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T01:37:25.677 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 95/122 2023-10-06T01:37:25.886 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 96/122 2023-10-06T01:37:26.081 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T01:37:26.300 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T01:37:26.540 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T01:37:26.938 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T01:37:27.071 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 94/122 2023-10-06T01:37:27.285 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 95/122 2023-10-06T01:37:27.491 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 96/122 2023-10-06T01:37:27.510 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T01:37:27.688 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T01:37:27.720 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T01:37:27.822 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T01:37:27.906 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 97/122 2023-10-06T01:37:28.084 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T01:37:28.188 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 100/122 2023-10-06T01:37:28.382 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T01:37:28.420 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T01:37:28.586 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T01:37:28.598 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T01:37:29.053 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 98/122 2023-10-06T01:37:29.236 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T01:37:29.336 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 99/122 2023-10-06T01:37:29.706 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 100/122 2023-10-06T01:37:29.876 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T01:37:29.913 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 101/122 2023-10-06T01:37:30.069 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T01:37:30.080 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 102/122 2023-10-06T01:37:30.177 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 103/122 2023-10-06T01:37:30.432 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T01:37:30.518 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T01:37:30.695 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T01:37:30.739 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T01:37:30.895 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T01:37:31.244 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T01:37:31.403 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T01:37:31.708 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 103/122 2023-10-06T01:37:31.995 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T01:37:32.092 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 104/122 2023-10-06T01:37:32.245 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T01:37:32.289 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1296.g736ac 105/122 2023-10-06T01:37:32.419 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T01:37:32.766 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 106/122 2023-10-06T01:37:32.960 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T01:37:36.330 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T01:37:36.680 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 108/122 2023-10-06T01:37:36.843 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T01:37:37.566 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-10-06T01:37:37.899 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 107/122 2023-10-06T01:37:37.973 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-10-06T01:37:38.199 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 111/122 2023-10-06T01:37:38.363 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-10-06T01:37:38.556 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 113/122 2023-10-06T01:37:38.707 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T01:37:38.855 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 108/122 2023-10-06T01:37:38.893 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 115/122 2023-10-06T01:37:39.109 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 116/122 2023-10-06T01:37:39.261 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 117/122 2023-10-06T01:37:39.265 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 109/122 2023-10-06T01:37:39.457 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 110/122 2023-10-06T01:37:39.501 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-10-06T01:37:39.689 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 111/122 2023-10-06T01:37:39.726 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T01:37:39.789 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-10-06T01:37:39.817 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T01:37:39.829 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/122 2023-10-06T01:37:39.963 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 113/122 2023-10-06T01:37:40.018 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T01:37:40.028 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-10-06T01:37:40.028 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T01:37:40.130 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-06T01:37:40.229 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T01:37:40.230 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T01:37:40.284 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 115/122 2023-10-06T01:37:40.458 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 116/122 2023-10-06T01:37:40.706 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 117/122 2023-10-06T01:37:40.892 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T01:37:40.949 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 118/122 2023-10-06T01:37:41.125 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T01:37:41.125 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 1/122 2023-10-06T01:37:41.126 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2/122 2023-10-06T01:37:41.126 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 3/122 2023-10-06T01:37:41.126 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T01:37:41.126 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 5/122 2023-10-06T01:37:41.126 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T01:37:41.126 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T01:37:41.126 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T01:37:41.126 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/122 2023-10-06T01:37:41.126 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T01:37:41.126 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 11/122 2023-10-06T01:37:41.127 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 12/122 2023-10-06T01:37:41.127 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T01:37:41.127 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 14/122 2023-10-06T01:37:41.127 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 15/122 2023-10-06T01:37:41.127 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 16/122 2023-10-06T01:37:41.127 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 17/122 2023-10-06T01:37:41.127 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/122 2023-10-06T01:37:41.127 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 19/122 2023-10-06T01:37:41.127 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 20/122 2023-10-06T01:37:41.127 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 21/122 2023-10-06T01:37:41.127 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 22/122 2023-10-06T01:37:41.127 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 23/122 2023-10-06T01:37:41.128 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 24/122 2023-10-06T01:37:41.128 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 25/122 2023-10-06T01:37:41.128 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 26/122 2023-10-06T01:37:41.128 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 27/122 2023-10-06T01:37:41.128 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 28/122 2023-10-06T01:37:41.128 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 29/122 2023-10-06T01:37:41.128 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 30/122 2023-10-06T01:37:41.136 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 31/122 2023-10-06T01:37:41.136 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 32/122 2023-10-06T01:37:41.136 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 33/122 2023-10-06T01:37:41.136 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 34/122 2023-10-06T01:37:41.136 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 35/122 2023-10-06T01:37:41.136 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 36/122 2023-10-06T01:37:41.136 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 37/122 2023-10-06T01:37:41.137 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 38/122 2023-10-06T01:37:41.137 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T01:37:41.137 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T01:37:41.137 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T01:37:41.137 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T01:37:41.137 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T01:37:41.137 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T01:37:41.137 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T01:37:41.137 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T01:37:41.137 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T01:37:41.137 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T01:37:41.138 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T01:37:41.138 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T01:37:41.138 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T01:37:41.138 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T01:37:41.138 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T01:37:41.138 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T01:37:41.138 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T01:37:41.138 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T01:37:41.138 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T01:37:41.138 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T01:37:41.138 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T01:37:41.138 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T01:37:41.139 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T01:37:41.139 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T01:37:41.139 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T01:37:41.139 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T01:37:41.139 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T01:37:41.139 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T01:37:41.139 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T01:37:41.139 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T01:37:41.139 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T01:37:41.139 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T01:37:41.140 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T01:37:41.140 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-10-06T01:37:41.140 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-10-06T01:37:41.140 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-10-06T01:37:41.140 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-10-06T01:37:41.140 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-10-06T01:37:41.140 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-10-06T01:37:41.140 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-10-06T01:37:41.140 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-10-06T01:37:41.140 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-10-06T01:37:41.140 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-10-06T01:37:41.141 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-10-06T01:37:41.141 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-10-06T01:37:41.141 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-10-06T01:37:41.141 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-10-06T01:37:41.141 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-10-06T01:37:41.141 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-10-06T01:37:41.141 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-10-06T01:37:41.141 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-10-06T01:37:41.141 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-10-06T01:37:41.141 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-10-06T01:37:41.141 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-10-06T01:37:41.141 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-10-06T01:37:41.141 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-10-06T01:37:41.142 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-10-06T01:37:41.142 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-10-06T01:37:41.142 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-10-06T01:37:41.142 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-10-06T01:37:41.142 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-10-06T01:37:41.142 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-10-06T01:37:41.142 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-10-06T01:37:41.142 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-10-06T01:37:41.142 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-10-06T01:37:41.142 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-10-06T01:37:41.142 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-10-06T01:37:41.142 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-10-06T01:37:41.143 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-10-06T01:37:41.143 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-10-06T01:37:41.143 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-10-06T01:37:41.143 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-10-06T01:37:41.143 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-10-06T01:37:41.143 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-10-06T01:37:41.143 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-10-06T01:37:41.143 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-10-06T01:37:41.143 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-10-06T01:37:41.143 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-10-06T01:37:41.143 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-10-06T01:37:41.143 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-10-06T01:37:41.144 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 119/122 2023-10-06T01:37:41.144 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T01:37:41.144 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 121/122 2023-10-06T01:37:41.167 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T01:37:41.176 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 119/122 2023-10-06T01:37:41.302 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/122 2023-10-06T01:37:41.302 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T01:37:41.503 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-06T01:37:41.503 INFO:teuthology.orchestra.run.smithi088.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T01:37:42.353 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T01:37:42.353 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 1/122 2023-10-06T01:37:42.354 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2/122 2023-10-06T01:37:42.354 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 3/122 2023-10-06T01:37:42.354 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 4/122 2023-10-06T01:37:42.354 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1296.g736ac 5/122 2023-10-06T01:37:42.354 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 6/122 2023-10-06T01:37:42.354 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 7/122 2023-10-06T01:37:42.354 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 8/122 2023-10-06T01:37:42.354 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 9/122 2023-10-06T01:37:42.354 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 10/122 2023-10-06T01:37:42.354 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 11/122 2023-10-06T01:37:42.355 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 12/122 2023-10-06T01:37:42.355 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 13/122 2023-10-06T01:37:42.355 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_ 14/122 2023-10-06T01:37:42.355 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 15/122 2023-10-06T01:37:42.355 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 16/122 2023-10-06T01:37:42.355 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_6 17/122 2023-10-06T01:37:42.355 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86 18/122 2023-10-06T01:37:42.355 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 19/122 2023-10-06T01:37:42.355 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el 20/122 2023-10-06T01:37:42.356 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8. 21/122 2023-10-06T01:37:42.356 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_6 22/122 2023-10-06T01:37:42.356 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 23/122 2023-10-06T01:37:42.356 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 24/122 2023-10-06T01:37:42.356 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 25/122 2023-10-06T01:37:42.357 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 26/122 2023-10-06T01:37:42.357 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 27/122 2023-10-06T01:37:42.367 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 28/122 2023-10-06T01:37:42.367 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba. 29/122 2023-10-06T01:37:42.367 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noa 30/122 2023-10-06T01:37:42.367 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.n 31/122 2023-10-06T01:37:42.367 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1296.g736 32/122 2023-10-06T01:37:42.367 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el 33/122 2023-10-06T01:37:42.367 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 34/122 2023-10-06T01:37:42.367 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.e 35/122 2023-10-06T01:37:42.367 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 36/122 2023-10-06T01:37:42.367 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 37/122 2023-10-06T01:37:42.368 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 38/122 2023-10-06T01:37:42.368 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-06T01:37:42.368 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-06T01:37:42.368 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-06T01:37:42.368 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-06T01:37:42.368 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-06T01:37:42.368 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-06T01:37:42.368 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-06T01:37:42.368 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-06T01:37:42.368 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-06T01:37:42.368 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-06T01:37:42.369 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-06T01:37:42.369 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-06T01:37:42.369 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-06T01:37:42.369 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-06T01:37:42.369 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-06T01:37:42.369 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-06T01:37:42.369 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-06T01:37:42.369 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-06T01:37:42.369 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-06T01:37:42.369 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-06T01:37:42.369 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-06T01:37:42.369 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-06T01:37:42.370 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-06T01:37:42.370 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-06T01:37:42.370 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-06T01:37:42.370 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-06T01:37:42.370 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-06T01:37:42.370 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-06T01:37:42.370 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-06T01:37:42.370 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-06T01:37:42.370 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-06T01:37:42.370 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-06T01:37:42.370 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-06T01:37:42.371 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 72/122 2023-10-06T01:37:42.371 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 73/122 2023-10-06T01:37:42.371 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 74/122 2023-10-06T01:37:42.371 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 75/122 2023-10-06T01:37:42.371 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 76/122 2023-10-06T01:37:42.371 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 77/122 2023-10-06T01:37:42.371 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 78/122 2023-10-06T01:37:42.371 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 79/122 2023-10-06T01:37:42.371 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 80/122 2023-10-06T01:37:42.372 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 81/122 2023-10-06T01:37:42.372 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 82/122 2023-10-06T01:37:42.372 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 83/122 2023-10-06T01:37:42.372 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 84/122 2023-10-06T01:37:42.372 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 85/122 2023-10-06T01:37:42.372 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 86/122 2023-10-06T01:37:42.372 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 87/122 2023-10-06T01:37:42.372 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 88/122 2023-10-06T01:37:42.373 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 89/122 2023-10-06T01:37:42.373 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 90/122 2023-10-06T01:37:42.373 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 91/122 2023-10-06T01:37:42.373 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 92/122 2023-10-06T01:37:42.373 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 93/122 2023-10-06T01:37:42.373 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 94/122 2023-10-06T01:37:42.373 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 95/122 2023-10-06T01:37:42.373 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 96/122 2023-10-06T01:37:42.374 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : jq-1.5-12.el8.x86_64 97/122 2023-10-06T01:37:42.374 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : flex-2.6.1-9.el8.x86_64 98/122 2023-10-06T01:37:42.374 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 99/122 2023-10-06T01:37:42.374 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 100/122 2023-10-06T01:37:42.374 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 101/122 2023-10-06T01:37:42.374 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : bison-3.0.4-10.el8.x86_64 102/122 2023-10-06T01:37:42.374 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 103/122 2023-10-06T01:37:42.374 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 104/122 2023-10-06T01:37:42.374 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 105/122 2023-10-06T01:37:42.374 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 106/122 2023-10-06T01:37:42.374 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 107/122 2023-10-06T01:37:42.375 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 108/122 2023-10-06T01:37:42.375 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 109/122 2023-10-06T01:37:42.375 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 110/122 2023-10-06T01:37:42.375 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/122 2023-10-06T01:37:42.375 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 112/122 2023-10-06T01:37:42.375 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 113/122 2023-10-06T01:37:42.375 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 114/122 2023-10-06T01:37:42.375 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 115/122 2023-10-06T01:37:42.375 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 116/122 2023-10-06T01:37:42.375 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 117/122 2023-10-06T01:37:42.375 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : automake-1.16.1-7.el8.noarch 118/122 2023-10-06T01:37:42.375 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 119/122 2023-10-06T01:37:42.376 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-06T01:37:42.376 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 121/122 2023-10-06T01:37:43.466 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T01:37:43.466 INFO:teuthology.orchestra.run.smithi069.stdout:Last metadata expiration check: 0:01:41 ago on Fri 06 Oct 2023 01:36:02 AM UTC. 2023-10-06T01:37:44.468 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-06T01:37:44.468 INFO:teuthology.orchestra.run.smithi088.stdout:Last metadata expiration check: 0:01:41 ago on Fri 06 Oct 2023 01:36:03 AM UTC. 2023-10-06T01:37:45.572 INFO:teuthology.orchestra.run.smithi069.stdout:Installed products updated. 2023-10-06T01:37:45.726 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:45.726 INFO:teuthology.orchestra.run.smithi069.stdout:Upgraded: 2023-10-06T01:37:45.727 INFO:teuthology.orchestra.run.smithi069.stdout: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.727 INFO:teuthology.orchestra.run.smithi069.stdout: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.727 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2023-10-06T01:37:45.727 INFO:teuthology.orchestra.run.smithi069.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T01:37:45.727 INFO:teuthology.orchestra.run.smithi069.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T01:37:45.727 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.727 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.727 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.727 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.727 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:37:45.727 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-immutable-object-cache-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.728 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.728 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.728 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:37:45.728 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:37:45.728 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:37:45.728 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:37:45.728 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:37:45.728 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.728 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.728 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:37:45.728 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.728 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.729 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.729 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:37:45.729 INFO:teuthology.orchestra.run.smithi069.stdout: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:37:45.729 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.729 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:37:45.729 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T01:37:45.729 INFO:teuthology.orchestra.run.smithi069.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T01:37:45.729 INFO:teuthology.orchestra.run.smithi069.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T01:37:45.729 INFO:teuthology.orchestra.run.smithi069.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T01:37:45.729 INFO:teuthology.orchestra.run.smithi069.stdout: jq-1.5-12.el8.x86_64 2023-10-06T01:37:45.729 INFO:teuthology.orchestra.run.smithi069.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T01:37:45.730 INFO:teuthology.orchestra.run.smithi069.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T01:37:45.730 INFO:teuthology.orchestra.run.smithi069.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T01:37:45.730 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.730 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.730 INFO:teuthology.orchestra.run.smithi069.stdout: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.730 INFO:teuthology.orchestra.run.smithi069.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T01:37:45.730 INFO:teuthology.orchestra.run.smithi069.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T01:37:45.730 INFO:teuthology.orchestra.run.smithi069.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T01:37:45.731 INFO:teuthology.orchestra.run.smithi069.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T01:37:45.731 INFO:teuthology.orchestra.run.smithi069.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T01:37:45.731 INFO:teuthology.orchestra.run.smithi069.stdout: librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.731 INFO:teuthology.orchestra.run.smithi069.stdout: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.731 INFO:teuthology.orchestra.run.smithi069.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T01:37:45.731 INFO:teuthology.orchestra.run.smithi069.stdout: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.731 INFO:teuthology.orchestra.run.smithi069.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T01:37:45.731 INFO:teuthology.orchestra.run.smithi069.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T01:37:45.731 INFO:teuthology.orchestra.run.smithi069.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T01:37:45.731 INFO:teuthology.orchestra.run.smithi069.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T01:37:45.731 INFO:teuthology.orchestra.run.smithi069.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T01:37:45.732 INFO:teuthology.orchestra.run.smithi069.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T01:37:45.732 INFO:teuthology.orchestra.run.smithi069.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T01:37:45.732 INFO:teuthology.orchestra.run.smithi069.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T01:37:45.732 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T01:37:45.732 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T01:37:45.732 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T01:37:45.732 INFO:teuthology.orchestra.run.smithi069.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T01:37:45.732 INFO:teuthology.orchestra.run.smithi069.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T01:37:45.732 INFO:teuthology.orchestra.run.smithi069.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T01:37:45.732 INFO:teuthology.orchestra.run.smithi069.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T01:37:45.732 INFO:teuthology.orchestra.run.smithi069.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T01:37:45.732 INFO:teuthology.orchestra.run.smithi069.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T01:37:45.733 INFO:teuthology.orchestra.run.smithi069.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T01:37:45.733 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T01:37:45.733 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.733 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.733 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.734 INFO:teuthology.orchestra.run.smithi069.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T01:37:45.734 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T01:37:45.734 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T01:37:45.734 INFO:teuthology.orchestra.run.smithi069.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T01:37:45.734 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T01:37:45.734 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T01:37:45.734 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T01:37:45.734 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T01:37:45.734 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T01:37:45.734 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T01:37:45.734 INFO:teuthology.orchestra.run.smithi069.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T01:37:45.735 INFO:teuthology.orchestra.run.smithi069.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T01:37:45.735 INFO:teuthology.orchestra.run.smithi069.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T01:37:45.735 INFO:teuthology.orchestra.run.smithi069.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T01:37:45.735 INFO:teuthology.orchestra.run.smithi069.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T01:37:45.735 INFO:teuthology.orchestra.run.smithi069.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T01:37:45.735 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T01:37:45.735 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T01:37:45.735 INFO:teuthology.orchestra.run.smithi069.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T01:37:45.735 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T01:37:45.735 INFO:teuthology.orchestra.run.smithi069.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T01:37:45.735 INFO:teuthology.orchestra.run.smithi069.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T01:37:45.736 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T01:37:45.736 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T01:37:45.736 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T01:37:45.736 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.736 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.736 INFO:teuthology.orchestra.run.smithi069.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T01:37:45.736 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T01:37:45.736 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.736 INFO:teuthology.orchestra.run.smithi069.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T01:37:45.736 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T01:37:45.736 INFO:teuthology.orchestra.run.smithi069.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T01:37:45.736 INFO:teuthology.orchestra.run.smithi069.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T01:37:45.737 INFO:teuthology.orchestra.run.smithi069.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T01:37:45.737 INFO:teuthology.orchestra.run.smithi069.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T01:37:45.737 INFO:teuthology.orchestra.run.smithi069.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T01:37:45.737 INFO:teuthology.orchestra.run.smithi069.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T01:37:45.737 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T01:37:45.737 INFO:teuthology.orchestra.run.smithi069.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T01:37:45.737 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T01:37:45.737 INFO:teuthology.orchestra.run.smithi069.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T01:37:45.737 INFO:teuthology.orchestra.run.smithi069.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T01:37:45.737 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.737 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.737 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:45.738 INFO:teuthology.orchestra.run.smithi069.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T01:37:45.738 INFO:teuthology.orchestra.run.smithi069.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T01:37:45.738 INFO:teuthology.orchestra.run.smithi069.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T01:37:45.738 INFO:teuthology.orchestra.run.smithi069.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T01:37:45.738 INFO:teuthology.orchestra.run.smithi069.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T01:37:45.738 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:45.738 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2023-10-06T01:37:46.042 DEBUG:teuthology.parallel:result is None 2023-10-06T01:37:46.398 INFO:teuthology.orchestra.run.smithi088.stdout:Installed products updated. 2023-10-06T01:37:46.540 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:46.540 INFO:teuthology.orchestra.run.smithi088.stdout:Upgraded: 2023-10-06T01:37:46.540 INFO:teuthology.orchestra.run.smithi088.stdout: librados2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.540 INFO:teuthology.orchestra.run.smithi088.stdout: librbd1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.540 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2023-10-06T01:37:46.540 INFO:teuthology.orchestra.run.smithi088.stdout: automake-1.16.1-7.el8.noarch 2023-10-06T01:37:46.541 INFO:teuthology.orchestra.run.smithi088.stdout: bison-3.0.4-10.el8.x86_64 2023-10-06T01:37:46.541 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.541 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-base-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.541 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.541 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.541 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-grafana-dashboards-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:37:46.541 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-immutable-object-cache-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.541 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mds-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.541 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.541 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:37:46.541 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-dashboard-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:37:46.541 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:37:46.542 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-modules-core-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:37:46.542 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mgr-rook-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:37:46.542 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-mon-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.542 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-osd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.542 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-prometheus-alerts-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:37:46.542 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-radosgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.542 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-selinux-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.542 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-test-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.542 INFO:teuthology.orchestra.run.smithi088.stdout: ceph-volume-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:37:46.542 INFO:teuthology.orchestra.run.smithi088.stdout: cephadm-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:37:46.543 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.543 INFO:teuthology.orchestra.run.smithi088.stdout: cephfs-top-2:17.2.6-1296.g736ac5ba.el8.noarch 2023-10-06T01:37:46.543 INFO:teuthology.orchestra.run.smithi088.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-06T01:37:46.543 INFO:teuthology.orchestra.run.smithi088.stdout: flex-2.6.1-9.el8.x86_64 2023-10-06T01:37:46.543 INFO:teuthology.orchestra.run.smithi088.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-06T01:37:46.543 INFO:teuthology.orchestra.run.smithi088.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-06T01:37:46.543 INFO:teuthology.orchestra.run.smithi088.stdout: jq-1.5-12.el8.x86_64 2023-10-06T01:37:46.543 INFO:teuthology.orchestra.run.smithi088.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-06T01:37:46.543 INFO:teuthology.orchestra.run.smithi088.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-06T01:37:46.543 INFO:teuthology.orchestra.run.smithi088.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-06T01:37:46.543 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.543 INFO:teuthology.orchestra.run.smithi088.stdout: libcephfs2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.544 INFO:teuthology.orchestra.run.smithi088.stdout: libcephsqlite-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.544 INFO:teuthology.orchestra.run.smithi088.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-06T01:37:46.544 INFO:teuthology.orchestra.run.smithi088.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-06T01:37:46.544 INFO:teuthology.orchestra.run.smithi088.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-06T01:37:46.544 INFO:teuthology.orchestra.run.smithi088.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-06T01:37:46.544 INFO:teuthology.orchestra.run.smithi088.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-06T01:37:46.544 INFO:teuthology.orchestra.run.smithi088.stdout: librados-devel-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.544 INFO:teuthology.orchestra.run.smithi088.stdout: libradosstriper1-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.544 INFO:teuthology.orchestra.run.smithi088.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-06T01:37:46.544 INFO:teuthology.orchestra.run.smithi088.stdout: librgw2-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.544 INFO:teuthology.orchestra.run.smithi088.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-06T01:37:46.544 INFO:teuthology.orchestra.run.smithi088.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-06T01:37:46.545 INFO:teuthology.orchestra.run.smithi088.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-06T01:37:46.545 INFO:teuthology.orchestra.run.smithi088.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-06T01:37:46.545 INFO:teuthology.orchestra.run.smithi088.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-06T01:37:46.545 INFO:teuthology.orchestra.run.smithi088.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-06T01:37:46.545 INFO:teuthology.orchestra.run.smithi088.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-06T01:37:46.545 INFO:teuthology.orchestra.run.smithi088.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-06T01:37:46.545 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-06T01:37:46.545 INFO:teuthology.orchestra.run.smithi088.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-06T01:37:46.545 INFO:teuthology.orchestra.run.smithi088.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-06T01:37:46.545 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-06T01:37:46.545 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-06T01:37:46.546 INFO:teuthology.orchestra.run.smithi088.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-06T01:37:46.546 INFO:teuthology.orchestra.run.smithi088.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-06T01:37:46.546 INFO:teuthology.orchestra.run.smithi088.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-06T01:37:46.546 INFO:teuthology.orchestra.run.smithi088.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-06T01:37:46.546 INFO:teuthology.orchestra.run.smithi088.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-06T01:37:46.546 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-06T01:37:46.546 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-argparse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.546 INFO:teuthology.orchestra.run.smithi088.stdout: python3-ceph-common-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.546 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cephfs-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.546 INFO:teuthology.orchestra.run.smithi088.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-06T01:37:46.546 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-06T01:37:46.547 INFO:teuthology.orchestra.run.smithi088.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-06T01:37:46.547 INFO:teuthology.orchestra.run.smithi088.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-06T01:37:46.547 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-06T01:37:46.547 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-06T01:37:46.547 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-06T01:37:46.547 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-06T01:37:46.547 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-06T01:37:46.547 INFO:teuthology.orchestra.run.smithi088.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-06T01:37:46.547 INFO:teuthology.orchestra.run.smithi088.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-06T01:37:46.547 INFO:teuthology.orchestra.run.smithi088.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-06T01:37:46.547 INFO:teuthology.orchestra.run.smithi088.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-06T01:37:46.547 INFO:teuthology.orchestra.run.smithi088.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-06T01:37:46.548 INFO:teuthology.orchestra.run.smithi088.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-06T01:37:46.548 INFO:teuthology.orchestra.run.smithi088.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-06T01:37:46.548 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-06T01:37:46.548 INFO:teuthology.orchestra.run.smithi088.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-06T01:37:46.548 INFO:teuthology.orchestra.run.smithi088.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-06T01:37:46.548 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-06T01:37:46.548 INFO:teuthology.orchestra.run.smithi088.stdout: python3-portend-2.6-1.el8.noarch 2023-10-06T01:37:46.548 INFO:teuthology.orchestra.run.smithi088.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-06T01:37:46.548 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-06T01:37:46.548 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-06T01:37:46.548 INFO:teuthology.orchestra.run.smithi088.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-06T01:37:46.548 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rados-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.549 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.549 INFO:teuthology.orchestra.run.smithi088.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-06T01:37:46.549 INFO:teuthology.orchestra.run.smithi088.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-06T01:37:46.549 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rgw-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.549 INFO:teuthology.orchestra.run.smithi088.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-06T01:37:46.549 INFO:teuthology.orchestra.run.smithi088.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-06T01:37:46.549 INFO:teuthology.orchestra.run.smithi088.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-06T01:37:46.549 INFO:teuthology.orchestra.run.smithi088.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-06T01:37:46.549 INFO:teuthology.orchestra.run.smithi088.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-06T01:37:46.549 INFO:teuthology.orchestra.run.smithi088.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-06T01:37:46.550 INFO:teuthology.orchestra.run.smithi088.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-06T01:37:46.550 INFO:teuthology.orchestra.run.smithi088.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-06T01:37:46.550 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-06T01:37:46.550 INFO:teuthology.orchestra.run.smithi088.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-06T01:37:46.550 INFO:teuthology.orchestra.run.smithi088.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-06T01:37:46.550 INFO:teuthology.orchestra.run.smithi088.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-06T01:37:46.550 INFO:teuthology.orchestra.run.smithi088.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-06T01:37:46.550 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-fuse-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.550 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-mirror-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.550 INFO:teuthology.orchestra.run.smithi088.stdout: rbd-nbd-2:17.2.6-1296.g736ac5ba.el8.x86_64 2023-10-06T01:37:46.550 INFO:teuthology.orchestra.run.smithi088.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-06T01:37:46.550 INFO:teuthology.orchestra.run.smithi088.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-06T01:37:46.551 INFO:teuthology.orchestra.run.smithi088.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-06T01:37:46.551 INFO:teuthology.orchestra.run.smithi088.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-06T01:37:46.551 INFO:teuthology.orchestra.run.smithi088.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-06T01:37:46.551 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:46.551 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2023-10-06T01:37:46.825 DEBUG:teuthology.parallel:result is None 2023-10-06T01:37:46.825 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T01:37:47.082 DEBUG:teuthology.orchestra.run.smithi069:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T01:37:47.103 INFO:teuthology.orchestra.run.smithi069.stdout:17.2.6-1296.g736ac5ba.el8 2023-10-06T01:37:47.104 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296.g736ac5ba.el8 2023-10-06T01:37:47.104 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296.g736ac5ba is installed. 2023-10-06T01:37:47.104 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=736ac5ba72cb47af7d6f6666b1e100f7e20a20e2 2023-10-06T01:37:47.361 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-06T01:37:47.382 INFO:teuthology.orchestra.run.smithi088.stdout:17.2.6-1296.g736ac5ba.el8 2023-10-06T01:37:47.382 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1296.g736ac5ba.el8 2023-10-06T01:37:47.383 INFO:teuthology.task.install:The correct ceph version 17.2.6-1296.g736ac5ba is installed. 2023-10-06T01:37:47.383 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-06T01:37:47.383 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-10-06T01:37:47.383 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T01:37:47.421 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-06T01:37:47.421 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-06T01:37:47.461 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-06T01:37:47.461 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-10-06T01:37:47.461 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T01:37:47.485 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T01:37:47.550 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-06T01:37:47.550 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/daemon-helper 2023-10-06T01:37:47.574 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-06T01:37:47.638 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-06T01:37:47.638 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-10-06T01:37:47.638 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T01:37:47.663 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T01:37:47.727 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-06T01:37:47.727 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-06T01:37:47.751 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-06T01:37:47.815 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-06T01:37:47.815 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-10-06T01:37:47.815 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T01:37:47.839 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T01:37:47.903 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-06T01:37:47.903 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/usr/bin/stdin-killer 2023-10-06T01:37:47.926 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-06T01:37:47.990 INFO:teuthology.run_tasks:Running task ceph... 2023-10-06T01:37:48.069 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-06T01:37:48.069 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 777 /var/log/ceph 2023-10-06T01:37:48.071 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 777 /var/log/ceph 2023-10-06T01:37:48.095 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-06T01:37:48.095 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T01:37:48.136 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-06T01:37:48.160 INFO:tasks.ceph:Creating extra log directories... 2023-10-06T01:37:48.160 DEBUG:teuthology.orchestra.run.smithi069:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T01:37:48.200 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-06T01:37:48.231 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-06T01:37:48.231 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-06T01:37:48.231 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-06T01:37:48.231 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-10-06T01:37:48.231 DEBUG:teuthology.orchestra.run.smithi069:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T01:37:48.276 DEBUG:teuthology.orchestra.run.smithi069:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T01:37:48.388 DEBUG:teuthology.orchestra.run.smithi069:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T01:37:48.413 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-06T01:37:48.413 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-06T01:37:48.428 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-06T01:37:48.540 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-06T01:37:48.585 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-06T01:37:48.585 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-06T01:37:48.585 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412094', 'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7412094', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 7519, 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-10-05-0730-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_f1e315a9732d36c05ec316678e2397dc58561c7f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'f1e315a9732d36c05ec316678e2397dc58561c7f', 'targets': {'smithi069.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBowBKOLIpyipqFpD3/v7Yj0n5BMVMwAyKP5FFD/+0wS7K/ftkOtxWGpWHhdt032Y7/PG9/qTK4oKf9dlL8Pe7U=', 'smithi088.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE0WqH0gRmlxyp8SlhsxOCEwnRt2oa83IfsFqZYkOxEWUH0tdXtupPuhn7MMwD/PxOS4dZhixw1qoUf9f++llto='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '736ac5ba72cb47af7d6f6666b1e100f7e20a20e2'}}, {'ceph': None}, {'kclient': None}, {'check-counter': {'counters': {'mgr': [{'min': 4, 'name': 'finisher-volumes.complete_latency.avgcount'}, {'expected_val': 0, 'name': 'finisher-volumes.queue_len'}]}}}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestPerModuleFinsherThread']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-05_23:52:50', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-06T01:37:48.586 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T01:37:48.588 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-06T01:37:48.634 DEBUG:teuthology.orchestra.run.smithi069:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T01:37:48.643 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m0777 -- /var/run/ceph 2023-10-06T01:37:48.699 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-10-06T01:37:48.699 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T01:37:48.721 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T01:37:48.721 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_1 2023-10-06T01:37:48.776 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T01:37:48.776 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T01:37:48.776 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 6h/6d Inode: 222263 Links: 1 2023-10-06T01:37:48.776 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T01:37:48.776 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T01:37:48.776 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-10-06 01:37:40.691920764 +0000 2023-10-06T01:37:48.776 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-10-06 01:35:17.391410807 +0000 2023-10-06T01:37:48.777 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-10-06 01:35:17.391410807 +0000 2023-10-06T01:37:48.777 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: - 2023-10-06T01:37:48.777 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T01:37:48.839 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-10-06T01:37:48.839 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-10-06T01:37:48.839 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000232876 s, 2.2 MB/s 2023-10-06T01:37:48.840 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T01:37:48.896 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_2 2023-10-06T01:37:48.951 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T01:37:48.951 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T01:37:48.951 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 6h/6d Inode: 223266 Links: 1 2023-10-06T01:37:48.951 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T01:37:48.951 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T01:37:48.951 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-10-06 01:37:40.691920764 +0000 2023-10-06T01:37:48.952 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-10-06 01:35:17.891400000 +0000 2023-10-06T01:37:48.952 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-10-06 01:35:17.891400000 +0000 2023-10-06T01:37:48.952 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: - 2023-10-06T01:37:48.952 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T01:37:49.014 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-10-06T01:37:49.014 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-10-06T01:37:49.014 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000223087 s, 2.3 MB/s 2023-10-06T01:37:49.015 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T01:37:49.071 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_3 2023-10-06T01:37:49.125 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T01:37:49.126 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T01:37:49.126 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 6h/6d Inode: 220500 Links: 1 2023-10-06T01:37:49.126 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T01:37:49.126 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T01:37:49.126 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-10-06 01:37:40.691920764 +0000 2023-10-06T01:37:49.126 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-10-06 01:35:18.391389191 +0000 2023-10-06T01:37:49.126 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-10-06 01:35:18.391389191 +0000 2023-10-06T01:37:49.126 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: - 2023-10-06T01:37:49.127 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T01:37:49.189 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-10-06T01:37:49.189 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-10-06T01:37:49.189 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000224863 s, 2.3 MB/s 2023-10-06T01:37:49.190 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T01:37:49.245 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_4 2023-10-06T01:37:49.301 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T01:37:49.301 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T01:37:49.301 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 6h/6d Inode: 221435 Links: 1 2023-10-06T01:37:49.301 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T01:37:49.301 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T01:37:49.301 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2023-10-06 01:37:40.692920743 +0000 2023-10-06T01:37:49.301 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2023-10-06 01:35:18.893378339 +0000 2023-10-06T01:37:49.301 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2023-10-06 01:35:18.893378339 +0000 2023-10-06T01:37:49.302 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: - 2023-10-06T01:37:49.302 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T01:37:49.364 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2023-10-06T01:37:49.364 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2023-10-06T01:37:49.364 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000171887 s, 3.0 MB/s 2023-10-06T01:37:49.365 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T01:37:49.420 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T01:37:49.420 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-06T01:37:49.421 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/scratch_devs of=/dev/stdout 2023-10-06T01:37:49.436 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-06T01:37:49.437 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_1 2023-10-06T01:37:49.493 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-06T01:37:49.493 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T01:37:49.493 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 6h/6d Inode: 218686 Links: 1 2023-10-06T01:37:49.493 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T01:37:49.493 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T01:37:49.493 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-10-06 01:37:41.943366480 +0000 2023-10-06T01:37:49.493 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-10-06 01:35:16.261528791 +0000 2023-10-06T01:37:49.493 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-10-06 01:35:16.261528791 +0000 2023-10-06T01:37:49.493 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2023-10-06T01:37:49.494 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-06T01:37:49.557 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-10-06T01:37:49.557 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-10-06T01:37:49.557 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000249045 s, 2.1 MB/s 2023-10-06T01:37:49.558 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-06T01:37:49.615 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_2 2023-10-06T01:37:49.671 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-06T01:37:49.671 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T01:37:49.671 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 6h/6d Inode: 214773 Links: 1 2023-10-06T01:37:49.671 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T01:37:49.671 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T01:37:49.671 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-10-06 01:37:41.943366480 +0000 2023-10-06T01:37:49.671 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-10-06 01:35:16.760518797 +0000 2023-10-06T01:37:49.671 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-10-06 01:35:16.760518797 +0000 2023-10-06T01:37:49.671 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2023-10-06T01:37:49.672 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-06T01:37:49.734 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-10-06T01:37:49.734 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-10-06T01:37:49.735 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000220198 s, 2.3 MB/s 2023-10-06T01:37:49.736 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-06T01:37:49.792 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_3 2023-10-06T01:37:49.847 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-06T01:37:49.847 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T01:37:49.847 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 6h/6d Inode: 215961 Links: 1 2023-10-06T01:37:49.847 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T01:37:49.847 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T01:37:49.847 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-10-06 01:37:41.944366460 +0000 2023-10-06T01:37:49.847 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-10-06 01:35:17.263508725 +0000 2023-10-06T01:37:49.847 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-10-06 01:35:17.263508725 +0000 2023-10-06T01:37:49.848 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2023-10-06T01:37:49.848 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-06T01:37:49.910 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-10-06T01:37:49.910 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-10-06T01:37:49.910 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000217066 s, 2.4 MB/s 2023-10-06T01:37:49.911 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-06T01:37:49.967 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_4 2023-10-06T01:37:50.022 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-06T01:37:50.022 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-06T01:37:50.022 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 6h/6d Inode: 223243 Links: 1 2023-10-06T01:37:50.023 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-06T01:37:50.023 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2023-10-06T01:37:50.023 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2023-10-06 01:37:41.944366460 +0000 2023-10-06T01:37:50.023 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2023-10-06 01:35:17.778498411 +0000 2023-10-06T01:37:50.023 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2023-10-06 01:35:17.778498411 +0000 2023-10-06T01:37:50.023 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: - 2023-10-06T01:37:50.024 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-06T01:37:50.085 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2023-10-06T01:37:50.085 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2023-10-06T01:37:50.085 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000214554 s, 2.4 MB/s 2023-10-06T01:37:50.086 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-06T01:37:50.141 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T01:37:50.142 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi069.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T01:37:50.142 INFO:tasks.ceph:Generating config... 2023-10-06T01:37:50.143 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-06T01:37:50.143 INFO:tasks.ceph:[client] debug client = 20 2023-10-06T01:37:50.143 INFO:tasks.ceph:[client] debug ms = 1 2023-10-06T01:37:50.143 INFO:tasks.ceph:[client] pid file = 2023-10-06T01:37:50.144 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-06T01:37:50.144 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-06T01:37:50.144 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-06T01:37:50.144 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-06T01:37:50.144 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-06T01:37:50.144 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-06T01:37:50.144 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-06T01:37:50.144 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-06T01:37:50.144 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-06T01:37:50.145 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-06T01:37:50.145 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-06T01:37:50.145 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-06T01:37:50.145 INFO:tasks.ceph:[mgr] debug client = 20 2023-10-06T01:37:50.145 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-10-06T01:37:50.145 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-06T01:37:50.146 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-06T01:37:50.146 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-06T01:37:50.146 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-06T01:37:50.146 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-06T01:37:50.146 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-06T01:37:50.146 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-06T01:37:50.146 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-06T01:37:50.147 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-06T01:37:50.147 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-06T01:37:50.147 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-06T01:37:50.147 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-06T01:37:50.147 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-06T01:37:50.147 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-06T01:37:50.147 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-06T01:37:50.147 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-06T01:37:50.148 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-06T01:37:50.148 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-06T01:37:50.148 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-06T01:37:50.148 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-06T01:37:50.148 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-06T01:37:50.148 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-06T01:37:50.148 INFO:tasks.ceph:Setting up mon.a... 2023-10-06T01:37:50.149 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-06T01:37:50.196 INFO:teuthology.orchestra.run.smithi069.stdout:creating /etc/ceph/ceph.keyring 2023-10-06T01:37:50.199 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-06T01:37:50.238 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T01:37:50.305 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.69'), ('mon.b', '172.21.15.88'), ('mon.c', '[v2:172.21.15.88:3301,v1:172.21.15.88:6790]')] 2023-10-06T01:37:50.305 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.69,172.21.15.88,[v2:172.21.15.88:3301,v1:172.21.15.88:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-06T01:37:50.306 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-10-06T01:37:50.306 DEBUG:teuthology.orchestra.run.smithi069:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T01:37:50.359 DEBUG:teuthology.orchestra.run.smithi069:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.69 --add b 172.21.15.88 --addv c '[v2:172.21.15.88:3301,v1:172.21.15.88:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:37:50.440 INFO:teuthology.orchestra.run.smithi069.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:37:50.441 INFO:teuthology.orchestra.run.smithi069.stdout:monmaptool: generated fsid c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6 2023-10-06T01:37:50.441 INFO:teuthology.orchestra.run.smithi069.stdout:setting min_mon_release = octopus 2023-10-06T01:37:50.441 INFO:teuthology.orchestra.run.smithi069.stdout:epoch 0 2023-10-06T01:37:50.441 INFO:teuthology.orchestra.run.smithi069.stdout:fsid c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6 2023-10-06T01:37:50.441 INFO:teuthology.orchestra.run.smithi069.stdout:last_changed 2023-10-06T01:37:50.440957+0000 2023-10-06T01:37:50.441 INFO:teuthology.orchestra.run.smithi069.stdout:created 2023-10-06T01:37:50.440957+0000 2023-10-06T01:37:50.441 INFO:teuthology.orchestra.run.smithi069.stdout:min_mon_release 15 (octopus) 2023-10-06T01:37:50.441 INFO:teuthology.orchestra.run.smithi069.stdout:election_strategy: 1 2023-10-06T01:37:50.441 INFO:teuthology.orchestra.run.smithi069.stdout:0: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.a 2023-10-06T01:37:50.441 INFO:teuthology.orchestra.run.smithi069.stdout:1: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.b 2023-10-06T01:37:50.441 INFO:teuthology.orchestra.run.smithi069.stdout:2: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2023-10-06T01:37:50.442 INFO:teuthology.orchestra.run.smithi069.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-06T01:37:50.443 DEBUG:teuthology.orchestra.run.smithi069:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-06T01:37:50.499 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6... 2023-10-06T01:37:50.500 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T01:37:50.541 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-06T01:37:50.582 INFO:teuthology.orchestra.run.smithi069.stdout:[global] 2023-10-06T01:37:50.582 INFO:teuthology.orchestra.run.smithi069.stdout: chdir = "" 2023-10-06T01:37:50.582 INFO:teuthology.orchestra.run.smithi069.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T01:37:50.582 INFO:teuthology.orchestra.run.smithi069.stdout: auth supported = cephx 2023-10-06T01:37:50.582 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.582 INFO:teuthology.orchestra.run.smithi069.stdout: filestore xattr use omap = true 2023-10-06T01:37:50.583 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.583 INFO:teuthology.orchestra.run.smithi069.stdout: mon clock drift allowed = 1.000 2023-10-06T01:37:50.583 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.583 INFO:teuthology.orchestra.run.smithi069.stdout: osd crush chooseleaf type = 0 2023-10-06T01:37:50.583 INFO:teuthology.orchestra.run.smithi069.stdout: auth debug = true 2023-10-06T01:37:50.583 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.583 INFO:teuthology.orchestra.run.smithi069.stdout: ms die on old message = true 2023-10-06T01:37:50.583 INFO:teuthology.orchestra.run.smithi069.stdout: ms die on bug = true 2023-10-06T01:37:50.583 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.583 INFO:teuthology.orchestra.run.smithi069.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T01:37:50.583 INFO:teuthology.orchestra.run.smithi069.stdout: mon pg warn max object skew = 0 2023-10-06T01:37:50.583 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.584 INFO:teuthology.orchestra.run.smithi069.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T01:37:50.584 INFO:teuthology.orchestra.run.smithi069.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T01:37:50.584 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.584 INFO:teuthology.orchestra.run.smithi069.stdout: osd pool default size = 2 2023-10-06T01:37:50.584 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.584 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd allow primary affinity = true 2023-10-06T01:37:50.584 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd allow pg remap = true 2023-10-06T01:37:50.584 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on legacy crush tunables = false 2023-10-06T01:37:50.584 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on crush straw calc version zero = false 2023-10-06T01:37:50.584 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on no sortbitwise = false 2023-10-06T01:37:50.584 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on osd down out interval zero = false 2023-10-06T01:37:50.584 INFO:teuthology.orchestra.run.smithi069.stdout: mon warn on too few osds = false 2023-10-06T01:37:50.585 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T01:37:50.585 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T01:37:50.585 INFO:teuthology.orchestra.run.smithi069.stdout: mon_allow_pool_size_one = true 2023-10-06T01:37:50.585 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.585 INFO:teuthology.orchestra.run.smithi069.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T01:37:50.585 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.585 INFO:teuthology.orchestra.run.smithi069.stdout: osd default data pool replay window = 5 2023-10-06T01:37:50.585 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.585 INFO:teuthology.orchestra.run.smithi069.stdout: mon allow pool delete = true 2023-10-06T01:37:50.585 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.585 INFO:teuthology.orchestra.run.smithi069.stdout: mon cluster log file level = debug 2023-10-06T01:37:50.585 INFO:teuthology.orchestra.run.smithi069.stdout: debug asserts on shutdown = true 2023-10-06T01:37:50.585 INFO:teuthology.orchestra.run.smithi069.stdout: mon health detail to clog = false 2023-10-06T01:37:50.586 INFO:teuthology.orchestra.run.smithi069.stdout: mon host = "172.21.15.69,172.21.15.88,[v2:172.21.15.88:3301,v1:172.21.15.88:6790]" 2023-10-06T01:37:50.586 INFO:teuthology.orchestra.run.smithi069.stdout: ms die on skipped message = False 2023-10-06T01:37:50.586 INFO:teuthology.orchestra.run.smithi069.stdout: fsid = c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6 2023-10-06T01:37:50.586 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.586 INFO:teuthology.orchestra.run.smithi069.stdout:[osd] 2023-10-06T01:37:50.586 INFO:teuthology.orchestra.run.smithi069.stdout: osd journal size = 100 2023-10-06T01:37:50.586 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.586 INFO:teuthology.orchestra.run.smithi069.stdout: osd scrub load threshold = 5.0 2023-10-06T01:37:50.586 INFO:teuthology.orchestra.run.smithi069.stdout: osd scrub max interval = 600 2023-10-06T01:37:50.586 INFO:teuthology.orchestra.run.smithi069.stdout: osd mclock profile = high_recovery_ops 2023-10-06T01:37:50.586 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.587 INFO:teuthology.orchestra.run.smithi069.stdout: osd recover clone overlap = true 2023-10-06T01:37:50.587 INFO:teuthology.orchestra.run.smithi069.stdout: osd recovery max chunk = 1048576 2023-10-06T01:37:50.587 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.587 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug shutdown = true 2023-10-06T01:37:50.587 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug op order = true 2023-10-06T01:37:50.587 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug verify stray on activate = true 2023-10-06T01:37:50.587 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.587 INFO:teuthology.orchestra.run.smithi069.stdout: osd open classes on start = true 2023-10-06T01:37:50.587 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug pg log writeout = true 2023-10-06T01:37:50.587 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.587 INFO:teuthology.orchestra.run.smithi069.stdout: osd deep scrub update digest min age = 30 2023-10-06T01:37:50.587 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.587 INFO:teuthology.orchestra.run.smithi069.stdout: osd map max advance = 10 2023-10-06T01:37:50.588 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.588 INFO:teuthology.orchestra.run.smithi069.stdout: journal zero on create = true 2023-10-06T01:37:50.588 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.588 INFO:teuthology.orchestra.run.smithi069.stdout: filestore ondisk finisher threads = 3 2023-10-06T01:37:50.588 INFO:teuthology.orchestra.run.smithi069.stdout: filestore apply finisher threads = 3 2023-10-06T01:37:50.588 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.588 INFO:teuthology.orchestra.run.smithi069.stdout: bdev debug aio = true 2023-10-06T01:37:50.588 INFO:teuthology.orchestra.run.smithi069.stdout: osd debug misdirected ops = true 2023-10-06T01:37:50.588 INFO:teuthology.orchestra.run.smithi069.stdout: bdev async discard = True 2023-10-06T01:37:50.588 INFO:teuthology.orchestra.run.smithi069.stdout: bdev enable discard = True 2023-10-06T01:37:50.588 INFO:teuthology.orchestra.run.smithi069.stdout: bluestore allocator = bitmap 2023-10-06T01:37:50.588 INFO:teuthology.orchestra.run.smithi069.stdout: bluestore block size = 96636764160 2023-10-06T01:37:50.589 INFO:teuthology.orchestra.run.smithi069.stdout: bluestore fsck on mount = True 2023-10-06T01:37:50.589 INFO:teuthology.orchestra.run.smithi069.stdout: debug bluefs = 1/20 2023-10-06T01:37:50.589 INFO:teuthology.orchestra.run.smithi069.stdout: debug bluestore = 1/20 2023-10-06T01:37:50.589 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-10-06T01:37:50.589 INFO:teuthology.orchestra.run.smithi069.stdout: debug osd = 20 2023-10-06T01:37:50.589 INFO:teuthology.orchestra.run.smithi069.stdout: debug rocksdb = 4/10 2023-10-06T01:37:50.589 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T01:37:50.589 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd full ratio = 0.9 2023-10-06T01:37:50.589 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd nearfull ratio = 0.8 2023-10-06T01:37:50.589 INFO:teuthology.orchestra.run.smithi069.stdout: osd failsafe full ratio = 0.95 2023-10-06T01:37:50.589 INFO:teuthology.orchestra.run.smithi069.stdout: osd objectstore = bluestore 2023-10-06T01:37:50.589 INFO:teuthology.orchestra.run.smithi069.stdout: osd op complaint time = 180 2023-10-06T01:37:50.590 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.590 INFO:teuthology.orchestra.run.smithi069.stdout:[mgr] 2023-10-06T01:37:50.590 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-10-06T01:37:50.590 INFO:teuthology.orchestra.run.smithi069.stdout: debug mgr = 20 2023-10-06T01:37:50.590 INFO:teuthology.orchestra.run.smithi069.stdout: debug mon = 20 2023-10-06T01:37:50.590 INFO:teuthology.orchestra.run.smithi069.stdout: debug auth = 20 2023-10-06T01:37:50.590 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min pgs per osd = 4 2023-10-06T01:37:50.590 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min bytes per osd = 10 2023-10-06T01:37:50.590 INFO:teuthology.orchestra.run.smithi069.stdout: mgr/telemetry/nag = false 2023-10-06T01:37:50.590 INFO:teuthology.orchestra.run.smithi069.stdout: debug client = 20 2023-10-06T01:37:50.590 INFO:teuthology.orchestra.run.smithi069.stdout: debug finisher = 20 2023-10-06T01:37:50.590 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.591 INFO:teuthology.orchestra.run.smithi069.stdout:[mon] 2023-10-06T01:37:50.591 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-10-06T01:37:50.591 INFO:teuthology.orchestra.run.smithi069.stdout: debug mon = 20 2023-10-06T01:37:50.591 INFO:teuthology.orchestra.run.smithi069.stdout: debug paxos = 20 2023-10-06T01:37:50.591 INFO:teuthology.orchestra.run.smithi069.stdout: debug auth = 20 2023-10-06T01:37:50.591 INFO:teuthology.orchestra.run.smithi069.stdout: mon data avail warn = 5 2023-10-06T01:37:50.591 INFO:teuthology.orchestra.run.smithi069.stdout: mon mgr mkfs grace = 240 2023-10-06T01:37:50.591 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min pgs per osd = 4 2023-10-06T01:37:50.591 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd reporter subtree level = osd 2023-10-06T01:37:50.591 INFO:teuthology.orchestra.run.smithi069.stdout: mon osd prime pg temp = true 2023-10-06T01:37:50.591 INFO:teuthology.orchestra.run.smithi069.stdout: mon reweight min bytes per osd = 10 2023-10-06T01:37:50.591 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.592 INFO:teuthology.orchestra.run.smithi069.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T01:37:50.592 INFO:teuthology.orchestra.run.smithi069.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T01:37:50.592 INFO:teuthology.orchestra.run.smithi069.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T01:37:50.592 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.592 INFO:teuthology.orchestra.run.smithi069.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T01:37:50.592 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T01:37:50.592 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T01:37:50.592 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.592 INFO:teuthology.orchestra.run.smithi069.stdout: # 1m isn't quite enough 2023-10-06T01:37:50.592 INFO:teuthology.orchestra.run.smithi069.stdout: mon_down_mkfs_grace = 2m 2023-10-06T01:37:50.592 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.592 INFO:teuthology.orchestra.run.smithi069.stdout: mon_warn_on_filestore_osds = false 2023-10-06T01:37:50.592 INFO:teuthology.orchestra.run.smithi069.stdout: mon op complaint time = 120 2023-10-06T01:37:50.593 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:37:50.593 INFO:teuthology.orchestra.run.smithi069.stdout:[client] 2023-10-06T01:37:50.593 INFO:teuthology.orchestra.run.smithi069.stdout: rgw cache enabled = true 2023-10-06T01:37:50.593 INFO:teuthology.orchestra.run.smithi069.stdout: rgw enable ops log = true 2023-10-06T01:37:50.593 INFO:teuthology.orchestra.run.smithi069.stdout: rgw enable usage log = true 2023-10-06T01:37:50.593 INFO:teuthology.orchestra.run.smithi069.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T01:37:50.593 INFO:teuthology.orchestra.run.smithi069.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T01:37:50.593 INFO:teuthology.orchestra.run.smithi069.stdout: client mount timeout = 600 2023-10-06T01:37:50.593 INFO:teuthology.orchestra.run.smithi069.stdout: debug client = 20 2023-10-06T01:37:50.593 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-10-06T01:37:50.593 INFO:teuthology.orchestra.run.smithi069.stdout: pid file = "" 2023-10-06T01:37:50.593 INFO:teuthology.orchestra.run.smithi069.stdout: rados mon op timeout = 900 2023-10-06T01:37:50.594 INFO:teuthology.orchestra.run.smithi069.stdout: rados osd op timeout = 900 2023-10-06T01:37:50.594 INFO:teuthology.orchestra.run.smithi069.stdout:[mon.a] 2023-10-06T01:37:50.594 INFO:teuthology.orchestra.run.smithi069.stdout:[mon.b] 2023-10-06T01:37:50.594 INFO:teuthology.orchestra.run.smithi069.stdout:[mon.c] 2023-10-06T01:37:50.594 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.a] 2023-10-06T01:37:50.594 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.c] 2023-10-06T01:37:50.594 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.b] 2023-10-06T01:37:50.594 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.d] 2023-10-06T01:37:50.594 INFO:teuthology.orchestra.run.smithi069.stdout:[mds] 2023-10-06T01:37:50.594 INFO:teuthology.orchestra.run.smithi069.stdout: debug mds = 20 2023-10-06T01:37:50.594 INFO:teuthology.orchestra.run.smithi069.stdout: debug ms = 1 2023-10-06T01:37:50.594 INFO:teuthology.orchestra.run.smithi069.stdout: mds debug frag = True 2023-10-06T01:37:50.594 INFO:teuthology.orchestra.run.smithi069.stdout: mds debug scatterstat = True 2023-10-06T01:37:50.595 INFO:teuthology.orchestra.run.smithi069.stdout: mds op complaint time = 180 2023-10-06T01:37:50.595 INFO:teuthology.orchestra.run.smithi069.stdout: mds verify scatter = True 2023-10-06T01:37:50.595 INFO:teuthology.orchestra.run.smithi069.stdout: osd op complaint time = 180 2023-10-06T01:37:50.595 INFO:teuthology.orchestra.run.smithi069.stdout: rados mon op timeout = 900 2023-10-06T01:37:50.595 INFO:teuthology.orchestra.run.smithi069.stdout: rados osd op timeout = 900 2023-10-06T01:37:50.596 INFO:teuthology.orchestra.run.smithi088.stdout:[global] 2023-10-06T01:37:50.597 INFO:teuthology.orchestra.run.smithi088.stdout: chdir = "" 2023-10-06T01:37:50.597 INFO:teuthology.orchestra.run.smithi088.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-06T01:37:50.597 INFO:teuthology.orchestra.run.smithi088.stdout: auth supported = cephx 2023-10-06T01:37:50.597 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.597 INFO:teuthology.orchestra.run.smithi088.stdout: filestore xattr use omap = true 2023-10-06T01:37:50.597 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.597 INFO:teuthology.orchestra.run.smithi088.stdout: mon clock drift allowed = 1.000 2023-10-06T01:37:50.597 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.597 INFO:teuthology.orchestra.run.smithi088.stdout: osd crush chooseleaf type = 0 2023-10-06T01:37:50.597 INFO:teuthology.orchestra.run.smithi088.stdout: auth debug = true 2023-10-06T01:37:50.597 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.597 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on old message = true 2023-10-06T01:37:50.598 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on bug = true 2023-10-06T01:37:50.598 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.598 INFO:teuthology.orchestra.run.smithi088.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-06T01:37:50.598 INFO:teuthology.orchestra.run.smithi088.stdout: mon pg warn max object skew = 0 2023-10-06T01:37:50.598 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.598 INFO:teuthology.orchestra.run.smithi088.stdout: # disable pg_autoscaler by default for new pools 2023-10-06T01:37:50.598 INFO:teuthology.orchestra.run.smithi088.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-06T01:37:50.598 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.598 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default size = 2 2023-10-06T01:37:50.598 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.598 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow primary affinity = true 2023-10-06T01:37:50.598 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd allow pg remap = true 2023-10-06T01:37:50.599 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on legacy crush tunables = false 2023-10-06T01:37:50.599 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on crush straw calc version zero = false 2023-10-06T01:37:50.599 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on no sortbitwise = false 2023-10-06T01:37:50.599 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on osd down out interval zero = false 2023-10-06T01:37:50.599 INFO:teuthology.orchestra.run.smithi088.stdout: mon warn on too few osds = false 2023-10-06T01:37:50.599 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-06T01:37:50.599 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-06T01:37:50.599 INFO:teuthology.orchestra.run.smithi088.stdout: mon_allow_pool_size_one = true 2023-10-06T01:37:50.599 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.599 INFO:teuthology.orchestra.run.smithi088.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-06T01:37:50.599 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.599 INFO:teuthology.orchestra.run.smithi088.stdout: osd default data pool replay window = 5 2023-10-06T01:37:50.600 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.600 INFO:teuthology.orchestra.run.smithi088.stdout: mon allow pool delete = true 2023-10-06T01:37:50.600 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.600 INFO:teuthology.orchestra.run.smithi088.stdout: mon cluster log file level = debug 2023-10-06T01:37:50.600 INFO:teuthology.orchestra.run.smithi088.stdout: debug asserts on shutdown = true 2023-10-06T01:37:50.600 INFO:teuthology.orchestra.run.smithi088.stdout: mon health detail to clog = false 2023-10-06T01:37:50.600 INFO:teuthology.orchestra.run.smithi088.stdout: mon host = "172.21.15.69,172.21.15.88,[v2:172.21.15.88:3301,v1:172.21.15.88:6790]" 2023-10-06T01:37:50.600 INFO:teuthology.orchestra.run.smithi088.stdout: ms die on skipped message = False 2023-10-06T01:37:50.600 INFO:teuthology.orchestra.run.smithi088.stdout: fsid = c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6 2023-10-06T01:37:50.600 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.600 INFO:teuthology.orchestra.run.smithi088.stdout:[osd] 2023-10-06T01:37:50.600 INFO:teuthology.orchestra.run.smithi088.stdout: osd journal size = 100 2023-10-06T01:37:50.600 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.601 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub load threshold = 5.0 2023-10-06T01:37:50.601 INFO:teuthology.orchestra.run.smithi088.stdout: osd scrub max interval = 600 2023-10-06T01:37:50.601 INFO:teuthology.orchestra.run.smithi088.stdout: osd mclock profile = high_recovery_ops 2023-10-06T01:37:50.601 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.601 INFO:teuthology.orchestra.run.smithi088.stdout: osd recover clone overlap = true 2023-10-06T01:37:50.601 INFO:teuthology.orchestra.run.smithi088.stdout: osd recovery max chunk = 1048576 2023-10-06T01:37:50.601 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.601 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug shutdown = true 2023-10-06T01:37:50.601 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug op order = true 2023-10-06T01:37:50.601 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug verify stray on activate = true 2023-10-06T01:37:50.601 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.601 INFO:teuthology.orchestra.run.smithi088.stdout: osd open classes on start = true 2023-10-06T01:37:50.602 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug pg log writeout = true 2023-10-06T01:37:50.602 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.602 INFO:teuthology.orchestra.run.smithi088.stdout: osd deep scrub update digest min age = 30 2023-10-06T01:37:50.602 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.602 INFO:teuthology.orchestra.run.smithi088.stdout: osd map max advance = 10 2023-10-06T01:37:50.602 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.602 INFO:teuthology.orchestra.run.smithi088.stdout: journal zero on create = true 2023-10-06T01:37:50.602 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.602 INFO:teuthology.orchestra.run.smithi088.stdout: filestore ondisk finisher threads = 3 2023-10-06T01:37:50.602 INFO:teuthology.orchestra.run.smithi088.stdout: filestore apply finisher threads = 3 2023-10-06T01:37:50.602 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.602 INFO:teuthology.orchestra.run.smithi088.stdout: bdev debug aio = true 2023-10-06T01:37:50.603 INFO:teuthology.orchestra.run.smithi088.stdout: osd debug misdirected ops = true 2023-10-06T01:37:50.603 INFO:teuthology.orchestra.run.smithi088.stdout: bdev async discard = True 2023-10-06T01:37:50.603 INFO:teuthology.orchestra.run.smithi088.stdout: bdev enable discard = True 2023-10-06T01:37:50.603 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore allocator = bitmap 2023-10-06T01:37:50.603 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore block size = 96636764160 2023-10-06T01:37:50.603 INFO:teuthology.orchestra.run.smithi088.stdout: bluestore fsck on mount = True 2023-10-06T01:37:50.603 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluefs = 1/20 2023-10-06T01:37:50.603 INFO:teuthology.orchestra.run.smithi088.stdout: debug bluestore = 1/20 2023-10-06T01:37:50.603 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-10-06T01:37:50.603 INFO:teuthology.orchestra.run.smithi088.stdout: debug osd = 20 2023-10-06T01:37:50.603 INFO:teuthology.orchestra.run.smithi088.stdout: debug rocksdb = 4/10 2023-10-06T01:37:50.603 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd backfillfull_ratio = 0.85 2023-10-06T01:37:50.603 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd full ratio = 0.9 2023-10-06T01:37:50.604 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd nearfull ratio = 0.8 2023-10-06T01:37:50.604 INFO:teuthology.orchestra.run.smithi088.stdout: osd failsafe full ratio = 0.95 2023-10-06T01:37:50.604 INFO:teuthology.orchestra.run.smithi088.stdout: osd objectstore = bluestore 2023-10-06T01:37:50.604 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2023-10-06T01:37:50.604 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.604 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr] 2023-10-06T01:37:50.604 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-10-06T01:37:50.604 INFO:teuthology.orchestra.run.smithi088.stdout: debug mgr = 20 2023-10-06T01:37:50.604 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2023-10-06T01:37:50.604 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2023-10-06T01:37:50.604 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2023-10-06T01:37:50.604 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2023-10-06T01:37:50.605 INFO:teuthology.orchestra.run.smithi088.stdout: mgr/telemetry/nag = false 2023-10-06T01:37:50.605 INFO:teuthology.orchestra.run.smithi088.stdout: debug client = 20 2023-10-06T01:37:50.605 INFO:teuthology.orchestra.run.smithi088.stdout: debug finisher = 20 2023-10-06T01:37:50.605 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.605 INFO:teuthology.orchestra.run.smithi088.stdout:[mon] 2023-10-06T01:37:50.605 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-10-06T01:37:50.605 INFO:teuthology.orchestra.run.smithi088.stdout: debug mon = 20 2023-10-06T01:37:50.605 INFO:teuthology.orchestra.run.smithi088.stdout: debug paxos = 20 2023-10-06T01:37:50.605 INFO:teuthology.orchestra.run.smithi088.stdout: debug auth = 20 2023-10-06T01:37:50.605 INFO:teuthology.orchestra.run.smithi088.stdout: mon data avail warn = 5 2023-10-06T01:37:50.605 INFO:teuthology.orchestra.run.smithi088.stdout: mon mgr mkfs grace = 240 2023-10-06T01:37:50.605 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min pgs per osd = 4 2023-10-06T01:37:50.606 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd reporter subtree level = osd 2023-10-06T01:37:50.606 INFO:teuthology.orchestra.run.smithi088.stdout: mon osd prime pg temp = true 2023-10-06T01:37:50.606 INFO:teuthology.orchestra.run.smithi088.stdout: mon reweight min bytes per osd = 10 2023-10-06T01:37:50.606 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.606 INFO:teuthology.orchestra.run.smithi088.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-06T01:37:50.606 INFO:teuthology.orchestra.run.smithi088.stdout: auth mon ticket ttl = 660 # 11m 2023-10-06T01:37:50.606 INFO:teuthology.orchestra.run.smithi088.stdout: auth service ticket ttl = 240 # 4m 2023-10-06T01:37:50.606 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.606 INFO:teuthology.orchestra.run.smithi088.stdout: # don't complain about insecure global_id in the test suite 2023-10-06T01:37:50.606 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-06T01:37:50.606 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-06T01:37:50.606 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.607 INFO:teuthology.orchestra.run.smithi088.stdout: # 1m isn't quite enough 2023-10-06T01:37:50.607 INFO:teuthology.orchestra.run.smithi088.stdout: mon_down_mkfs_grace = 2m 2023-10-06T01:37:50.607 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.607 INFO:teuthology.orchestra.run.smithi088.stdout: mon_warn_on_filestore_osds = false 2023-10-06T01:37:50.607 INFO:teuthology.orchestra.run.smithi088.stdout: mon op complaint time = 120 2023-10-06T01:37:50.607 INFO:teuthology.orchestra.run.smithi088.stdout: 2023-10-06T01:37:50.607 INFO:teuthology.orchestra.run.smithi088.stdout:[client] 2023-10-06T01:37:50.607 INFO:teuthology.orchestra.run.smithi088.stdout: rgw cache enabled = true 2023-10-06T01:37:50.607 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable ops log = true 2023-10-06T01:37:50.607 INFO:teuthology.orchestra.run.smithi088.stdout: rgw enable usage log = true 2023-10-06T01:37:50.607 INFO:teuthology.orchestra.run.smithi088.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-06T01:37:50.607 INFO:teuthology.orchestra.run.smithi088.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-06T01:37:50.607 INFO:teuthology.orchestra.run.smithi088.stdout: client mount timeout = 600 2023-10-06T01:37:50.608 INFO:teuthology.orchestra.run.smithi088.stdout: debug client = 20 2023-10-06T01:37:50.608 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-10-06T01:37:50.608 INFO:teuthology.orchestra.run.smithi088.stdout: pid file = "" 2023-10-06T01:37:50.608 INFO:teuthology.orchestra.run.smithi088.stdout: rados mon op timeout = 900 2023-10-06T01:37:50.608 INFO:teuthology.orchestra.run.smithi088.stdout: rados osd op timeout = 900 2023-10-06T01:37:50.608 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.a] 2023-10-06T01:37:50.608 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.b] 2023-10-06T01:37:50.608 INFO:teuthology.orchestra.run.smithi088.stdout:[mon.c] 2023-10-06T01:37:50.608 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2023-10-06T01:37:50.608 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.c] 2023-10-06T01:37:50.608 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.b] 2023-10-06T01:37:50.608 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.d] 2023-10-06T01:37:50.609 INFO:teuthology.orchestra.run.smithi088.stdout:[mds] 2023-10-06T01:37:50.609 INFO:teuthology.orchestra.run.smithi088.stdout: debug mds = 20 2023-10-06T01:37:50.609 INFO:teuthology.orchestra.run.smithi088.stdout: debug ms = 1 2023-10-06T01:37:50.609 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug frag = True 2023-10-06T01:37:50.609 INFO:teuthology.orchestra.run.smithi088.stdout: mds debug scatterstat = True 2023-10-06T01:37:50.609 INFO:teuthology.orchestra.run.smithi088.stdout: mds op complaint time = 180 2023-10-06T01:37:50.609 INFO:teuthology.orchestra.run.smithi088.stdout: mds verify scatter = True 2023-10-06T01:37:50.609 INFO:teuthology.orchestra.run.smithi088.stdout: osd op complaint time = 180 2023-10-06T01:37:50.609 INFO:teuthology.orchestra.run.smithi088.stdout: rados mon op timeout = 900 2023-10-06T01:37:50.609 INFO:teuthology.orchestra.run.smithi088.stdout: rados osd op timeout = 900 2023-10-06T01:37:50.609 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-06T01:37:50.610 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-06T01:37:50.687 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-06T01:37:50.688 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-10-06T01:37:50.688 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-06T01:37:50.702 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-10-06T01:37:50.702 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-06T01:37:50.756 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi069.front.sepia.ceph.com 2023-10-06T01:37:50.757 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-10-06T01:37:50.757 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T01:37:50.757 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T01:37:50.831 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-10-06T01:37:50.831 DEBUG:teuthology.orchestra.run.smithi069:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:37:50.885 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi088.front.sepia.ceph.com 2023-10-06T01:37:50.886 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-06T01:37:50.886 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-06T01:37:50.886 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-06T01:37:50.920 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-06T01:37:50.921 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:37:50.975 INFO:tasks.ceph:Setting up mon nodes... 2023-10-06T01:37:50.975 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-06T01:37:50.975 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T01:37:51.023 INFO:teuthology.orchestra.run.smithi069.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-06T01:37:51.025 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T01:37:51.088 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-06T01:37:51.091 INFO:tasks.ceph:Setting up mds nodes... 2023-10-06T01:37:51.091 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T01:37:51.138 INFO:teuthology.orchestra.run.smithi069.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-06T01:37:51.140 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-06T01:37:51.164 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T01:37:51.253 INFO:teuthology.orchestra.run.smithi069.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-06T01:37:51.255 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-06T01:37:51.279 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T01:37:51.328 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-06T01:37:51.330 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-06T01:37:51.354 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T01:37:51.442 INFO:teuthology.orchestra.run.smithi088.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-06T01:37:51.444 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-06T01:37:51.468 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-06T01:37:51.469 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-06T01:37:51.506 INFO:teuthology.orchestra.run.smithi069.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-06T01:37:51.519 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-06T01:37:51.596 INFO:teuthology.orchestra.run.smithi069.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-06T01:37:51.609 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-06T01:37:51.646 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-06T01:37:51.658 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-06T01:37:51.736 INFO:teuthology.orchestra.run.smithi088.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-06T01:37:51.748 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-06T01:37:51.753 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi069.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi088.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-06T01:37:51.753 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-06T01:37:51.777 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T01:37:51.777 INFO:tasks.ceph:role: osd.0 2023-10-06T01:37:51.777 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi069.front.sepia.ceph.com 2023-10-06T01:37:51.778 DEBUG:teuthology.orchestra.run.smithi069:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T01:37:51.848 INFO:teuthology.orchestra.run.smithi069.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T01:37:51.849 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T01:37:51.849 INFO:teuthology.orchestra.run.smithi069.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T01:37:51.849 INFO:teuthology.orchestra.run.smithi069.stdout: = reflink=1 2023-10-06T01:37:51.849 INFO:teuthology.orchestra.run.smithi069.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T01:37:51.849 INFO:teuthology.orchestra.run.smithi069.stdout: = sunit=0 swidth=0 blks 2023-10-06T01:37:51.849 INFO:teuthology.orchestra.run.smithi069.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T01:37:51.849 INFO:teuthology.orchestra.run.smithi069.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T01:37:51.849 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T01:37:51.850 INFO:teuthology.orchestra.run.smithi069.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T01:37:52.278 INFO:teuthology.orchestra.run.smithi069.stdout:Discarding blocks...Done. 2023-10-06T01:37:52.279 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi069.front.sepia.ceph.com -o noatime 2023-10-06T01:37:52.280 DEBUG:teuthology.orchestra.run.smithi069:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-06T01:37:52.435 DEBUG:teuthology.orchestra.run.smithi069:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-06T01:37:52.467 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-06T01:37:52.534 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T01:37:52.534 INFO:tasks.ceph:role: osd.1 2023-10-06T01:37:52.534 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi069.front.sepia.ceph.com 2023-10-06T01:37:52.534 DEBUG:teuthology.orchestra.run.smithi069:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T01:37:52.605 INFO:teuthology.orchestra.run.smithi069.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T01:37:52.606 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T01:37:52.606 INFO:teuthology.orchestra.run.smithi069.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T01:37:52.606 INFO:teuthology.orchestra.run.smithi069.stdout: = reflink=1 2023-10-06T01:37:52.606 INFO:teuthology.orchestra.run.smithi069.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T01:37:52.606 INFO:teuthology.orchestra.run.smithi069.stdout: = sunit=0 swidth=0 blks 2023-10-06T01:37:52.606 INFO:teuthology.orchestra.run.smithi069.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T01:37:52.606 INFO:teuthology.orchestra.run.smithi069.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T01:37:52.606 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T01:37:52.606 INFO:teuthology.orchestra.run.smithi069.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T01:37:53.029 INFO:teuthology.orchestra.run.smithi069.stdout:Discarding blocks...Done. 2023-10-06T01:37:53.031 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi069.front.sepia.ceph.com -o noatime 2023-10-06T01:37:53.031 DEBUG:teuthology.orchestra.run.smithi069:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-06T01:37:53.141 DEBUG:teuthology.orchestra.run.smithi069:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-06T01:37:53.170 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-06T01:37:53.234 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T01:37:53.235 INFO:tasks.ceph:role: osd.2 2023-10-06T01:37:53.235 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi069.front.sepia.ceph.com 2023-10-06T01:37:53.235 DEBUG:teuthology.orchestra.run.smithi069:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T01:37:53.306 INFO:teuthology.orchestra.run.smithi069.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T01:37:53.307 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T01:37:53.307 INFO:teuthology.orchestra.run.smithi069.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T01:37:53.307 INFO:teuthology.orchestra.run.smithi069.stdout: = reflink=1 2023-10-06T01:37:53.307 INFO:teuthology.orchestra.run.smithi069.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T01:37:53.307 INFO:teuthology.orchestra.run.smithi069.stdout: = sunit=0 swidth=0 blks 2023-10-06T01:37:53.307 INFO:teuthology.orchestra.run.smithi069.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T01:37:53.307 INFO:teuthology.orchestra.run.smithi069.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T01:37:53.307 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T01:37:53.307 INFO:teuthology.orchestra.run.smithi069.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T01:37:53.762 INFO:teuthology.orchestra.run.smithi069.stdout:Discarding blocks...Done. 2023-10-06T01:37:53.762 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi069.front.sepia.ceph.com -o noatime 2023-10-06T01:37:53.763 DEBUG:teuthology.orchestra.run.smithi069:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-06T01:37:53.922 DEBUG:teuthology.orchestra.run.smithi069:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-06T01:37:53.951 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-06T01:37:54.015 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-06T01:37:54.015 INFO:tasks.ceph:role: osd.3 2023-10-06T01:37:54.015 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi069.front.sepia.ceph.com 2023-10-06T01:37:54.015 DEBUG:teuthology.orchestra.run.smithi069:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T01:37:54.088 INFO:teuthology.orchestra.run.smithi069.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T01:37:54.088 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T01:37:54.088 INFO:teuthology.orchestra.run.smithi069.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T01:37:54.088 INFO:teuthology.orchestra.run.smithi069.stdout: = reflink=1 2023-10-06T01:37:54.088 INFO:teuthology.orchestra.run.smithi069.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T01:37:54.088 INFO:teuthology.orchestra.run.smithi069.stdout: = sunit=0 swidth=0 blks 2023-10-06T01:37:54.088 INFO:teuthology.orchestra.run.smithi069.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T01:37:54.088 INFO:teuthology.orchestra.run.smithi069.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T01:37:54.088 INFO:teuthology.orchestra.run.smithi069.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T01:37:54.088 INFO:teuthology.orchestra.run.smithi069.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T01:37:54.525 INFO:teuthology.orchestra.run.smithi069.stdout:Discarding blocks...Done. 2023-10-06T01:37:54.527 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi069.front.sepia.ceph.com -o noatime 2023-10-06T01:37:54.527 DEBUG:teuthology.orchestra.run.smithi069:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-06T01:37:54.676 DEBUG:teuthology.orchestra.run.smithi069:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-06T01:37:54.705 DEBUG:teuthology.orchestra.run.smithi069:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:37:54.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:37:54.970+0000 7efe435be540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-06T01:37:54.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:37:54.971+0000 7efe435be540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-06T01:37:54.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:37:54.971+0000 7efe435be540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T01:37:54.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:37:54.971+0000 7efe435be540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T01:37:54.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:37:54.971+0000 7efe435be540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-06T01:37:54.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:37:54.971+0000 7efe435be540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-06T01:37:55.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:37:55.501+0000 7efe435be540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:37:56.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:37:56.265+0000 7efe435be540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:37:57.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:37:57.028+0000 7efe435be540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:37:57.821 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-06T01:37:57.846 DEBUG:teuthology.orchestra.run.smithi069:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:37:57.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:37:57.925+0000 7f9c97c19540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-06T01:37:57.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:37:57.925+0000 7f9c97c19540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-06T01:37:57.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:37:57.925+0000 7f9c97c19540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T01:37:57.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:37:57.925+0000 7f9c97c19540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T01:37:57.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:37:57.925+0000 7f9c97c19540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-06T01:37:57.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:37:57.926+0000 7f9c97c19540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-06T01:37:58.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:37:58.451+0000 7f9c97c19540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:37:59.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:37:59.214+0000 7f9c97c19540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:37:59.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:37:59.976+0000 7f9c97c19540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:38:00.773 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-06T01:38:00.841 DEBUG:teuthology.orchestra.run.smithi069:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:38:00.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:00.923+0000 7f689b292540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-06T01:38:00.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:00.924+0000 7f689b292540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-06T01:38:00.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:00.924+0000 7f689b292540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T01:38:00.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:00.924+0000 7f689b292540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T01:38:00.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:00.924+0000 7f689b292540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-06T01:38:00.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:00.924+0000 7f689b292540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-06T01:38:01.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:01.454+0000 7f689b292540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:38:02.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:02.217+0000 7f689b292540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:38:02.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:02.980+0000 7f689b292540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:38:03.777 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-06T01:38:03.846 DEBUG:teuthology.orchestra.run.smithi069:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:38:03.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:03.931+0000 7fcce9c80540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-06T01:38:03.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:03.931+0000 7fcce9c80540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-06T01:38:03.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:03.931+0000 7fcce9c80540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T01:38:03.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:03.931+0000 7fcce9c80540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T01:38:03.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:03.931+0000 7fcce9c80540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-06T01:38:03.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:03.932+0000 7fcce9c80540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-06T01:38:04.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:04.461+0000 7fcce9c80540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:38:05.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:05.225+0000 7fcce9c80540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:38:05.987 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:05.987+0000 7fcce9c80540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:38:06.782 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-06T01:38:06.810 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-06T01:38:06.840 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T01:38:06.840 INFO:tasks.ceph:role: osd.4 2023-10-06T01:38:06.840 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com 2023-10-06T01:38:06.841 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-06T01:38:06.916 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T01:38:06.916 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T01:38:06.916 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T01:38:06.916 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 2023-10-06T01:38:06.916 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T01:38:06.916 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-10-06T01:38:06.917 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T01:38:06.917 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T01:38:06.917 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T01:38:06.917 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T01:38:07.344 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-10-06T01:38:07.346 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-10-06T01:38:07.346 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-06T01:38:07.502 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-06T01:38:07.536 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-06T01:38:07.603 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T01:38:07.604 INFO:tasks.ceph:role: osd.5 2023-10-06T01:38:07.604 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com 2023-10-06T01:38:07.604 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-06T01:38:07.677 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T01:38:07.677 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T01:38:07.677 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T01:38:07.677 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 2023-10-06T01:38:07.677 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T01:38:07.677 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-10-06T01:38:07.677 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T01:38:07.677 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T01:38:07.677 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T01:38:07.678 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T01:38:08.098 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-10-06T01:38:08.100 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-10-06T01:38:08.100 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-06T01:38:08.206 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-06T01:38:08.235 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-06T01:38:08.301 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T01:38:08.301 INFO:tasks.ceph:role: osd.6 2023-10-06T01:38:08.301 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com 2023-10-06T01:38:08.301 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-06T01:38:08.374 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T01:38:08.374 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T01:38:08.374 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T01:38:08.374 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 2023-10-06T01:38:08.374 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T01:38:08.374 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-10-06T01:38:08.375 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T01:38:08.375 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T01:38:08.375 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T01:38:08.375 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T01:38:08.818 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-10-06T01:38:08.820 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-10-06T01:38:08.821 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-06T01:38:08.998 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-06T01:38:09.029 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-06T01:38:09.096 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-06T01:38:09.096 INFO:tasks.ceph:role: osd.7 2023-10-06T01:38:09.096 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com 2023-10-06T01:38:09.096 DEBUG:teuthology.orchestra.run.smithi088:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-06T01:38:09.170 INFO:teuthology.orchestra.run.smithi088.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-06T01:38:09.170 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-06T01:38:09.171 INFO:teuthology.orchestra.run.smithi088.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-06T01:38:09.171 INFO:teuthology.orchestra.run.smithi088.stdout: = reflink=1 2023-10-06T01:38:09.171 INFO:teuthology.orchestra.run.smithi088.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-06T01:38:09.171 INFO:teuthology.orchestra.run.smithi088.stdout: = sunit=0 swidth=0 blks 2023-10-06T01:38:09.171 INFO:teuthology.orchestra.run.smithi088.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-06T01:38:09.171 INFO:teuthology.orchestra.run.smithi088.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-06T01:38:09.171 INFO:teuthology.orchestra.run.smithi088.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-06T01:38:09.171 INFO:teuthology.orchestra.run.smithi088.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-06T01:38:09.612 INFO:teuthology.orchestra.run.smithi088.stdout:Discarding blocks...Done. 2023-10-06T01:38:09.614 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi088.front.sepia.ceph.com -o noatime 2023-10-06T01:38:09.614 DEBUG:teuthology.orchestra.run.smithi088:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-06T01:38:09.774 DEBUG:teuthology.orchestra.run.smithi088:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-06T01:38:09.809 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:38:10.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:10.086+0000 7f88279cc540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-06T01:38:10.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:10.086+0000 7f88279cc540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-06T01:38:10.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:10.086+0000 7f88279cc540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T01:38:10.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:10.086+0000 7f88279cc540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T01:38:10.088 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:10.086+0000 7f88279cc540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-06T01:38:10.089 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:10.087+0000 7f88279cc540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-06T01:38:10.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:10.611+0000 7f88279cc540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:38:11.378 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:11.376+0000 7f88279cc540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:38:12.140 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:12.138+0000 7f88279cc540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:38:12.938 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-06T01:38:12.965 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:38:13.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:13.046+0000 7ff3e21c6540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-06T01:38:13.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:13.046+0000 7ff3e21c6540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-06T01:38:13.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:13.046+0000 7ff3e21c6540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T01:38:13.048 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:13.046+0000 7ff3e21c6540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T01:38:13.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:13.046+0000 7ff3e21c6540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-06T01:38:13.049 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:13.047+0000 7ff3e21c6540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-06T01:38:13.572 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:13.571+0000 7ff3e21c6540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:38:14.332 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:14.332+0000 7ff3e21c6540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:38:15.098 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:15.098+0000 7ff3e21c6540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:38:15.894 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-06T01:38:15.960 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:38:16.041 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:16.040+0000 7f512bbcc540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-06T01:38:16.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:16.040+0000 7f512bbcc540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-06T01:38:16.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:16.040+0000 7f512bbcc540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T01:38:16.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:16.040+0000 7f512bbcc540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T01:38:16.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:16.040+0000 7f512bbcc540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-06T01:38:16.042 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:16.041+0000 7f512bbcc540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-06T01:38:16.575 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:16.574+0000 7f512bbcc540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:38:17.338 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:17.337+0000 7f512bbcc540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:38:18.100 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:18.100+0000 7f512bbcc540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:38:18.587 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:38:18.590 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:38:18.894 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-06T01:38:18.920 DEBUG:teuthology.orchestra.run.smithi088:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:38:19.002 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:19.001+0000 7fbd779d2540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-06T01:38:19.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:19.002+0000 7fbd779d2540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-06T01:38:19.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:19.002+0000 7fbd779d2540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T01:38:19.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:19.002+0000 7fbd779d2540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T01:38:19.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:19.002+0000 7fbd779d2540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-06T01:38:19.003 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:19.002+0000 7fbd779d2540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-06T01:38:19.525 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:19.524+0000 7fbd779d2540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:38:20.288 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:20.287+0000 7fbd779d2540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:38:21.051 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:21.050+0000 7fbd779d2540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-06T01:38:21.849 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-06T01:38:21.914 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-06T01:38:21.915 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-10-06T01:38:21.915 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-06T01:38:21.941 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-10-06T01:38:21.941 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-06T01:38:22.006 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-10-06T01:38:22.007 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-06T01:38:22.072 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-10-06T01:38:22.072 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-06T01:38:22.136 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-10-06T01:38:22.137 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-06T01:38:22.201 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-10-06T01:38:22.201 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-06T01:38:22.265 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-10-06T01:38:22.265 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-06T01:38:22.329 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-06T01:38:22.329 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-06T01:38:22.355 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-06T01:38:22.355 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-06T01:38:22.421 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-06T01:38:22.421 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-06T01:38:22.485 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-06T01:38:22.485 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-06T01:38:22.549 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-06T01:38:22.550 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-06T01:38:22.613 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-06T01:38:22.614 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-06T01:38:22.677 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-06T01:38:22.677 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-06T01:38:22.741 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-10-06T01:38:22.741 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-06T01:38:22.756 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-10-06T01:38:22.756 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-06T01:38:22.810 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-06T01:38:22.811 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-06T01:38:22.825 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-06T01:38:22.825 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-06T01:38:22.880 INFO:tasks.ceph:Adding keys to all mons... 2023-10-06T01:38:22.880 DEBUG:teuthology.orchestra.run.smithi069:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T01:38:22.882 DEBUG:teuthology.orchestra.run.smithi088:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-06T01:38:22.923 INFO:teuthology.orchestra.run.smithi069.stdout:[mgr.y] 2023-10-06T01:38:22.924 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQDvZB9lnLdnARAABp2Qojj2sIXz8haVNkf8Nw== 2023-10-06T01:38:22.924 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.a] 2023-10-06T01:38:22.924 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQDvZB9lDLBHCBAA9LtyIH7woDBhEceD0hDkiw== 2023-10-06T01:38:22.924 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.c] 2023-10-06T01:38:22.924 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQDvZB9lkh0jDxAAH6lMaQuBexeD5eDZIUYPpA== 2023-10-06T01:38:22.924 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.0] 2023-10-06T01:38:22.924 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQDyZB9ltmXzORAAx/wCbigTzSc5osl/ABC4jA== 2023-10-06T01:38:22.924 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.1] 2023-10-06T01:38:22.924 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQD1ZB9lkKZCNxAA7sQjwntcRwmMTPMNVYOMEw== 2023-10-06T01:38:22.924 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.2] 2023-10-06T01:38:22.925 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQD4ZB9lavwmNxAA35fbJbgShm+zes1JZ38/kg== 2023-10-06T01:38:22.925 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.3] 2023-10-06T01:38:22.925 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQD7ZB9lZ6eONxAAQ17q0pJXN4YlzHTl47iaiw== 2023-10-06T01:38:22.925 INFO:teuthology.orchestra.run.smithi069.stdout:[mgr.x] 2023-10-06T01:38:22.925 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQDvZB9lsTtPBRAASyhxUCZeGPQ+Kd4nV3TDSw== 2023-10-06T01:38:22.925 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.b] 2023-10-06T01:38:22.925 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQDvZB9lximTExAAwY6J7LEDzucnYmuiEjOS+g== 2023-10-06T01:38:22.925 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.d] 2023-10-06T01:38:22.925 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQDvZB9lX7RnGhAAWglHygzv/JYLnoZlkdyucQ== 2023-10-06T01:38:22.925 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.4] 2023-10-06T01:38:22.925 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQACZR9ldk4/BRAAvDlRT/Kx90icSA+ifSG1Xw== 2023-10-06T01:38:22.925 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.5] 2023-10-06T01:38:22.926 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAFZR9lOjPTAhAAaaLbdYCPlSOezx8HmIY9Xg== 2023-10-06T01:38:22.926 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.6] 2023-10-06T01:38:22.926 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQAIZR9lgsB4AhAAVT0MZ1Yh0LSsfMEUIrpH+Q== 2023-10-06T01:38:22.926 INFO:teuthology.orchestra.run.smithi069.stdout:[osd.7] 2023-10-06T01:38:22.926 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQALZR9lY+cnABAAS9Z7IGrXNwxnPW49vD3iCg== 2023-10-06T01:38:22.926 INFO:teuthology.orchestra.run.smithi069.stdout:[client.0] 2023-10-06T01:38:22.926 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQDvZB9lccI4HhAAylGGkLosRiajQ2YJiLp7iQ== 2023-10-06T01:38:22.926 INFO:teuthology.orchestra.run.smithi069.stdout:[client.2] 2023-10-06T01:38:22.926 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQDvZB9lvhaWIxAAMcWf1R8HSodkk1qDMe8lhg== 2023-10-06T01:38:22.926 INFO:teuthology.orchestra.run.smithi069.stdout:[client.1] 2023-10-06T01:38:22.926 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQDvZB9lBm2MJhAAltQ9hAlMOOIoVnXIqwn/kA== 2023-10-06T01:38:22.927 INFO:teuthology.orchestra.run.smithi069.stdout:[client.3] 2023-10-06T01:38:22.927 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQDvZB9lKLThKxAA7PxLW5OznMc1jQ/Ec2kW1Q== 2023-10-06T01:38:22.943 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.y] 2023-10-06T01:38:22.943 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDvZB9lnLdnARAABp2Qojj2sIXz8haVNkf8Nw== 2023-10-06T01:38:22.943 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.a] 2023-10-06T01:38:22.943 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDvZB9lDLBHCBAA9LtyIH7woDBhEceD0hDkiw== 2023-10-06T01:38:22.943 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.c] 2023-10-06T01:38:22.943 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDvZB9lkh0jDxAAH6lMaQuBexeD5eDZIUYPpA== 2023-10-06T01:38:22.944 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.0] 2023-10-06T01:38:22.944 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDyZB9ltmXzORAAx/wCbigTzSc5osl/ABC4jA== 2023-10-06T01:38:22.944 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.1] 2023-10-06T01:38:22.944 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQD1ZB9lkKZCNxAA7sQjwntcRwmMTPMNVYOMEw== 2023-10-06T01:38:22.944 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.2] 2023-10-06T01:38:22.944 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQD4ZB9lavwmNxAA35fbJbgShm+zes1JZ38/kg== 2023-10-06T01:38:22.944 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.3] 2023-10-06T01:38:22.944 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQD7ZB9lZ6eONxAAQ17q0pJXN4YlzHTl47iaiw== 2023-10-06T01:38:22.944 INFO:teuthology.orchestra.run.smithi088.stdout:[mgr.x] 2023-10-06T01:38:22.944 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDvZB9lsTtPBRAASyhxUCZeGPQ+Kd4nV3TDSw== 2023-10-06T01:38:22.945 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.b] 2023-10-06T01:38:22.945 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDvZB9lximTExAAwY6J7LEDzucnYmuiEjOS+g== 2023-10-06T01:38:22.945 INFO:teuthology.orchestra.run.smithi088.stdout:[mds.d] 2023-10-06T01:38:22.945 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDvZB9lX7RnGhAAWglHygzv/JYLnoZlkdyucQ== 2023-10-06T01:38:22.945 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.4] 2023-10-06T01:38:22.945 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQACZR9ldk4/BRAAvDlRT/Kx90icSA+ifSG1Xw== 2023-10-06T01:38:22.945 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.5] 2023-10-06T01:38:22.945 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQAFZR9lOjPTAhAAaaLbdYCPlSOezx8HmIY9Xg== 2023-10-06T01:38:22.945 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.6] 2023-10-06T01:38:22.945 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQAIZR9lgsB4AhAAVT0MZ1Yh0LSsfMEUIrpH+Q== 2023-10-06T01:38:22.945 INFO:teuthology.orchestra.run.smithi088.stdout:[osd.7] 2023-10-06T01:38:22.946 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQALZR9lY+cnABAAS9Z7IGrXNwxnPW49vD3iCg== 2023-10-06T01:38:22.946 INFO:teuthology.orchestra.run.smithi088.stdout:[client.0] 2023-10-06T01:38:22.946 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDvZB9lccI4HhAAylGGkLosRiajQ2YJiLp7iQ== 2023-10-06T01:38:22.946 INFO:teuthology.orchestra.run.smithi088.stdout:[client.2] 2023-10-06T01:38:22.946 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDvZB9lvhaWIxAAMcWf1R8HSodkk1qDMe8lhg== 2023-10-06T01:38:22.946 INFO:teuthology.orchestra.run.smithi088.stdout:[client.1] 2023-10-06T01:38:22.946 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDvZB9lBm2MJhAAltQ9hAlMOOIoVnXIqwn/kA== 2023-10-06T01:38:22.946 INFO:teuthology.orchestra.run.smithi088.stdout:[client.3] 2023-10-06T01:38:22.946 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQDvZB9lKLThKxAA7PxLW5OznMc1jQ/Ec2kW1Q== 2023-10-06T01:38:22.948 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T01:38:22.970 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T01:38:23.034 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T01:38:23.036 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T01:38:23.086 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T01:38:23.088 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T01:38:23.138 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:38:23.140 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:38:23.186 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:38:23.188 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:38:23.235 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:38:23.238 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:38:23.284 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:38:23.286 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:38:23.333 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T01:38:23.336 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-06T01:38:23.383 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T01:38:23.385 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T01:38:23.436 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T01:38:23.438 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-06T01:38:23.488 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:38:23.490 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:38:23.536 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:38:23.539 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:38:23.586 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:38:23.588 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:38:23.635 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:38:23.637 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-06T01:38:23.684 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T01:38:23.686 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T01:38:23.736 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T01:38:23.738 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T01:38:23.788 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T01:38:23.790 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T01:38:23.840 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T01:38:23.842 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-06T01:38:23.892 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-06T01:38:23.892 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-06T01:38:23.917 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T01:38:24.008 DEBUG:teuthology.orchestra.run.smithi069:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-06T01:38:24.032 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-06T01:38:24.057 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T01:38:24.148 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-06T01:38:24.172 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-06T01:38:24.236 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-06T01:38:24.328 DEBUG:teuthology.orchestra.run.smithi088:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-06T01:38:24.352 DEBUG:teuthology.orchestra.run.smithi069:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:38:24.354 DEBUG:teuthology.orchestra.run.smithi088:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-06T01:38:24.407 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-06T01:38:24.407 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-06T01:38:24.407 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-06T01:38:24.409 INFO:tasks.ceph.mon.a:Started 2023-10-06T01:38:24.409 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-06T01:38:24.410 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-06T01:38:24.449 INFO:tasks.ceph.mon.b:Started 2023-10-06T01:38:24.450 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-06T01:38:24.450 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-06T01:38:24.452 INFO:tasks.ceph.mon.c:Started 2023-10-06T01:38:24.452 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-06T01:38:24.452 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-06T01:38:24.452 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-06T01:38:24.454 INFO:tasks.ceph.mgr.y:Started 2023-10-06T01:38:24.455 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-06T01:38:24.455 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-06T01:38:24.457 INFO:tasks.ceph.mgr.x:Started 2023-10-06T01:38:24.457 INFO:tasks.ceph:Setting crush tunables to default 2023-10-06T01:38:24.457 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd crush tunables default 2023-10-06T01:38:24.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.571+0000 7f05926a9700 1 Processor -- start 2023-10-06T01:38:24.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.571+0000 7f05926a9700 1 -- start start 2023-10-06T01:38:24.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.572+0000 7f05926a9700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f058c1598b0 0x7f058c0b2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:24.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.572+0000 7f05926a9700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f058c0cd7c0 0x7f058c06d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:24.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.572+0000 7f05926a9700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f058c15d3e0 con 0x7f058c0b2aa0 2023-10-06T01:38:24.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.572+0000 7f05926a9700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058c15df60 con 0x7f058c0cd7c0 2023-10-06T01:38:24.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.572+0000 7f05926a9700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058c15d630 con 0x7f058c1598b0 2023-10-06T01:38:24.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.572+0000 7f058b7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f058c0cd7c0 0x7f058c06d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:24.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.572+0000 7f058b7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f058c0cd7c0 0x7f058c06d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32800/0 (socket says 172.21.15.69:32800) 2023-10-06T01:38:24.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.572+0000 7f058b7fe700 1 -- 172.21.15.69:0/466639187 learned_addr learned my addr 172.21.15.69:0/466639187 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:24.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.572+0000 7f058bfff700 1 --2- 172.21.15.69:0/466639187 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f058c1598b0 0x7f058c0b2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:24.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.572+0000 7f058b7fe700 1 -- 172.21.15.69:0/466639187 >> v2:172.21.15.69:3300/0 conn(0x7f058c0cd7c0 msgr2=0x7f058c06d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-06T01:38:24.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.572+0000 7f058b7fe700 1 -- 172.21.15.69:0/466639187 >> v2:172.21.15.69:3300/0 conn(0x7f058c0cd7c0 msgr2=0x7f058c06d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T01:38:24.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.572+0000 7f058b7fe700 1 --2- 172.21.15.69:0/466639187 >> v2:172.21.15.69:3300/0 conn(0x7f058c0cd7c0 0x7f058c06d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T01:38:24.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.572+0000 7f058b7fe700 1 --2- 172.21.15.69:0/466639187 >> v2:172.21.15.69:3300/0 conn(0x7f058c0cd7c0 0x7f058c06d940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T01:38:24.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.572+0000 7f058bfff700 1 -- 172.21.15.69:0/466639187 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f058c1598b0 msgr2=0x7f058c0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-10-06T01:38:24.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.572+0000 7f058bfff700 1 -- 172.21.15.69:0/466639187 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f058c1598b0 msgr2=0x7f058c0b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-06T01:38:24.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.572+0000 7f058bfff700 1 --2- 172.21.15.69:0/466639187 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f058c1598b0 0x7f058c0b2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-06T01:38:24.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.572+0000 7f058bfff700 1 --2- 172.21.15.69:0/466639187 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f058c1598b0 0x7f058c0b2560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-06T01:38:24.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.758+0000 7f058affd700 1 -- 172.21.15.69:0/466639187 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1839390233 0 0) 0x7f058c15d3e0 con 0x7f058c0b2aa0 2023-10-06T01:38:24.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.758+0000 7f058affd700 1 -- 172.21.15.69:0/466639187 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0574003570 con 0x7f058c0b2aa0 2023-10-06T01:38:24.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.758+0000 7f058affd700 1 -- 172.21.15.69:0/466639187 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3481943715 0 0) 0x7f0574003570 con 0x7f058c0b2aa0 2023-10-06T01:38:24.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.758+0000 7f058affd700 1 -- 172.21.15.69:0/466639187 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f058c1598b0 msgr2=0x7f058c0b2560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T01:38:24.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.758+0000 7f058affd700 1 --2- 172.21.15.69:0/466639187 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f058c1598b0 0x7f058c0b2560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:24.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.758+0000 7f058affd700 1 -- 172.21.15.69:0/466639187 >> v2:172.21.15.69:3300/0 conn(0x7f058c0cd7c0 msgr2=0x7f058c06d940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T01:38:24.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.758+0000 7f058affd700 1 --2- 172.21.15.69:0/466639187 >> v2:172.21.15.69:3300/0 conn(0x7f058c0cd7c0 0x7f058c06d940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:24.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.758+0000 7f058affd700 1 -- 172.21.15.69:0/466639187 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058c15d910 con 0x7f058c0b2aa0 2023-10-06T01:38:24.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.758+0000 7f058affd700 1 -- 172.21.15.69:0/466639187 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f05840017f0 con 0x7f058c0b2aa0 2023-10-06T01:38:24.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.758+0000 7f058affd700 1 -- 172.21.15.69:0/466639187 >> v1:172.21.15.88:6789/0 conn(0x7f058c0b2aa0 legacy=0x7f058c0b0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:24.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.758+0000 7f058affd700 1 --2- 172.21.15.69:0/466639187 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f058c1598b0 0x7f0574003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:24.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.758+0000 7f058affd700 1 --2- 172.21.15.69:0/466639187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0574004090 0x7f0574004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:24.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.758+0000 7f058affd700 1 --2- 172.21.15.69:0/466639187 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0574004d50 0x7f05740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:24.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.758+0000 7f058affd700 1 -- 172.21.15.69:0/466639187 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c15df60 con 0x7f0574004d50 2023-10-06T01:38:24.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.758+0000 7f058affd700 1 -- 172.21.15.69:0/466639187 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c15d630 con 0x7f0574004090 2023-10-06T01:38:24.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.758+0000 7f058affd700 1 -- 172.21.15.69:0/466639187 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057400bbf0 con 0x7f058c1598b0 2023-10-06T01:38:24.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.759+0000 7f0590c46700 1 --2- 172.21.15.69:0/466639187 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0574004d50 0x7f05740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:24.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.759+0000 7f058b7fe700 1 --2- 172.21.15.69:0/466639187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0574004090 0x7f0574004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:24.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.759+0000 7f058bfff700 1 --2- 172.21.15.69:0/466639187 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f058c1598b0 0x7f0574003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:24.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.759+0000 7f0590c46700 1 -- 172.21.15.69:0/466639187 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f058c1598b0 msgr2=0x7f0574003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:24.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.759+0000 7f0590c46700 1 --2- 172.21.15.69:0/466639187 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f058c1598b0 0x7f0574003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:24.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.759+0000 7f0590c46700 1 -- 172.21.15.69:0/466639187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0574004090 msgr2=0x7f0574004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:24.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.759+0000 7f0590c46700 1 --2- 172.21.15.69:0/466639187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0574004090 0x7f0574004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:24.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.759+0000 7f0590c46700 1 -- 172.21.15.69:0/466639187 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0574003570 con 0x7f0574004d50 2023-10-06T01:38:24.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.759+0000 7f058b7fe700 1 --2- 172.21.15.69:0/466639187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0574004090 0x7f0574004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:38:24.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.759+0000 7f0590c46700 1 --2- 172.21.15.69:0/466639187 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0574004d50 0x7f05740051c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f058400c5f0 tx=0x7f0584002e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=230c8b940d0dbc08 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:24.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.759+0000 7f058affd700 1 -- 172.21.15.69:0/466639187 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0584016070 con 0x7f0574004d50 2023-10-06T01:38:24.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.759+0000 7f058affd700 1 -- 172.21.15.69:0/466639187 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0584006ba0 con 0x7f0574004d50 2023-10-06T01:38:24.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.759+0000 7f058affd700 1 -- 172.21.15.69:0/466639187 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0584007020 con 0x7f0574004d50 2023-10-06T01:38:24.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.760+0000 7f05926a9700 1 -- 172.21.15.69:0/466639187 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0574004d50 msgr2=0x7f05740051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:24.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.760+0000 7f05926a9700 1 --2- 172.21.15.69:0/466639187 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0574004d50 0x7f05740051c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f058400c5f0 tx=0x7f0584002e60 comp rx=0 tx=0).stop 2023-10-06T01:38:24.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.760+0000 7f0590c46700 1 -- 172.21.15.69:0/466639187 reap_dead start 2023-10-06T01:38:24.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.760+0000 7f05926a9700 1 -- 172.21.15.69:0/466639187 shutdown_connections 2023-10-06T01:38:24.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.760+0000 7f05926a9700 1 -- 172.21.15.69:0/466639187 >> 172.21.15.69:0/466639187 conn(0x7f058c0703a0 msgr2=0x7f058c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:24.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.760+0000 7f05926a9700 1 -- 172.21.15.69:0/466639187 shutdown_connections 2023-10-06T01:38:24.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.760+0000 7f05926a9700 1 -- 172.21.15.69:0/466639187 wait complete. 2023-10-06T01:38:24.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.762+0000 7f05926a9700 1 Processor -- start 2023-10-06T01:38:24.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.762+0000 7f05926a9700 1 -- start start 2023-10-06T01:38:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.763+0000 7f05926a9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0574004d50 0x7f058c16d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.763+0000 7f05926a9700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f058c0c4940 0x7f058c0cb5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.763+0000 7f05926a9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f058c14a670 0x7f058c14ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.763+0000 7f05926a9700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c16de50 con 0x7f058c14a670 2023-10-06T01:38:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.763+0000 7f05926a9700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c14b050 con 0x7f0574004d50 2023-10-06T01:38:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.763+0000 7f05926a9700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058c15ac70 con 0x7f058c0c4940 2023-10-06T01:38:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.763+0000 7f058bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0574004d50 0x7f058c16d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.763+0000 7f058b7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f058c0c4940 0x7f058c0cb5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.763+0000 7f058bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0574004d50 0x7f058c16d910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.69:43418/0 (socket says 172.21.15.69:43418) 2023-10-06T01:38:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.763+0000 7f058bfff700 1 -- 172.21.15.69:0/948147246 learned_addr learned my addr 172.21.15.69:0/948147246 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.763+0000 7f0590c46700 1 --2- 172.21.15.69:0/948147246 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f058c14a670 0x7f058c14ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.763+0000 7f058bfff700 1 -- 172.21.15.69:0/948147246 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f058c0c4940 msgr2=0x7f058c0cb5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.763+0000 7f058bfff700 1 --2- 172.21.15.69:0/948147246 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f058c0c4940 0x7f058c0cb5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.763+0000 7f058bfff700 1 -- 172.21.15.69:0/948147246 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f058c14a670 msgr2=0x7f058c14ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.763+0000 7f058bfff700 1 --2- 172.21.15.69:0/948147246 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f058c14a670 0x7f058c14ab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.763+0000 7f058bfff700 1 -- 172.21.15.69:0/948147246 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058c15a060 con 0x7f0574004d50 2023-10-06T01:38:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.763+0000 7f058bfff700 1 --2- 172.21.15.69:0/948147246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0574004d50 0x7f058c16d910 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f057c010a50 tx=0x7f057c008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.763+0000 7f0573fff700 1 -- 172.21.15.69:0/948147246 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c010e90 con 0x7f0574004d50 2023-10-06T01:38:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.764+0000 7f0573fff700 1 -- 172.21.15.69:0/948147246 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057c00e8d0 con 0x7f0574004d50 2023-10-06T01:38:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.764+0000 7f05926a9700 1 -- 172.21.15.69:0/948147246 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f058c15a340 con 0x7f0574004d50 2023-10-06T01:38:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.764+0000 7f0573fff700 1 -- 172.21.15.69:0/948147246 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c00ecb0 con 0x7f0574004d50 2023-10-06T01:38:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.764+0000 7f05926a9700 1 -- 172.21.15.69:0/948147246 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f058c15a900 con 0x7f0574004d50 2023-10-06T01:38:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.764+0000 7f0573fff700 1 -- 172.21.15.69:0/948147246 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f057c016690 con 0x7f0574004d50 2023-10-06T01:38:24.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.764+0000 7f0573fff700 1 -- 172.21.15.69:0/948147246 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f057c014780 con 0x7f0574004d50 2023-10-06T01:38:24.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.764+0000 7f05926a9700 1 -- 172.21.15.69:0/948147246 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f058c04c3c0 con 0x7f0574004d50 2023-10-06T01:38:24.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.767+0000 7f0573fff700 1 -- 172.21.15.69:0/948147246 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f057c01a020 con 0x7f0574004d50 2023-10-06T01:38:24.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.842+0000 7f05926a9700 1 -- 172.21.15.69:0/948147246 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f058c15dbf0 con 0x7f0574004d50 2023-10-06T01:38:24.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.849+0000 7f0573fff700 1 -- 172.21.15.69:0/948147246 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f057c02c090 con 0x7f0574004d50 2023-10-06T01:38:24.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.850+0000 7f05926a9700 1 -- 172.21.15.69:0/948147246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0574004d50 msgr2=0x7f058c16d910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:24.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.850+0000 7f05926a9700 1 --2- 172.21.15.69:0/948147246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0574004d50 0x7f058c16d910 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f057c010a50 tx=0x7f057c008040 comp rx=0 tx=0).stop 2023-10-06T01:38:24.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.850+0000 7f05926a9700 1 -- 172.21.15.69:0/948147246 shutdown_connections 2023-10-06T01:38:24.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.850+0000 7f05926a9700 1 --2- 172.21.15.69:0/948147246 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f058c14a670 0x7f058c14ab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:24.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.850+0000 7f05926a9700 1 --2- 172.21.15.69:0/948147246 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0574004d50 0x7f058c16d910 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:24.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.850+0000 7f05926a9700 1 --2- 172.21.15.69:0/948147246 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f058c0c4940 0x7f058c0cb5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:24.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.850+0000 7f05926a9700 1 -- 172.21.15.69:0/948147246 >> 172.21.15.69:0/948147246 conn(0x7f058c0703a0 msgr2=0x7f058c0b0dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:24.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.850+0000 7f05926a9700 1 -- 172.21.15.69:0/948147246 shutdown_connections 2023-10-06T01:38:24.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:24.850+0000 7f05926a9700 1 -- 172.21.15.69:0/948147246 wait complete. 2023-10-06T01:38:24.853 INFO:teuthology.orchestra.run.smithi069.stderr:adjusted tunables profile to default 2023-10-06T01:38:24.863 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-06T01:38:24.864 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-10-06T01:38:24.864 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-06T01:38:24.888 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-10-06T01:38:24.888 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-06T01:38:24.953 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-10-06T01:38:24.954 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-06T01:38:25.019 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2023-10-06T01:38:25.019 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-06T01:38:25.084 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-06T01:38:25.084 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-06T01:38:25.107 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-06T01:38:25.108 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-06T01:38:25.172 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-06T01:38:25.172 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-06T01:38:25.237 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2023-10-06T01:38:25.238 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-06T01:38:25.301 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd new 9bf77b60-3401-4ba3-a7ec-830047c16cd4 0 2023-10-06T01:38:25.457 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.457+0000 7f1acd06e700 1 Processor -- start 2023-10-06T01:38:25.458 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.457+0000 7f1acd06e700 1 -- start start 2023-10-06T01:38:25.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.458+0000 7f1acd06e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1ac81508b0 0x7f1ac80ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:25.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.458+0000 7f1acd06e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1ac80675a0 0x7f1ac80679e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:25.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.458+0000 7f1acd06e700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ac80cddf0 con 0x7f1ac8150c80 2023-10-06T01:38:25.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.458+0000 7f1acd06e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ac80b0360 con 0x7f1ac81508b0 2023-10-06T01:38:25.460 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.458+0000 7f1acd06e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac8067f20 con 0x7f1ac80675a0 2023-10-06T01:38:25.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.458+0000 7f1ac6d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1ac81508b0 0x7f1ac80ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:25.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.458+0000 7f1ac759e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1ac80675a0 0x7f1ac80679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:25.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.458+0000 7f1ac6d9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1ac81508b0 0x7f1ac80ccec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36098/0 (socket says 172.21.15.88:36098) 2023-10-06T01:38:25.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.458+0000 7f1ac759e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1ac80675a0 0x7f1ac80679e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:36882/0 (socket says 172.21.15.88:36882) 2023-10-06T01:38:25.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.458+0000 7f1ac6d9d700 1 -- 172.21.15.88:0/1552140348 learned_addr learned my addr 172.21.15.88:0/1552140348 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-06T01:38:25.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.458+0000 7f1ac759e700 1 -- 172.21.15.88:0/1552140348 >> v2:172.21.15.88:3300/0 conn(0x7f1ac81508b0 msgr2=0x7f1ac80ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:25.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.458+0000 7f1ac759e700 1 --2- 172.21.15.88:0/1552140348 >> v2:172.21.15.88:3300/0 conn(0x7f1ac81508b0 0x7f1ac80ccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:25.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.458+0000 7f1ac759e700 1 -- 172.21.15.88:0/1552140348 >> v1:172.21.15.69:6789/0 conn(0x7f1ac8150c80 legacy=0x7f1ac81573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:25.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.458+0000 7f1ac759e700 1 -- 172.21.15.88:0/1552140348 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ac80cd550 con 0x7f1ac80675a0 2023-10-06T01:38:25.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.458+0000 7f1ac6d9d700 1 --2- 172.21.15.88:0/1552140348 >> v2:172.21.15.88:3300/0 conn(0x7f1ac81508b0 0x7f1ac80ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:38:25.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.458+0000 7f1ac759e700 1 --2- 172.21.15.88:0/1552140348 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1ac80675a0 0x7f1ac80679e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0009e60 tx=0x7f1ac0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98490863e46a00a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:25.461 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.458+0000 7f1ac5d9b700 1 -- 172.21.15.88:0/1552140348 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac000e070 con 0x7f1ac80675a0 2023-10-06T01:38:25.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.458+0000 7f1ac5d9b700 1 -- 172.21.15.88:0/1552140348 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac000bb60 con 0x7f1ac80675a0 2023-10-06T01:38:25.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.458+0000 7f1ac5d9b700 1 -- 172.21.15.88:0/1552140348 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0012430 con 0x7f1ac80675a0 2023-10-06T01:38:25.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.459+0000 7f1acd06e700 1 -- 172.21.15.88:0/1552140348 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1ac80675a0 msgr2=0x7f1ac80679e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:25.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.459+0000 7f1acd06e700 1 --2- 172.21.15.88:0/1552140348 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1ac80675a0 0x7f1ac80679e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0009e60 tx=0x7f1ac0009780 comp rx=0 tx=0).stop 2023-10-06T01:38:25.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.459+0000 7f1acd06e700 1 -- 172.21.15.88:0/1552140348 shutdown_connections 2023-10-06T01:38:25.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.459+0000 7f1acd06e700 1 --2- 172.21.15.88:0/1552140348 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1ac80675a0 0x7f1ac80679e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:25.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.459+0000 7f1acd06e700 1 --2- 172.21.15.88:0/1552140348 >> v2:172.21.15.88:3300/0 conn(0x7f1ac81508b0 0x7f1ac80ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:25.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.459+0000 7f1acd06e700 1 -- 172.21.15.88:0/1552140348 >> 172.21.15.88:0/1552140348 conn(0x7f1ac806d7b0 msgr2=0x7f1ac806dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:25.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.459+0000 7f1acd06e700 1 -- 172.21.15.88:0/1552140348 shutdown_connections 2023-10-06T01:38:25.462 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.459+0000 7f1acd06e700 1 -- 172.21.15.88:0/1552140348 wait complete. 2023-10-06T01:38:25.464 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.460+0000 7f1acd06e700 1 Processor -- start 2023-10-06T01:38:25.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.461+0000 7f1acd06e700 1 -- start start 2023-10-06T01:38:25.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.461+0000 7f1acd06e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ac80675a0 0x7f1ac8151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:25.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.461+0000 7f1acd06e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ac81508b0 0x7f1ac8153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:25.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.461+0000 7f1acd06e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1ac8150c80 0x7f1ac814ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:25.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.461+0000 7f1acd06e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac81537b0 con 0x7f1ac81508b0 2023-10-06T01:38:25.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.461+0000 7f1acd06e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac81654a0 con 0x7f1ac80675a0 2023-10-06T01:38:25.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.461+0000 7f1acd06e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ac8153a30 con 0x7f1ac8150c80 2023-10-06T01:38:25.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.461+0000 7f1ac6d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ac80675a0 0x7f1ac8151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:25.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.461+0000 7f1ac759e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1ac8150c80 0x7f1ac814ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:25.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.461+0000 7f1ac6d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ac80675a0 0x7f1ac8151b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36100/0 (socket says 172.21.15.88:36100) 2023-10-06T01:38:25.465 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.461+0000 7f1ac6d9d700 1 -- 172.21.15.88:0/695901339 learned_addr learned my addr 172.21.15.88:0/695901339 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-06T01:38:25.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.461+0000 7f1ac659c700 1 --2- 172.21.15.88:0/695901339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ac81508b0 0x7f1ac8153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:25.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.462+0000 7f1ac759e700 1 -- 172.21.15.88:0/695901339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ac80675a0 msgr2=0x7f1ac8151b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:25.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.462+0000 7f1ac759e700 1 --2- 172.21.15.88:0/695901339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ac80675a0 0x7f1ac8151b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:25.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.462+0000 7f1ac759e700 1 -- 172.21.15.88:0/695901339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ac81508b0 msgr2=0x7f1ac8153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:25.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.462+0000 7f1ac759e700 1 --2- 172.21.15.88:0/695901339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ac81508b0 0x7f1ac8153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:25.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.462+0000 7f1ac759e700 1 -- 172.21.15.88:0/695901339 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ab800b790 con 0x7f1ac8150c80 2023-10-06T01:38:25.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.462+0000 7f1ac6d9d700 1 --2- 172.21.15.88:0/695901339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ac80675a0 0x7f1ac8151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:38:25.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.462+0000 7f1ac759e700 1 --2- 172.21.15.88:0/695901339 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1ac8150c80 0x7f1ac814ef90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0016000 tx=0x7f1ac0019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:25.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.462+0000 7f1aaeffd700 1 -- 172.21.15.88:0/695901339 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac0027470 con 0x7f1ac8150c80 2023-10-06T01:38:25.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.462+0000 7f1aaeffd700 1 -- 172.21.15.88:0/695901339 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ac00275f0 con 0x7f1ac8150c80 2023-10-06T01:38:25.466 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.462+0000 7f1acd06e700 1 -- 172.21.15.88:0/695901339 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ac0009a20 con 0x7f1ac8150c80 2023-10-06T01:38:25.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.462+0000 7f1aaeffd700 1 -- 172.21.15.88:0/695901339 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ac00279b0 con 0x7f1ac8150c80 2023-10-06T01:38:25.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.462+0000 7f1acd06e700 1 -- 172.21.15.88:0/695901339 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ac8153ff0 con 0x7f1ac8150c80 2023-10-06T01:38:25.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.462+0000 7f1aaeffd700 1 -- 172.21.15.88:0/695901339 <== mon.2 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1ac0024070 con 0x7f1ac8150c80 2023-10-06T01:38:25.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.462+0000 7f1aaeffd700 1 -- 172.21.15.88:0/695901339 <== mon.2 v2:172.21.15.88:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f1ac001d910 con 0x7f1ac8150c80 2023-10-06T01:38:25.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.463+0000 7f1acd06e700 1 -- 172.21.15.88:0/695901339 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ac8165660 con 0x7f1ac8150c80 2023-10-06T01:38:25.467 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.465+0000 7f1aaeffd700 1 -- 172.21.15.88:0/695901339 <== mon.2 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f1ac00466d0 con 0x7f1ac8150c80 2023-10-06T01:38:25.549 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.548+0000 7f1acd06e700 1 -- 172.21.15.88:0/695901339 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9bf77b60-3401-4ba3-a7ec-830047c16cd4", "id": 0} v 0) v1 -- 0x7f1ac804c3c0 con 0x7f1ac8150c80 2023-10-06T01:38:25.554 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.554+0000 7f1aaeffd700 1 -- 172.21.15.88:0/695901339 <== mon.2 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9bf77b60-3401-4ba3-a7ec-830047c16cd4", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1ac0035030 con 0x7f1ac8150c80 2023-10-06T01:38:25.555 INFO:teuthology.orchestra.run.smithi088.stdout:0 2023-10-06T01:38:25.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.555+0000 7f1acd06e700 1 -- 172.21.15.88:0/695901339 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1ac8150c80 msgr2=0x7f1ac814ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:25.555 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.555+0000 7f1acd06e700 1 --2- 172.21.15.88:0/695901339 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1ac8150c80 0x7f1ac814ef90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1ac0016000 tx=0x7f1ac0019000 comp rx=0 tx=0).stop 2023-10-06T01:38:25.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.555+0000 7f1acd06e700 1 -- 172.21.15.88:0/695901339 shutdown_connections 2023-10-06T01:38:25.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.555+0000 7f1acd06e700 1 --2- 172.21.15.88:0/695901339 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1ac8150c80 0x7f1ac814ef90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:25.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.555+0000 7f1acd06e700 1 --2- 172.21.15.88:0/695901339 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ac80675a0 0x7f1ac8151b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:25.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.555+0000 7f1acd06e700 1 --2- 172.21.15.88:0/695901339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ac81508b0 0x7f1ac8153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:25.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.555+0000 7f1acd06e700 1 -- 172.21.15.88:0/695901339 >> 172.21.15.88:0/695901339 conn(0x7f1ac806d7b0 msgr2=0x7f1ac814f980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:25.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.555+0000 7f1acd06e700 1 -- 172.21.15.88:0/695901339 shutdown_connections 2023-10-06T01:38:25.556 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.555+0000 7f1acd06e700 1 -- 172.21.15.88:0/695901339 wait complete. 2023-10-06T01:38:25.566 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd new c6ccaba1-6768-4136-8097-abdb827a4bb9 1 2023-10-06T01:38:25.681 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.681+0000 7f3810879700 1 Processor -- start 2023-10-06T01:38:25.682 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.681+0000 7f3810879700 1 -- start start 2023-10-06T01:38:25.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.682+0000 7f3810879700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f380c06dc70 0x7f380c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:25.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.682+0000 7f3810879700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f380c06e0e0 0x7f380c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:25.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.682+0000 7f3810879700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f380c0ccfd0 con 0x7f380c159530 2023-10-06T01:38:25.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.682+0000 7f3810879700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f380c15a3d0 con 0x7f380c06dc70 2023-10-06T01:38:25.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.682+0000 7f3810879700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f380c15a6b0 con 0x7f380c06e0e0 2023-10-06T01:38:25.684 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.682+0000 7f380ad9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f380c06e0e0 0x7f380c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:25.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.682+0000 7f380ad9d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f380c06e0e0 0x7f380c0cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36110/0 (socket says 172.21.15.88:36110) 2023-10-06T01:38:25.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.682+0000 7f380ad9d700 1 -- 172.21.15.88:0/3153181123 learned_addr learned my addr 172.21.15.88:0/3153181123 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-06T01:38:25.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.682+0000 7f3809d9b700 1 --2- 172.21.15.88:0/3153181123 >> v2:172.21.15.69:3300/0 conn(0x7f380c06dc70 0x7f380c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:25.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.682+0000 7f380ad9d700 1 -- 172.21.15.88:0/3153181123 >> v2:172.21.15.69:3300/0 conn(0x7f380c06dc70 msgr2=0x7f380c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:25.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.682+0000 7f380ad9d700 1 --2- 172.21.15.88:0/3153181123 >> v2:172.21.15.69:3300/0 conn(0x7f380c06dc70 0x7f380c159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:25.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.682+0000 7f380ad9d700 1 -- 172.21.15.88:0/3153181123 >> v1:172.21.15.69:6789/0 conn(0x7f380c159530 legacy=0x7f380c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:25.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.682+0000 7f380ad9d700 1 -- 172.21.15.88:0/3153181123 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380c15a990 con 0x7f380c06e0e0 2023-10-06T01:38:25.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.682+0000 7f380ad9d700 1 --2- 172.21.15.88:0/3153181123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f380c06e0e0 0x7f380c0cb6f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f380c0cf2b0 tx=0x7f3804009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c0f20c57a24bae32 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:25.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.682+0000 7f380959a700 1 -- 172.21.15.88:0/3153181123 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380400e070 con 0x7f380c06e0e0 2023-10-06T01:38:25.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.683+0000 7f380959a700 1 -- 172.21.15.88:0/3153181123 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380400ba20 con 0x7f380c06e0e0 2023-10-06T01:38:25.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.683+0000 7f380959a700 1 -- 172.21.15.88:0/3153181123 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38040092e0 con 0x7f380c06e0e0 2023-10-06T01:38:25.685 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.683+0000 7f3810879700 1 -- 172.21.15.88:0/3153181123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f380c06e0e0 msgr2=0x7f380c0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:25.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.683+0000 7f3810879700 1 --2- 172.21.15.88:0/3153181123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f380c06e0e0 0x7f380c0cb6f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f380c0cf2b0 tx=0x7f3804009840 comp rx=0 tx=0).stop 2023-10-06T01:38:25.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.683+0000 7f3810879700 1 -- 172.21.15.88:0/3153181123 shutdown_connections 2023-10-06T01:38:25.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.683+0000 7f3810879700 1 --2- 172.21.15.88:0/3153181123 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f380c06e0e0 0x7f380c0cb6f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:25.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.683+0000 7f3810879700 1 --2- 172.21.15.88:0/3153181123 >> v2:172.21.15.69:3300/0 conn(0x7f380c06dc70 0x7f380c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:25.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.683+0000 7f3810879700 1 -- 172.21.15.88:0/3153181123 >> 172.21.15.88:0/3153181123 conn(0x7f380c0703a0 msgr2=0x7f380c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:25.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.683+0000 7f3810879700 1 -- 172.21.15.88:0/3153181123 shutdown_connections 2023-10-06T01:38:25.686 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.683+0000 7f3810879700 1 -- 172.21.15.88:0/3153181123 wait complete. 2023-10-06T01:38:25.688 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.684+0000 7f3810879700 1 Processor -- start 2023-10-06T01:38:25.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.684+0000 7f3810879700 1 -- start start 2023-10-06T01:38:25.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.685+0000 7f3810879700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f380c06dc70 0x7f380c0b4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:25.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.685+0000 7f3810879700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f380c06e0e0 0x7f380c0c7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:25.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.685+0000 7f3810879700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f380c159530 0x7f380c0c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:25.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.685+0000 7f3810879700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c0b5760 con 0x7f380c159530 2023-10-06T01:38:25.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.685+0000 7f3810879700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c0b4b50 con 0x7f380c06dc70 2023-10-06T01:38:25.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.685+0000 7f3810879700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f380c0b4e30 con 0x7f380c06e0e0 2023-10-06T01:38:25.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.685+0000 7f3809d9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f380c06e0e0 0x7f380c0c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:25.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.685+0000 7f380a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f380c06dc70 0x7f380c0b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:25.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.685+0000 7f380a59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f380c06dc70 0x7f380c0b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36126/0 (socket says 172.21.15.88:36126) 2023-10-06T01:38:25.689 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.685+0000 7f3809d9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f380c06e0e0 0x7f380c0c7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:36898/0 (socket says 172.21.15.88:36898) 2023-10-06T01:38:25.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.685+0000 7f380a59c700 1 -- 172.21.15.88:0/106583617 learned_addr learned my addr 172.21.15.88:0/106583617 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-06T01:38:25.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.685+0000 7f380ad9d700 1 --2- 172.21.15.88:0/106583617 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f380c159530 0x7f380c0c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:25.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.685+0000 7f380a59c700 1 -- 172.21.15.88:0/106583617 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f380c06e0e0 msgr2=0x7f380c0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:25.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.685+0000 7f380a59c700 1 --2- 172.21.15.88:0/106583617 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f380c06e0e0 0x7f380c0c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:25.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.685+0000 7f380a59c700 1 -- 172.21.15.88:0/106583617 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f380c159530 msgr2=0x7f380c0c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:25.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.685+0000 7f380a59c700 1 --2- 172.21.15.88:0/106583617 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f380c159530 0x7f380c0c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:25.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.685+0000 7f380a59c700 1 -- 172.21.15.88:0/106583617 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3804009ae0 con 0x7f380c06dc70 2023-10-06T01:38:25.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.686+0000 7f380a59c700 1 --2- 172.21.15.88:0/106583617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f380c06dc70 0x7f380c0b4450 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00c4e0 tx=0x7f37fc00c7f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:25.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.686+0000 7f37fa7fc700 1 -- 172.21.15.88:0/106583617 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc011590 con 0x7f380c06dc70 2023-10-06T01:38:25.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.686+0000 7f37fa7fc700 1 -- 172.21.15.88:0/106583617 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37fc011710 con 0x7f380c06dc70 2023-10-06T01:38:25.690 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.686+0000 7f3810879700 1 -- 172.21.15.88:0/106583617 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f380c0b5110 con 0x7f380c06dc70 2023-10-06T01:38:25.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.686+0000 7f37fa7fc700 1 -- 172.21.15.88:0/106583617 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37fc011ad0 con 0x7f380c06dc70 2023-10-06T01:38:25.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.686+0000 7f3810879700 1 -- 172.21.15.88:0/106583617 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f380c154110 con 0x7f380c06dc70 2023-10-06T01:38:25.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.686+0000 7f37fa7fc700 1 -- 172.21.15.88:0/106583617 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f37fc01c6c0 con 0x7f380c06dc70 2023-10-06T01:38:25.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.686+0000 7f37fa7fc700 1 -- 172.21.15.88:0/106583617 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f37fc0127e0 con 0x7f380c06dc70 2023-10-06T01:38:25.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.687+0000 7f3810879700 1 -- 172.21.15.88:0/106583617 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f380c04c3c0 con 0x7f380c06dc70 2023-10-06T01:38:25.691 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.689+0000 7f37fa7fc700 1 -- 172.21.15.88:0/106583617 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f37fc017070 con 0x7f380c06dc70 2023-10-06T01:38:25.772 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.772+0000 7f3810879700 1 -- 172.21.15.88:0/106583617 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c6ccaba1-6768-4136-8097-abdb827a4bb9", "id": 1} v 0) v1 -- 0x7f380c15ac70 con 0x7f380c06dc70 2023-10-06T01:38:25.779 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.778+0000 7f37fa7fc700 1 -- 172.21.15.88:0/106583617 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c6ccaba1-6768-4136-8097-abdb827a4bb9", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f37fc01cba0 con 0x7f380c06dc70 2023-10-06T01:38:25.779 INFO:teuthology.orchestra.run.smithi088.stdout:1 2023-10-06T01:38:25.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.779+0000 7f3810879700 1 -- 172.21.15.88:0/106583617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f380c06dc70 msgr2=0x7f380c0b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:25.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.779+0000 7f3810879700 1 --2- 172.21.15.88:0/106583617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f380c06dc70 0x7f380c0b4450 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00c4e0 tx=0x7f37fc00c7f0 comp rx=0 tx=0).stop 2023-10-06T01:38:25.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.779+0000 7f3810879700 1 -- 172.21.15.88:0/106583617 shutdown_connections 2023-10-06T01:38:25.780 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.779+0000 7f3810879700 1 --2- 172.21.15.88:0/106583617 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f380c159530 0x7f380c0c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:25.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.779+0000 7f3810879700 1 --2- 172.21.15.88:0/106583617 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f380c06dc70 0x7f380c0b4450 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:25.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.779+0000 7f3810879700 1 --2- 172.21.15.88:0/106583617 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f380c06e0e0 0x7f380c0c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:25.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.779+0000 7f3810879700 1 -- 172.21.15.88:0/106583617 >> 172.21.15.88:0/106583617 conn(0x7f380c0703a0 msgr2=0x7f380c0d0ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:25.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.779+0000 7f3810879700 1 -- 172.21.15.88:0/106583617 shutdown_connections 2023-10-06T01:38:25.781 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.779+0000 7f3810879700 1 -- 172.21.15.88:0/106583617 wait complete. 2023-10-06T01:38:25.791 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd new c05201ad-d3f4-464c-b785-cec1e887e930 2 2023-10-06T01:38:25.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.909+0000 7f6b85e0d700 1 Processor -- start 2023-10-06T01:38:25.910 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.909+0000 7f6b85e0d700 1 -- start start 2023-10-06T01:38:25.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.910+0000 7f6b85e0d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6b800cc320 0x7f6b8013c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:25.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.910+0000 7f6b85e0d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6b8006a110 0x7f6b8013c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:25.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.910+0000 7f6b85e0d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b8006d7b0 con 0x7f6b800cc6f0 2023-10-06T01:38:25.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.910+0000 7f6b85e0d700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b8006a570 con 0x7f6b8006a110 2023-10-06T01:38:25.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.910+0000 7f6b85e0d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b8006f7d0 con 0x7f6b800cc320 2023-10-06T01:38:25.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.910+0000 7f6b7f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6b800cc320 0x7f6b8013c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:25.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.910+0000 7f6b7f7fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6b800cc320 0x7f6b8013c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36138/0 (socket says 172.21.15.88:36138) 2023-10-06T01:38:25.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.910+0000 7f6b7f7fe700 1 -- 172.21.15.88:0/1102826586 learned_addr learned my addr 172.21.15.88:0/1102826586 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-06T01:38:25.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.910+0000 7f6b76ffd700 1 --1- 172.21.15.88:0/1102826586 >> v1:172.21.15.88:6789/0 conn(0x7f6b800cc6f0 0x7f6b80069a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40110/0 (socket says 172.21.15.88:40110) 2023-10-06T01:38:25.913 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.910+0000 7f6b7ffff700 1 --2- 172.21.15.88:0/1102826586 >> v2:172.21.15.69:3300/0 conn(0x7f6b8006a110 0x7f6b8013c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:25.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.911+0000 7f6b7f7fe700 1 -- 172.21.15.88:0/1102826586 >> v2:172.21.15.69:3300/0 conn(0x7f6b8006a110 msgr2=0x7f6b8013c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:25.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.911+0000 7f6b7f7fe700 1 --2- 172.21.15.88:0/1102826586 >> v2:172.21.15.69:3300/0 conn(0x7f6b8006a110 0x7f6b8013c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:25.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.911+0000 7f6b7f7fe700 1 -- 172.21.15.88:0/1102826586 >> v1:172.21.15.88:6789/0 conn(0x7f6b800cc6f0 legacy=0x7f6b80069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:25.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.911+0000 7f6b7effd700 1 -- 172.21.15.88:0/1102826586 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534046546 0 0) 0x7f6b8006d7b0 con 0x7f6b800cc6f0 2023-10-06T01:38:25.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.911+0000 7f6b7f7fe700 1 -- 172.21.15.88:0/1102826586 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8006e330 con 0x7f6b800cc320 2023-10-06T01:38:25.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.911+0000 7f6b7f7fe700 1 --2- 172.21.15.88:0/1102826586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b800cc320 0x7f6b8013c2a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6b800cf510 tx=0x7f6b70009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79fb4ae859fa6613 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:25.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.911+0000 7f6b7effd700 1 -- 172.21.15.88:0/1102826586 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b70009e70 con 0x7f6b800cc320 2023-10-06T01:38:25.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.911+0000 7f6b7effd700 1 -- 172.21.15.88:0/1102826586 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b7000b860 con 0x7f6b800cc320 2023-10-06T01:38:25.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.911+0000 7f6b7effd700 1 -- 172.21.15.88:0/1102826586 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7000bc00 con 0x7f6b800cc320 2023-10-06T01:38:25.914 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.911+0000 7f6b85e0d700 1 -- 172.21.15.88:0/1102826586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b800cc320 msgr2=0x7f6b8013c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:25.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.911+0000 7f6b85e0d700 1 --2- 172.21.15.88:0/1102826586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b800cc320 0x7f6b8013c2a0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6b800cf510 tx=0x7f6b70009250 comp rx=0 tx=0).stop 2023-10-06T01:38:25.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.911+0000 7f6b85e0d700 1 -- 172.21.15.88:0/1102826586 shutdown_connections 2023-10-06T01:38:25.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.911+0000 7f6b85e0d700 1 --2- 172.21.15.88:0/1102826586 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b800cc320 0x7f6b8013c2a0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:25.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.911+0000 7f6b85e0d700 1 --2- 172.21.15.88:0/1102826586 >> v2:172.21.15.69:3300/0 conn(0x7f6b8006a110 0x7f6b8013c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:25.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.911+0000 7f6b85e0d700 1 -- 172.21.15.88:0/1102826586 >> 172.21.15.88:0/1102826586 conn(0x7f6b80067f00 msgr2=0x7f6b80068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:25.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.912+0000 7f6b85e0d700 1 -- 172.21.15.88:0/1102826586 shutdown_connections 2023-10-06T01:38:25.915 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.912+0000 7f6b85e0d700 1 -- 172.21.15.88:0/1102826586 wait complete. 2023-10-06T01:38:25.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.913+0000 7f6b85e0d700 1 Processor -- start 2023-10-06T01:38:25.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.913+0000 7f6b85e0d700 1 -- start start 2023-10-06T01:38:25.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.913+0000 7f6b85e0d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6b8006a110 0x7f6b80152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:25.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.913+0000 7f6b85e0d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b800cc320 0x7f6b800c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:25.917 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.913+0000 7f6b85e0d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b800cc6f0 0x7f6b800aae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:25.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.913+0000 7f6b85e0d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b800c8880 con 0x7f6b800cc6f0 2023-10-06T01:38:25.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.913+0000 7f6b85e0d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b800ae110 con 0x7f6b800cc320 2023-10-06T01:38:25.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.913+0000 7f6b85e0d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b800ae3f0 con 0x7f6b8006a110 2023-10-06T01:38:25.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.914+0000 7f6b76ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b800cc320 0x7f6b800c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:25.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.914+0000 7f6b7f7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6b8006a110 0x7f6b80152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:25.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.914+0000 7f6b7f7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6b8006a110 0x7f6b80152920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:36912/0 (socket says 172.21.15.88:36912) 2023-10-06T01:38:25.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.914+0000 7f6b7f7fe700 1 -- 172.21.15.88:0/3329762012 learned_addr learned my addr 172.21.15.88:0/3329762012 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-06T01:38:25.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.914+0000 7f6b76ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b800cc320 0x7f6b800c8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36150/0 (socket says 172.21.15.88:36150) 2023-10-06T01:38:25.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.914+0000 7f6b7ffff700 1 --2- 172.21.15.88:0/3329762012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b800cc6f0 0x7f6b800aae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:25.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.914+0000 7f6b7f7fe700 1 -- 172.21.15.88:0/3329762012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b800cc320 msgr2=0x7f6b800c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:25.918 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.914+0000 7f6b7f7fe700 1 --2- 172.21.15.88:0/3329762012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b800cc320 0x7f6b800c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:25.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.914+0000 7f6b7f7fe700 1 -- 172.21.15.88:0/3329762012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b800cc6f0 msgr2=0x7f6b800aae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:25.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.914+0000 7f6b7f7fe700 1 --2- 172.21.15.88:0/3329762012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b800cc6f0 0x7f6b800aae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:25.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.914+0000 7f6b7f7fe700 1 -- 172.21.15.88:0/3329762012 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b700094f0 con 0x7f6b8006a110 2023-10-06T01:38:25.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.914+0000 7f6b7f7fe700 1 --2- 172.21.15.88:0/3329762012 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6b8006a110 0x7f6b80152920 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6b70006fd0 tx=0x7f6b70017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:25.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.914+0000 7f6b77fff700 1 -- 172.21.15.88:0/3329762012 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b7001f070 con 0x7f6b8006a110 2023-10-06T01:38:25.919 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.914+0000 7f6b77fff700 1 -- 172.21.15.88:0/3329762012 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b70000bc0 con 0x7f6b8006a110 2023-10-06T01:38:25.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.914+0000 7f6b85e0d700 1 -- 172.21.15.88:0/3329762012 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b800ae6d0 con 0x7f6b8006a110 2023-10-06T01:38:25.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.914+0000 7f6b77fff700 1 -- 172.21.15.88:0/3329762012 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b70025420 con 0x7f6b8006a110 2023-10-06T01:38:25.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.914+0000 7f6b85e0d700 1 -- 172.21.15.88:0/3329762012 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b800c8570 con 0x7f6b8006a110 2023-10-06T01:38:25.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.914+0000 7f6b77fff700 1 -- 172.21.15.88:0/3329762012 <== mon.2 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f6b70023070 con 0x7f6b8006a110 2023-10-06T01:38:25.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.914+0000 7f6b77fff700 1 -- 172.21.15.88:0/3329762012 <== mon.2 v2:172.21.15.88:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f6b70011850 con 0x7f6b8006a110 2023-10-06T01:38:25.920 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.915+0000 7f6b85e0d700 1 -- 172.21.15.88:0/3329762012 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b800ae250 con 0x7f6b8006a110 2023-10-06T01:38:25.920 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:38:25.916+0000 7f9689952180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T01:38:25.921 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:25.917+0000 7f6b77fff700 1 -- 172.21.15.88:0/3329762012 <== mon.2 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f6b800ae250 con 0x7f6b8006a110 2023-10-06T01:38:25.954 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-06T01:38:25.954+0000 7f760eaa8180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-06T01:38:26.015 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.014+0000 7f6b85e0d700 1 -- 172.21.15.88:0/3329762012 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c05201ad-d3f4-464c-b785-cec1e887e930", "id": 2} v 0) v1 -- 0x7f6b8004c3c0 con 0x7f6b8006a110 2023-10-06T01:38:26.022 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.022+0000 7f6b77fff700 1 -- 172.21.15.88:0/3329762012 <== mon.2 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c05201ad-d3f4-464c-b785-cec1e887e930", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6b7002a070 con 0x7f6b8006a110 2023-10-06T01:38:26.022 INFO:teuthology.orchestra.run.smithi088.stdout:2 2023-10-06T01:38:26.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.023+0000 7f6b85e0d700 1 -- 172.21.15.88:0/3329762012 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6b8006a110 msgr2=0x7f6b80152920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:26.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.023+0000 7f6b85e0d700 1 --2- 172.21.15.88:0/3329762012 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6b8006a110 0x7f6b80152920 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6b70006fd0 tx=0x7f6b70017000 comp rx=0 tx=0).stop 2023-10-06T01:38:26.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.023+0000 7f6b85e0d700 1 -- 172.21.15.88:0/3329762012 shutdown_connections 2023-10-06T01:38:26.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.023+0000 7f6b85e0d700 1 --2- 172.21.15.88:0/3329762012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b800cc6f0 0x7f6b800aae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.024 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.023+0000 7f6b85e0d700 1 --2- 172.21.15.88:0/3329762012 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6b8006a110 0x7f6b80152920 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.023+0000 7f6b85e0d700 1 --2- 172.21.15.88:0/3329762012 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6b800cc320 0x7f6b800c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.023+0000 7f6b85e0d700 1 -- 172.21.15.88:0/3329762012 >> 172.21.15.88:0/3329762012 conn(0x7f6b80067f00 msgr2=0x7f6b800b3670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:26.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.023+0000 7f6b85e0d700 1 -- 172.21.15.88:0/3329762012 shutdown_connections 2023-10-06T01:38:26.025 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.023+0000 7f6b85e0d700 1 -- 172.21.15.88:0/3329762012 wait complete. 2023-10-06T01:38:26.035 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd new 3f4b5214-7d97-479b-8056-ee79660aa29f 3 2023-10-06T01:38:26.049 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:38:26.048+0000 7f9689952180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T01:38:26.103 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-06T01:38:26.103+0000 7f760eaa8180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-06T01:38:26.124 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:38:26.123+0000 7f9689952180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T01:38:26.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.152+0000 7f4fbd8e8700 1 Processor -- start 2023-10-06T01:38:26.153 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.152+0000 7f4fbd8e8700 1 -- start start 2023-10-06T01:38:26.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.153+0000 7f4fbd8e8700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4fb8157930 0x7f4fb80ab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:26.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.153+0000 7f4fbd8e8700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4fb80ca2c0 0x7f4fb80ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:26.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.153+0000 7f4fbd8e8700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fb80c32a0 con 0x7f4fb80ccba0 2023-10-06T01:38:26.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.153+0000 7f4fbd8e8700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fb80c9730 con 0x7f4fb80ca2c0 2023-10-06T01:38:26.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.153+0000 7f4fbd8e8700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb80c4100 con 0x7f4fb8157930 2023-10-06T01:38:26.156 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.153+0000 7f4fb67fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4fb80ca2c0 0x7f4fb80ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:26.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.153+0000 7f4fb6ffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4fb8157930 0x7f4fb80ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:26.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.153+0000 7f4fb77fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f4fb80ccba0 0x7f4fb80c4590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40114/0 (socket says 172.21.15.88:40114) 2023-10-06T01:38:26.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.153+0000 7f4fb67fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4fb80ca2c0 0x7f4fb80ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36152/0 (socket says 172.21.15.88:36152) 2023-10-06T01:38:26.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.153+0000 7f4fb77fe700 1 -- 172.21.15.88:0/722895959 learned_addr learned my addr 172.21.15.88:0/722895959 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-06T01:38:26.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.154+0000 7f4fb6ffd700 1 -- 172.21.15.88:0/722895959 >> v2:172.21.15.88:3300/0 conn(0x7f4fb80ca2c0 msgr2=0x7f4fb80ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:26.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.154+0000 7f4fb6ffd700 1 --2- 172.21.15.88:0/722895959 >> v2:172.21.15.88:3300/0 conn(0x7f4fb80ca2c0 0x7f4fb80ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.154+0000 7f4fb6ffd700 1 -- 172.21.15.88:0/722895959 >> v1:172.21.15.88:6789/0 conn(0x7f4fb80ccba0 legacy=0x7f4fb80c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:26.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.154+0000 7f4fb6ffd700 1 -- 172.21.15.88:0/722895959 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fb80c34f0 con 0x7f4fb8157930 2023-10-06T01:38:26.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.154+0000 7f4fb5ffb700 1 -- 172.21.15.88:0/722895959 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809365810 0 0) 0x7f4fb80c32a0 con 0x7f4fb80ccba0 2023-10-06T01:38:26.157 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.154+0000 7f4fb67fc700 1 --2- 172.21.15.88:0/722895959 >> v2:172.21.15.88:3300/0 conn(0x7f4fb80ca2c0 0x7f4fb80ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:38:26.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.154+0000 7f4fb6ffd700 1 --2- 172.21.15.88:0/722895959 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4fb8157930 0x7f4fb80ab070 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4fac0098e0 tx=0x7f4fac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6148278b0b193b36 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:26.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.154+0000 7f4fb5ffb700 1 -- 172.21.15.88:0/722895959 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac00b640 con 0x7f4fb8157930 2023-10-06T01:38:26.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.154+0000 7f4fb5ffb700 1 -- 172.21.15.88:0/722895959 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fac00b7a0 con 0x7f4fb8157930 2023-10-06T01:38:26.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.154+0000 7f4fb5ffb700 1 -- 172.21.15.88:0/722895959 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac00bb40 con 0x7f4fb8157930 2023-10-06T01:38:26.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.155+0000 7f4fbd8e8700 1 -- 172.21.15.88:0/722895959 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4fb8157930 msgr2=0x7f4fb80ab070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:26.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.155+0000 7f4fbd8e8700 1 --2- 172.21.15.88:0/722895959 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4fb8157930 0x7f4fb80ab070 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4fac0098e0 tx=0x7f4fac0091a0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.155+0000 7f4fbd8e8700 1 -- 172.21.15.88:0/722895959 shutdown_connections 2023-10-06T01:38:26.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.155+0000 7f4fbd8e8700 1 --2- 172.21.15.88:0/722895959 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4fb8157930 0x7f4fb80ab070 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.155+0000 7f4fbd8e8700 1 --2- 172.21.15.88:0/722895959 >> v2:172.21.15.88:3300/0 conn(0x7f4fb80ca2c0 0x7f4fb80ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.155+0000 7f4fbd8e8700 1 -- 172.21.15.88:0/722895959 >> 172.21.15.88:0/722895959 conn(0x7f4fb8088000 msgr2=0x7f4fb80883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:26.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.155+0000 7f4fbd8e8700 1 -- 172.21.15.88:0/722895959 shutdown_connections 2023-10-06T01:38:26.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.155+0000 7f4fbd8e8700 1 -- 172.21.15.88:0/722895959 wait complete. 2023-10-06T01:38:26.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.156+0000 7f4fbd8e8700 1 Processor -- start 2023-10-06T01:38:26.161 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.156+0000 7f4fbd8e8700 1 -- start start 2023-10-06T01:38:26.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.157+0000 7f4fbd8e8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fb80ca2c0 0x7f4fb80c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:26.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.157+0000 7f4fbd8e8700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4fb80ccba0 0x7f4fb80c7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:26.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.157+0000 7f4fbd8e8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4fb8157930 0x7f4fb80c7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:26.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.157+0000 7f4fbd8e8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb80aeb50 con 0x7f4fb8157930 2023-10-06T01:38:26.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.157+0000 7f4fbd8e8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb80c7dc0 con 0x7f4fb80ca2c0 2023-10-06T01:38:26.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.157+0000 7f4fbd8e8700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fb80b3a90 con 0x7f4fb80ccba0 2023-10-06T01:38:26.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.157+0000 7f4fb6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fb80ca2c0 0x7f4fb80c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:26.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.157+0000 7f4fb6ffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fb80ca2c0 0x7f4fb80c83b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36156/0 (socket says 172.21.15.88:36156) 2023-10-06T01:38:26.162 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.157+0000 7f4fb6ffd700 1 -- 172.21.15.88:0/3703218031 learned_addr learned my addr 172.21.15.88:0/3703218031 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-06T01:38:26.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.157+0000 7f4fb67fc700 1 --2- 172.21.15.88:0/3703218031 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4fb80ccba0 0x7f4fb80c7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:26.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.157+0000 7f4fb77fe700 1 --2- 172.21.15.88:0/3703218031 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4fb8157930 0x7f4fb80c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:26.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.157+0000 7f4fb6ffd700 1 -- 172.21.15.88:0/3703218031 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4fb80ccba0 msgr2=0x7f4fb80c7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:26.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.157+0000 7f4fb6ffd700 1 --2- 172.21.15.88:0/3703218031 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4fb80ccba0 0x7f4fb80c7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.157+0000 7f4fb6ffd700 1 -- 172.21.15.88:0/3703218031 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4fb8157930 msgr2=0x7f4fb80c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:26.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.157+0000 7f4fb6ffd700 1 --2- 172.21.15.88:0/3703218031 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4fb8157930 0x7f4fb80c7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.157+0000 7f4fb6ffd700 1 -- 172.21.15.88:0/3703218031 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa8009420 con 0x7f4fb80ca2c0 2023-10-06T01:38:26.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.157+0000 7f4fb6ffd700 1 --2- 172.21.15.88:0/3703218031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fb80ca2c0 0x7f4fb80c83b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4fac0093f0 tx=0x7f4fac017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:26.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.157+0000 7f4f9effd700 1 -- 172.21.15.88:0/3703218031 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac020070 con 0x7f4fb80ca2c0 2023-10-06T01:38:26.163 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.158+0000 7f4f9effd700 1 -- 172.21.15.88:0/3703218031 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4fac000c90 con 0x7f4fb80ca2c0 2023-10-06T01:38:26.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.158+0000 7f4fbd8e8700 1 -- 172.21.15.88:0/3703218031 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fac009420 con 0x7f4fb80ca2c0 2023-10-06T01:38:26.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.158+0000 7f4f9effd700 1 -- 172.21.15.88:0/3703218031 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4fac026420 con 0x7f4fb80ca2c0 2023-10-06T01:38:26.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.158+0000 7f4fbd8e8700 1 -- 172.21.15.88:0/3703218031 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fb80ae500 con 0x7f4fb80ca2c0 2023-10-06T01:38:26.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.158+0000 7f4f9effd700 1 -- 172.21.15.88:0/3703218031 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f4fac024070 con 0x7f4fb80ca2c0 2023-10-06T01:38:26.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.158+0000 7f4f9effd700 1 -- 172.21.15.88:0/3703218031 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f4fac0118c0 con 0x7f4fb80ca2c0 2023-10-06T01:38:26.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.158+0000 7f4fbd8e8700 1 -- 172.21.15.88:0/3703218031 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fb804c3c0 con 0x7f4fb80ca2c0 2023-10-06T01:38:26.164 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.162+0000 7f4f9effd700 1 -- 172.21.15.88:0/3703218031 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f4fac02b070 con 0x7f4fb80ca2c0 2023-10-06T01:38:26.184 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-06T01:38:26.183+0000 7f760eaa8180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-06T01:38:26.245 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.244+0000 7f4fbd8e8700 1 -- 172.21.15.88:0/3703218031 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3f4b5214-7d97-479b-8056-ee79660aa29f", "id": 3} v 0) v1 -- 0x7f4fb80cbb00 con 0x7f4fb80ca2c0 2023-10-06T01:38:26.252 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.252+0000 7f4f9effd700 1 -- 172.21.15.88:0/3703218031 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3f4b5214-7d97-479b-8056-ee79660aa29f", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4fac015020 con 0x7f4fb80ca2c0 2023-10-06T01:38:26.252 INFO:teuthology.orchestra.run.smithi088.stdout:3 2023-10-06T01:38:26.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.252+0000 7f4fbd8e8700 1 -- 172.21.15.88:0/3703218031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fb80ca2c0 msgr2=0x7f4fb80c83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:26.253 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.252+0000 7f4fbd8e8700 1 --2- 172.21.15.88:0/3703218031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fb80ca2c0 0x7f4fb80c83b0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f4fac0093f0 tx=0x7f4fac017000 comp rx=0 tx=0).stop 2023-10-06T01:38:26.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.253+0000 7f4fbd8e8700 1 -- 172.21.15.88:0/3703218031 shutdown_connections 2023-10-06T01:38:26.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.253+0000 7f4fbd8e8700 1 --2- 172.21.15.88:0/3703218031 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4fb8157930 0x7f4fb80c7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.253+0000 7f4fbd8e8700 1 --2- 172.21.15.88:0/3703218031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4fb80ca2c0 0x7f4fb80c83b0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.253+0000 7f4fbd8e8700 1 --2- 172.21.15.88:0/3703218031 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4fb80ccba0 0x7f4fb80c7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.253+0000 7f4fbd8e8700 1 -- 172.21.15.88:0/3703218031 >> 172.21.15.88:0/3703218031 conn(0x7f4fb8088000 msgr2=0x7f4fb80c9b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:26.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.253+0000 7f4fbd8e8700 1 -- 172.21.15.88:0/3703218031 shutdown_connections 2023-10-06T01:38:26.254 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.253+0000 7f4fbd8e8700 1 -- 172.21.15.88:0/3703218031 wait complete. 2023-10-06T01:38:26.264 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd new 1fbfbf3d-cba6-4dc4-837e-791dd43836c0 4 2023-10-06T01:38:26.307 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:38:26.305+0000 7f9689952180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T01:38:26.375 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-06T01:38:26.374+0000 7f760eaa8180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-06T01:38:26.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.379+0000 7f142cede700 1 Processor -- start 2023-10-06T01:38:26.380 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.379+0000 7f142cede700 1 -- start start 2023-10-06T01:38:26.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.380+0000 7f142cede700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1428159530 0x7f14280ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:26.382 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.380+0000 7f142cede700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f142806dc70 0x7f1428159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:26.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.380+0000 7f142cede700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14280ccfd0 con 0x7f142806e0e0 2023-10-06T01:38:26.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.380+0000 7f142cede700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14280cf0e0 con 0x7f142806dc70 2023-10-06T01:38:26.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.380+0000 7f142cede700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f142815a3d0 con 0x7f1428159530 2023-10-06T01:38:26.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.380+0000 7f142659c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1428159530 0x7f14280ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:26.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.380+0000 7f142659c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1428159530 0x7f14280ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36172/0 (socket says 172.21.15.88:36172) 2023-10-06T01:38:26.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.380+0000 7f142659c700 1 -- 172.21.15.88:0/904187105 learned_addr learned my addr 172.21.15.88:0/904187105 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-06T01:38:26.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.380+0000 7f1425d9b700 1 --2- 172.21.15.88:0/904187105 >> v2:172.21.15.69:3300/0 conn(0x7f142806dc70 0x7f1428159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:26.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.381+0000 7f142659c700 1 -- 172.21.15.88:0/904187105 >> v2:172.21.15.69:3300/0 conn(0x7f142806dc70 msgr2=0x7f1428159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:26.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.381+0000 7f142659c700 1 --2- 172.21.15.88:0/904187105 >> v2:172.21.15.69:3300/0 conn(0x7f142806dc70 0x7f1428159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.381+0000 7f142659c700 1 -- 172.21.15.88:0/904187105 >> v1:172.21.15.69:6789/0 conn(0x7f142806e0e0 legacy=0x7f14280cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:26.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.381+0000 7f142659c700 1 -- 172.21.15.88:0/904187105 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142815a6b0 con 0x7f1428159530 2023-10-06T01:38:26.383 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.381+0000 7f1425d9b700 1 --2- 172.21.15.88:0/904187105 >> v2:172.21.15.69:3300/0 conn(0x7f142806dc70 0x7f1428159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:38:26.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.381+0000 7f142659c700 1 --2- 172.21.15.88:0/904187105 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1428159530 0x7f14280ceba0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f142806d630 tx=0x7f1418009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82b6a3ba3e95d363 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:26.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.381+0000 7f142559a700 1 -- 172.21.15.88:0/904187105 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141800b860 con 0x7f1428159530 2023-10-06T01:38:26.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.381+0000 7f142559a700 1 -- 172.21.15.88:0/904187105 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f141800b9c0 con 0x7f1428159530 2023-10-06T01:38:26.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.381+0000 7f142559a700 1 -- 172.21.15.88:0/904187105 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f141800bd60 con 0x7f1428159530 2023-10-06T01:38:26.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.381+0000 7f142cede700 1 -- 172.21.15.88:0/904187105 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1428159530 msgr2=0x7f14280ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:26.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.381+0000 7f142cede700 1 --2- 172.21.15.88:0/904187105 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1428159530 0x7f14280ceba0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f142806d630 tx=0x7f1418009250 comp rx=0 tx=0).stop 2023-10-06T01:38:26.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.381+0000 7f142cede700 1 -- 172.21.15.88:0/904187105 shutdown_connections 2023-10-06T01:38:26.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.381+0000 7f142cede700 1 --2- 172.21.15.88:0/904187105 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1428159530 0x7f14280ceba0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.381+0000 7f142cede700 1 --2- 172.21.15.88:0/904187105 >> v2:172.21.15.69:3300/0 conn(0x7f142806dc70 0x7f1428159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.381+0000 7f142cede700 1 -- 172.21.15.88:0/904187105 >> 172.21.15.88:0/904187105 conn(0x7f14280703a0 msgr2=0x7f14280707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:26.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.382+0000 7f142cede700 1 -- 172.21.15.88:0/904187105 shutdown_connections 2023-10-06T01:38:26.384 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.382+0000 7f142cede700 1 -- 172.21.15.88:0/904187105 wait complete. 2023-10-06T01:38:26.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.383+0000 7f142cede700 1 Processor -- start 2023-10-06T01:38:26.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.383+0000 7f142cede700 1 -- start start 2023-10-06T01:38:26.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.383+0000 7f142cede700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f142806dc70 0x7f1428157da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:26.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.383+0000 7f142cede700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f142806e0e0 0x7f142816add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:26.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.383+0000 7f142cede700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1428159530 0x7f14280b3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:26.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.383+0000 7f142cede700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14281582e0 con 0x7f142806dc70 2023-10-06T01:38:26.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.383+0000 7f142cede700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14280c96c0 con 0x7f142806e0e0 2023-10-06T01:38:26.387 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.383+0000 7f142cede700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f142816b310 con 0x7f1428159530 2023-10-06T01:38:26.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.383+0000 7f1425d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f142806e0e0 0x7f142816add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:26.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.383+0000 7f142659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f142806dc70 0x7f1428157da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:26.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.383+0000 7f142659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f142806dc70 0x7f1428157da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.88:35880/0 (socket says 172.21.15.88:35880) 2023-10-06T01:38:26.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.383+0000 7f1426d9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1428159530 0x7f14280b3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:26.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.383+0000 7f142659c700 1 -- 172.21.15.88:0/567982385 learned_addr learned my addr 172.21.15.88:0/567982385 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-06T01:38:26.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.383+0000 7f1425d9b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f142806e0e0 0x7f142816add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36176/0 (socket says 172.21.15.88:36176) 2023-10-06T01:38:26.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.384+0000 7f1425d9b700 1 -- 172.21.15.88:0/567982385 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1428159530 msgr2=0x7f14280b3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:26.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.384+0000 7f1425d9b700 1 --2- 172.21.15.88:0/567982385 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1428159530 0x7f14280b3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.384+0000 7f1425d9b700 1 -- 172.21.15.88:0/567982385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f142806dc70 msgr2=0x7f1428157da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:26.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.384+0000 7f1425d9b700 1 --2- 172.21.15.88:0/567982385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f142806dc70 0x7f1428157da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.388 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.384+0000 7f1425d9b700 1 -- 172.21.15.88:0/567982385 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14180094f0 con 0x7f142806e0e0 2023-10-06T01:38:26.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.384+0000 7f1426d9d700 1 --2- 172.21.15.88:0/567982385 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1428159530 0x7f14280b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:38:26.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.384+0000 7f1425d9b700 1 --2- 172.21.15.88:0/567982385 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f142806e0e0 0x7f142816add0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1410006fd0 tx=0x7f1410008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:26.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.384+0000 7f141e7fc700 1 -- 172.21.15.88:0/567982385 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1410013410 con 0x7f142806e0e0 2023-10-06T01:38:26.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.384+0000 7f141e7fc700 1 -- 172.21.15.88:0/567982385 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1410013570 con 0x7f142806e0e0 2023-10-06T01:38:26.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.384+0000 7f142cede700 1 -- 172.21.15.88:0/567982385 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14280c8f10 con 0x7f142806e0e0 2023-10-06T01:38:26.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.384+0000 7f141e7fc700 1 -- 172.21.15.88:0/567982385 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14100138f0 con 0x7f142806e0e0 2023-10-06T01:38:26.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.384+0000 7f142cede700 1 -- 172.21.15.88:0/567982385 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f142816e1d0 con 0x7f142806e0e0 2023-10-06T01:38:26.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.384+0000 7f141e7fc700 1 -- 172.21.15.88:0/567982385 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1410013ce0 con 0x7f142806e0e0 2023-10-06T01:38:26.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.384+0000 7f141e7fc700 1 -- 172.21.15.88:0/567982385 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f1410012370 con 0x7f142806e0e0 2023-10-06T01:38:26.389 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.385+0000 7f142cede700 1 -- 172.21.15.88:0/567982385 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14280c9830 con 0x7f142806e0e0 2023-10-06T01:38:26.390 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.387+0000 7f141e7fc700 1 -- 172.21.15.88:0/567982385 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f1410020060 con 0x7f142806e0e0 2023-10-06T01:38:26.470 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.469+0000 7f142cede700 1 -- 172.21.15.88:0/567982385 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1fbfbf3d-cba6-4dc4-837e-791dd43836c0", "id": 4} v 0) v1 -- 0x7f142804c3c0 con 0x7f142806e0e0 2023-10-06T01:38:26.477 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.477+0000 7f141e7fc700 1 -- 172.21.15.88:0/567982385 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1fbfbf3d-cba6-4dc4-837e-791dd43836c0", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f141000f040 con 0x7f142806e0e0 2023-10-06T01:38:26.477 INFO:teuthology.orchestra.run.smithi088.stdout:4 2023-10-06T01:38:26.478 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.477+0000 7f142cede700 1 -- 172.21.15.88:0/567982385 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f142806e0e0 msgr2=0x7f142816add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:26.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.477+0000 7f142cede700 1 --2- 172.21.15.88:0/567982385 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f142806e0e0 0x7f142816add0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f1410006fd0 tx=0x7f1410008040 comp rx=0 tx=0).stop 2023-10-06T01:38:26.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.478+0000 7f142cede700 1 -- 172.21.15.88:0/567982385 shutdown_connections 2023-10-06T01:38:26.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.478+0000 7f142cede700 1 --2- 172.21.15.88:0/567982385 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1428159530 0x7f14280b3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.478+0000 7f142cede700 1 --2- 172.21.15.88:0/567982385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f142806dc70 0x7f1428157da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.479 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.478+0000 7f142cede700 1 --2- 172.21.15.88:0/567982385 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f142806e0e0 0x7f142816add0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.478+0000 7f142cede700 1 -- 172.21.15.88:0/567982385 >> 172.21.15.88:0/567982385 conn(0x7f14280703a0 msgr2=0x7f14280cb910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:26.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.478+0000 7f142cede700 1 -- 172.21.15.88:0/567982385 shutdown_connections 2023-10-06T01:38:26.480 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.478+0000 7f142cede700 1 -- 172.21.15.88:0/567982385 wait complete. 2023-10-06T01:38:26.480 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:38:26.479+0000 7f9689952180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T01:38:26.490 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd new 36532a3d-5055-4dbc-8cb0-c8de8f687d58 5 2023-10-06T01:38:26.556 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:38:26.555+0000 7f9689952180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T01:38:26.557 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-06T01:38:26.556+0000 7f760eaa8180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-06T01:38:26.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.605+0000 7fafb8b34700 1 Processor -- start 2023-10-06T01:38:26.606 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.605+0000 7fafb8b34700 1 -- start start 2023-10-06T01:38:26.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.606+0000 7fafb8b34700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fafb41597e0 0x7fafb4159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:26.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.606+0000 7fafb8b34700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb40c71a0 con 0x7fafb406cdb0 2023-10-06T01:38:26.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.606+0000 7fafb8b34700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafb40c7a40 con 0x7fafb406e950 2023-10-06T01:38:26.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.606+0000 7fafb8b34700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafb406d3d0 con 0x7fafb41597e0 2023-10-06T01:38:26.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.606+0000 7fafb259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fafb41597e0 0x7fafb4159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:26.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.606+0000 7fafb1d9b700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fafb406e950 0x7fafb406c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40130/0 (socket says 172.21.15.88:40130) 2023-10-06T01:38:26.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.606+0000 7fafb259c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fafb41597e0 0x7fafb4159bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36180/0 (socket says 172.21.15.88:36180) 2023-10-06T01:38:26.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.606+0000 7fafb1d9b700 1 -- 172.21.15.88:0/2595576278 learned_addr learned my addr 172.21.15.88:0/2595576278 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-06T01:38:26.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.607+0000 7fafb259c700 1 -- 172.21.15.88:0/2595576278 >> v1:172.21.15.88:6789/0 conn(0x7fafb406e950 legacy=0x7fafb406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:26.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.607+0000 7fafb259c700 1 -- 172.21.15.88:0/2595576278 >> v1:172.21.15.69:6789/0 conn(0x7fafb406cdb0 legacy=0x7fafb40c7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:26.609 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.607+0000 7fafb259c700 1 -- 172.21.15.88:0/2595576278 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb40c73f0 con 0x7fafb41597e0 2023-10-06T01:38:26.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.607+0000 7fafb259c700 1 --2- 172.21.15.88:0/2595576278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafb41597e0 0x7fafb4159bb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fafa80098d0 tx=0x7fafa8009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffb41ce014db12d2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:26.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.607+0000 7fafb159a700 1 -- 172.21.15.88:0/2595576278 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa8009e70 con 0x7fafb41597e0 2023-10-06T01:38:26.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.607+0000 7fafb159a700 1 -- 172.21.15.88:0/2595576278 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa8005c10 con 0x7fafb41597e0 2023-10-06T01:38:26.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.607+0000 7fafb159a700 1 -- 172.21.15.88:0/2595576278 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa800b650 con 0x7fafb41597e0 2023-10-06T01:38:26.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.608+0000 7fafb8b34700 1 -- 172.21.15.88:0/2595576278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafb41597e0 msgr2=0x7fafb4159bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:26.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.608+0000 7fafb8b34700 1 --2- 172.21.15.88:0/2595576278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafb41597e0 0x7fafb4159bb0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fafa80098d0 tx=0x7fafa8009120 comp rx=0 tx=0).stop 2023-10-06T01:38:26.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.608+0000 7fafb8b34700 1 -- 172.21.15.88:0/2595576278 shutdown_connections 2023-10-06T01:38:26.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.608+0000 7fafb8b34700 1 --2- 172.21.15.88:0/2595576278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafb41597e0 0x7fafb4159bb0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.608+0000 7fafb8b34700 1 -- 172.21.15.88:0/2595576278 >> 172.21.15.88:0/2595576278 conn(0x7fafb40ccb60 msgr2=0x7fafb40ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:26.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.608+0000 7fafb8b34700 1 -- 172.21.15.88:0/2595576278 shutdown_connections 2023-10-06T01:38:26.610 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.608+0000 7fafb8b34700 1 -- 172.21.15.88:0/2595576278 wait complete. 2023-10-06T01:38:26.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.609+0000 7fafb8b34700 1 Processor -- start 2023-10-06T01:38:26.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.609+0000 7fafb8b34700 1 -- start start 2023-10-06T01:38:26.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.610+0000 7fafb8b34700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fafb406cdb0 0x7fafb40a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:26.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.610+0000 7fafb8b34700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fafb406e950 0x7fafb41516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:26.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.610+0000 7fafb8b34700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafb41597e0 0x7fafb40ae730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:26.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.610+0000 7fafb8b34700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb40afff0 con 0x7fafb406e950 2023-10-06T01:38:26.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.610+0000 7fafb8b34700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafb40a9e20 con 0x7fafb41597e0 2023-10-06T01:38:26.613 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.610+0000 7fafb8b34700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafb40af030 con 0x7fafb406cdb0 2023-10-06T01:38:26.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.610+0000 7fafb259c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fafb406cdb0 0x7fafb40a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:26.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.610+0000 7fafb2d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafb41597e0 0x7fafb40ae730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:26.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.610+0000 7fafb259c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fafb406cdb0 0x7fafb40a98e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:36936/0 (socket says 172.21.15.88:36936) 2023-10-06T01:38:26.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.610+0000 7fafb2d9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafb41597e0 0x7fafb40ae730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36194/0 (socket says 172.21.15.88:36194) 2023-10-06T01:38:26.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.610+0000 7fafb259c700 1 -- 172.21.15.88:0/2666102297 learned_addr learned my addr 172.21.15.88:0/2666102297 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-06T01:38:26.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.610+0000 7fafb1d9b700 1 --2- 172.21.15.88:0/2666102297 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fafb406e950 0x7fafb41516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:26.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.610+0000 7fafb259c700 1 -- 172.21.15.88:0/2666102297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafb41597e0 msgr2=0x7fafb40ae730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:26.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.610+0000 7fafb259c700 1 --2- 172.21.15.88:0/2666102297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafb41597e0 0x7fafb40ae730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.610+0000 7fafb259c700 1 -- 172.21.15.88:0/2666102297 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fafb406e950 msgr2=0x7fafb41516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:26.614 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.610+0000 7fafb259c700 1 --2- 172.21.15.88:0/2666102297 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fafb406e950 0x7fafb41516d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.610+0000 7fafb259c700 1 -- 172.21.15.88:0/2666102297 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafa80093c0 con 0x7fafb406cdb0 2023-10-06T01:38:26.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.610+0000 7fafb259c700 1 --2- 172.21.15.88:0/2666102297 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fafb406cdb0 0x7fafb40a98e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fafa8009160 tx=0x7fafa8016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:26.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.610+0000 7fafa27fc700 1 -- 172.21.15.88:0/2666102297 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa80063e0 con 0x7fafb406cdb0 2023-10-06T01:38:26.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.610+0000 7fafa27fc700 1 -- 172.21.15.88:0/2666102297 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafa8006540 con 0x7fafb406cdb0 2023-10-06T01:38:26.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.610+0000 7fafb8b34700 1 -- 172.21.15.88:0/2666102297 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafb40af310 con 0x7fafb406cdb0 2023-10-06T01:38:26.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.610+0000 7fafa27fc700 1 -- 172.21.15.88:0/2666102297 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafa8006900 con 0x7fafb406cdb0 2023-10-06T01:38:26.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.610+0000 7fafb8b34700 1 -- 172.21.15.88:0/2666102297 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafb40afc80 con 0x7fafb406cdb0 2023-10-06T01:38:26.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.610+0000 7fafa27fc700 1 -- 172.21.15.88:0/2666102297 <== mon.2 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fafa801a8b0 con 0x7fafb406cdb0 2023-10-06T01:38:26.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.610+0000 7fafa27fc700 1 -- 172.21.15.88:0/2666102297 <== mon.2 v2:172.21.15.88:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7fafa80269b0 con 0x7fafb406cdb0 2023-10-06T01:38:26.615 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.611+0000 7fafb8b34700 1 -- 172.21.15.88:0/2666102297 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafb404c3c0 con 0x7fafb406cdb0 2023-10-06T01:38:26.616 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.613+0000 7fafa27fc700 1 -- 172.21.15.88:0/2666102297 <== mon.2 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fafa80456d0 con 0x7fafb406cdb0 2023-10-06T01:38:26.638 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-06T01:38:26.637+0000 7f760eaa8180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-06T01:38:26.690 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:38:26.688+0000 7f9689952180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T01:38:26.696 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.696+0000 7fafb8b34700 1 -- 172.21.15.88:0/2666102297 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd new", "uuid": "36532a3d-5055-4dbc-8cb0-c8de8f687d58", "id": 5} v 0) v1 -- 0x7fafb4070590 con 0x7fafb406cdb0 2023-10-06T01:38:26.704 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.703+0000 7fafa27fc700 1 -- 172.21.15.88:0/2666102297 <== mon.2 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "36532a3d-5055-4dbc-8cb0-c8de8f687d58", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fafa8034030 con 0x7fafb406cdb0 2023-10-06T01:38:26.704 INFO:teuthology.orchestra.run.smithi088.stdout:5 2023-10-06T01:38:26.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.704+0000 7fafb8b34700 1 -- 172.21.15.88:0/2666102297 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fafb406cdb0 msgr2=0x7fafb40a98e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:26.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.704+0000 7fafb8b34700 1 --2- 172.21.15.88:0/2666102297 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fafb406cdb0 0x7fafb40a98e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fafa8009160 tx=0x7fafa8016000 comp rx=0 tx=0).stop 2023-10-06T01:38:26.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.704+0000 7fafb8b34700 1 -- 172.21.15.88:0/2666102297 shutdown_connections 2023-10-06T01:38:26.705 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.704+0000 7fafb8b34700 1 --2- 172.21.15.88:0/2666102297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fafb41597e0 0x7fafb40ae730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.704+0000 7fafb8b34700 1 --2- 172.21.15.88:0/2666102297 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fafb406cdb0 0x7fafb40a98e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.704+0000 7fafb8b34700 1 --2- 172.21.15.88:0/2666102297 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fafb406e950 0x7fafb41516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.704+0000 7fafb8b34700 1 -- 172.21.15.88:0/2666102297 >> 172.21.15.88:0/2666102297 conn(0x7fafb40ccb60 msgr2=0x7fafb406edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:26.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.704+0000 7fafb8b34700 1 -- 172.21.15.88:0/2666102297 shutdown_connections 2023-10-06T01:38:26.706 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.704+0000 7fafb8b34700 1 -- 172.21.15.88:0/2666102297 wait complete. 2023-10-06T01:38:26.716 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd new 67635a24-61ff-457f-aa95-006b03b707ad 6 2023-10-06T01:38:26.782 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-06T01:38:26.781+0000 7f760eaa8180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-06T01:38:26.785 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:38:26.784+0000 7f9689952180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T01:38:26.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.834+0000 7f9c78b29700 1 Processor -- start 2023-10-06T01:38:26.835 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.834+0000 7f9c78b29700 1 -- start start 2023-10-06T01:38:26.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.835+0000 7f9c78b29700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9c740cd8e0 0x7f9c74161010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:26.837 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.835+0000 7f9c78b29700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c740c8cd0 con 0x7f9c7413fb60 2023-10-06T01:38:26.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.835+0000 7f9c78b29700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c7406b480 con 0x7f9c7413ff30 2023-10-06T01:38:26.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.835+0000 7f9c78b29700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c7415aa20 con 0x7f9c740cd8e0 2023-10-06T01:38:26.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.835+0000 7f9c72ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f9c7413ff30 0x7f9c740cd1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40140/0 (socket says 172.21.15.88:40140) 2023-10-06T01:38:26.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.835+0000 7f9c72ffd700 1 -- 172.21.15.88:0/4144885622 learned_addr learned my addr 172.21.15.88:0/4144885622 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-06T01:38:26.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.835+0000 7f9c73fff700 1 --2- 172.21.15.88:0/4144885622 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9c740cd8e0 0x7f9c74161010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:26.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.835+0000 7f9c727fc700 1 -- 172.21.15.88:0/4144885622 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1374133825 0 0) 0x7f9c7406b480 con 0x7f9c7413ff30 2023-10-06T01:38:26.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.835+0000 7f9c727fc700 1 -- 172.21.15.88:0/4144885622 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c5c003570 con 0x7f9c7413ff30 2023-10-06T01:38:26.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.835+0000 7f9c73fff700 1 -- 172.21.15.88:0/4144885622 >> v1:172.21.15.88:6789/0 conn(0x7f9c7413ff30 legacy=0x7f9c740cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:26.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.835+0000 7f9c73fff700 1 -- 172.21.15.88:0/4144885622 >> v1:172.21.15.69:6789/0 conn(0x7f9c7413fb60 legacy=0x7f9c74159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:26.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.835+0000 7f9c73fff700 1 -- 172.21.15.88:0/4144885622 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c7415ad00 con 0x7f9c740cd8e0 2023-10-06T01:38:26.838 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.836+0000 7f9c73fff700 1 --2- 172.21.15.88:0/4144885622 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9c740cd8e0 0x7f9c74161010 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c009e90 tx=0x7f9c6c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f595ae91159c76f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:26.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.836+0000 7f9c727fc700 1 -- 172.21.15.88:0/4144885622 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c00e070 con 0x7f9c740cd8e0 2023-10-06T01:38:26.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.836+0000 7f9c727fc700 1 -- 172.21.15.88:0/4144885622 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6c00bc30 con 0x7f9c740cd8e0 2023-10-06T01:38:26.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.836+0000 7f9c727fc700 1 -- 172.21.15.88:0/4144885622 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c012430 con 0x7f9c740cd8e0 2023-10-06T01:38:26.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.836+0000 7f9c78b29700 1 -- 172.21.15.88:0/4144885622 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9c740cd8e0 msgr2=0x7f9c74161010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:26.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.836+0000 7f9c78b29700 1 --2- 172.21.15.88:0/4144885622 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9c740cd8e0 0x7f9c74161010 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c009e90 tx=0x7f9c6c009780 comp rx=0 tx=0).stop 2023-10-06T01:38:26.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.836+0000 7f9c78b29700 1 -- 172.21.15.88:0/4144885622 shutdown_connections 2023-10-06T01:38:26.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.836+0000 7f9c78b29700 1 --2- 172.21.15.88:0/4144885622 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9c740cd8e0 0x7f9c74161010 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.836+0000 7f9c78b29700 1 -- 172.21.15.88:0/4144885622 >> 172.21.15.88:0/4144885622 conn(0x7f9c740675a0 msgr2=0x7f9c740679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:26.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.837+0000 7f9c78b29700 1 -- 172.21.15.88:0/4144885622 shutdown_connections 2023-10-06T01:38:26.839 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.837+0000 7f9c78b29700 1 -- 172.21.15.88:0/4144885622 wait complete. 2023-10-06T01:38:26.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.838+0000 7f9c78b29700 1 Processor -- start 2023-10-06T01:38:26.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.838+0000 7f9c78b29700 1 -- start start 2023-10-06T01:38:26.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.838+0000 7f9c78b29700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9c740cd8e0 0x7f9c74158e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:26.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.838+0000 7f9c78b29700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c7413fb60 0x7f9c740c4540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:26.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.838+0000 7f9c78b29700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c7413ff30 0x7f9c740c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:26.842 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.838+0000 7f9c78b29700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c741589a0 con 0x7f9c7413fb60 2023-10-06T01:38:26.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.838+0000 7f9c78b29700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c74159370 con 0x7f9c7413ff30 2023-10-06T01:38:26.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.838+0000 7f9c78b29700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c74157d90 con 0x7f9c740cd8e0 2023-10-06T01:38:26.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.839+0000 7f9c737fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9c740cd8e0 0x7f9c74158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:26.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.839+0000 7f9c73fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c7413ff30 0x7f9c740c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:26.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.839+0000 7f9c737fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9c740cd8e0 0x7f9c74158e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:36954/0 (socket says 172.21.15.88:36954) 2023-10-06T01:38:26.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.839+0000 7f9c737fe700 1 -- 172.21.15.88:0/1826326225 learned_addr learned my addr 172.21.15.88:0/1826326225 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-06T01:38:26.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.839+0000 7f9c72ffd700 1 --2- 172.21.15.88:0/1826326225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c7413fb60 0x7f9c740c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:26.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.839+0000 7f9c737fe700 1 -- 172.21.15.88:0/1826326225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c7413ff30 msgr2=0x7f9c740c6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:26.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.839+0000 7f9c737fe700 1 --2- 172.21.15.88:0/1826326225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c7413ff30 0x7f9c740c6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.839+0000 7f9c737fe700 1 -- 172.21.15.88:0/1826326225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c7413fb60 msgr2=0x7f9c740c4540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:26.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.839+0000 7f9c737fe700 1 --2- 172.21.15.88:0/1826326225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c7413fb60 0x7f9c740c4540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.843 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.839+0000 7f9c737fe700 1 -- 172.21.15.88:0/1826326225 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c009a20 con 0x7f9c740cd8e0 2023-10-06T01:38:26.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.839+0000 7f9c73fff700 1 --2- 172.21.15.88:0/1826326225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c7413ff30 0x7f9c740c6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:38:26.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.839+0000 7f9c72ffd700 1 --2- 172.21.15.88:0/1826326225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c7413fb60 0x7f9c740c4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:38:26.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.839+0000 7f9c737fe700 1 --2- 172.21.15.88:0/1826326225 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9c740cd8e0 0x7f9c74158e30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9c6400c590 tx=0x7f9c6400c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:26.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.839+0000 7f9c5b7fe700 1 -- 172.21.15.88:0/1826326225 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c64011590 con 0x7f9c740cd8e0 2023-10-06T01:38:26.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.839+0000 7f9c5b7fe700 1 -- 172.21.15.88:0/1826326225 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c64011710 con 0x7f9c740cd8e0 2023-10-06T01:38:26.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.839+0000 7f9c78b29700 1 -- 172.21.15.88:0/1826326225 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c74158070 con 0x7f9c740cd8e0 2023-10-06T01:38:26.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.839+0000 7f9c5b7fe700 1 -- 172.21.15.88:0/1826326225 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c64011ad0 con 0x7f9c740cd8e0 2023-10-06T01:38:26.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.839+0000 7f9c78b29700 1 -- 172.21.15.88:0/1826326225 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c74158630 con 0x7f9c740cd8e0 2023-10-06T01:38:26.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.839+0000 7f9c5b7fe700 1 -- 172.21.15.88:0/1826326225 <== mon.2 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9c6401c6c0 con 0x7f9c740cd8e0 2023-10-06T01:38:26.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.839+0000 7f9c5b7fe700 1 -- 172.21.15.88:0/1826326225 <== mon.2 v2:172.21.15.88:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7f9c64012a20 con 0x7f9c740cd8e0 2023-10-06T01:38:26.844 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.840+0000 7f9c78b29700 1 -- 172.21.15.88:0/1826326225 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c74158c80 con 0x7f9c740cd8e0 2023-10-06T01:38:26.845 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.842+0000 7f9c5b7fe700 1 -- 172.21.15.88:0/1826326225 <== mon.2 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9c64017070 con 0x7f9c740cd8e0 2023-10-06T01:38:26.881 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-06T01:38:26.881+0000 7f760eaa8180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-06T01:38:26.925 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.925+0000 7f9c78b29700 1 -- 172.21.15.88:0/1826326225 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd new", "uuid": "67635a24-61ff-457f-aa95-006b03b707ad", "id": 6} v 0) v1 -- 0x7f9c7406d8b0 con 0x7f9c740cd8e0 2023-10-06T01:38:26.933 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.932+0000 7f9c5b7fe700 1 -- 172.21.15.88:0/1826326225 <== mon.2 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "67635a24-61ff-457f-aa95-006b03b707ad", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9c6401cba0 con 0x7f9c740cd8e0 2023-10-06T01:38:26.933 INFO:teuthology.orchestra.run.smithi088.stdout:6 2023-10-06T01:38:26.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.933+0000 7f9c78b29700 1 -- 172.21.15.88:0/1826326225 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9c740cd8e0 msgr2=0x7f9c74158e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:26.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.933+0000 7f9c78b29700 1 --2- 172.21.15.88:0/1826326225 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9c740cd8e0 0x7f9c74158e30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f9c6400c590 tx=0x7f9c6400c8a0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.933+0000 7f9c78b29700 1 -- 172.21.15.88:0/1826326225 shutdown_connections 2023-10-06T01:38:26.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.933+0000 7f9c78b29700 1 --2- 172.21.15.88:0/1826326225 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9c7413ff30 0x7f9c740c6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.935 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.933+0000 7f9c78b29700 1 --2- 172.21.15.88:0/1826326225 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9c740cd8e0 0x7f9c74158e30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.933+0000 7f9c78b29700 1 --2- 172.21.15.88:0/1826326225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c7413fb60 0x7f9c740c4540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:26.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.933+0000 7f9c78b29700 1 -- 172.21.15.88:0/1826326225 >> 172.21.15.88:0/1826326225 conn(0x7f9c740675a0 msgr2=0x7f9c74159ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:26.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.933+0000 7f9c78b29700 1 -- 172.21.15.88:0/1826326225 shutdown_connections 2023-10-06T01:38:26.936 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:26.933+0000 7f9c78b29700 1 -- 172.21.15.88:0/1826326225 wait complete. 2023-10-06T01:38:26.947 DEBUG:teuthology.orchestra.run.smithi088:> sudo ceph --cluster ceph osd new 125b9ba4-f842-4f56-8e97-2c9e89367bca 7 2023-10-06T01:38:27.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.061+0000 7f7a092b9700 1 Processor -- start 2023-10-06T01:38:27.062 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.061+0000 7f7a092b9700 1 -- start start 2023-10-06T01:38:27.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.062+0000 7f7a092b9700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7a0413fb60 0x7f7a04159f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:27.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.062+0000 7f7a092b9700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a040c8cd0 con 0x7f7a0413ff30 2023-10-06T01:38:27.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.062+0000 7f7a092b9700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a0406b480 con 0x7f7a040cd8e0 2023-10-06T01:38:27.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.062+0000 7f7a092b9700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a0415aa20 con 0x7f7a0413fb60 2023-10-06T01:38:27.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.062+0000 7f7a08ab8700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f7a040cd8e0 0x7f7a040c9160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.88:40144/0 (socket says 172.21.15.88:40144) 2023-10-06T01:38:27.066 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.062+0000 7f7a08ab8700 1 -- 172.21.15.88:0/396968474 learned_addr learned my addr 172.21.15.88:0/396968474 (peer_addr_for_me v1:172.21.15.88:0/0) 2023-10-06T01:38:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.062+0000 7f7a03fff700 1 --2- 172.21.15.88:0/396968474 >> v2:172.21.15.69:3300/0 conn(0x7f7a0413fb60 0x7f7a04159f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.062+0000 7f7a02ffd700 1 -- 172.21.15.88:0/396968474 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3119425413 0 0) 0x7f7a0406b480 con 0x7f7a040cd8e0 2023-10-06T01:38:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.062+0000 7f7a02ffd700 1 -- 172.21.15.88:0/396968474 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79ec003570 con 0x7f7a040cd8e0 2023-10-06T01:38:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.062+0000 7f7a02ffd700 1 -- 172.21.15.88:0/396968474 <== mon.1 v1:172.21.15.88:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 285098760 0 0) 0x7f79ec003570 con 0x7f7a040cd8e0 2023-10-06T01:38:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.062+0000 7f7a02ffd700 1 -- 172.21.15.88:0/396968474 >> v2:172.21.15.69:3300/0 conn(0x7f7a0413fb60 msgr2=0x7f7a04159f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.062+0000 7f7a02ffd700 1 --2- 172.21.15.88:0/396968474 >> v2:172.21.15.69:3300/0 conn(0x7f7a0413fb60 0x7f7a04159f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.063+0000 7f7a02ffd700 1 -- 172.21.15.88:0/396968474 >> v1:172.21.15.69:6789/0 conn(0x7f7a0413ff30 legacy=0x7f7a040cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.063+0000 7f7a02ffd700 1 -- 172.21.15.88:0/396968474 --> v1:172.21.15.88:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0415ad00 con 0x7f7a040cd8e0 2023-10-06T01:38:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.063+0000 7f7a02ffd700 1 -- 172.21.15.88:0/396968474 <== mon.1 v1:172.21.15.88:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f79fc0017f0 con 0x7f7a040cd8e0 2023-10-06T01:38:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.063+0000 7f7a02ffd700 1 -- 172.21.15.88:0/396968474 >> v1:172.21.15.88:6789/0 conn(0x7f7a040cd8e0 legacy=0x7f7a040c9160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:27.067 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.063+0000 7f7a02ffd700 1 --2- 172.21.15.88:0/396968474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79ec003a60 0x7f79ec003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:27.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.063+0000 7f7a02ffd700 1 --2- 172.21.15.88:0/396968474 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f79ec004810 0x7f79ec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:27.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.063+0000 7f7a02ffd700 1 --2- 172.21.15.88:0/396968474 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f79ec0051c0 0x7f79ec00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:27.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.063+0000 7f7a02ffd700 1 -- 172.21.15.88:0/396968474 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0415aa20 con 0x7f79ec004810 2023-10-06T01:38:27.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.063+0000 7f7a02ffd700 1 -- 172.21.15.88:0/396968474 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec00c0d0 con 0x7f79ec003a60 2023-10-06T01:38:27.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.063+0000 7f7a02ffd700 1 -- 172.21.15.88:0/396968474 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79ec00c290 con 0x7f79ec0051c0 2023-10-06T01:38:27.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.063+0000 7f7a03fff700 1 --2- 172.21.15.88:0/396968474 >> v2:172.21.15.69:3300/0 conn(0x7f7a0413fb60 0x7f7a04159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:38:27.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.063+0000 7f7a08ab8700 1 --2- 172.21.15.88:0/396968474 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f79ec0051c0 0x7f79ec00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:27.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.063+0000 7f7a037fe700 1 --2- 172.21.15.88:0/396968474 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f79ec004810 0x7f79ec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:27.068 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.063+0000 7f7a03fff700 1 --2- 172.21.15.88:0/396968474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79ec003a60 0x7f79ec003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:27.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.063+0000 7f7a08ab8700 1 -- 172.21.15.88:0/396968474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79ec003a60 msgr2=0x7f79ec003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:27.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.063+0000 7f7a08ab8700 1 --2- 172.21.15.88:0/396968474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79ec003a60 0x7f79ec003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:27.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.063+0000 7f7a08ab8700 1 -- 172.21.15.88:0/396968474 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f79ec004810 msgr2=0x7f79ec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:27.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.063+0000 7f7a08ab8700 1 --2- 172.21.15.88:0/396968474 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f79ec004810 0x7f79ec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:27.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.063+0000 7f7a08ab8700 1 -- 172.21.15.88:0/396968474 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79ec003570 con 0x7f79ec0051c0 2023-10-06T01:38:27.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.063+0000 7f7a03fff700 1 --2- 172.21.15.88:0/396968474 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f79ec003a60 0x7f79ec003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:38:27.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.063+0000 7f7a037fe700 1 --2- 172.21.15.88:0/396968474 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f79ec004810 0x7f79ec004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:38:27.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.063+0000 7f7a08ab8700 1 -- 172.21.15.88:0/396968474 reap_dead start 2023-10-06T01:38:27.069 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.063+0000 7f7a08ab8700 1 --2- 172.21.15.88:0/396968474 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f79ec0051c0 0x7f79ec00ba60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7a040c7830 tx=0x7f7a040c78b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cdb461bb442a548b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:27.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.063+0000 7f7a02ffd700 1 -- 172.21.15.88:0/396968474 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc0070d0 con 0x7f79ec0051c0 2023-10-06T01:38:27.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.063+0000 7f7a02ffd700 1 -- 172.21.15.88:0/396968474 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79fc007230 con 0x7f79ec0051c0 2023-10-06T01:38:27.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.063+0000 7f7a02ffd700 1 -- 172.21.15.88:0/396968474 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79fc0075f0 con 0x7f79ec0051c0 2023-10-06T01:38:27.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.064+0000 7f7a092b9700 1 -- 172.21.15.88:0/396968474 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f79ec0051c0 msgr2=0x7f79ec00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:27.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.064+0000 7f7a092b9700 1 --2- 172.21.15.88:0/396968474 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f79ec0051c0 0x7f79ec00ba60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f7a040c7830 tx=0x7f7a040c78b0 comp rx=0 tx=0).stop 2023-10-06T01:38:27.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.064+0000 7f7a092b9700 1 -- 172.21.15.88:0/396968474 shutdown_connections 2023-10-06T01:38:27.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.064+0000 7f7a092b9700 1 --2- 172.21.15.88:0/396968474 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f79ec0051c0 0x7f79ec00ba60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:27.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.064+0000 7f7a092b9700 1 -- 172.21.15.88:0/396968474 >> 172.21.15.88:0/396968474 conn(0x7f7a040675a0 msgr2=0x7f7a040679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:27.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.064+0000 7f7a092b9700 1 -- 172.21.15.88:0/396968474 shutdown_connections 2023-10-06T01:38:27.070 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.064+0000 7f7a092b9700 1 -- 172.21.15.88:0/396968474 wait complete. 2023-10-06T01:38:27.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.065+0000 7f7a092b9700 1 Processor -- start 2023-10-06T01:38:27.071 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.065+0000 7f7a092b9700 1 -- start start 2023-10-06T01:38:27.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.066+0000 7f7a092b9700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f79ec0051c0 0x7f7a04155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:27.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.066+0000 7f7a092b9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a04158a70 0x7f7a04158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:27.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.066+0000 7f7a092b9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a0406d5f0 0x7f7a0406da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:27.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.066+0000 7f7a092b9700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0406dfa0 con 0x7f7a0406d5f0 2023-10-06T01:38:27.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.066+0000 7f7a092b9700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0416cd90 con 0x7f7a04158a70 2023-10-06T01:38:27.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.066+0000 7f7a092b9700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a0416d070 con 0x7f79ec0051c0 2023-10-06T01:38:27.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.066+0000 7f7a03fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f79ec0051c0 0x7f7a04155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:27.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.066+0000 7f7a037fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a04158a70 0x7f7a04158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:27.073 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.066+0000 7f7a03fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f79ec0051c0 0x7f7a04155c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.88:36986/0 (socket says 172.21.15.88:36986) 2023-10-06T01:38:27.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.066+0000 7f7a03fff700 1 -- 172.21.15.88:0/4026900101 learned_addr learned my addr 172.21.15.88:0/4026900101 (peer_addr_for_me v2:172.21.15.88:0/0) 2023-10-06T01:38:27.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.066+0000 7f7a037fe700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a04158a70 0x7f7a04158ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.88:36230/0 (socket says 172.21.15.88:36230) 2023-10-06T01:38:27.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.066+0000 7f7a08ab8700 1 --2- 172.21.15.88:0/4026900101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a0406d5f0 0x7f7a0406da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:27.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.066+0000 7f7a03fff700 1 -- 172.21.15.88:0/4026900101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a04158a70 msgr2=0x7f7a04158ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:27.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.066+0000 7f7a03fff700 1 --2- 172.21.15.88:0/4026900101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a04158a70 0x7f7a04158ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:27.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.066+0000 7f7a03fff700 1 -- 172.21.15.88:0/4026900101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a0406d5f0 msgr2=0x7f7a0406da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:27.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.066+0000 7f7a03fff700 1 --2- 172.21.15.88:0/4026900101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a0406d5f0 0x7f7a0406da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:27.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.066+0000 7f7a03fff700 1 -- 172.21.15.88:0/4026900101 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a0416d350 con 0x7f79ec0051c0 2023-10-06T01:38:27.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.066+0000 7f7a037fe700 1 --2- 172.21.15.88:0/4026900101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a04158a70 0x7f7a04158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:38:27.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.066+0000 7f7a03fff700 1 --2- 172.21.15.88:0/4026900101 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f79ec0051c0 0x7f7a04155c00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f79f4011e20 tx=0x7f79f40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:27.074 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.067+0000 7f79ebfff700 1 -- 172.21.15.88:0/4026900101 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f400fc20 con 0x7f79ec0051c0 2023-10-06T01:38:27.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.067+0000 7f79ebfff700 1 -- 172.21.15.88:0/4026900101 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79f400fd80 con 0x7f79ec0051c0 2023-10-06T01:38:27.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.067+0000 7f7a092b9700 1 -- 172.21.15.88:0/4026900101 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a0416d630 con 0x7f79ec0051c0 2023-10-06T01:38:27.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.067+0000 7f79ebfff700 1 -- 172.21.15.88:0/4026900101 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79f4014670 con 0x7f79ec0051c0 2023-10-06T01:38:27.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.067+0000 7f7a092b9700 1 -- 172.21.15.88:0/4026900101 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a04156140 con 0x7f79ec0051c0 2023-10-06T01:38:27.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.067+0000 7f79ebfff700 1 -- 172.21.15.88:0/4026900101 <== mon.2 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f79f4014ca0 con 0x7f79ec0051c0 2023-10-06T01:38:27.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.067+0000 7f79ebfff700 1 -- 172.21.15.88:0/4026900101 <== mon.2 v2:172.21.15.88:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f79f4018070 con 0x7f79ec0051c0 2023-10-06T01:38:27.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.067+0000 7f7a092b9700 1 -- 172.21.15.88:0/4026900101 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a0404c3c0 con 0x7f79ec0051c0 2023-10-06T01:38:27.075 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.069+0000 7f79ebfff700 1 -- 172.21.15.88:0/4026900101 <== mon.2 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f79f401c430 con 0x7f79ec0051c0 2023-10-06T01:38:27.152 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.152+0000 7f7a092b9700 1 -- 172.21.15.88:0/4026900101 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd new", "uuid": "125b9ba4-f842-4f56-8e97-2c9e89367bca", "id": 7} v 0) v1 -- 0x7f7a04067c40 con 0x7f79ec0051c0 2023-10-06T01:38:27.158 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.157+0000 7f79ebfff700 1 -- 172.21.15.88:0/4026900101 <== mon.2 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "125b9ba4-f842-4f56-8e97-2c9e89367bca", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f79f401c8e0 con 0x7f79ec0051c0 2023-10-06T01:38:27.158 INFO:teuthology.orchestra.run.smithi088.stdout:7 2023-10-06T01:38:27.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.158+0000 7f7a092b9700 1 -- 172.21.15.88:0/4026900101 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f79ec0051c0 msgr2=0x7f7a04155c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:27.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.158+0000 7f7a092b9700 1 --2- 172.21.15.88:0/4026900101 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f79ec0051c0 0x7f7a04155c00 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f79f4011e20 tx=0x7f79f40091a0 comp rx=0 tx=0).stop 2023-10-06T01:38:27.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.159+0000 7f7a092b9700 1 -- 172.21.15.88:0/4026900101 shutdown_connections 2023-10-06T01:38:27.159 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.159+0000 7f7a092b9700 1 --2- 172.21.15.88:0/4026900101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a0406d5f0 0x7f7a0406da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:27.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.159+0000 7f7a092b9700 1 --2- 172.21.15.88:0/4026900101 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f79ec0051c0 0x7f7a04155c00 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:27.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.159+0000 7f7a092b9700 1 --2- 172.21.15.88:0/4026900101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a04158a70 0x7f7a04158ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:27.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.159+0000 7f7a092b9700 1 -- 172.21.15.88:0/4026900101 >> 172.21.15.88:0/4026900101 conn(0x7f7a040675a0 msgr2=0x7f7a0413e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:27.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.159+0000 7f7a092b9700 1 -- 172.21.15.88:0/4026900101 shutdown_connections 2023-10-06T01:38:27.160 INFO:teuthology.orchestra.run.smithi088.stderr:2023-10-06T01:38:27.159+0000 7f7a092b9700 1 -- 172.21.15.88:0/4026900101 wait complete. 2023-10-06T01:38:27.172 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-06T01:38:27.172 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-06T01:38:27.174 INFO:tasks.ceph.osd.0:Started 2023-10-06T01:38:27.174 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-06T01:38:27.174 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-06T01:38:27.176 INFO:tasks.ceph.osd.1:Started 2023-10-06T01:38:27.177 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-06T01:38:27.177 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-06T01:38:27.178 INFO:tasks.ceph.osd.2:Started 2023-10-06T01:38:27.178 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-06T01:38:27.179 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-06T01:38:27.181 INFO:tasks.ceph.osd.3:Started 2023-10-06T01:38:27.181 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-06T01:38:27.181 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-06T01:38:27.183 INFO:tasks.ceph.osd.4:Started 2023-10-06T01:38:27.183 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-06T01:38:27.184 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-06T01:38:27.185 INFO:tasks.ceph.osd.5:Started 2023-10-06T01:38:27.185 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-06T01:38:27.185 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-06T01:38:27.187 INFO:tasks.ceph.osd.6:Started 2023-10-06T01:38:27.187 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-06T01:38:27.188 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-06T01:38:27.190 INFO:tasks.ceph.osd.7:Started 2023-10-06T01:38:27.190 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:38:27.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.348+0000 7fbf1c449700 1 Processor -- start 2023-10-06T01:38:27.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.348+0000 7fbf1c449700 1 -- start start 2023-10-06T01:38:27.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.349+0000 7fbf1c449700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fbf140cb970 0x7fbf14159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:27.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.349+0000 7fbf1c449700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbf1415a400 0x7fbf14156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:27.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.349+0000 7fbf1c449700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf1415ae40 con 0x7fbf140cb5a0 2023-10-06T01:38:27.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.349+0000 7fbf1c449700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf140ce0f0 con 0x7fbf1415a400 2023-10-06T01:38:27.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.349+0000 7fbf1c449700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf140d13f0 con 0x7fbf140cb970 2023-10-06T01:38:27.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.349+0000 7fbf1a9e6700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbf1415a400 0x7fbf14156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:27.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.349+0000 7fbf1a9e6700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbf1415a400 0x7fbf14156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38330/0 (socket says 172.21.15.69:38330) 2023-10-06T01:38:27.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.349+0000 7fbf1a9e6700 1 -- 172.21.15.69:0/2711330030 learned_addr learned my addr 172.21.15.69:0/2711330030 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:27.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.349+0000 7fbf199e4700 1 --2- 172.21.15.69:0/2711330030 >> v2:172.21.15.88:3300/0 conn(0x7fbf140cb970 0x7fbf14159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:27.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.350+0000 7fbf1a9e6700 1 -- 172.21.15.69:0/2711330030 >> v2:172.21.15.88:3300/0 conn(0x7fbf140cb970 msgr2=0x7fbf14159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:27.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.350+0000 7fbf1a9e6700 1 --2- 172.21.15.69:0/2711330030 >> v2:172.21.15.88:3300/0 conn(0x7fbf140cb970 0x7fbf14159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:27.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.350+0000 7fbf1a9e6700 1 -- 172.21.15.69:0/2711330030 >> v1:172.21.15.88:6789/0 conn(0x7fbf140cb5a0 legacy=0x7fbf140cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:27.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.350+0000 7fbf1a9e6700 1 -- 172.21.15.69:0/2711330030 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1415ab60 con 0x7fbf1415a400 2023-10-06T01:38:27.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.350+0000 7fbf1a9e6700 1 --2- 172.21.15.69:0/2711330030 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf1415a400 0x7fbf14156e90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbf140d1780 tx=0x7fbf0c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a0a0b83cacc4cee server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:27.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.350+0000 7fbf191e3700 1 -- 172.21.15.69:0/2711330030 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c00e070 con 0x7fbf1415a400 2023-10-06T01:38:27.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.350+0000 7fbf191e3700 1 -- 172.21.15.69:0/2711330030 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf0c00ba20 con 0x7fbf1415a400 2023-10-06T01:38:27.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.350+0000 7fbf191e3700 1 -- 172.21.15.69:0/2711330030 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c0092e0 con 0x7fbf1415a400 2023-10-06T01:38:27.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.350+0000 7fbf1c449700 1 -- 172.21.15.69:0/2711330030 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf1415a400 msgr2=0x7fbf14156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:27.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.350+0000 7fbf1c449700 1 --2- 172.21.15.69:0/2711330030 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf1415a400 0x7fbf14156e90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbf140d1780 tx=0x7fbf0c009840 comp rx=0 tx=0).stop 2023-10-06T01:38:27.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.351+0000 7fbf1c449700 1 -- 172.21.15.69:0/2711330030 shutdown_connections 2023-10-06T01:38:27.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.351+0000 7fbf1c449700 1 --2- 172.21.15.69:0/2711330030 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf1415a400 0x7fbf14156e90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:27.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.351+0000 7fbf1c449700 1 --2- 172.21.15.69:0/2711330030 >> v2:172.21.15.88:3300/0 conn(0x7fbf140cb970 0x7fbf14159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:27.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.351+0000 7fbf1c449700 1 -- 172.21.15.69:0/2711330030 >> 172.21.15.69:0/2711330030 conn(0x7fbf14070e30 msgr2=0x7fbf140d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:27.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.351+0000 7fbf1c449700 1 -- 172.21.15.69:0/2711330030 shutdown_connections 2023-10-06T01:38:27.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.351+0000 7fbf1c449700 1 -- 172.21.15.69:0/2711330030 wait complete. 2023-10-06T01:38:27.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.352+0000 7fbf1c449700 1 Processor -- start 2023-10-06T01:38:27.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.352+0000 7fbf1c449700 1 -- start start 2023-10-06T01:38:27.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.352+0000 7fbf1c449700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf140cb5a0 0x7fbf141512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:27.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.352+0000 7fbf1c449700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf140cb970 0x7fbf14154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:27.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.352+0000 7fbf1c449700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbf1415a400 0x7fbf141545c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:27.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.352+0000 7fbf1c449700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf141517f0 con 0x7fbf140cb5a0 2023-10-06T01:38:27.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.352+0000 7fbf1c449700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf140c9d10 con 0x7fbf140cb970 2023-10-06T01:38:27.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.352+0000 7fbf1c449700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf140c9ff0 con 0x7fbf1415a400 2023-10-06T01:38:27.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.352+0000 7fbf1a1e5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf140cb5a0 0x7fbf141512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:27.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.353+0000 7fbf1a1e5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf140cb5a0 0x7fbf141512b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38338/0 (socket says 172.21.15.69:38338) 2023-10-06T01:38:27.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.353+0000 7fbf1a1e5700 1 -- 172.21.15.69:0/1005197419 learned_addr learned my addr 172.21.15.69:0/1005197419 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:27.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.353+0000 7fbf199e4700 1 --2- 172.21.15.69:0/1005197419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf140cb970 0x7fbf14154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:27.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.353+0000 7fbf1a9e6700 1 --2- 172.21.15.69:0/1005197419 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbf1415a400 0x7fbf141545c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:27.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.353+0000 7fbf1a1e5700 1 -- 172.21.15.69:0/1005197419 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbf1415a400 msgr2=0x7fbf141545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:27.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.353+0000 7fbf1a1e5700 1 --2- 172.21.15.69:0/1005197419 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbf1415a400 0x7fbf141545c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:27.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.353+0000 7fbf1a1e5700 1 -- 172.21.15.69:0/1005197419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf140cb970 msgr2=0x7fbf14154080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:27.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.353+0000 7fbf1a1e5700 1 --2- 172.21.15.69:0/1005197419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf140cb970 0x7fbf14154080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:27.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.353+0000 7fbf1a1e5700 1 -- 172.21.15.69:0/1005197419 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf0c009ae0 con 0x7fbf140cb5a0 2023-10-06T01:38:27.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.353+0000 7fbf1a1e5700 1 --2- 172.21.15.69:0/1005197419 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf140cb5a0 0x7fbf141512b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400c590 tx=0x7fbf0400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:27.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.353+0000 7fbf0a7fc700 1 -- 172.21.15.69:0/1005197419 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf04011590 con 0x7fbf140cb5a0 2023-10-06T01:38:27.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.353+0000 7fbf0a7fc700 1 -- 172.21.15.69:0/1005197419 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf04011710 con 0x7fbf140cb5a0 2023-10-06T01:38:27.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.353+0000 7fbf1c449700 1 -- 172.21.15.69:0/1005197419 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf140ca2d0 con 0x7fbf140cb5a0 2023-10-06T01:38:27.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.353+0000 7fbf0a7fc700 1 -- 172.21.15.69:0/1005197419 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf04011ad0 con 0x7fbf140cb5a0 2023-10-06T01:38:27.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.353+0000 7fbf1c449700 1 -- 172.21.15.69:0/1005197419 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf1415b110 con 0x7fbf140cb5a0 2023-10-06T01:38:27.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.353+0000 7fbf0a7fc700 1 -- 172.21.15.69:0/1005197419 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fbf0401c6c0 con 0x7fbf140cb5a0 2023-10-06T01:38:27.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.353+0000 7fbf0a7fc700 1 -- 172.21.15.69:0/1005197419 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fbf04012b00 con 0x7fbf140cb5a0 2023-10-06T01:38:27.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.354+0000 7fbf1c449700 1 -- 172.21.15.69:0/1005197419 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf1415b330 con 0x7fbf140cb5a0 2023-10-06T01:38:27.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.356+0000 7fbf0a7fc700 1 -- 172.21.15.69:0/1005197419 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fbf04017070 con 0x7fbf140cb5a0 2023-10-06T01:38:27.364 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:38:27.363+0000 7f9689952180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T01:38:27.404 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-06T01:38:27.404+0000 7f760eaa8180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-06T01:38:27.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.425+0000 7fbf1c449700 1 -- 172.21.15.69:0/1005197419 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf1404c3c0 con 0x7fbf140cb5a0 2023-10-06T01:38:27.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.425+0000 7fbf0a7fc700 1 -- 172.21.15.69:0/1005197419 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fbf0401cba0 con 0x7fbf140cb5a0 2023-10-06T01:38:27.427 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:38:27.427 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":10,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:38:27.153763+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:38:27.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.426+0000 7fbf1c449700 1 -- 172.21.15.69:0/1005197419 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf140cb5a0 msgr2=0x7fbf141512b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:27.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.426+0000 7fbf1c449700 1 --2- 172.21.15.69:0/1005197419 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf140cb5a0 0x7fbf141512b0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbf0400c590 tx=0x7fbf0400c8a0 comp rx=0 tx=0).stop 2023-10-06T01:38:27.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.426+0000 7fbf1c449700 1 -- 172.21.15.69:0/1005197419 shutdown_connections 2023-10-06T01:38:27.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.426+0000 7fbf1c449700 1 --2- 172.21.15.69:0/1005197419 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbf1415a400 0x7fbf141545c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:27.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.426+0000 7fbf1c449700 1 --2- 172.21.15.69:0/1005197419 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf140cb5a0 0x7fbf141512b0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:27.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.426+0000 7fbf1c449700 1 --2- 172.21.15.69:0/1005197419 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbf140cb970 0x7fbf14154080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:27.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.426+0000 7fbf1c449700 1 -- 172.21.15.69:0/1005197419 >> 172.21.15.69:0/1005197419 conn(0x7fbf14070e30 msgr2=0x7fbf14155e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:27.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.426+0000 7fbf1c449700 1 -- 172.21.15.69:0/1005197419 shutdown_connections 2023-10-06T01:38:27.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:27.426+0000 7fbf1c449700 1 -- 172.21.15.69:0/1005197419 wait complete. 2023-10-06T01:38:27.439 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-06T01:38:27.440 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-06T01:38:27.445 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:38:27.444+0000 7f9689952180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T01:38:27.481 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-06T01:38:27.480+0000 7f760eaa8180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-06T01:38:27.523 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:38:27.522+0000 7f9689952180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T01:38:27.559 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-06T01:38:27.559+0000 7f760eaa8180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-06T01:38:27.774 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-10-06T01:38:27.773+0000 7fa9e0642540 -1 Falling back to public interface 2023-10-06T01:38:27.788 INFO:tasks.ceph.osd.2.smithi069.stderr:2023-10-06T01:38:27.787+0000 7fc764913540 -1 Falling back to public interface 2023-10-06T01:38:27.793 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-10-06T01:38:27.791+0000 7fa83054b540 -1 Falling back to public interface 2023-10-06T01:38:27.795 INFO:tasks.ceph.osd.5.smithi088.stderr:2023-10-06T01:38:27.794+0000 7f23ba777540 -1 Falling back to public interface 2023-10-06T01:38:27.795 INFO:tasks.ceph.osd.4.smithi088.stderr:2023-10-06T01:38:27.795+0000 7f06dde9d540 -1 Falling back to public interface 2023-10-06T01:38:27.797 INFO:tasks.ceph.osd.3.smithi069.stderr:2023-10-06T01:38:27.796+0000 7f25e4040540 -1 Falling back to public interface 2023-10-06T01:38:27.808 INFO:tasks.ceph.osd.7.smithi088.stderr:2023-10-06T01:38:27.807+0000 7f5700e64540 -1 Falling back to public interface 2023-10-06T01:38:27.808 INFO:tasks.ceph.osd.6.smithi088.stderr:2023-10-06T01:38:27.807+0000 7f69e8532540 -1 Falling back to public interface 2023-10-06T01:38:28.103 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:38:28.102+0000 7f9689952180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T01:38:28.141 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-06T01:38:28.140+0000 7f760eaa8180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-06T01:38:28.240 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:38:28.238+0000 7f9689952180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T01:38:28.246 DEBUG:teuthology.orchestra.run.smithi069:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T01:38:28.278 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-06T01:38:28.277+0000 7f760eaa8180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-06T01:38:28.334 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:38:28.332+0000 7f9689952180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T01:38:28.354 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.353+0000 7f93f4c43700 1 Processor -- start 2023-10-06T01:38:28.354 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.353+0000 7f93f4c43700 1 -- start start 2023-10-06T01:38:28.356 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.354+0000 7f93f4c43700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f93f0156720 0x7f93f00add50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:28.356 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.354+0000 7f93f4c43700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f93f0156af0 0x7f93f015add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:28.356 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.354+0000 7f93f4c43700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f015b310 con 0x7f93f00c8c00 2023-10-06T01:38:28.357 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.354+0000 7f93f4c43700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f00ca810 con 0x7f93f0156af0 2023-10-06T01:38:28.357 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.354+0000 7f93f4c43700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f00679c0 con 0x7f93f0156720 2023-10-06T01:38:28.357 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.354+0000 7f93edd9b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f93f0156af0 0x7f93f015add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:28.357 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.354+0000 7f93edd9b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f93f0156af0 0x7f93f015add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38354/0 (socket says 172.21.15.69:38354) 2023-10-06T01:38:28.357 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.354+0000 7f93edd9b700 1 -- 172.21.15.69:0/102329944 learned_addr learned my addr 172.21.15.69:0/102329944 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:28.357 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.354+0000 7f93ee59c700 1 --2- 172.21.15.69:0/102329944 >> v2:172.21.15.88:3300/0 conn(0x7f93f0156720 0x7f93f00add50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:28.357 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.354+0000 7f93edd9b700 1 -- 172.21.15.69:0/102329944 >> v2:172.21.15.88:3300/0 conn(0x7f93f0156720 msgr2=0x7f93f00add50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:28.357 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.354+0000 7f93ed59a700 1 -- 172.21.15.69:0/102329944 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2444234191 0 0) 0x7f93f015b310 con 0x7f93f00c8c00 2023-10-06T01:38:28.357 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.354+0000 7f93edd9b700 1 --2- 172.21.15.69:0/102329944 >> v2:172.21.15.88:3300/0 conn(0x7f93f0156720 0x7f93f00add50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:28.357 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.354+0000 7f93edd9b700 1 -- 172.21.15.69:0/102329944 >> v1:172.21.15.88:6789/0 conn(0x7f93f00c8c00 legacy=0x7f93f00c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:28.357 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.354+0000 7f93edd9b700 1 -- 172.21.15.69:0/102329944 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f0067ca0 con 0x7f93f0156af0 2023-10-06T01:38:28.357 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.354+0000 7f93edd9b700 1 --2- 172.21.15.69:0/102329944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93f0156af0 0x7f93f015add0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f93f00633e0 tx=0x7f93d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f941ca84b7ad3d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:28.358 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.354+0000 7f93ed59a700 1 -- 172.21.15.69:0/102329944 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d8009e70 con 0x7f93f0156af0 2023-10-06T01:38:28.358 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.354+0000 7f93ed59a700 1 -- 172.21.15.69:0/102329944 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d800b860 con 0x7f93f0156af0 2023-10-06T01:38:28.358 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.354+0000 7f93ed59a700 1 -- 172.21.15.69:0/102329944 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d800bc00 con 0x7f93f0156af0 2023-10-06T01:38:28.358 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.355+0000 7f93f4c43700 1 -- 172.21.15.69:0/102329944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93f0156af0 msgr2=0x7f93f015add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:28.358 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.355+0000 7f93f4c43700 1 --2- 172.21.15.69:0/102329944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93f0156af0 0x7f93f015add0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f93f00633e0 tx=0x7f93d8009250 comp rx=0 tx=0).stop 2023-10-06T01:38:28.358 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.355+0000 7f93f4c43700 1 -- 172.21.15.69:0/102329944 shutdown_connections 2023-10-06T01:38:28.358 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.355+0000 7f93f4c43700 1 --2- 172.21.15.69:0/102329944 >> v2:172.21.15.88:3300/0 conn(0x7f93f0156720 0x7f93f00add50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:28.358 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.355+0000 7f93f4c43700 1 --2- 172.21.15.69:0/102329944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93f0156af0 0x7f93f015add0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:28.358 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.355+0000 7f93f4c43700 1 -- 172.21.15.69:0/102329944 >> 172.21.15.69:0/102329944 conn(0x7f93f006e1a0 msgr2=0x7f93f00c9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:28.358 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.355+0000 7f93f4c43700 1 -- 172.21.15.69:0/102329944 shutdown_connections 2023-10-06T01:38:28.358 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.355+0000 7f93f4c43700 1 -- 172.21.15.69:0/102329944 wait complete. 2023-10-06T01:38:28.361 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.356+0000 7f93f4c43700 1 Processor -- start 2023-10-06T01:38:28.361 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.356+0000 7f93f4c43700 1 -- start start 2023-10-06T01:38:28.361 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.357+0000 7f93f4c43700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93f00c8c00 0x7f93f00c2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:28.361 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.357+0000 7f93f4c43700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93f0156720 0x7f93f0159470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:28.361 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.357+0000 7f93f4c43700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93f0156af0 0x7f93f00c0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:28.361 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.357+0000 7f93f4c43700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f0158850 con 0x7f93f0156720 2023-10-06T01:38:28.361 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.357+0000 7f93f4c43700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f0157c40 con 0x7f93f00c8c00 2023-10-06T01:38:28.361 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.357+0000 7f93f4c43700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f0157f20 con 0x7f93f0156af0 2023-10-06T01:38:28.361 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.357+0000 7f93edd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93f0156720 0x7f93f0159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:28.362 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.357+0000 7f93ee59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93f00c8c00 0x7f93f00c2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:28.362 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.357+0000 7f93ee59c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93f00c8c00 0x7f93f00c2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.69:48976/0 (socket says 172.21.15.69:48976) 2023-10-06T01:38:28.362 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.357+0000 7f93edd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93f0156720 0x7f93f0159470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38364/0 (socket says 172.21.15.69:38364) 2023-10-06T01:38:28.362 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.357+0000 7f93ee59c700 1 -- 172.21.15.69:0/3185685732 learned_addr learned my addr 172.21.15.69:0/3185685732 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:28.362 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.357+0000 7f93eed9d700 1 --2- 172.21.15.69:0/3185685732 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93f0156af0 0x7f93f00c0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:28.362 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.357+0000 7f93ee59c700 1 -- 172.21.15.69:0/3185685732 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93f0156af0 msgr2=0x7f93f00c0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:28.362 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.357+0000 7f93ee59c700 1 --2- 172.21.15.69:0/3185685732 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93f0156af0 0x7f93f00c0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:28.362 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.357+0000 7f93ee59c700 1 -- 172.21.15.69:0/3185685732 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93f0156720 msgr2=0x7f93f0159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:28.362 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.357+0000 7f93ee59c700 1 --2- 172.21.15.69:0/3185685732 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93f0156720 0x7f93f0159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:28.362 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.357+0000 7f93ee59c700 1 -- 172.21.15.69:0/3185685732 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d80094f0 con 0x7f93f00c8c00 2023-10-06T01:38:28.362 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.357+0000 7f93ee59c700 1 --2- 172.21.15.69:0/3185685732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93f00c8c00 0x7f93f00c2690 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f93e000ec80 tx=0x7f93e00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:28.362 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.358+0000 7f93e67fc700 1 -- 172.21.15.69:0/3185685732 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e000c850 con 0x7f93f00c8c00 2023-10-06T01:38:28.363 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.358+0000 7f93e67fc700 1 -- 172.21.15.69:0/3185685732 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e000c9b0 con 0x7f93f00c8c00 2023-10-06T01:38:28.363 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.358+0000 7f93f4c43700 1 -- 172.21.15.69:0/3185685732 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f0158200 con 0x7f93f00c8c00 2023-10-06T01:38:28.363 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.358+0000 7f93e67fc700 1 -- 172.21.15.69:0/3185685732 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e000cd50 con 0x7f93f00c8c00 2023-10-06T01:38:28.363 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.358+0000 7f93f4c43700 1 -- 172.21.15.69:0/3185685732 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f01578f0 con 0x7f93f00c8c00 2023-10-06T01:38:28.363 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.358+0000 7f93e67fc700 1 -- 172.21.15.69:0/3185685732 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f93e0005c80 con 0x7f93f00c8c00 2023-10-06T01:38:28.363 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.358+0000 7f93e67fc700 1 -- 172.21.15.69:0/3185685732 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f93e0013680 con 0x7f93f00c8c00 2023-10-06T01:38:28.363 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.358+0000 7f93f4c43700 1 -- 172.21.15.69:0/3185685732 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f0166b40 con 0x7f93f00c8c00 2023-10-06T01:38:28.363 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.361+0000 7f93e67fc700 1 -- 172.21.15.69:0/3185685732 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f93e0021060 con 0x7f93f00c8c00 2023-10-06T01:38:28.368 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-06T01:38:28.368+0000 7f760eaa8180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-06T01:38:28.431 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.430+0000 7f93f4c43700 1 -- 172.21.15.69:0/3185685732 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f93f004c3c0 con 0x7f93f00c8c00 2023-10-06T01:38:28.431 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.430+0000 7f93e67fc700 1 -- 172.21.15.69:0/3185685732 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f93e0029020 con 0x7f93f00c8c00 2023-10-06T01:38:28.432 INFO:teuthology.misc.health.smithi069.stdout: 2023-10-06T01:38:28.432 INFO:teuthology.misc.health.smithi069.stdout:{"epoch":10,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:38:27.153763+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:38:28.433 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.431+0000 7f93f4c43700 1 -- 172.21.15.69:0/3185685732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93f00c8c00 msgr2=0x7f93f00c2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:28.433 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.431+0000 7f93f4c43700 1 --2- 172.21.15.69:0/3185685732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93f00c8c00 0x7f93f00c2690 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f93e000ec80 tx=0x7f93e00091a0 comp rx=0 tx=0).stop 2023-10-06T01:38:28.433 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.431+0000 7f93f4c43700 1 -- 172.21.15.69:0/3185685732 shutdown_connections 2023-10-06T01:38:28.433 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.431+0000 7f93f4c43700 1 --2- 172.21.15.69:0/3185685732 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93f0156af0 0x7f93f00c0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:28.433 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.431+0000 7f93f4c43700 1 --2- 172.21.15.69:0/3185685732 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93f00c8c00 0x7f93f00c2690 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:28.433 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.431+0000 7f93f4c43700 1 --2- 172.21.15.69:0/3185685732 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93f0156720 0x7f93f0159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:28.434 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.431+0000 7f93f4c43700 1 -- 172.21.15.69:0/3185685732 >> 172.21.15.69:0/3185685732 conn(0x7f93f006e1a0 msgr2=0x7f93f00cd420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:28.434 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.431+0000 7f93f4c43700 1 -- 172.21.15.69:0/3185685732 shutdown_connections 2023-10-06T01:38:28.434 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:28.431+0000 7f93f4c43700 1 -- 172.21.15.69:0/3185685732 wait complete. 2023-10-06T01:38:28.444 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T01:38:28.585 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:38:28.584+0000 7f9689952180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T01:38:28.613 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-06T01:38:28.612+0000 7f760eaa8180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-06T01:38:28.664 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:38:28.663+0000 7f9689952180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T01:38:28.691 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-06T01:38:28.691+0000 7f760eaa8180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-06T01:38:29.483 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:38:29.482+0000 7f9689952180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T01:38:29.513 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-06T01:38:29.512+0000 7f760eaa8180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-06T01:38:29.557 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:38:29.555+0000 7f9689952180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T01:38:29.585 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-06T01:38:29.585+0000 7f760eaa8180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-06T01:38:29.630 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:38:29.629+0000 7f9689952180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T01:38:29.658 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-06T01:38:29.657+0000 7f760eaa8180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-06T01:38:29.764 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:38:29.763+0000 7f9689952180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T01:38:29.792 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-06T01:38:29.791+0000 7f760eaa8180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-06T01:38:29.847 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:38:29.846+0000 7f9689952180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T01:38:29.876 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-06T01:38:29.876+0000 7f760eaa8180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-06T01:38:29.999 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:38:29.997+0000 7f9689952180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T01:38:30.024 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-06T01:38:30.024+0000 7f760eaa8180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-06T01:38:30.075 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:38:30.074+0000 7f9689952180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T01:38:30.102 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-06T01:38:30.101+0000 7f760eaa8180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-06T01:38:30.149 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:38:30.148+0000 7f9689952180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T01:38:30.176 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-06T01:38:30.175+0000 7f760eaa8180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-06T01:38:30.225 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:38:30.223+0000 7f9689952180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T01:38:30.251 INFO:tasks.ceph.mgr.x.smithi088.stderr:2023-10-06T01:38:30.251+0000 7f760eaa8180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-06T01:38:31.249 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:38:31.248+0000 7f9642d53700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-06T01:38:31.250 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:38:31.249+0000 7f9642d53700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-06T01:38:31.264 INFO:tasks.ceph.osd.2.smithi069.stderr:2023-10-06T01:38:31.263+0000 7fc764913540 -1 osd.2 0 log_to_monitors true 2023-10-06T01:38:31.297 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-10-06T01:38:31.296+0000 7fa9e0642540 -1 osd.1 0 log_to_monitors true 2023-10-06T01:38:31.310 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-10-06T01:38:31.309+0000 7fa83054b540 -1 osd.0 0 log_to_monitors true 2023-10-06T01:38:31.329 INFO:tasks.ceph.osd.3.smithi069.stderr:2023-10-06T01:38:31.328+0000 7f25e4040540 -1 osd.3 0 log_to_monitors true 2023-10-06T01:38:31.352 INFO:tasks.ceph.osd.5.smithi088.stderr:2023-10-06T01:38:31.352+0000 7f23ba777540 -1 osd.5 0 log_to_monitors true 2023-10-06T01:38:31.402 INFO:tasks.ceph.osd.6.smithi088.stderr:2023-10-06T01:38:31.401+0000 7f69e8532540 -1 osd.6 0 log_to_monitors true 2023-10-06T01:38:31.406 INFO:tasks.ceph.osd.4.smithi088.stderr:2023-10-06T01:38:31.405+0000 7f06dde9d540 -1 osd.4 0 log_to_monitors true 2023-10-06T01:38:31.406 INFO:tasks.ceph.osd.7.smithi088.stderr:2023-10-06T01:38:31.405+0000 7f5700e64540 -1 osd.7 0 log_to_monitors true 2023-10-06T01:38:35.251 DEBUG:teuthology.orchestra.run.smithi069:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T01:38:35.267 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-10-06T01:38:35.266+0000 7fa9d8a67700 -1 osd.1 0 waiting for initial osdmap 2023-10-06T01:38:35.273 INFO:tasks.ceph.osd.1.smithi069.stderr:2023-10-06T01:38:35.270+0000 7fa9d005b700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T01:38:35.277 INFO:tasks.ceph.osd.4.smithi088.stderr:2023-10-06T01:38:35.276+0000 7f06d62c2700 -1 osd.4 0 waiting for initial osdmap 2023-10-06T01:38:35.279 INFO:tasks.ceph.osd.5.smithi088.stderr:2023-10-06T01:38:35.278+0000 7f23b2b9c700 -1 osd.5 0 waiting for initial osdmap 2023-10-06T01:38:35.283 INFO:tasks.ceph.osd.6.smithi088.stderr:2023-10-06T01:38:35.282+0000 7f69df154700 -1 osd.6 0 waiting for initial osdmap 2023-10-06T01:38:35.283 INFO:tasks.ceph.osd.7.smithi088.stderr:2023-10-06T01:38:35.283+0000 7f56f7a86700 -1 osd.7 0 waiting for initial osdmap 2023-10-06T01:38:35.283 INFO:tasks.ceph.osd.4.smithi088.stderr:2023-10-06T01:38:35.283+0000 7f06cd8b6700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T01:38:35.285 INFO:tasks.ceph.osd.5.smithi088.stderr:2023-10-06T01:38:35.285+0000 7f23aa190700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T01:38:35.289 INFO:tasks.ceph.osd.6.smithi088.stderr:2023-10-06T01:38:35.288+0000 7f69d7f4b700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T01:38:35.289 INFO:tasks.ceph.osd.3.smithi069.stderr:2023-10-06T01:38:35.288+0000 7f25dc465700 -1 osd.3 0 waiting for initial osdmap 2023-10-06T01:38:35.291 INFO:tasks.ceph.osd.7.smithi088.stderr:2023-10-06T01:38:35.290+0000 7f56f087d700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T01:38:35.294 INFO:tasks.ceph.osd.3.smithi069.stderr:2023-10-06T01:38:35.293+0000 7f25d3a59700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T01:38:35.298 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-10-06T01:38:35.297+0000 7fa82716d700 -1 osd.0 0 waiting for initial osdmap 2023-10-06T01:38:35.303 INFO:tasks.ceph.osd.0.smithi069.stderr:2023-10-06T01:38:35.302+0000 7fa81ff64700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T01:38:35.310 INFO:tasks.ceph.osd.2.smithi069.stderr:2023-10-06T01:38:35.309+0000 7fc75b535700 -1 osd.2 0 waiting for initial osdmap 2023-10-06T01:38:35.315 INFO:tasks.ceph.osd.2.smithi069.stderr:2023-10-06T01:38:35.314+0000 7fc75432c700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-06T01:38:35.378 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.376+0000 7f1cadd82700 1 Processor -- start 2023-10-06T01:38:35.378 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.376+0000 7f1cadd82700 1 -- start start 2023-10-06T01:38:35.381 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.377+0000 7f1cadd82700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1ca8157740 0x7f1ca806cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:35.381 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.377+0000 7f1cadd82700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca815b1f0 con 0x7f1ca80c7e50 2023-10-06T01:38:35.381 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.377+0000 7f1cadd82700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ca8068400 con 0x7f1ca80c79e0 2023-10-06T01:38:35.381 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.377+0000 7f1cadd82700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca806d4c0 con 0x7f1ca8157740 2023-10-06T01:38:35.381 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.377+0000 7f1ca7fff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f1ca80c7e50 0x7f1ca8067cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:43220/0 (socket says 172.21.15.69:43220) 2023-10-06T01:38:35.381 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.377+0000 7f1ca7fff700 1 -- 172.21.15.69:0/4053316302 learned_addr learned my addr 172.21.15.69:0/4053316302 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:38:35.381 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.378+0000 7f1ca77fe700 1 --2- 172.21.15.69:0/4053316302 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1ca8157740 0x7f1ca806cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:35.381 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.378+0000 7f1ca67fc700 1 -- 172.21.15.69:0/4053316302 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 534320803 0 0) 0x7f1ca815b1f0 con 0x7f1ca80c7e50 2023-10-06T01:38:35.381 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.378+0000 7f1ca67fc700 1 -- 172.21.15.69:0/4053316302 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c90003570 con 0x7f1ca80c7e50 2023-10-06T01:38:35.381 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.378+0000 7f1ca67fc700 1 -- 172.21.15.69:0/4053316302 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1992613077 0 0) 0x7f1ca8068400 con 0x7f1ca80c79e0 2023-10-06T01:38:35.381 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.378+0000 7f1ca67fc700 1 -- 172.21.15.69:0/4053316302 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ca815b1f0 con 0x7f1ca80c79e0 2023-10-06T01:38:35.382 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.378+0000 7f1ca77fe700 1 -- 172.21.15.69:0/4053316302 >> v1:172.21.15.88:6789/0 conn(0x7f1ca80c79e0 legacy=0x7f1ca80675e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:35.382 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.378+0000 7f1ca77fe700 1 -- 172.21.15.69:0/4053316302 >> v1:172.21.15.69:6789/0 conn(0x7f1ca80c7e50 legacy=0x7f1ca8067cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:35.382 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.378+0000 7f1ca67fc700 1 -- 172.21.15.69:0/4053316302 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1319252327 0 0) 0x7f1c90003570 con 0x7f1ca80c7e50 2023-10-06T01:38:35.382 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.378+0000 7f1ca77fe700 1 -- 172.21.15.69:0/4053316302 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca815a370 con 0x7f1ca8157740 2023-10-06T01:38:35.382 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.378+0000 7f1ca77fe700 1 --2- 172.21.15.69:0/4053316302 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1ca8157740 0x7f1ca806cf80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1c98009e90 tx=0x7f1c98009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ff3e6475b5754410 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:35.382 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.378+0000 7f1ca67fc700 1 -- 172.21.15.69:0/4053316302 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9800e070 con 0x7f1ca8157740 2023-10-06T01:38:35.382 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.378+0000 7f1ca67fc700 1 -- 172.21.15.69:0/4053316302 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9800b870 con 0x7f1ca8157740 2023-10-06T01:38:35.382 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.378+0000 7f1ca67fc700 1 -- 172.21.15.69:0/4053316302 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca0001470 con 0x7f1ca8157740 2023-10-06T01:38:35.382 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.379+0000 7f1cadd82700 1 -- 172.21.15.69:0/4053316302 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1ca8157740 msgr2=0x7f1ca806cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:35.382 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.379+0000 7f1cadd82700 1 --2- 172.21.15.69:0/4053316302 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1ca8157740 0x7f1ca806cf80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f1c98009e90 tx=0x7f1c98009780 comp rx=0 tx=0).stop 2023-10-06T01:38:35.382 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.379+0000 7f1cadd82700 1 -- 172.21.15.69:0/4053316302 shutdown_connections 2023-10-06T01:38:35.382 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.379+0000 7f1cadd82700 1 --2- 172.21.15.69:0/4053316302 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1ca8157740 0x7f1ca806cf80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:35.383 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.379+0000 7f1cadd82700 1 -- 172.21.15.69:0/4053316302 >> 172.21.15.69:0/4053316302 conn(0x7f1ca806e1a0 msgr2=0x7f1ca80c9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:35.383 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.379+0000 7f1cadd82700 1 -- 172.21.15.69:0/4053316302 shutdown_connections 2023-10-06T01:38:35.383 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.379+0000 7f1cadd82700 1 -- 172.21.15.69:0/4053316302 wait complete. 2023-10-06T01:38:35.385 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.380+0000 7f1cadd82700 1 Processor -- start 2023-10-06T01:38:35.385 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.380+0000 7f1cadd82700 1 -- start start 2023-10-06T01:38:35.385 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.381+0000 7f1cadd82700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ca80c79e0 0x7f1ca80b13d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:35.385 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.381+0000 7f1cadd82700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1ca80c7e50 0x7f1ca8151250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:35.385 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.381+0000 7f1cadd82700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ca8157740 0x7f1ca8155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:35.386 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.381+0000 7f1cadd82700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca816e2d0 con 0x7f1ca80c79e0 2023-10-06T01:38:35.386 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.381+0000 7f1cadd82700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca816d6c0 con 0x7f1ca8157740 2023-10-06T01:38:35.386 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.381+0000 7f1cadd82700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca816d9a0 con 0x7f1ca80c7e50 2023-10-06T01:38:35.386 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.381+0000 7f1ca77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ca80c79e0 0x7f1ca80b13d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:35.386 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.381+0000 7f1ca77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ca80c79e0 0x7f1ca80b13d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38492/0 (socket says 172.21.15.69:38492) 2023-10-06T01:38:35.386 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.381+0000 7f1ca77fe700 1 -- 172.21.15.69:0/662862310 learned_addr learned my addr 172.21.15.69:0/662862310 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:35.386 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.381+0000 7f1ca7fff700 1 --2- 172.21.15.69:0/662862310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ca8157740 0x7f1ca8155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:35.386 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.381+0000 7f1ca6ffd700 1 --2- 172.21.15.69:0/662862310 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1ca80c7e50 0x7f1ca8151250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:35.386 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.381+0000 7f1ca77fe700 1 -- 172.21.15.69:0/662862310 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1ca80c7e50 msgr2=0x7f1ca8151250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:35.386 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.381+0000 7f1ca77fe700 1 --2- 172.21.15.69:0/662862310 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1ca80c7e50 0x7f1ca8151250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:35.386 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.381+0000 7f1ca77fe700 1 -- 172.21.15.69:0/662862310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ca8157740 msgr2=0x7f1ca8155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:35.386 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.381+0000 7f1ca77fe700 1 --2- 172.21.15.69:0/662862310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ca8157740 0x7f1ca8155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:35.387 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.381+0000 7f1ca77fe700 1 -- 172.21.15.69:0/662862310 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c98009a20 con 0x7f1ca80c79e0 2023-10-06T01:38:35.387 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.381+0000 7f1ca77fe700 1 --2- 172.21.15.69:0/662862310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ca80c79e0 0x7f1ca80b13d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1c980097c0 tx=0x7f1c98017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:35.387 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.381+0000 7f1c8f7fe700 1 -- 172.21.15.69:0/662862310 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c98001090 con 0x7f1ca80c79e0 2023-10-06T01:38:35.387 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.381+0000 7f1c8f7fe700 1 -- 172.21.15.69:0/662862310 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c98012b70 con 0x7f1ca80c79e0 2023-10-06T01:38:35.387 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.381+0000 7f1cadd82700 1 -- 172.21.15.69:0/662862310 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca816dc80 con 0x7f1ca80c79e0 2023-10-06T01:38:35.387 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.381+0000 7f1c8f7fe700 1 -- 172.21.15.69:0/662862310 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9801e450 con 0x7f1ca80c79e0 2023-10-06T01:38:35.387 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.382+0000 7f1cadd82700 1 -- 172.21.15.69:0/662862310 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca8151790 con 0x7f1ca80c79e0 2023-10-06T01:38:35.387 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.382+0000 7f1cadd82700 1 -- 172.21.15.69:0/662862310 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca804c3c0 con 0x7f1ca80c79e0 2023-10-06T01:38:35.387 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.383+0000 7f1c8f7fe700 1 -- 172.21.15.69:0/662862310 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f1c9801e840 con 0x7f1ca80c79e0 2023-10-06T01:38:35.387 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.383+0000 7f1c8f7fe700 1 --2- 172.21.15.69:0/662862310 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1c94066ea0 0x7f1c94069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:35.387 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.383+0000 7f1c8f7fe700 1 -- 172.21.15.69:0/662862310 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7f1c98085850 con 0x7f1ca80c79e0 2023-10-06T01:38:35.387 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.383+0000 7f1ca6ffd700 1 --2- 172.21.15.69:0/662862310 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1c94066ea0 0x7f1c94069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:35.388 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.383+0000 7f1ca6ffd700 1 --2- 172.21.15.69:0/662862310 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1c94066ea0 0x7f1c94069350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80cd0a0 tx=0x7f1c9c007d50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:35.389 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.388+0000 7f1c8f7fe700 1 -- 172.21.15.69:0/662862310 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c98053930 con 0x7f1ca80c79e0 2023-10-06T01:38:35.574 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.573+0000 7f1cadd82700 1 -- 172.21.15.69:0/662862310 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ca80c4210 con 0x7f1ca80c79e0 2023-10-06T01:38:35.575 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.574+0000 7f1c8f7fe700 1 -- 172.21.15.69:0/662862310 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f1c98016090 con 0x7f1ca80c79e0 2023-10-06T01:38:35.575 INFO:teuthology.misc.health.smithi069.stdout: 2023-10-06T01:38:35.575 INFO:teuthology.misc.health.smithi069.stdout:{"epoch":12,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:38:33.245469+0000","last_up_change":"0.000000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:38:35.578 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.576+0000 7f1cadd82700 1 -- 172.21.15.69:0/662862310 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1c94066ea0 msgr2=0x7f1c94069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:35.578 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.576+0000 7f1cadd82700 1 --2- 172.21.15.69:0/662862310 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1c94066ea0 0x7f1c94069350 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f1ca80cd0a0 tx=0x7f1c9c007d50 comp rx=0 tx=0).stop 2023-10-06T01:38:35.578 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.576+0000 7f1cadd82700 1 -- 172.21.15.69:0/662862310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ca80c79e0 msgr2=0x7f1ca80b13d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:35.578 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.576+0000 7f1cadd82700 1 --2- 172.21.15.69:0/662862310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ca80c79e0 0x7f1ca80b13d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1c980097c0 tx=0x7f1c98017000 comp rx=0 tx=0).stop 2023-10-06T01:38:35.578 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.576+0000 7f1cadd82700 1 -- 172.21.15.69:0/662862310 shutdown_connections 2023-10-06T01:38:35.578 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.576+0000 7f1cadd82700 1 --2- 172.21.15.69:0/662862310 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1c94066ea0 0x7f1c94069350 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:35.578 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.576+0000 7f1cadd82700 1 --2- 172.21.15.69:0/662862310 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1ca8157740 0x7f1ca8155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:35.578 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.576+0000 7f1cadd82700 1 --2- 172.21.15.69:0/662862310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ca80c79e0 0x7f1ca80b13d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:35.579 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.576+0000 7f1cadd82700 1 --2- 172.21.15.69:0/662862310 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1ca80c7e50 0x7f1ca8151250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:35.579 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.576+0000 7f1cadd82700 1 -- 172.21.15.69:0/662862310 >> 172.21.15.69:0/662862310 conn(0x7f1ca806e1a0 msgr2=0x7f1ca815c700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:35.579 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.576+0000 7f1cadd82700 1 -- 172.21.15.69:0/662862310 shutdown_connections 2023-10-06T01:38:35.579 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:35.576+0000 7f1cadd82700 1 -- 172.21.15.69:0/662862310 wait complete. 2023-10-06T01:38:35.588 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-06T01:38:42.394 DEBUG:teuthology.orchestra.run.smithi069:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-06T01:38:42.511 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.509+0000 7f4bb3f36700 1 Processor -- start 2023-10-06T01:38:42.511 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.510+0000 7f4bb3f36700 1 -- start start 2023-10-06T01:38:42.513 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.510+0000 7f4bb3f36700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4bac0cd070 0x7f4bac0ad220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:42.513 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.510+0000 7f4bb3f36700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4bac0cd440 0x7f4bac0c6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:42.513 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.510+0000 7f4bb3f36700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4bac0c6bc0 0x7f4bac0cb490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:42.514 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.510+0000 7f4bb3f36700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bac159ed0 con 0x7f4bac0cd070 2023-10-06T01:38:42.514 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.510+0000 7f4bb3f36700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bac0c61f0 con 0x7f4bac0cd440 2023-10-06T01:38:42.514 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.510+0000 7f4bb3f36700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac0c5620 con 0x7f4bac0c6bc0 2023-10-06T01:38:42.514 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.511+0000 7f4bb1cd2700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4bac0cd070 0x7f4bac0ad220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:42.514 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.511+0000 7f4bb1cd2700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4bac0cd070 0x7f4bac0ad220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57838/0 (socket says 172.21.15.69:57838) 2023-10-06T01:38:42.514 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.511+0000 7f4bb1cd2700 1 -- 172.21.15.69:0/3073128178 learned_addr learned my addr 172.21.15.69:0/3073128178 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:42.514 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.511+0000 7f4bb14d1700 1 --2- 172.21.15.69:0/3073128178 >> v2:172.21.15.88:3300/0 conn(0x7f4bac0cd440 0x7f4bac0c6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:42.514 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.511+0000 7f4bb24d3700 1 --2- 172.21.15.69:0/3073128178 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4bac0c6bc0 0x7f4bac0cb490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:42.514 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.511+0000 7f4bb1cd2700 1 -- 172.21.15.69:0/3073128178 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4bac0c6bc0 msgr2=0x7f4bac0cb490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:42.514 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.511+0000 7f4bb1cd2700 1 --2- 172.21.15.69:0/3073128178 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4bac0c6bc0 0x7f4bac0cb490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:42.514 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.511+0000 7f4bb1cd2700 1 -- 172.21.15.69:0/3073128178 >> v2:172.21.15.88:3300/0 conn(0x7f4bac0cd440 msgr2=0x7f4bac0c6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:42.515 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.511+0000 7f4bb1cd2700 1 --2- 172.21.15.69:0/3073128178 >> v2:172.21.15.88:3300/0 conn(0x7f4bac0cd440 0x7f4bac0c6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:42.515 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.511+0000 7f4bb1cd2700 1 -- 172.21.15.69:0/3073128178 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bac0c58c0 con 0x7f4bac0cd070 2023-10-06T01:38:42.515 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.511+0000 7f4bb14d1700 1 --2- 172.21.15.69:0/3073128178 >> v2:172.21.15.88:3300/0 conn(0x7f4bac0cd440 0x7f4bac0c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:38:42.515 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.511+0000 7f4bb1cd2700 1 --2- 172.21.15.69:0/3073128178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4bac0cd070 0x7f4bac0ad220 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4bac063370 tx=0x7f4b9c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e7180084154715f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:42.515 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.511+0000 7f4bb0cd0700 1 -- 172.21.15.69:0/3073128178 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c00e070 con 0x7f4bac0cd070 2023-10-06T01:38:42.515 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.511+0000 7f4bb0cd0700 1 -- 172.21.15.69:0/3073128178 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c00ba20 con 0x7f4bac0cd070 2023-10-06T01:38:42.515 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.511+0000 7f4bb0cd0700 1 -- 172.21.15.69:0/3073128178 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c0092e0 con 0x7f4bac0cd070 2023-10-06T01:38:42.515 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.512+0000 7f4bb3f36700 1 -- 172.21.15.69:0/3073128178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4bac0cd070 msgr2=0x7f4bac0ad220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:42.515 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.512+0000 7f4bb3f36700 1 --2- 172.21.15.69:0/3073128178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4bac0cd070 0x7f4bac0ad220 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f4bac063370 tx=0x7f4b9c009840 comp rx=0 tx=0).stop 2023-10-06T01:38:42.515 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.512+0000 7f4bb3f36700 1 -- 172.21.15.69:0/3073128178 shutdown_connections 2023-10-06T01:38:42.515 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.512+0000 7f4bb3f36700 1 --2- 172.21.15.69:0/3073128178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4bac0cd070 0x7f4bac0ad220 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:42.515 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.512+0000 7f4bb3f36700 1 --2- 172.21.15.69:0/3073128178 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4bac0c6bc0 0x7f4bac0cb490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:42.516 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.512+0000 7f4bb3f36700 1 --2- 172.21.15.69:0/3073128178 >> v2:172.21.15.88:3300/0 conn(0x7f4bac0cd440 0x7f4bac0c6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:42.516 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.512+0000 7f4bb3f36700 1 -- 172.21.15.69:0/3073128178 >> 172.21.15.69:0/3073128178 conn(0x7f4bac099a90 msgr2=0x7f4bac06cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:42.516 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.512+0000 7f4bb3f36700 1 -- 172.21.15.69:0/3073128178 shutdown_connections 2023-10-06T01:38:42.516 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.512+0000 7f4bb3f36700 1 -- 172.21.15.69:0/3073128178 wait complete. 2023-10-06T01:38:42.518 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.513+0000 7f4bb3f36700 1 Processor -- start 2023-10-06T01:38:42.518 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.513+0000 7f4bb3f36700 1 -- start start 2023-10-06T01:38:42.518 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.514+0000 7f4bb3f36700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4bac0c6bc0 0x7f4bac0b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:42.518 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.514+0000 7f4bb3f36700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4bac0cd070 0x7f4bac0b3510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:42.518 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.514+0000 7f4bb3f36700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bac0cd440 0x7f4bac15b190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:42.518 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.514+0000 7f4bb3f36700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac0b5420 con 0x7f4bac0c6bc0 2023-10-06T01:38:42.518 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.514+0000 7f4bb3f36700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac0b4820 con 0x7f4bac0cd440 2023-10-06T01:38:42.518 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.514+0000 7f4bb3f36700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bac0b3c10 con 0x7f4bac0cd070 2023-10-06T01:38:42.519 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.514+0000 7f4bb1cd2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4bac0c6bc0 0x7f4bac0b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:42.519 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.514+0000 7f4bb1cd2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4bac0c6bc0 0x7f4bac0b5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57852/0 (socket says 172.21.15.69:57852) 2023-10-06T01:38:42.519 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.514+0000 7f4bb1cd2700 1 -- 172.21.15.69:0/3749750019 learned_addr learned my addr 172.21.15.69:0/3749750019 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:42.519 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.514+0000 7f4bb24d3700 1 --2- 172.21.15.69:0/3749750019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bac0cd440 0x7f4bac15b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:42.519 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.514+0000 7f4bb14d1700 1 --2- 172.21.15.69:0/3749750019 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4bac0cd070 0x7f4bac0b3510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:42.519 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.514+0000 7f4bb1cd2700 1 -- 172.21.15.69:0/3749750019 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4bac0cd070 msgr2=0x7f4bac0b3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:42.519 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.514+0000 7f4bb1cd2700 1 --2- 172.21.15.69:0/3749750019 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4bac0cd070 0x7f4bac0b3510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:42.519 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.514+0000 7f4bb1cd2700 1 -- 172.21.15.69:0/3749750019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bac0cd440 msgr2=0x7f4bac15b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:42.519 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.514+0000 7f4bb1cd2700 1 --2- 172.21.15.69:0/3749750019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bac0cd440 0x7f4bac15b190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:42.519 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.514+0000 7f4bb1cd2700 1 -- 172.21.15.69:0/3749750019 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b9c009ae0 con 0x7f4bac0c6bc0 2023-10-06T01:38:42.519 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.514+0000 7f4bb1cd2700 1 --2- 172.21.15.69:0/3749750019 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4bac0c6bc0 0x7f4bac0b5fd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4bac064750 tx=0x7f4b9c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:42.520 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.516+0000 7f4ba9ffb700 1 -- 172.21.15.69:0/3749750019 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c0092e0 con 0x7f4bac0c6bc0 2023-10-06T01:38:42.520 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.516+0000 7f4ba9ffb700 1 -- 172.21.15.69:0/3749750019 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b9c007820 con 0x7f4bac0c6bc0 2023-10-06T01:38:42.520 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.516+0000 7f4bb3f36700 1 -- 172.21.15.69:0/3749750019 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bac0b3ef0 con 0x7f4bac0c6bc0 2023-10-06T01:38:42.520 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.516+0000 7f4ba9ffb700 1 -- 172.21.15.69:0/3749750019 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b9c007bc0 con 0x7f4bac0c6bc0 2023-10-06T01:38:42.520 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.516+0000 7f4bb3f36700 1 -- 172.21.15.69:0/3749750019 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bac0b44b0 con 0x7f4bac0c6bc0 2023-10-06T01:38:42.521 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.517+0000 7f4bb3f36700 1 -- 172.21.15.69:0/3749750019 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bac155fa0 con 0x7f4bac0c6bc0 2023-10-06T01:38:42.521 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.518+0000 7f4ba9ffb700 1 -- 172.21.15.69:0/3749750019 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4b9c003040 con 0x7f4bac0c6bc0 2023-10-06T01:38:42.521 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.518+0000 7f4ba9ffb700 1 --2- 172.21.15.69:0/3749750019 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4b98066f30 0x7f4b980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:42.521 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.518+0000 7f4ba9ffb700 1 -- 172.21.15.69:0/3749750019 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4b9c085b50 con 0x7f4bac0c6bc0 2023-10-06T01:38:42.521 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.518+0000 7f4bb14d1700 1 --2- 172.21.15.69:0/3749750019 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4b98066f30 0x7f4b980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:42.521 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.519+0000 7f4bb14d1700 1 --2- 172.21.15.69:0/3749750019 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4b98066f30 0x7f4b980693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0b6510 tx=0x7f4ba0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:42.524 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.523+0000 7f4ba9ffb700 1 -- 172.21.15.69:0/3749750019 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b9c053070 con 0x7f4bac0c6bc0 2023-10-06T01:38:42.707 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.706+0000 7f4bb3f36700 1 -- 172.21.15.69:0/3749750019 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4bac04c3c0 con 0x7f4bac0c6bc0 2023-10-06T01:38:42.708 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.707+0000 7f4ba9ffb700 1 -- 172.21.15.69:0/3749750019 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12079 (secure 0 0 0) 0x7f4b9c056690 con 0x7f4bac0c6bc0 2023-10-06T01:38:42.708 INFO:teuthology.misc.health.smithi069.stdout: 2023-10-06T01:38:42.709 INFO:teuthology.misc.health.smithi069.stdout:{"epoch":17,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:38:40.507391+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:38:42.711 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.709+0000 7f4bb3f36700 1 -- 172.21.15.69:0/3749750019 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4b98066f30 msgr2=0x7f4b980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:42.711 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.709+0000 7f4bb3f36700 1 --2- 172.21.15.69:0/3749750019 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4b98066f30 0x7f4b980693e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4bac0b6510 tx=0x7f4ba0008040 comp rx=0 tx=0).stop 2023-10-06T01:38:42.711 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.709+0000 7f4bb3f36700 1 -- 172.21.15.69:0/3749750019 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4bac0c6bc0 msgr2=0x7f4bac0b5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:42.711 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.709+0000 7f4bb3f36700 1 --2- 172.21.15.69:0/3749750019 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4bac0c6bc0 0x7f4bac0b5fd0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4bac064750 tx=0x7f4b9c018000 comp rx=0 tx=0).stop 2023-10-06T01:38:42.711 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.709+0000 7f4bb3f36700 1 -- 172.21.15.69:0/3749750019 shutdown_connections 2023-10-06T01:38:42.711 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.709+0000 7f4bb3f36700 1 --2- 172.21.15.69:0/3749750019 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4b98066f30 0x7f4b980693e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:42.711 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.709+0000 7f4bb3f36700 1 --2- 172.21.15.69:0/3749750019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4bac0cd440 0x7f4bac15b190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:42.711 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.709+0000 7f4bb3f36700 1 --2- 172.21.15.69:0/3749750019 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4bac0c6bc0 0x7f4bac0b5fd0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:42.711 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.709+0000 7f4bb3f36700 1 --2- 172.21.15.69:0/3749750019 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4bac0cd070 0x7f4bac0b3510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:42.711 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.709+0000 7f4bb3f36700 1 -- 172.21.15.69:0/3749750019 >> 172.21.15.69:0/3749750019 conn(0x7f4bac099a90 msgr2=0x7f4bac06dfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:42.712 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.709+0000 7f4bb3f36700 1 -- 172.21.15.69:0/3749750019 shutdown_connections 2023-10-06T01:38:42.712 INFO:teuthology.misc.health.smithi069.stderr:2023-10-06T01:38:42.709+0000 7f4bb3f36700 1 -- 172.21.15.69:0/3749750019 wait complete. 2023-10-06T01:38:42.721 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-06T01:38:42.721 INFO:tasks.ceph:Creating RBD pool 2023-10-06T01:38:42.721 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd pool create rbd 8 2023-10-06T01:38:42.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.834+0000 7f34c0e9d700 1 Processor -- start 2023-10-06T01:38:42.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.834+0000 7f34c0e9d700 1 -- start start 2023-10-06T01:38:42.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.835+0000 7f34c0e9d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f34bc1508b0 0x7f34bc0ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:42.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.835+0000 7f34c0e9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f34bc0675a0 0x7f34bc0679e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:42.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.835+0000 7f34c0e9d700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34bc0cddf0 con 0x7f34bc150c80 2023-10-06T01:38:42.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.835+0000 7f34c0e9d700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34bc0b0360 con 0x7f34bc1508b0 2023-10-06T01:38:42.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.835+0000 7f34c0e9d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc067f20 con 0x7f34bc0675a0 2023-10-06T01:38:42.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.835+0000 7f34ba59c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f34bc1508b0 0x7f34bc0ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:42.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.835+0000 7f34b9d9b700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f34bc150c80 0x7f34bc1573e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:46124/0 (socket says 172.21.15.69:46124) 2023-10-06T01:38:42.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.835+0000 7f34b9d9b700 1 -- 172.21.15.69:0/1929835080 learned_addr learned my addr 172.21.15.69:0/1929835080 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:38:42.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.835+0000 7f34bad9d700 1 --2- 172.21.15.69:0/1929835080 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f34bc0675a0 0x7f34bc0679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:42.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.835+0000 7f34ba59c700 1 -- 172.21.15.69:0/1929835080 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f34bc0675a0 msgr2=0x7f34bc0679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:42.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.835+0000 7f34ba59c700 1 --2- 172.21.15.69:0/1929835080 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f34bc0675a0 0x7f34bc0679e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:42.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.835+0000 7f34ba59c700 1 -- 172.21.15.69:0/1929835080 >> v1:172.21.15.69:6789/0 conn(0x7f34bc150c80 legacy=0x7f34bc1573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:42.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.835+0000 7f34b959a700 1 -- 172.21.15.69:0/1929835080 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2868445512 0 0) 0x7f34bc0cddf0 con 0x7f34bc150c80 2023-10-06T01:38:42.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.835+0000 7f34ba59c700 1 -- 172.21.15.69:0/1929835080 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34bc0cd550 con 0x7f34bc1508b0 2023-10-06T01:38:42.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.836+0000 7f34ba59c700 1 --2- 172.21.15.69:0/1929835080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34bc1508b0 0x7f34bc0ccec0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f34ac009e60 tx=0x7f34ac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca79069875720a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:42.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.836+0000 7f34b959a700 1 -- 172.21.15.69:0/1929835080 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac00e070 con 0x7f34bc1508b0 2023-10-06T01:38:42.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.836+0000 7f34b959a700 1 -- 172.21.15.69:0/1929835080 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ac00bc30 con 0x7f34bc1508b0 2023-10-06T01:38:42.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.836+0000 7f34b959a700 1 -- 172.21.15.69:0/1929835080 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ac012430 con 0x7f34bc1508b0 2023-10-06T01:38:42.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.836+0000 7f34c0e9d700 1 -- 172.21.15.69:0/1929835080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34bc1508b0 msgr2=0x7f34bc0ccec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:42.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.836+0000 7f34c0e9d700 1 --2- 172.21.15.69:0/1929835080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34bc1508b0 0x7f34bc0ccec0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f34ac009e60 tx=0x7f34ac009780 comp rx=0 tx=0).stop 2023-10-06T01:38:42.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.836+0000 7f34c0e9d700 1 -- 172.21.15.69:0/1929835080 shutdown_connections 2023-10-06T01:38:42.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.836+0000 7f34c0e9d700 1 --2- 172.21.15.69:0/1929835080 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f34bc0675a0 0x7f34bc0679e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:42.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.836+0000 7f34c0e9d700 1 --2- 172.21.15.69:0/1929835080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34bc1508b0 0x7f34bc0ccec0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:42.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.836+0000 7f34c0e9d700 1 -- 172.21.15.69:0/1929835080 >> 172.21.15.69:0/1929835080 conn(0x7f34bc06d7b0 msgr2=0x7f34bc06dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:42.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.836+0000 7f34c0e9d700 1 -- 172.21.15.69:0/1929835080 shutdown_connections 2023-10-06T01:38:42.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.836+0000 7f34c0e9d700 1 -- 172.21.15.69:0/1929835080 wait complete. 2023-10-06T01:38:42.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.837+0000 7f34c0e9d700 1 Processor -- start 2023-10-06T01:38:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.837+0000 7f34c0e9d700 1 -- start start 2023-10-06T01:38:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.838+0000 7f34c0e9d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34bc0675a0 0x7f34bc14f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.838+0000 7f34c0e9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34bc1508b0 0x7f34bc165a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.838+0000 7f34c0e9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f34bc150c80 0x7f34bc0c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.838+0000 7f34c0e9d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc1669f0 con 0x7f34bc1508b0 2023-10-06T01:38:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.838+0000 7f34c0e9d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc166430 con 0x7f34bc0675a0 2023-10-06T01:38:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.838+0000 7f34c0e9d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34bc166710 con 0x7f34bc150c80 2023-10-06T01:38:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.838+0000 7f34b9d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34bc1508b0 0x7f34bc165a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.838+0000 7f34b9d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34bc1508b0 0x7f34bc165a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57862/0 (socket says 172.21.15.69:57862) 2023-10-06T01:38:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.838+0000 7f34b9d9b700 1 -- 172.21.15.69:0/2447834497 learned_addr learned my addr 172.21.15.69:0/2447834497 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:42.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.838+0000 7f34ba59c700 1 --2- 172.21.15.69:0/2447834497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34bc0675a0 0x7f34bc14f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.838+0000 7f34bad9d700 1 --2- 172.21.15.69:0/2447834497 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f34bc150c80 0x7f34bc0c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.838+0000 7f34b9d9b700 1 -- 172.21.15.69:0/2447834497 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f34bc150c80 msgr2=0x7f34bc0c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.838+0000 7f34b9d9b700 1 --2- 172.21.15.69:0/2447834497 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f34bc150c80 0x7f34bc0c3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.838+0000 7f34b9d9b700 1 -- 172.21.15.69:0/2447834497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34bc0675a0 msgr2=0x7f34bc14f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.838+0000 7f34b9d9b700 1 --2- 172.21.15.69:0/2447834497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34bc0675a0 0x7f34bc14f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.838+0000 7f34b9d9b700 1 -- 172.21.15.69:0/2447834497 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ac009a20 con 0x7f34bc1508b0 2023-10-06T01:38:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.839+0000 7f34b9d9b700 1 --2- 172.21.15.69:0/2447834497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34bc1508b0 0x7f34bc165a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f34b000c5e0 tx=0x7f34b0000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.839+0000 7f34aa7fc700 1 -- 172.21.15.69:0/2447834497 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b0005b30 con 0x7f34bc1508b0 2023-10-06T01:38:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.839+0000 7f34aa7fc700 1 -- 172.21.15.69:0/2447834497 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34b0005c90 con 0x7f34bc1508b0 2023-10-06T01:38:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.839+0000 7f34c0e9d700 1 -- 172.21.15.69:0/2447834497 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34bc0c22b0 con 0x7f34bc1508b0 2023-10-06T01:38:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.839+0000 7f34aa7fc700 1 -- 172.21.15.69:0/2447834497 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34b0007300 con 0x7f34bc1508b0 2023-10-06T01:38:42.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.839+0000 7f34c0e9d700 1 -- 172.21.15.69:0/2447834497 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34bc14f550 con 0x7f34bc1508b0 2023-10-06T01:38:42.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.840+0000 7f34c0e9d700 1 -- 172.21.15.69:0/2447834497 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34bc04c3c0 con 0x7f34bc1508b0 2023-10-06T01:38:42.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.840+0000 7f34aa7fc700 1 -- 172.21.15.69:0/2447834497 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34b00076b0 con 0x7f34bc1508b0 2023-10-06T01:38:42.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.840+0000 7f34aa7fc700 1 --2- 172.21.15.69:0/2447834497 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f349c066f30 0x7f349c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:42.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.840+0000 7f34aa7fc700 1 -- 172.21.15.69:0/2447834497 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f34b00837a0 con 0x7f34bc1508b0 2023-10-06T01:38:42.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.840+0000 7f34ba59c700 1 --2- 172.21.15.69:0/2447834497 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f349c066f30 0x7f349c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:42.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.841+0000 7f34ba59c700 1 --2- 172.21.15.69:0/2447834497 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f349c066f30 0x7f349c0693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f34ac009e60 tx=0x7f34ac019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:42.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:42.845+0000 7f34aa7fc700 1 -- 172.21.15.69:0/2447834497 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34b0050d60 con 0x7f34bc1508b0 2023-10-06T01:38:43.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.027+0000 7f34c0e9d700 1 -- 172.21.15.69:0/2447834497 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f34bc0cd830 con 0x7f34bc1508b0 2023-10-06T01:38:43.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.522+0000 7f34aa7fc700 1 -- 172.21.15.69:0/2447834497 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v18) v1 ==== 109+0+0 (secure 0 0 0) 0x7f34b0054380 con 0x7f34bc1508b0 2023-10-06T01:38:43.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.525+0000 7f34c0e9d700 1 -- 172.21.15.69:0/2447834497 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f349c066f30 msgr2=0x7f349c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:43.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.525+0000 7f34c0e9d700 1 --2- 172.21.15.69:0/2447834497 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f349c066f30 0x7f349c0693e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f34ac009e60 tx=0x7f34ac019000 comp rx=0 tx=0).stop 2023-10-06T01:38:43.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.525+0000 7f34c0e9d700 1 -- 172.21.15.69:0/2447834497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34bc1508b0 msgr2=0x7f34bc165a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:43.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.525+0000 7f34c0e9d700 1 --2- 172.21.15.69:0/2447834497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34bc1508b0 0x7f34bc165a00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f34b000c5e0 tx=0x7f34b0000fe0 comp rx=0 tx=0).stop 2023-10-06T01:38:43.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.525+0000 7f34c0e9d700 1 -- 172.21.15.69:0/2447834497 shutdown_connections 2023-10-06T01:38:43.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.525+0000 7f34c0e9d700 1 --2- 172.21.15.69:0/2447834497 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f349c066f30 0x7f349c0693e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:43.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.525+0000 7f34c0e9d700 1 --2- 172.21.15.69:0/2447834497 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f34bc150c80 0x7f34bc0c3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:43.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.525+0000 7f34c0e9d700 1 --2- 172.21.15.69:0/2447834497 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34bc0675a0 0x7f34bc14f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:43.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.525+0000 7f34c0e9d700 1 --2- 172.21.15.69:0/2447834497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34bc1508b0 0x7f34bc165a00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:43.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.526+0000 7f34c0e9d700 1 -- 172.21.15.69:0/2447834497 >> 172.21.15.69:0/2447834497 conn(0x7f34bc06d7b0 msgr2=0x7f34bc1585c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:43.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.526+0000 7f34c0e9d700 1 -- 172.21.15.69:0/2447834497 shutdown_connections 2023-10-06T01:38:43.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.526+0000 7f34c0e9d700 1 -- 172.21.15.69:0/2447834497 wait complete. 2023-10-06T01:38:43.528 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'rbd' created 2023-10-06T01:38:43.540 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-10-06T01:38:43.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.656+0000 7f317494b700 1 Processor -- start 2023-10-06T01:38:43.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.656+0000 7f317494b700 1 -- start start 2023-10-06T01:38:43.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.657+0000 7f317494b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f3170159fb0 0x7f317015a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:43.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.657+0000 7f317494b700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f317015d570 con 0x7f317015a8c0 2023-10-06T01:38:43.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.657+0000 7f317494b700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f317015d850 con 0x7f31700cd5a0 2023-10-06T01:38:43.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.657+0000 7f317494b700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f317015e180 con 0x7f3170159fb0 2023-10-06T01:38:43.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.657+0000 7f316f7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f3170159fb0 0x7f317015a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:43.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.657+0000 7f316effd700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f317015a8c0 0x7f31700cce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:46130/0 (socket says 172.21.15.69:46130) 2023-10-06T01:38:43.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.657+0000 7f316effd700 1 -- 172.21.15.69:0/3304301741 learned_addr learned my addr 172.21.15.69:0/3304301741 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:38:43.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.657+0000 7f316e7fc700 1 -- 172.21.15.69:0/3304301741 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 238657588 0 0) 0x7f317015d570 con 0x7f317015a8c0 2023-10-06T01:38:43.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.657+0000 7f316e7fc700 1 -- 172.21.15.69:0/3304301741 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3158003570 con 0x7f317015a8c0 2023-10-06T01:38:43.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.657+0000 7f316f7fe700 1 -- 172.21.15.69:0/3304301741 >> v1:172.21.15.88:6789/0 conn(0x7f31700cd5a0 legacy=0x7f31700cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:43.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.657+0000 7f316f7fe700 1 -- 172.21.15.69:0/3304301741 >> v1:172.21.15.69:6789/0 conn(0x7f317015a8c0 legacy=0x7f31700cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:43.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.657+0000 7f316f7fe700 1 -- 172.21.15.69:0/3304301741 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f317015db30 con 0x7f3170159fb0 2023-10-06T01:38:43.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.657+0000 7f316f7fe700 1 --2- 172.21.15.69:0/3304301741 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3170159fb0 0x7f317015a380 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3160009e60 tx=0x7f3160009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4f293ff4fdcfb18 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:43.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.658+0000 7f316e7fc700 1 -- 172.21.15.69:0/3304301741 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316000e070 con 0x7f3170159fb0 2023-10-06T01:38:43.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.658+0000 7f316e7fc700 1 -- 172.21.15.69:0/3304301741 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316000bb20 con 0x7f3170159fb0 2023-10-06T01:38:43.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.658+0000 7f316e7fc700 1 -- 172.21.15.69:0/3304301741 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316000bea0 con 0x7f3170159fb0 2023-10-06T01:38:43.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.658+0000 7f317494b700 1 -- 172.21.15.69:0/3304301741 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3170159fb0 msgr2=0x7f317015a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:43.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.658+0000 7f317494b700 1 --2- 172.21.15.69:0/3304301741 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3170159fb0 0x7f317015a380 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3160009e60 tx=0x7f3160009780 comp rx=0 tx=0).stop 2023-10-06T01:38:43.661 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.658+0000 7f317494b700 1 -- 172.21.15.69:0/3304301741 shutdown_connections 2023-10-06T01:38:43.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.658+0000 7f317494b700 1 --2- 172.21.15.69:0/3304301741 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3170159fb0 0x7f317015a380 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:43.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.658+0000 7f317494b700 1 -- 172.21.15.69:0/3304301741 >> 172.21.15.69:0/3304301741 conn(0x7f31700703a0 msgr2=0x7f31700707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:43.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.658+0000 7f317494b700 1 -- 172.21.15.69:0/3304301741 shutdown_connections 2023-10-06T01:38:43.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.658+0000 7f317494b700 1 -- 172.21.15.69:0/3304301741 wait complete. 2023-10-06T01:38:43.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.659+0000 7f317494b700 1 Processor -- start 2023-10-06T01:38:43.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.659+0000 7f317494b700 1 -- start start 2023-10-06T01:38:43.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.660+0000 7f317494b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31700cd5a0 0x7f317014df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:43.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.660+0000 7f317494b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3170159fb0 0x7f317016a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:43.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.660+0000 7f317494b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f317015a8c0 0x7f31700cc410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:43.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.660+0000 7f317494b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31700c6370 con 0x7f31700cd5a0 2023-10-06T01:38:43.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.660+0000 7f317494b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f317014e470 con 0x7f3170159fb0 2023-10-06T01:38:43.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.660+0000 7f317494b700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f317016aa20 con 0x7f317015a8c0 2023-10-06T01:38:43.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.660+0000 7f316f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31700cd5a0 0x7f317014df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:43.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.660+0000 7f316f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31700cd5a0 0x7f317014df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57884/0 (socket says 172.21.15.69:57884) 2023-10-06T01:38:43.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.660+0000 7f316f7fe700 1 -- 172.21.15.69:0/1177312992 learned_addr learned my addr 172.21.15.69:0/1177312992 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:43.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.660+0000 7f316ffff700 1 --2- 172.21.15.69:0/1177312992 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f317015a8c0 0x7f31700cc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:43.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.660+0000 7f316effd700 1 --2- 172.21.15.69:0/1177312992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3170159fb0 0x7f317016a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:43.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.660+0000 7f316f7fe700 1 -- 172.21.15.69:0/1177312992 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f317015a8c0 msgr2=0x7f31700cc410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:43.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.660+0000 7f316f7fe700 1 --2- 172.21.15.69:0/1177312992 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f317015a8c0 0x7f31700cc410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:43.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.660+0000 7f316f7fe700 1 -- 172.21.15.69:0/1177312992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3170159fb0 msgr2=0x7f317016a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:43.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.660+0000 7f316f7fe700 1 --2- 172.21.15.69:0/1177312992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3170159fb0 0x7f317016a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:43.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.660+0000 7f316f7fe700 1 -- 172.21.15.69:0/1177312992 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3160009a20 con 0x7f31700cd5a0 2023-10-06T01:38:43.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.661+0000 7f316f7fe700 1 --2- 172.21.15.69:0/1177312992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31700cd5a0 0x7f317014df30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f31600097c0 tx=0x7f3160018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:43.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.661+0000 7f31577fe700 1 -- 172.21.15.69:0/1177312992 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3160012e60 con 0x7f31700cd5a0 2023-10-06T01:38:43.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.661+0000 7f31577fe700 1 -- 172.21.15.69:0/1177312992 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3160027470 con 0x7f31700cd5a0 2023-10-06T01:38:43.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.661+0000 7f31577fe700 1 -- 172.21.15.69:0/1177312992 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3160027850 con 0x7f31700cd5a0 2023-10-06T01:38:43.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.661+0000 7f317494b700 1 -- 172.21.15.69:0/1177312992 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31700c57f0 con 0x7f31700cd5a0 2023-10-06T01:38:43.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.661+0000 7f317494b700 1 -- 172.21.15.69:0/1177312992 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31700c5db0 con 0x7f31700cd5a0 2023-10-06T01:38:43.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.662+0000 7f317494b700 1 -- 172.21.15.69:0/1177312992 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f317004c3c0 con 0x7f31700cd5a0 2023-10-06T01:38:43.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.662+0000 7f31577fe700 1 -- 172.21.15.69:0/1177312992 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3160024070 con 0x7f31700cd5a0 2023-10-06T01:38:43.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.662+0000 7f31577fe700 1 --2- 172.21.15.69:0/1177312992 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f315c066f30 0x7f315c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:43.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.663+0000 7f31577fe700 1 -- 172.21.15.69:0/1177312992 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5195+0+0 (secure 0 0 0) 0x7f3160086a40 con 0x7f31700cd5a0 2023-10-06T01:38:43.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.663+0000 7f316effd700 1 --2- 172.21.15.69:0/1177312992 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f315c066f30 0x7f315c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:43.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.663+0000 7f316effd700 1 --2- 172.21.15.69:0/1177312992 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f315c066f30 0x7f315c0693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f31700c75b0 tx=0x7f3164009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:43.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.667+0000 7f31577fe700 1 -- 172.21.15.69:0/1177312992 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3160088e60 con 0x7f31700cd5a0 2023-10-06T01:38:43.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:43.850+0000 7f317494b700 1 -- 172.21.15.69:0/1177312992 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f31701581c0 con 0x7f31700cd5a0 2023-10-06T01:38:44.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.526+0000 7f31577fe700 1 -- 172.21.15.69:0/1177312992 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v19) v1 ==== 173+0+0 (secure 0 0 0) 0x7f316002c0c0 con 0x7f31700cd5a0 2023-10-06T01:38:44.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.529+0000 7f317494b700 1 -- 172.21.15.69:0/1177312992 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f315c066f30 msgr2=0x7f315c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:44.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.529+0000 7f317494b700 1 --2- 172.21.15.69:0/1177312992 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f315c066f30 0x7f315c0693e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f31700c75b0 tx=0x7f3164009040 comp rx=0 tx=0).stop 2023-10-06T01:38:44.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.529+0000 7f317494b700 1 -- 172.21.15.69:0/1177312992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31700cd5a0 msgr2=0x7f317014df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:44.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.529+0000 7f317494b700 1 --2- 172.21.15.69:0/1177312992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31700cd5a0 0x7f317014df30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f31600097c0 tx=0x7f3160018000 comp rx=0 tx=0).stop 2023-10-06T01:38:44.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.530+0000 7f317494b700 1 -- 172.21.15.69:0/1177312992 shutdown_connections 2023-10-06T01:38:44.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.530+0000 7f317494b700 1 --2- 172.21.15.69:0/1177312992 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f315c066f30 0x7f315c0693e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:44.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.530+0000 7f317494b700 1 --2- 172.21.15.69:0/1177312992 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f317015a8c0 0x7f31700cc410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:44.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.530+0000 7f317494b700 1 --2- 172.21.15.69:0/1177312992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31700cd5a0 0x7f317014df30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:44.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.530+0000 7f317494b700 1 --2- 172.21.15.69:0/1177312992 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3170159fb0 0x7f317016a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:44.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.530+0000 7f317494b700 1 -- 172.21.15.69:0/1177312992 >> 172.21.15.69:0/1177312992 conn(0x7f31700703a0 msgr2=0x7f317014f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:44.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.530+0000 7f317494b700 1 -- 172.21.15.69:0/1177312992 shutdown_connections 2023-10-06T01:38:44.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.530+0000 7f317494b700 1 -- 172.21.15.69:0/1177312992 wait complete. 2023-10-06T01:38:44.533 INFO:teuthology.orchestra.run.smithi069.stderr:enabled application 'rbd' on pool 'rbd' 2023-10-06T01:38:44.544 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-06T01:38:44.545 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T01:38:44.545 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T01:38:44.547 INFO:tasks.ceph.mds.a:Started 2023-10-06T01:38:44.547 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T01:38:44.547 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T01:38:44.549 INFO:tasks.ceph.mds.c:Started 2023-10-06T01:38:44.549 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T01:38:44.549 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T01:38:44.552 INFO:tasks.ceph.mds.b:Started 2023-10-06T01:38:44.552 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T01:38:44.552 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T01:38:44.555 INFO:tasks.ceph.mds.d:Started 2023-10-06T01:38:44.555 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-06T01:38:44.555 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:38:44.620 INFO:tasks.ceph.mds.c.smithi069.stdout:starting mds.c at 2023-10-06T01:38:44.620 INFO:tasks.ceph.mds.a.smithi069.stdout:starting mds.a at 2023-10-06T01:38:44.635 INFO:tasks.ceph.mds.b.smithi088.stdout:starting mds.b at 2023-10-06T01:38:44.635 INFO:tasks.ceph.mds.d.smithi088.stdout:starting mds.d at 2023-10-06T01:38:44.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.675+0000 7fadf6cac700 1 Processor -- start 2023-10-06T01:38:44.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.675+0000 7fadf6cac700 1 -- start start 2023-10-06T01:38:44.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.676+0000 7fadf6cac700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fadf00aee90 0x7fadf00a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:44.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.676+0000 7fadf6cac700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf00ce1a0 con 0x7fadf006d280 2023-10-06T01:38:44.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.676+0000 7fadf6cac700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadf00cd5d0 con 0x7fadf00a8be0 2023-10-06T01:38:44.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.676+0000 7fadf6cac700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00cd870 con 0x7fadf00aee90 2023-10-06T01:38:44.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.676+0000 7fadf5249700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fadf006d280 0x7fadf00b1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:46156/0 (socket says 172.21.15.69:46156) 2023-10-06T01:38:44.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.676+0000 7fadf5249700 1 -- 172.21.15.69:0/568634512 learned_addr learned my addr 172.21.15.69:0/568634512 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:38:44.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.677+0000 7fadeffff700 1 --2- 172.21.15.69:0/568634512 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fadf00aee90 0x7fadf00a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:44.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.677+0000 7fadef7fe700 1 -- 172.21.15.69:0/568634512 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1143012053 0 0) 0x7fadf00ce1a0 con 0x7fadf006d280 2023-10-06T01:38:44.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.677+0000 7fadef7fe700 1 -- 172.21.15.69:0/568634512 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faddc003570 con 0x7fadf006d280 2023-10-06T01:38:44.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.677+0000 7fadef7fe700 1 -- 172.21.15.69:0/568634512 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 600301238 0 0) 0x7fadf00cd5d0 con 0x7fadf00a8be0 2023-10-06T01:38:44.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.677+0000 7fadef7fe700 1 -- 172.21.15.69:0/568634512 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadf00ce1a0 con 0x7fadf00a8be0 2023-10-06T01:38:44.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.677+0000 7fadef7fe700 1 -- 172.21.15.69:0/568634512 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2935070057 0 0) 0x7faddc003570 con 0x7fadf006d280 2023-10-06T01:38:44.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.677+0000 7fadef7fe700 1 -- 172.21.15.69:0/568634512 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fadf00aee90 msgr2=0x7fadf00a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:44.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.677+0000 7fadef7fe700 1 --2- 172.21.15.69:0/568634512 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fadf00aee90 0x7fadf00a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:44.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.677+0000 7fadef7fe700 1 -- 172.21.15.69:0/568634512 >> v1:172.21.15.88:6789/0 conn(0x7fadf00a8be0 legacy=0x7fadf00ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:44.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.677+0000 7fadef7fe700 1 -- 172.21.15.69:0/568634512 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf00cdb50 con 0x7fadf006d280 2023-10-06T01:38:44.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.677+0000 7fadef7fe700 1 -- 172.21.15.69:0/568634512 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7fadd8001470 con 0x7fadf006d280 2023-10-06T01:38:44.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.677+0000 7fadef7fe700 1 -- 172.21.15.69:0/568634512 >> v1:172.21.15.69:6789/0 conn(0x7fadf006d280 legacy=0x7fadf00b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:44.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.677+0000 7fadef7fe700 1 --2- 172.21.15.69:0/568634512 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faddc003c20 0x7faddc004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:44.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.677+0000 7fadef7fe700 1 --2- 172.21.15.69:0/568634512 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fadf00aee90 0x7faddc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:44.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.677+0000 7fadef7fe700 1 --2- 172.21.15.69:0/568634512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faddc004d50 0x7faddc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:44.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.677+0000 7fadef7fe700 1 -- 172.21.15.69:0/568634512 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00cd870 con 0x7faddc003c20 2023-10-06T01:38:44.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.677+0000 7fadef7fe700 1 -- 172.21.15.69:0/568634512 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faddc00bbf0 con 0x7faddc004d50 2023-10-06T01:38:44.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.677+0000 7fadef7fe700 1 -- 172.21.15.69:0/568634512 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faddc00bdb0 con 0x7fadf00aee90 2023-10-06T01:38:44.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.677+0000 7fadf4a48700 1 --2- 172.21.15.69:0/568634512 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faddc003c20 0x7faddc004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:44.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.677+0000 7fadf5249700 1 --2- 172.21.15.69:0/568634512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faddc004d50 0x7faddc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:44.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.677+0000 7fadeffff700 1 --2- 172.21.15.69:0/568634512 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fadf00aee90 0x7faddc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:44.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.677+0000 7fadf4a48700 1 -- 172.21.15.69:0/568634512 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fadf00aee90 msgr2=0x7faddc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:44.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.677+0000 7fadf4a48700 1 --2- 172.21.15.69:0/568634512 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fadf00aee90 0x7faddc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:44.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.677+0000 7fadf4a48700 1 -- 172.21.15.69:0/568634512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faddc004d50 msgr2=0x7faddc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:44.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.677+0000 7fadf4a48700 1 --2- 172.21.15.69:0/568634512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faddc004d50 0x7faddc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:44.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.677+0000 7fadf4a48700 1 -- 172.21.15.69:0/568634512 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faddc003570 con 0x7faddc003c20 2023-10-06T01:38:44.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.677+0000 7fadf5249700 1 --2- 172.21.15.69:0/568634512 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faddc004d50 0x7faddc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:38:44.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.678+0000 7fadf4a48700 1 --2- 172.21.15.69:0/568634512 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faddc003c20 0x7faddc004010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fade800c390 tx=0x7fade8001bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b8ea2eff4c8213 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:44.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.678+0000 7fadef7fe700 1 -- 172.21.15.69:0/568634512 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade8001ee0 con 0x7faddc003c20 2023-10-06T01:38:44.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.678+0000 7fadef7fe700 1 -- 172.21.15.69:0/568634512 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade800cc80 con 0x7faddc003c20 2023-10-06T01:38:44.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.678+0000 7fadef7fe700 1 -- 172.21.15.69:0/568634512 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade8012420 con 0x7faddc003c20 2023-10-06T01:38:44.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.678+0000 7fadf6cac700 1 -- 172.21.15.69:0/568634512 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faddc003c20 msgr2=0x7faddc004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:44.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.678+0000 7fadf6cac700 1 --2- 172.21.15.69:0/568634512 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faddc003c20 0x7faddc004010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fade800c390 tx=0x7fade8001bd0 comp rx=0 tx=0).stop 2023-10-06T01:38:44.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.678+0000 7fadf5249700 1 -- 172.21.15.69:0/568634512 reap_dead start 2023-10-06T01:38:44.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.678+0000 7fadf6cac700 1 -- 172.21.15.69:0/568634512 shutdown_connections 2023-10-06T01:38:44.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.678+0000 7fadf6cac700 1 -- 172.21.15.69:0/568634512 >> 172.21.15.69:0/568634512 conn(0x7fadf006ce80 msgr2=0x7fadf00ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:44.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.678+0000 7fadf6cac700 1 -- 172.21.15.69:0/568634512 shutdown_connections 2023-10-06T01:38:44.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.678+0000 7fadf6cac700 1 -- 172.21.15.69:0/568634512 wait complete. 2023-10-06T01:38:44.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.679+0000 7fadf6cac700 1 Processor -- start 2023-10-06T01:38:44.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.680+0000 7fadf6cac700 1 -- start start 2023-10-06T01:38:44.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.680+0000 7fadf6cac700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faddc003c20 0x7fadf00c8100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:44.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.680+0000 7fadf6cac700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fadf016afe0 0x7fadf016b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:44.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.680+0000 7fadf6cac700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadf00aca20 0x7fadf00acec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:44.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.680+0000 7fadf6cac700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf016b990 con 0x7fadf016afe0 2023-10-06T01:38:44.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.680+0000 7fadf6cac700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf00ad400 con 0x7fadf00aca20 2023-10-06T01:38:44.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.680+0000 7fadf6cac700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf0158fc0 con 0x7faddc003c20 2023-10-06T01:38:44.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.680+0000 7fadeffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fadf016afe0 0x7fadf016b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:44.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.680+0000 7fadeffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fadf016afe0 0x7fadf016b450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57926/0 (socket says 172.21.15.69:57926) 2023-10-06T01:38:44.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.680+0000 7fadeffff700 1 -- 172.21.15.69:0/1922792800 learned_addr learned my addr 172.21.15.69:0/1922792800 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:44.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.681+0000 7fadeffff700 1 -- 172.21.15.69:0/1922792800 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faddc003c20 msgr2=0x7fadf00c8100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:44.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.681+0000 7fadf4a48700 1 --2- 172.21.15.69:0/1922792800 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faddc003c20 0x7fadf00c8100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:44.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.681+0000 7fadf5249700 1 --2- 172.21.15.69:0/1922792800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadf00aca20 0x7fadf00acec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:44.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.681+0000 7fadeffff700 1 --2- 172.21.15.69:0/1922792800 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faddc003c20 0x7fadf00c8100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:44.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.681+0000 7fadeffff700 1 -- 172.21.15.69:0/1922792800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadf00aca20 msgr2=0x7fadf00acec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:44.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.681+0000 7fadeffff700 1 --2- 172.21.15.69:0/1922792800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadf00aca20 0x7fadf00acec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:44.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.681+0000 7fadeffff700 1 -- 172.21.15.69:0/1922792800 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadf00ca390 con 0x7fadf016afe0 2023-10-06T01:38:44.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.681+0000 7fadf5249700 1 --2- 172.21.15.69:0/1922792800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadf00aca20 0x7fadf00acec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:38:44.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.681+0000 7fadeffff700 1 --2- 172.21.15.69:0/1922792800 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fadf016afe0 0x7fadf016b450 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fade0011b60 tx=0x7fade0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:44.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.681+0000 7fadecff9700 1 -- 172.21.15.69:0/1922792800 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade0005c10 con 0x7fadf016afe0 2023-10-06T01:38:44.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.681+0000 7fadecff9700 1 -- 172.21.15.69:0/1922792800 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fade0005d70 con 0x7fadf016afe0 2023-10-06T01:38:44.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.681+0000 7fadf6cac700 1 -- 172.21.15.69:0/1922792800 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf00c9d80 con 0x7fadf016afe0 2023-10-06T01:38:44.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.681+0000 7fadecff9700 1 -- 172.21.15.69:0/1922792800 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fade000fa80 con 0x7fadf016afe0 2023-10-06T01:38:44.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.681+0000 7fadf6cac700 1 -- 172.21.15.69:0/1922792800 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadf00ca020 con 0x7fadf016afe0 2023-10-06T01:38:44.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.682+0000 7fadf6cac700 1 -- 172.21.15.69:0/1922792800 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadf00c9be0 con 0x7fadf016afe0 2023-10-06T01:38:44.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.682+0000 7fadecff9700 1 -- 172.21.15.69:0/1922792800 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fade0006030 con 0x7fadf016afe0 2023-10-06T01:38:44.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.683+0000 7fadecff9700 1 --2- 172.21.15.69:0/1922792800 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fadd0066f30 0x7fadd00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:44.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.683+0000 7fadecff9700 1 -- 172.21.15.69:0/1922792800 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fade0018030 con 0x7fadf016afe0 2023-10-06T01:38:44.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.683+0000 7fadf4a48700 1 --2- 172.21.15.69:0/1922792800 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fadd0066f30 0x7fadd00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:44.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.683+0000 7fadf4a48700 1 --2- 172.21.15.69:0/1922792800 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fadd0066f30 0x7fadd00693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fadf00a8960 tx=0x7fade8016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:44.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.687+0000 7fadecff9700 1 -- 172.21.15.69:0/1922792800 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fadf00c9be0 con 0x7fadf016afe0 2023-10-06T01:38:44.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.870+0000 7fadf6cac700 1 -- 172.21.15.69:0/1922792800 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fadf00c9be0 con 0x7fadf016afe0 2023-10-06T01:38:44.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.871+0000 7fadecff9700 1 -- 172.21.15.69:0/1922792800 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+13612 (secure 0 0 0) 0x7fadf00c9be0 con 0x7fadf016afe0 2023-10-06T01:38:44.872 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:38:44.873 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":19,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:38:44.521660+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:38:43.046056+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:38:44.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.873+0000 7fadf6cac700 1 -- 172.21.15.69:0/1922792800 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fadd0066f30 msgr2=0x7fadd00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:44.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.873+0000 7fadf6cac700 1 --2- 172.21.15.69:0/1922792800 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fadd0066f30 0x7fadd00693e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fadf00a8960 tx=0x7fade8016000 comp rx=0 tx=0).stop 2023-10-06T01:38:44.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.873+0000 7fadf6cac700 1 -- 172.21.15.69:0/1922792800 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fadf016afe0 msgr2=0x7fadf016b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:44.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.873+0000 7fadf6cac700 1 --2- 172.21.15.69:0/1922792800 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fadf016afe0 0x7fadf016b450 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fade0011b60 tx=0x7fade0009120 comp rx=0 tx=0).stop 2023-10-06T01:38:44.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.873+0000 7fadf6cac700 1 -- 172.21.15.69:0/1922792800 shutdown_connections 2023-10-06T01:38:44.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.873+0000 7fadf6cac700 1 --2- 172.21.15.69:0/1922792800 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fadd0066f30 0x7fadd00693e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:44.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.873+0000 7fadf6cac700 1 --2- 172.21.15.69:0/1922792800 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fadf00aca20 0x7fadf00acec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:44.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.873+0000 7fadf6cac700 1 --2- 172.21.15.69:0/1922792800 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faddc003c20 0x7fadf00c8100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:44.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.873+0000 7fadf6cac700 1 --2- 172.21.15.69:0/1922792800 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fadf016afe0 0x7fadf016b450 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:44.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.873+0000 7fadf6cac700 1 -- 172.21.15.69:0/1922792800 >> 172.21.15.69:0/1922792800 conn(0x7fadf006ce80 msgr2=0x7fadf00b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:44.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.873+0000 7fadf6cac700 1 -- 172.21.15.69:0/1922792800 shutdown_connections 2023-10-06T01:38:44.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:44.873+0000 7fadf6cac700 1 -- 172.21.15.69:0/1922792800 wait complete. 2023-10-06T01:38:44.886 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:38:38.288642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:38:43.046056+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T01:38:44.886 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:38:45.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.001+0000 7f5bc8182700 1 Processor -- start 2023-10-06T01:38:45.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.001+0000 7f5bc8182700 1 -- start start 2023-10-06T01:38:45.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.002+0000 7f5bc8182700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5bc0159530 0x7f5bc00ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:45.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.002+0000 7f5bc8182700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5bc006e0e0 0x7f5bc00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:45.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.002+0000 7f5bc8182700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bc00ccfd0 con 0x7f5bc006dc70 2023-10-06T01:38:45.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.002+0000 7f5bc8182700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bc00cf0e0 con 0x7f5bc006e0e0 2023-10-06T01:38:45.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.002+0000 7f5bc8182700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc015a3d0 con 0x7f5bc0159530 2023-10-06T01:38:45.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.002+0000 7f5bc571d700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f5bc006dc70 0x7f5bc0159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:46158/0 (socket says 172.21.15.69:46158) 2023-10-06T01:38:45.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.002+0000 7f5bc571d700 1 -- 172.21.15.69:0/940861883 learned_addr learned my addr 172.21.15.69:0/940861883 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:38:45.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.002+0000 7f5bc671f700 1 --2- 172.21.15.69:0/940861883 >> v2:172.21.15.88:3300/0 conn(0x7f5bc006e0e0 0x7f5bc00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:45.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.002+0000 7f5bc5f1e700 1 --2- 172.21.15.69:0/940861883 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5bc0159530 0x7f5bc00ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:45.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.002+0000 7f5bc4f1c700 1 -- 172.21.15.69:0/940861883 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3397339385 0 0) 0x7f5bc00ccfd0 con 0x7f5bc006dc70 2023-10-06T01:38:45.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.002+0000 7f5bc4f1c700 1 -- 172.21.15.69:0/940861883 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bac003570 con 0x7f5bc006dc70 2023-10-06T01:38:45.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.003+0000 7f5bc671f700 1 -- 172.21.15.69:0/940861883 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5bc0159530 msgr2=0x7f5bc00ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:45.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.003+0000 7f5bc671f700 1 --2- 172.21.15.69:0/940861883 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5bc0159530 0x7f5bc00ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.003+0000 7f5bc671f700 1 -- 172.21.15.69:0/940861883 >> v1:172.21.15.69:6789/0 conn(0x7f5bc006dc70 legacy=0x7f5bc0159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:45.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.003+0000 7f5bc671f700 1 -- 172.21.15.69:0/940861883 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bc015a6b0 con 0x7f5bc006e0e0 2023-10-06T01:38:45.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.003+0000 7f5bc5f1e700 1 --2- 172.21.15.69:0/940861883 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5bc0159530 0x7f5bc00ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:38:45.007 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.003+0000 7f5bc671f700 1 --2- 172.21.15.69:0/940861883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bc006e0e0 0x7f5bc00cb6f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5bb80098e0 tx=0x7f5bb80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d8a54ef53748247 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:45.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.003+0000 7f5bc4f1c700 1 -- 172.21.15.69:0/940861883 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8011630 con 0x7f5bc006e0e0 2023-10-06T01:38:45.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.003+0000 7f5bc4f1c700 1 -- 172.21.15.69:0/940861883 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb8011790 con 0x7f5bc006e0e0 2023-10-06T01:38:45.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.003+0000 7f5bc4f1c700 1 -- 172.21.15.69:0/940861883 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb8011b10 con 0x7f5bc006e0e0 2023-10-06T01:38:45.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.003+0000 7f5bc8182700 1 -- 172.21.15.69:0/940861883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bc006e0e0 msgr2=0x7f5bc00cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:45.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.003+0000 7f5bc8182700 1 --2- 172.21.15.69:0/940861883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bc006e0e0 0x7f5bc00cb6f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f5bb80098e0 tx=0x7f5bb80091a0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.003+0000 7f5bc8182700 1 -- 172.21.15.69:0/940861883 shutdown_connections 2023-10-06T01:38:45.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.003+0000 7f5bc8182700 1 --2- 172.21.15.69:0/940861883 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bc006e0e0 0x7f5bc00cb6f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.003+0000 7f5bc8182700 1 --2- 172.21.15.69:0/940861883 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5bc0159530 0x7f5bc00ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.003+0000 7f5bc8182700 1 -- 172.21.15.69:0/940861883 >> 172.21.15.69:0/940861883 conn(0x7f5bc00703a0 msgr2=0x7f5bc00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:45.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.003+0000 7f5bc8182700 1 -- 172.21.15.69:0/940861883 shutdown_connections 2023-10-06T01:38:45.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.004+0000 7f5bc8182700 1 -- 172.21.15.69:0/940861883 wait complete. 2023-10-06T01:38:45.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.004+0000 7f5bc8182700 1 Processor -- start 2023-10-06T01:38:45.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.005+0000 7f5bc8182700 1 -- start start 2023-10-06T01:38:45.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.005+0000 7f5bc8182700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bc006dc70 0x7f5bc015bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:45.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.005+0000 7f5bc8182700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bc006e0e0 0x7f5bc014cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:45.011 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.005+0000 7f5bc8182700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5bc0159530 0x7f5bc014d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:45.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.005+0000 7f5bc8182700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc00b3b70 con 0x7f5bc006e0e0 2023-10-06T01:38:45.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.005+0000 7f5bc8182700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc015e2c0 con 0x7f5bc006dc70 2023-10-06T01:38:45.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.005+0000 7f5bc8182700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc015e5a0 con 0x7f5bc0159530 2023-10-06T01:38:45.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.005+0000 7f5bc571d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bc006e0e0 0x7f5bc014cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:45.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.005+0000 7f5bc571d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bc006e0e0 0x7f5bc014cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57938/0 (socket says 172.21.15.69:57938) 2023-10-06T01:38:45.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.005+0000 7f5bc571d700 1 -- 172.21.15.69:0/3102668818 learned_addr learned my addr 172.21.15.69:0/3102668818 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:45.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.006+0000 7f5bc5f1e700 1 --2- 172.21.15.69:0/3102668818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bc006dc70 0x7f5bc015bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:45.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.006+0000 7f5bc671f700 1 --2- 172.21.15.69:0/3102668818 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5bc0159530 0x7f5bc014d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:45.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.006+0000 7f5bc571d700 1 -- 172.21.15.69:0/3102668818 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5bc0159530 msgr2=0x7f5bc014d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:45.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.006+0000 7f5bc571d700 1 --2- 172.21.15.69:0/3102668818 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5bc0159530 0x7f5bc014d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.006+0000 7f5bc571d700 1 -- 172.21.15.69:0/3102668818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bc006dc70 msgr2=0x7f5bc015bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:45.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.006+0000 7f5bc571d700 1 --2- 172.21.15.69:0/3102668818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bc006dc70 0x7f5bc015bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.006+0000 7f5bc571d700 1 -- 172.21.15.69:0/3102668818 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc009a20 con 0x7f5bc006e0e0 2023-10-06T01:38:45.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.006+0000 7f5bc671f700 1 --2- 172.21.15.69:0/3102668818 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5bc0159530 0x7f5bc014d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:38:45.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.006+0000 7f5bc571d700 1 --2- 172.21.15.69:0/3102668818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bc006e0e0 0x7f5bc014cf80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5bb00011e0 tx=0x7f5bb0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:45.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.006+0000 7f5bb5ffb700 1 -- 172.21.15.69:0/3102668818 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0005b30 con 0x7f5bc006e0e0 2023-10-06T01:38:45.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.006+0000 7f5bb5ffb700 1 -- 172.21.15.69:0/3102668818 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb0005c90 con 0x7f5bc006e0e0 2023-10-06T01:38:45.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.006+0000 7f5bc8182700 1 -- 172.21.15.69:0/3102668818 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb8009420 con 0x7f5bc006e0e0 2023-10-06T01:38:45.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.006+0000 7f5bb5ffb700 1 -- 172.21.15.69:0/3102668818 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0007320 con 0x7f5bc006e0e0 2023-10-06T01:38:45.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.006+0000 7f5bc8182700 1 -- 172.21.15.69:0/3102668818 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc00b3800 con 0x7f5bc006e0e0 2023-10-06T01:38:45.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.007+0000 7f5bc8182700 1 -- 172.21.15.69:0/3102668818 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc00b3ce0 con 0x7f5bc006e0e0 2023-10-06T01:38:45.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.007+0000 7f5bb5ffb700 1 -- 172.21.15.69:0/3102668818 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5bb0007690 con 0x7f5bc006e0e0 2023-10-06T01:38:45.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.008+0000 7f5bb5ffb700 1 --2- 172.21.15.69:0/3102668818 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5ba4066f30 0x7f5ba40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:45.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.008+0000 7f5bb5ffb700 1 -- 172.21.15.69:0/3102668818 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f5bb0083820 con 0x7f5bc006e0e0 2023-10-06T01:38:45.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.008+0000 7f5bc5f1e700 1 --2- 172.21.15.69:0/3102668818 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5ba4066f30 0x7f5ba40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:45.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.008+0000 7f5bc5f1e700 1 --2- 172.21.15.69:0/3102668818 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5ba4066f30 0x7f5ba40693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc00f650 tx=0x7f5bbc00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:45.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.012+0000 7f5bb5ffb700 1 -- 172.21.15.69:0/3102668818 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5bb0050c80 con 0x7f5bc006e0e0 2023-10-06T01:38:45.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.192+0000 7f5bc8182700 1 -- 172.21.15.69:0/3102668818 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5bc004c3c0 con 0x7f5bc006e0e0 2023-10-06T01:38:45.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.192+0000 7f5bb5ffb700 1 -- 172.21.15.69:0/3102668818 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5bb0017020 con 0x7f5bc006e0e0 2023-10-06T01:38:45.194 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-10-06T01:38:45.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.194+0000 7f5bc8182700 1 -- 172.21.15.69:0/3102668818 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5ba4066f30 msgr2=0x7f5ba40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:45.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.194+0000 7f5bc8182700 1 --2- 172.21.15.69:0/3102668818 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5ba4066f30 0x7f5ba40693e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc00f650 tx=0x7f5bbc00b040 comp rx=0 tx=0).stop 2023-10-06T01:38:45.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.194+0000 7f5bc8182700 1 -- 172.21.15.69:0/3102668818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bc006e0e0 msgr2=0x7f5bc014cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:45.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.194+0000 7f5bc8182700 1 --2- 172.21.15.69:0/3102668818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bc006e0e0 0x7f5bc014cf80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f5bb00011e0 tx=0x7f5bb0007df0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.194+0000 7f5bc8182700 1 -- 172.21.15.69:0/3102668818 shutdown_connections 2023-10-06T01:38:45.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.194+0000 7f5bc8182700 1 --2- 172.21.15.69:0/3102668818 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5ba4066f30 0x7f5ba40693e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.194+0000 7f5bc8182700 1 --2- 172.21.15.69:0/3102668818 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5bc0159530 0x7f5bc014d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.194+0000 7f5bc8182700 1 --2- 172.21.15.69:0/3102668818 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5bc006dc70 0x7f5bc015bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.194+0000 7f5bc8182700 1 --2- 172.21.15.69:0/3102668818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5bc006e0e0 0x7f5bc014cf80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.194+0000 7f5bc8182700 1 -- 172.21.15.69:0/3102668818 >> 172.21.15.69:0/3102668818 conn(0x7f5bc00703a0 msgr2=0x7f5bc00cb930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:45.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.194+0000 7f5bc8182700 1 -- 172.21.15.69:0/3102668818 shutdown_connections 2023-10-06T01:38:45.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.195+0000 7f5bc8182700 1 -- 172.21.15.69:0/3102668818 wait complete. 2023-10-06T01:38:45.207 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:38:45.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.323+0000 7f6f388d3700 1 Processor -- start 2023-10-06T01:38:45.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.323+0000 7f6f388d3700 1 -- start start 2023-10-06T01:38:45.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.324+0000 7f6f388d3700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6f34159530 0x7f6f340ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:45.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.324+0000 7f6f388d3700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6f3406e0e0 0x7f6f340cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:45.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.324+0000 7f6f388d3700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f340ccfd0 con 0x7f6f3406dc70 2023-10-06T01:38:45.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.324+0000 7f6f388d3700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f340cf0e0 con 0x7f6f3406e0e0 2023-10-06T01:38:45.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.324+0000 7f6f388d3700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3415a3d0 con 0x7f6f34159530 2023-10-06T01:38:45.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.324+0000 7f6f32d9d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6f3406e0e0 0x7f6f340cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:45.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.324+0000 7f6f32d9d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6f3406e0e0 0x7f6f340cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57944/0 (socket says 172.21.15.69:57944) 2023-10-06T01:38:45.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.324+0000 7f6f32d9d700 1 -- 172.21.15.69:0/78789919 learned_addr learned my addr 172.21.15.69:0/78789919 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:45.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.325+0000 7f6f3259c700 1 --2- 172.21.15.69:0/78789919 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6f34159530 0x7f6f340ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:45.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.325+0000 7f6f32d9d700 1 -- 172.21.15.69:0/78789919 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6f34159530 msgr2=0x7f6f340ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:45.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.325+0000 7f6f32d9d700 1 --2- 172.21.15.69:0/78789919 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6f34159530 0x7f6f340ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.325+0000 7f6f32d9d700 1 -- 172.21.15.69:0/78789919 >> v1:172.21.15.88:6789/0 conn(0x7f6f3406dc70 legacy=0x7f6f34159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:45.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.325+0000 7f6f32d9d700 1 -- 172.21.15.69:0/78789919 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3415a6b0 con 0x7f6f3406e0e0 2023-10-06T01:38:45.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.325+0000 7f6f3259c700 1 --2- 172.21.15.69:0/78789919 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6f34159530 0x7f6f340ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:38:45.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.325+0000 7f6f32d9d700 1 --2- 172.21.15.69:0/78789919 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f3406e0e0 0x7f6f340cb6f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c009f20 tx=0x7f6f2c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b54725c7cee90af3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:45.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.325+0000 7f6f31d9b700 1 -- 172.21.15.69:0/78789919 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c00e070 con 0x7f6f3406e0e0 2023-10-06T01:38:45.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.325+0000 7f6f31d9b700 1 -- 172.21.15.69:0/78789919 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2c00ba80 con 0x7f6f3406e0e0 2023-10-06T01:38:45.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.325+0000 7f6f31d9b700 1 -- 172.21.15.69:0/78789919 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2c0092e0 con 0x7f6f3406e0e0 2023-10-06T01:38:45.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.325+0000 7f6f388d3700 1 -- 172.21.15.69:0/78789919 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f3406e0e0 msgr2=0x7f6f340cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:45.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.325+0000 7f6f388d3700 1 --2- 172.21.15.69:0/78789919 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f3406e0e0 0x7f6f340cb6f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6f2c009f20 tx=0x7f6f2c009840 comp rx=0 tx=0).stop 2023-10-06T01:38:45.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.326+0000 7f6f388d3700 1 -- 172.21.15.69:0/78789919 shutdown_connections 2023-10-06T01:38:45.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.326+0000 7f6f388d3700 1 --2- 172.21.15.69:0/78789919 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6f34159530 0x7f6f340ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.326+0000 7f6f388d3700 1 --2- 172.21.15.69:0/78789919 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f3406e0e0 0x7f6f340cb6f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.326+0000 7f6f388d3700 1 -- 172.21.15.69:0/78789919 >> 172.21.15.69:0/78789919 conn(0x7f6f340703a0 msgr2=0x7f6f340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:45.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.326+0000 7f6f388d3700 1 -- 172.21.15.69:0/78789919 shutdown_connections 2023-10-06T01:38:45.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.326+0000 7f6f388d3700 1 -- 172.21.15.69:0/78789919 wait complete. 2023-10-06T01:38:45.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.327+0000 7f6f388d3700 1 Processor -- start 2023-10-06T01:38:45.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.327+0000 7f6f388d3700 1 -- start start 2023-10-06T01:38:45.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.327+0000 7f6f388d3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f3406dc70 0x7f6f340ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:45.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.328+0000 7f6f388d3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f3406e0e0 0x7f6f3416a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:45.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.328+0000 7f6f388d3700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6f34159530 0x7f6f3416aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:45.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.328+0000 7f6f388d3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3416aab0 con 0x7f6f3406dc70 2023-10-06T01:38:45.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.328+0000 7f6f388d3700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f340c8120 con 0x7f6f3406e0e0 2023-10-06T01:38:45.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.328+0000 7f6f388d3700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f340c7830 con 0x7f6f34159530 2023-10-06T01:38:45.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.328+0000 7f6f3259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f3406dc70 0x7f6f340ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:45.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.328+0000 7f6f3259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f3406dc70 0x7f6f340ca370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57948/0 (socket says 172.21.15.69:57948) 2023-10-06T01:38:45.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.328+0000 7f6f3259c700 1 -- 172.21.15.69:0/1284374836 learned_addr learned my addr 172.21.15.69:0/1284374836 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:45.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.328+0000 7f6f32d9d700 1 --2- 172.21.15.69:0/1284374836 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6f34159530 0x7f6f3416aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:45.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.328+0000 7f6f29d9b700 1 --2- 172.21.15.69:0/1284374836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f3406e0e0 0x7f6f3416a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:45.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.328+0000 7f6f3259c700 1 -- 172.21.15.69:0/1284374836 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6f34159530 msgr2=0x7f6f3416aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:45.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.328+0000 7f6f3259c700 1 --2- 172.21.15.69:0/1284374836 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6f34159530 0x7f6f3416aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.328+0000 7f6f3259c700 1 -- 172.21.15.69:0/1284374836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f3406e0e0 msgr2=0x7f6f3416a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:45.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.328+0000 7f6f3259c700 1 --2- 172.21.15.69:0/1284374836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f3406e0e0 0x7f6f3416a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.328+0000 7f6f3259c700 1 -- 172.21.15.69:0/1284374836 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f2c009ae0 con 0x7f6f3406dc70 2023-10-06T01:38:45.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.328+0000 7f6f32d9d700 1 --2- 172.21.15.69:0/1284374836 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6f34159530 0x7f6f3416aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:38:45.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.328+0000 7f6f3259c700 1 --2- 172.21.15.69:0/1284374836 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f3406dc70 0x7f6f340ca370 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400c880 tx=0x7f6f24008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:45.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.328+0000 7f6f2affd700 1 -- 172.21.15.69:0/1284374836 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f24011600 con 0x7f6f3406dc70 2023-10-06T01:38:45.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.328+0000 7f6f2affd700 1 -- 172.21.15.69:0/1284374836 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f24011760 con 0x7f6f3406dc70 2023-10-06T01:38:45.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.328+0000 7f6f388d3700 1 -- 172.21.15.69:0/1284374836 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f340c7ad0 con 0x7f6f3406dc70 2023-10-06T01:38:45.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.328+0000 7f6f2affd700 1 -- 172.21.15.69:0/1284374836 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f24011b00 con 0x7f6f3406dc70 2023-10-06T01:38:45.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.328+0000 7f6f388d3700 1 -- 172.21.15.69:0/1284374836 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f340caa70 con 0x7f6f3406dc70 2023-10-06T01:38:45.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.329+0000 7f6f388d3700 1 -- 172.21.15.69:0/1284374836 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3404c3c0 con 0x7f6f3406dc70 2023-10-06T01:38:45.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.330+0000 7f6f2affd700 1 -- 172.21.15.69:0/1284374836 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6f24018350 con 0x7f6f3406dc70 2023-10-06T01:38:45.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.330+0000 7f6f2affd700 1 --2- 172.21.15.69:0/1284374836 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6f14066f30 0x7f6f140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:45.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.330+0000 7f6f2affd700 1 -- 172.21.15.69:0/1284374836 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f6f240842c0 con 0x7f6f3406dc70 2023-10-06T01:38:45.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.330+0000 7f6f29d9b700 1 --2- 172.21.15.69:0/1284374836 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6f14066f30 0x7f6f140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:45.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.330+0000 7f6f29d9b700 1 --2- 172.21.15.69:0/1284374836 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6f14066f30 0x7f6f140693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6f341511e0 tx=0x7f6f1c007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:45.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.334+0000 7f6f2affd700 1 -- 172.21.15.69:0/1284374836 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f240551b0 con 0x7f6f3406dc70 2023-10-06T01:38:45.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.515+0000 7f6f388d3700 1 -- 172.21.15.69:0/1284374836 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6f3415a990 con 0x7f6f3406dc70 2023-10-06T01:38:45.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.516+0000 7f6f2affd700 1 -- 172.21.15.69:0/1284374836 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6f24054d40 con 0x7f6f3406dc70 2023-10-06T01:38:45.517 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 8 2023-10-06T01:38:45.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.518+0000 7f6f388d3700 1 -- 172.21.15.69:0/1284374836 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6f14066f30 msgr2=0x7f6f140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:45.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.518+0000 7f6f388d3700 1 --2- 172.21.15.69:0/1284374836 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6f14066f30 0x7f6f140693e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6f341511e0 tx=0x7f6f1c007ec0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.518+0000 7f6f388d3700 1 -- 172.21.15.69:0/1284374836 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f3406dc70 msgr2=0x7f6f340ca370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:45.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.518+0000 7f6f388d3700 1 --2- 172.21.15.69:0/1284374836 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f3406dc70 0x7f6f340ca370 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6f2400c880 tx=0x7f6f24008040 comp rx=0 tx=0).stop 2023-10-06T01:38:45.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.518+0000 7f6f388d3700 1 -- 172.21.15.69:0/1284374836 shutdown_connections 2023-10-06T01:38:45.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.518+0000 7f6f388d3700 1 --2- 172.21.15.69:0/1284374836 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6f14066f30 0x7f6f140693e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.518+0000 7f6f388d3700 1 --2- 172.21.15.69:0/1284374836 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6f34159530 0x7f6f3416aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.518+0000 7f6f388d3700 1 --2- 172.21.15.69:0/1284374836 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6f3406dc70 0x7f6f340ca370 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.518+0000 7f6f388d3700 1 --2- 172.21.15.69:0/1284374836 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6f3406e0e0 0x7f6f3416a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.518+0000 7f6f388d3700 1 -- 172.21.15.69:0/1284374836 >> 172.21.15.69:0/1284374836 conn(0x7f6f340703a0 msgr2=0x7f6f340b1320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:45.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.518+0000 7f6f388d3700 1 -- 172.21.15.69:0/1284374836 shutdown_connections 2023-10-06T01:38:45.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.518+0000 7f6f388d3700 1 -- 172.21.15.69:0/1284374836 wait complete. 2023-10-06T01:38:45.531 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:38:45.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.644+0000 7feeedbe1700 1 Processor -- start 2023-10-06T01:38:45.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.645+0000 7feeedbe1700 1 -- start start 2023-10-06T01:38:45.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.645+0000 7feeedbe1700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feee815cb50 0x7feee80b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:45.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.645+0000 7feeedbe1700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7feee80b0710 0x7feee81536c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:45.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.645+0000 7feeedbe1700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee815ad50 con 0x7feee815cf20 2023-10-06T01:38:45.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.645+0000 7feeedbe1700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee815a140 con 0x7feee80b0710 2023-10-06T01:38:45.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.645+0000 7feeedbe1700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee815a420 con 0x7feee815cb50 2023-10-06T01:38:45.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.645+0000 7feee7fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7feee80b0710 0x7feee81536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:45.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.645+0000 7feee7fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7feee80b0710 0x7feee81536c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57958/0 (socket says 172.21.15.69:57958) 2023-10-06T01:38:45.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.645+0000 7feee7fff700 1 -- 172.21.15.69:0/1538148301 learned_addr learned my addr 172.21.15.69:0/1538148301 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:45.648 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.646+0000 7feee77fe700 1 --2- 172.21.15.69:0/1538148301 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feee815cb50 0x7feee80b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:45.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.646+0000 7feee7fff700 1 -- 172.21.15.69:0/1538148301 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feee815cb50 msgr2=0x7feee80b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:45.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.646+0000 7feee7fff700 1 --2- 172.21.15.69:0/1538148301 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feee815cb50 0x7feee80b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.646+0000 7feee7fff700 1 -- 172.21.15.69:0/1538148301 >> v1:172.21.15.88:6789/0 conn(0x7feee815cf20 legacy=0x7feee80b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:45.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.646+0000 7feee7fff700 1 -- 172.21.15.69:0/1538148301 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee815a700 con 0x7feee80b0710 2023-10-06T01:38:45.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.646+0000 7feee7fff700 1 --2- 172.21.15.69:0/1538148301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feee80b0710 0x7feee81536c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7feee00099b0 tx=0x7feee0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce757b88cc3034de server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:45.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.646+0000 7feee67fc700 1 -- 172.21.15.69:0/1538148301 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee000b860 con 0x7feee80b0710 2023-10-06T01:38:45.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.646+0000 7feee67fc700 1 -- 172.21.15.69:0/1538148301 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee000b9c0 con 0x7feee80b0710 2023-10-06T01:38:45.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.646+0000 7feee67fc700 1 -- 172.21.15.69:0/1538148301 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee000bd60 con 0x7feee80b0710 2023-10-06T01:38:45.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.646+0000 7feeedbe1700 1 -- 172.21.15.69:0/1538148301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feee80b0710 msgr2=0x7feee81536c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:45.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.646+0000 7feeedbe1700 1 --2- 172.21.15.69:0/1538148301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feee80b0710 0x7feee81536c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7feee00099b0 tx=0x7feee0009250 comp rx=0 tx=0).stop 2023-10-06T01:38:45.649 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.646+0000 7feeedbe1700 1 -- 172.21.15.69:0/1538148301 shutdown_connections 2023-10-06T01:38:45.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.646+0000 7feeedbe1700 1 --2- 172.21.15.69:0/1538148301 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feee815cb50 0x7feee80b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.646+0000 7feeedbe1700 1 --2- 172.21.15.69:0/1538148301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feee80b0710 0x7feee81536c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.646+0000 7feeedbe1700 1 -- 172.21.15.69:0/1538148301 >> 172.21.15.69:0/1538148301 conn(0x7feee80cded0 msgr2=0x7feee806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:45.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.647+0000 7feeedbe1700 1 -- 172.21.15.69:0/1538148301 shutdown_connections 2023-10-06T01:38:45.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.647+0000 7feeedbe1700 1 -- 172.21.15.69:0/1538148301 wait complete. 2023-10-06T01:38:45.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.648+0000 7feeedbe1700 1 Processor -- start 2023-10-06T01:38:45.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.648+0000 7feeedbe1700 1 -- start start 2023-10-06T01:38:45.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.648+0000 7feeedbe1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feee80b0710 0x7feee80acd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:45.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.648+0000 7feeedbe1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feee815cb50 0x7feee8153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:45.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.648+0000 7feeedbe1700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feee815cf20 0x7feee815f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:45.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.648+0000 7feeedbe1700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee81604f0 con 0x7feee80b0710 2023-10-06T01:38:45.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.648+0000 7feeedbe1700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee81558a0 con 0x7feee815cb50 2023-10-06T01:38:45.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.648+0000 7feeedbe1700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee8154fb0 con 0x7feee815cf20 2023-10-06T01:38:45.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.648+0000 7feee77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feee80b0710 0x7feee80acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:45.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.649+0000 7feee77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feee80b0710 0x7feee80acd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57960/0 (socket says 172.21.15.69:57960) 2023-10-06T01:38:45.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.649+0000 7feee77fe700 1 -- 172.21.15.69:0/2730763185 learned_addr learned my addr 172.21.15.69:0/2730763185 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:45.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.649+0000 7feee6ffd700 1 --2- 172.21.15.69:0/2730763185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feee815cb50 0x7feee8153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:45.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.649+0000 7feee7fff700 1 --2- 172.21.15.69:0/2730763185 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feee815cf20 0x7feee815f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:45.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.649+0000 7feee77fe700 1 -- 172.21.15.69:0/2730763185 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feee815cf20 msgr2=0x7feee815f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:45.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.649+0000 7feee77fe700 1 --2- 172.21.15.69:0/2730763185 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feee815cf20 0x7feee815f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.649+0000 7feee77fe700 1 -- 172.21.15.69:0/2730763185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feee815cb50 msgr2=0x7feee8153460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:45.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.649+0000 7feee77fe700 1 --2- 172.21.15.69:0/2730763185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feee815cb50 0x7feee8153460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.649+0000 7feee77fe700 1 -- 172.21.15.69:0/2730763185 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee00094f0 con 0x7feee80b0710 2023-10-06T01:38:45.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.649+0000 7feee7fff700 1 --2- 172.21.15.69:0/2730763185 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feee815cf20 0x7feee815f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:38:45.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.649+0000 7feee77fe700 1 --2- 172.21.15.69:0/2730763185 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feee80b0710 0x7feee80acd10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feed800e190 tx=0x7feed8009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:45.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.649+0000 7feecf7fe700 1 -- 172.21.15.69:0/2730763185 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed800ee30 con 0x7feee80b0710 2023-10-06T01:38:45.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.649+0000 7feecf7fe700 1 -- 172.21.15.69:0/2730763185 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed8014420 con 0x7feee80b0710 2023-10-06T01:38:45.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.649+0000 7feeedbe1700 1 -- 172.21.15.69:0/2730763185 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee8160210 con 0x7feee80b0710 2023-10-06T01:38:45.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.649+0000 7feecf7fe700 1 -- 172.21.15.69:0/2730763185 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed80147e0 con 0x7feee80b0710 2023-10-06T01:38:45.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.649+0000 7feeedbe1700 1 -- 172.21.15.69:0/2730763185 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee8155530 con 0x7feee80b0710 2023-10-06T01:38:45.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.650+0000 7feeedbe1700 1 -- 172.21.15.69:0/2730763185 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee8155b80 con 0x7feee80b0710 2023-10-06T01:38:45.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.650+0000 7feecf7fe700 1 -- 172.21.15.69:0/2730763185 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feed8014b90 con 0x7feee80b0710 2023-10-06T01:38:45.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.651+0000 7feecf7fe700 1 --2- 172.21.15.69:0/2730763185 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7feed4066f30 0x7feed40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:45.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.651+0000 7feee6ffd700 1 --2- 172.21.15.69:0/2730763185 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7feed4066f30 0x7feed40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:45.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.651+0000 7feecf7fe700 1 -- 172.21.15.69:0/2730763185 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7feed8084b40 con 0x7feee80b0710 2023-10-06T01:38:45.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.651+0000 7feee6ffd700 1 --2- 172.21.15.69:0/2730763185 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7feed4066f30 0x7feed40693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feee80afec0 tx=0x7feedc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:45.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.655+0000 7feecf7fe700 1 -- 172.21.15.69:0/2730763185 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feed8051fa0 con 0x7feee80b0710 2023-10-06T01:38:45.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.880+0000 7feeedbe1700 1 -- 172.21.15.69:0/2730763185 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feee804c3c0 con 0x7feee80b0710 2023-10-06T01:38:45.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.881+0000 7feecf7fe700 1 -- 172.21.15.69:0/2730763185 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3524 (secure 0 0 0) 0x7feed8009a60 con 0x7feee80b0710 2023-10-06T01:38:45.882 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:38:45.883 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6836/2049506781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2049506781},{"type":"v1","addr":"172.21.15.69:6836","nonce":2049506781}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3367080201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6835","nonce":3367080201},{"type":"v1","addr":"172.21.15.69:6837","nonce":3367080201}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2692995813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":2692995813},{"type":"v1","addr":"172.21.15.88:6835","nonce":2692995813}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4302,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/2097597935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":2097597935},{"type":"v1","addr":"172.21.15.88:6834","nonce":2097597935}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-06T01:38:45.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.883+0000 7feeedbe1700 1 -- 172.21.15.69:0/2730763185 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7feed4066f30 msgr2=0x7feed40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:45.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.883+0000 7feeedbe1700 1 --2- 172.21.15.69:0/2730763185 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7feed4066f30 0x7feed40693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7feee80afec0 tx=0x7feedc009040 comp rx=0 tx=0).stop 2023-10-06T01:38:45.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.883+0000 7feeedbe1700 1 -- 172.21.15.69:0/2730763185 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feee80b0710 msgr2=0x7feee80acd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:45.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.883+0000 7feeedbe1700 1 --2- 172.21.15.69:0/2730763185 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feee80b0710 0x7feee80acd10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7feed800e190 tx=0x7feed8009920 comp rx=0 tx=0).stop 2023-10-06T01:38:45.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.883+0000 7feeedbe1700 1 -- 172.21.15.69:0/2730763185 shutdown_connections 2023-10-06T01:38:45.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.883+0000 7feeedbe1700 1 --2- 172.21.15.69:0/2730763185 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7feed4066f30 0x7feed40693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.883+0000 7feeedbe1700 1 --2- 172.21.15.69:0/2730763185 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7feee815cf20 0x7feee815f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.883+0000 7feeedbe1700 1 --2- 172.21.15.69:0/2730763185 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feee80b0710 0x7feee80acd10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.883+0000 7feeedbe1700 1 --2- 172.21.15.69:0/2730763185 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7feee815cb50 0x7feee8153460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:45.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.883+0000 7feeedbe1700 1 -- 172.21.15.69:0/2730763185 >> 172.21.15.69:0/2730763185 conn(0x7feee80cded0 msgr2=0x7feee8160630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:45.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.883+0000 7feeedbe1700 1 -- 172.21.15.69:0/2730763185 shutdown_connections 2023-10-06T01:38:45.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:45.883+0000 7feeedbe1700 1 -- 172.21.15.69:0/2730763185 wait complete. 2023-10-06T01:38:45.886 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 3 2023-10-06T01:38:45.896 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:38:46.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.009+0000 7f4aaa05a700 1 Processor -- start 2023-10-06T01:38:46.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.009+0000 7f4aaa05a700 1 -- start start 2023-10-06T01:38:46.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.010+0000 7f4aaa05a700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4aa41598b0 0x7f4aa40af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:46.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.010+0000 7f4aaa05a700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa40ce9d0 con 0x7f4aa4159c80 2023-10-06T01:38:46.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.010+0000 7f4aaa05a700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa40afc30 con 0x7f4aa40af790 2023-10-06T01:38:46.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.010+0000 7f4aaa05a700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa40aff10 con 0x7f4aa41598b0 2023-10-06T01:38:46.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.010+0000 7f4aa37fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4aa41598b0 0x7f4aa40af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:46.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.010+0000 7f4aa2ffd700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f4aa4159c80 0x7f4aa40cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:46168/0 (socket says 172.21.15.69:46168) 2023-10-06T01:38:46.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.010+0000 7f4aa37fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4aa41598b0 0x7f4aa40af250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57976/0 (socket says 172.21.15.69:57976) 2023-10-06T01:38:46.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.010+0000 7f4aa2ffd700 1 -- 172.21.15.69:0/547249183 learned_addr learned my addr 172.21.15.69:0/547249183 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:38:46.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.010+0000 7f4aa37fe700 1 -- 172.21.15.69:0/547249183 >> v1:172.21.15.88:6789/0 conn(0x7f4aa40af790 legacy=0x7f4aa4163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:46.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.010+0000 7f4aa37fe700 1 -- 172.21.15.69:0/547249183 >> v1:172.21.15.69:6789/0 conn(0x7f4aa4159c80 legacy=0x7f4aa40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:46.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.010+0000 7f4aa27fc700 1 -- 172.21.15.69:0/547249183 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 755220730 0 0) 0x7f4aa40afc30 con 0x7f4aa40af790 2023-10-06T01:38:46.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.010+0000 7f4aa37fe700 1 -- 172.21.15.69:0/547249183 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa40ce380 con 0x7f4aa41598b0 2023-10-06T01:38:46.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.010+0000 7f4aa37fe700 1 --2- 172.21.15.69:0/547249183 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4aa41598b0 0x7f4aa40af250 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4a940098e0 tx=0x7f4a940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=debf8abde760c9e5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:46.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.010+0000 7f4aa27fc700 1 -- 172.21.15.69:0/547249183 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a94009e80 con 0x7f4aa41598b0 2023-10-06T01:38:46.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.010+0000 7f4aa27fc700 1 -- 172.21.15.69:0/547249183 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9400b860 con 0x7f4aa41598b0 2023-10-06T01:38:46.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.010+0000 7f4aa27fc700 1 -- 172.21.15.69:0/547249183 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9400bbe0 con 0x7f4aa41598b0 2023-10-06T01:38:46.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.011+0000 7f4aaa05a700 1 -- 172.21.15.69:0/547249183 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4aa41598b0 msgr2=0x7f4aa40af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:46.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.011+0000 7f4aaa05a700 1 --2- 172.21.15.69:0/547249183 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4aa41598b0 0x7f4aa40af250 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f4a940098e0 tx=0x7f4a940091a0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.011+0000 7f4aaa05a700 1 -- 172.21.15.69:0/547249183 shutdown_connections 2023-10-06T01:38:46.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.011+0000 7f4aaa05a700 1 --2- 172.21.15.69:0/547249183 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4aa41598b0 0x7f4aa40af250 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.011+0000 7f4aaa05a700 1 -- 172.21.15.69:0/547249183 >> 172.21.15.69:0/547249183 conn(0x7f4aa4070e30 msgr2=0x7f4aa40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:46.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.011+0000 7f4aaa05a700 1 -- 172.21.15.69:0/547249183 shutdown_connections 2023-10-06T01:38:46.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.011+0000 7f4aaa05a700 1 -- 172.21.15.69:0/547249183 wait complete. 2023-10-06T01:38:46.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.012+0000 7f4aaa05a700 1 Processor -- start 2023-10-06T01:38:46.017 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.012+0000 7f4aaa05a700 1 -- start start 2023-10-06T01:38:46.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.013+0000 7f4aaa05a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4aa40af790 0x7f4aa4169bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:46.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.013+0000 7f4aaa05a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4aa41598b0 0x7f4aa4158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:46.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.013+0000 7f4aaa05a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4aa4159c80 0x7f4aa416d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:46.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.013+0000 7f4aaa05a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa415ba60 con 0x7f4aa41598b0 2023-10-06T01:38:46.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.013+0000 7f4aaa05a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa415bd40 con 0x7f4aa40af790 2023-10-06T01:38:46.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.013+0000 7f4aaa05a700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa416d670 con 0x7f4aa4159c80 2023-10-06T01:38:46.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.013+0000 7f4aa2ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4aa41598b0 0x7f4aa4158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:46.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.013+0000 7f4aa2ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4aa41598b0 0x7f4aa4158bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57982/0 (socket says 172.21.15.69:57982) 2023-10-06T01:38:46.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.013+0000 7f4aa2ffd700 1 -- 172.21.15.69:0/3619863894 learned_addr learned my addr 172.21.15.69:0/3619863894 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:46.018 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.013+0000 7f4aa37fe700 1 --2- 172.21.15.69:0/3619863894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4aa40af790 0x7f4aa4169bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:46.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.013+0000 7f4aa3fff700 1 --2- 172.21.15.69:0/3619863894 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4aa4159c80 0x7f4aa416d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:46.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.013+0000 7f4aa2ffd700 1 -- 172.21.15.69:0/3619863894 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4aa4159c80 msgr2=0x7f4aa416d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:46.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.014+0000 7f4aa2ffd700 1 --2- 172.21.15.69:0/3619863894 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4aa4159c80 0x7f4aa416d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.014+0000 7f4aa2ffd700 1 -- 172.21.15.69:0/3619863894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4aa40af790 msgr2=0x7f4aa4169bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:46.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.014+0000 7f4aa2ffd700 1 --2- 172.21.15.69:0/3619863894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4aa40af790 0x7f4aa4169bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.014+0000 7f4aa2ffd700 1 -- 172.21.15.69:0/3619863894 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a94009420 con 0x7f4aa41598b0 2023-10-06T01:38:46.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.014+0000 7f4aa37fe700 1 --2- 172.21.15.69:0/3619863894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4aa40af790 0x7f4aa4169bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:38:46.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.014+0000 7f4aa3fff700 1 --2- 172.21.15.69:0/3619863894 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4aa4159c80 0x7f4aa416d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:38:46.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.014+0000 7f4aa2ffd700 1 --2- 172.21.15.69:0/3619863894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4aa41598b0 0x7f4aa4158bc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4a9800c590 tx=0x7f4a98007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:46.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.014+0000 7f4a8b7fe700 1 -- 172.21.15.69:0/3619863894 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a98005b30 con 0x7f4aa41598b0 2023-10-06T01:38:46.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.014+0000 7f4a8b7fe700 1 -- 172.21.15.69:0/3619863894 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a98005cd0 con 0x7f4aa41598b0 2023-10-06T01:38:46.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.014+0000 7f4a8b7fe700 1 -- 172.21.15.69:0/3619863894 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a98007320 con 0x7f4aa41598b0 2023-10-06T01:38:46.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.014+0000 7f4aaa05a700 1 -- 172.21.15.69:0/3619863894 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa416d910 con 0x7f4aa41598b0 2023-10-06T01:38:46.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.014+0000 7f4aaa05a700 1 -- 172.21.15.69:0/3619863894 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa416ded0 con 0x7f4aa41598b0 2023-10-06T01:38:46.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.015+0000 7f4aaa05a700 1 -- 172.21.15.69:0/3619863894 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa415beb0 con 0x7f4aa41598b0 2023-10-06T01:38:46.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.015+0000 7f4a8b7fe700 1 -- 172.21.15.69:0/3619863894 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4a98007690 con 0x7f4aa41598b0 2023-10-06T01:38:46.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.016+0000 7f4a8b7fe700 1 --2- 172.21.15.69:0/3619863894 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4a90066f30 0x7f4a900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:46.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.016+0000 7f4a8b7fe700 1 -- 172.21.15.69:0/3619863894 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f4a98083610 con 0x7f4aa41598b0 2023-10-06T01:38:46.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.016+0000 7f4aa37fe700 1 --2- 172.21.15.69:0/3619863894 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4a90066f30 0x7f4a900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:46.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.016+0000 7f4aa37fe700 1 --2- 172.21.15.69:0/3619863894 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4a90066f30 0x7f4a900693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4a940098e0 tx=0x7f4a94017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:46.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.020+0000 7f4a8b7fe700 1 -- 172.21.15.69:0/3619863894 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4a9804b5a0 con 0x7f4aa41598b0 2023-10-06T01:38:46.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.203+0000 7f4aaa05a700 1 -- 172.21.15.69:0/3619863894 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4aa404c3c0 con 0x7f4aa41598b0 2023-10-06T01:38:46.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.204+0000 7f4a8b7fe700 1 -- 172.21.15.69:0/3619863894 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+13599 (secure 0 0 0) 0x7f4a98050a80 con 0x7f4aa41598b0 2023-10-06T01:38:46.206 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:38:46.206 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":20,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:38:45.525762+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:38:43.046056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:38:46.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.206+0000 7f4aaa05a700 1 -- 172.21.15.69:0/3619863894 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4a90066f30 msgr2=0x7f4a900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:46.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.206+0000 7f4aaa05a700 1 --2- 172.21.15.69:0/3619863894 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4a90066f30 0x7f4a900693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4a940098e0 tx=0x7f4a94017000 comp rx=0 tx=0).stop 2023-10-06T01:38:46.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.206+0000 7f4aaa05a700 1 -- 172.21.15.69:0/3619863894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4aa41598b0 msgr2=0x7f4aa4158bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:46.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.206+0000 7f4aaa05a700 1 --2- 172.21.15.69:0/3619863894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4aa41598b0 0x7f4aa4158bc0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4a9800c590 tx=0x7f4a98007f90 comp rx=0 tx=0).stop 2023-10-06T01:38:46.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.206+0000 7f4aaa05a700 1 -- 172.21.15.69:0/3619863894 shutdown_connections 2023-10-06T01:38:46.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.206+0000 7f4aaa05a700 1 --2- 172.21.15.69:0/3619863894 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4a90066f30 0x7f4a900693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.206+0000 7f4aaa05a700 1 --2- 172.21.15.69:0/3619863894 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4aa4159c80 0x7f4aa416d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.206+0000 7f4aaa05a700 1 --2- 172.21.15.69:0/3619863894 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4aa40af790 0x7f4aa4169bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.206+0000 7f4aaa05a700 1 --2- 172.21.15.69:0/3619863894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4aa41598b0 0x7f4aa4158bc0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.206+0000 7f4aaa05a700 1 -- 172.21.15.69:0/3619863894 >> 172.21.15.69:0/3619863894 conn(0x7f4aa4070e30 msgr2=0x7f4aa4153e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:46.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.206+0000 7f4aaa05a700 1 -- 172.21.15.69:0/3619863894 shutdown_connections 2023-10-06T01:38:46.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.206+0000 7f4aaa05a700 1 -- 172.21.15.69:0/3619863894 wait complete. 2023-10-06T01:38:46.220 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:38:38.288642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:38:43.046056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T01:38:46.220 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:38:46.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.336+0000 7f444cb69700 1 Processor -- start 2023-10-06T01:38:46.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.336+0000 7f444cb69700 1 -- start start 2023-10-06T01:38:46.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.337+0000 7f444cb69700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4448067cb0 0x7f44480ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:46.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.337+0000 7f444cb69700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44480cddf0 con 0x7f4448150c80 2023-10-06T01:38:46.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.337+0000 7f444cb69700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44480b0360 con 0x7f44481508b0 2023-10-06T01:38:46.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.337+0000 7f444cb69700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44480cd550 con 0x7f4448067cb0 2023-10-06T01:38:46.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.337+0000 7f4445d9b700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f4448150c80 0x7f44480675a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:46182/0 (socket says 172.21.15.69:46182) 2023-10-06T01:38:46.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.337+0000 7f4445d9b700 1 -- 172.21.15.69:0/551400019 learned_addr learned my addr 172.21.15.69:0/551400019 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:38:46.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.338+0000 7f4446d9d700 1 --2- 172.21.15.69:0/551400019 >> v2:172.21.15.88:3300/0 conn(0x7f4448067cb0 0x7f44480ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:46.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.338+0000 7f444559a700 1 -- 172.21.15.69:0/551400019 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4035178728 0 0) 0x7f44480cddf0 con 0x7f4448150c80 2023-10-06T01:38:46.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.338+0000 7f444559a700 1 -- 172.21.15.69:0/551400019 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4430003570 con 0x7f4448150c80 2023-10-06T01:38:46.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.338+0000 7f444559a700 1 -- 172.21.15.69:0/551400019 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 327546415 0 0) 0x7f4430003570 con 0x7f4448150c80 2023-10-06T01:38:46.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.338+0000 7f444559a700 1 -- 172.21.15.69:0/551400019 >> v2:172.21.15.88:3300/0 conn(0x7f4448067cb0 msgr2=0x7f44480ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:46.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.338+0000 7f444559a700 1 --2- 172.21.15.69:0/551400019 >> v2:172.21.15.88:3300/0 conn(0x7f4448067cb0 0x7f44480ccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.338+0000 7f444559a700 1 -- 172.21.15.69:0/551400019 >> v1:172.21.15.88:6789/0 conn(0x7f44481508b0 legacy=0x7f44481573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:46.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.338+0000 7f444559a700 1 -- 172.21.15.69:0/551400019 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44480cd830 con 0x7f4448150c80 2023-10-06T01:38:46.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.338+0000 7f444559a700 1 -- 172.21.15.69:0/551400019 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f443c001470 con 0x7f4448150c80 2023-10-06T01:38:46.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.338+0000 7f444559a700 1 -- 172.21.15.69:0/551400019 >> v1:172.21.15.69:6789/0 conn(0x7f4448150c80 legacy=0x7f44480675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:46.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.338+0000 7f444559a700 1 --2- 172.21.15.69:0/551400019 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4430003a60 0x7f4430003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:46.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.338+0000 7f444559a700 1 --2- 172.21.15.69:0/551400019 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4430004810 0x7f4430004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:46.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.338+0000 7f444559a700 1 --2- 172.21.15.69:0/551400019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44300051c0 0x7f443000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:46.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.338+0000 7f444559a700 1 -- 172.21.15.69:0/551400019 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44480cd550 con 0x7f4430003a60 2023-10-06T01:38:46.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.338+0000 7f444559a700 1 -- 172.21.15.69:0/551400019 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f443000c160 con 0x7f44300051c0 2023-10-06T01:38:46.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.338+0000 7f444559a700 1 -- 172.21.15.69:0/551400019 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f443000c320 con 0x7f4430004810 2023-10-06T01:38:46.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.338+0000 7f444659c700 1 --2- 172.21.15.69:0/551400019 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4430003a60 0x7f4430003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:46.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.338+0000 7f4446d9d700 1 --2- 172.21.15.69:0/551400019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44300051c0 0x7f443000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:46.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.338+0000 7f4445d9b700 1 --2- 172.21.15.69:0/551400019 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4430004810 0x7f4430004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:46.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.338+0000 7f444659c700 1 -- 172.21.15.69:0/551400019 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4430004810 msgr2=0x7f4430004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:46.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.338+0000 7f444659c700 1 --2- 172.21.15.69:0/551400019 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4430004810 0x7f4430004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.338+0000 7f444659c700 1 -- 172.21.15.69:0/551400019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44300051c0 msgr2=0x7f443000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:46.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.338+0000 7f444659c700 1 --2- 172.21.15.69:0/551400019 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f44300051c0 0x7f443000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.338+0000 7f444659c700 1 -- 172.21.15.69:0/551400019 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4430003570 con 0x7f4430003a60 2023-10-06T01:38:46.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.338+0000 7f4446d9d700 1 -- 172.21.15.69:0/551400019 reap_dead start 2023-10-06T01:38:46.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.338+0000 7f444659c700 1 --2- 172.21.15.69:0/551400019 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4430003a60 0x7f4430003e70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4438001fc0 tx=0x7f4438001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f38f99cee513cd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:46.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.339+0000 7f444559a700 1 -- 172.21.15.69:0/551400019 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4438001950 con 0x7f4430003a60 2023-10-06T01:38:46.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.339+0000 7f444559a700 1 -- 172.21.15.69:0/551400019 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f443800c8b0 con 0x7f4430003a60 2023-10-06T01:38:46.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.339+0000 7f444559a700 1 -- 172.21.15.69:0/551400019 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f443800cc50 con 0x7f4430003a60 2023-10-06T01:38:46.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.339+0000 7f444cb69700 1 -- 172.21.15.69:0/551400019 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4430003a60 msgr2=0x7f4430003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:46.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.339+0000 7f444cb69700 1 --2- 172.21.15.69:0/551400019 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4430003a60 0x7f4430003e70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4438001fc0 tx=0x7f4438001640 comp rx=0 tx=0).stop 2023-10-06T01:38:46.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.339+0000 7f444cb69700 1 -- 172.21.15.69:0/551400019 shutdown_connections 2023-10-06T01:38:46.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.339+0000 7f444cb69700 1 --2- 172.21.15.69:0/551400019 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4430003a60 0x7f4430003e70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.339+0000 7f444cb69700 1 -- 172.21.15.69:0/551400019 >> 172.21.15.69:0/551400019 conn(0x7f444806d7b0 msgr2=0x7f444806dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:46.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.339+0000 7f444cb69700 1 -- 172.21.15.69:0/551400019 shutdown_connections 2023-10-06T01:38:46.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.339+0000 7f444cb69700 1 -- 172.21.15.69:0/551400019 wait complete. 2023-10-06T01:38:46.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.340+0000 7f444cb69700 1 Processor -- start 2023-10-06T01:38:46.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.340+0000 7f444cb69700 1 -- start start 2023-10-06T01:38:46.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.341+0000 7f444cb69700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4430003a60 0x7f44480c4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:46.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.341+0000 7f444cb69700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f44480c3470 0x7f4448140db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:46.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.341+0000 7f444cb69700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4448153740 0x7f4448153be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:46.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.341+0000 7f444cb69700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4448154120 con 0x7f4448153740 2023-10-06T01:38:46.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.341+0000 7f444cb69700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44480c2180 con 0x7f4430003a60 2023-10-06T01:38:46.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.341+0000 7f444cb69700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44480c2fe0 con 0x7f44480c3470 2023-10-06T01:38:46.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.341+0000 7f4446d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4448153740 0x7f4448153be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:46.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.341+0000 7f4446d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4448153740 0x7f4448153be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57994/0 (socket says 172.21.15.69:57994) 2023-10-06T01:38:46.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.341+0000 7f4446d9d700 1 -- 172.21.15.69:0/1606374641 learned_addr learned my addr 172.21.15.69:0/1606374641 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:46.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.341+0000 7f4445d9b700 1 --2- 172.21.15.69:0/1606374641 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f44480c3470 0x7f4448140db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:46.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.341+0000 7f444659c700 1 --2- 172.21.15.69:0/1606374641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4430003a60 0x7f44480c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:46.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.341+0000 7f4446d9d700 1 -- 172.21.15.69:0/1606374641 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f44480c3470 msgr2=0x7f4448140db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:46.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.341+0000 7f4446d9d700 1 --2- 172.21.15.69:0/1606374641 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f44480c3470 0x7f4448140db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.341+0000 7f4446d9d700 1 -- 172.21.15.69:0/1606374641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4430003a60 msgr2=0x7f44480c4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:46.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.341+0000 7f4446d9d700 1 --2- 172.21.15.69:0/1606374641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4430003a60 0x7f44480c4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.341+0000 7f4446d9d700 1 -- 172.21.15.69:0/1606374641 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44480c47c0 con 0x7f4448153740 2023-10-06T01:38:46.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.342+0000 7f4446d9d700 1 --2- 172.21.15.69:0/1606374641 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4448153740 0x7f4448153be0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4440006f00 tx=0x7f44400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:46.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.342+0000 7f44367fc700 1 -- 172.21.15.69:0/1606374641 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4440013750 con 0x7f4448153740 2023-10-06T01:38:46.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.342+0000 7f44367fc700 1 -- 172.21.15.69:0/1606374641 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44400138d0 con 0x7f4448153740 2023-10-06T01:38:46.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.342+0000 7f444cb69700 1 -- 172.21.15.69:0/1606374641 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44480c23d0 con 0x7f4448153740 2023-10-06T01:38:46.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.342+0000 7f44367fc700 1 -- 172.21.15.69:0/1606374641 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4440013c90 con 0x7f4448153740 2023-10-06T01:38:46.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.342+0000 7f444cb69700 1 -- 172.21.15.69:0/1606374641 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44480c2990 con 0x7f4448153740 2023-10-06T01:38:46.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.343+0000 7f444cb69700 1 -- 172.21.15.69:0/1606374641 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44480c3150 con 0x7f4448153740 2023-10-06T01:38:46.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.343+0000 7f44367fc700 1 -- 172.21.15.69:0/1606374641 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4440014650 con 0x7f4448153740 2023-10-06T01:38:46.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.343+0000 7f44367fc700 1 --2- 172.21.15.69:0/1606374641 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4428066f30 0x7f44280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:46.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.343+0000 7f44367fc700 1 -- 172.21.15.69:0/1606374641 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f4440084770 con 0x7f4448153740 2023-10-06T01:38:46.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.344+0000 7f444659c700 1 --2- 172.21.15.69:0/1606374641 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4428066f30 0x7f44280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:46.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.344+0000 7f444659c700 1 --2- 172.21.15.69:0/1606374641 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4428066f30 0x7f44280693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4438001da0 tx=0x7f4438015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:46.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.348+0000 7f44367fc700 1 -- 172.21.15.69:0/1606374641 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4440051c50 con 0x7f4448153740 2023-10-06T01:38:46.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.532+0000 7f444cb69700 1 -- 172.21.15.69:0/1606374641 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f444804c3c0 con 0x7f4448153740 2023-10-06T01:38:46.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.532+0000 7f44367fc700 1 -- 172.21.15.69:0/1606374641 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4440006cb0 con 0x7f4448153740 2023-10-06T01:38:46.534 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-10-06T01:38:46.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.534+0000 7f444cb69700 1 -- 172.21.15.69:0/1606374641 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4428066f30 msgr2=0x7f44280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:46.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.534+0000 7f444cb69700 1 --2- 172.21.15.69:0/1606374641 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4428066f30 0x7f44280693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4438001da0 tx=0x7f4438015000 comp rx=0 tx=0).stop 2023-10-06T01:38:46.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.534+0000 7f444cb69700 1 -- 172.21.15.69:0/1606374641 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4448153740 msgr2=0x7f4448153be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:46.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.534+0000 7f444cb69700 1 --2- 172.21.15.69:0/1606374641 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4448153740 0x7f4448153be0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4440006f00 tx=0x7f44400091a0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.534+0000 7f444cb69700 1 -- 172.21.15.69:0/1606374641 shutdown_connections 2023-10-06T01:38:46.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.534+0000 7f444cb69700 1 --2- 172.21.15.69:0/1606374641 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4428066f30 0x7f44280693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.534+0000 7f444cb69700 1 --2- 172.21.15.69:0/1606374641 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4448153740 0x7f4448153be0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.534+0000 7f444cb69700 1 --2- 172.21.15.69:0/1606374641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4430003a60 0x7f44480c4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.534+0000 7f444cb69700 1 --2- 172.21.15.69:0/1606374641 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f44480c3470 0x7f4448140db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.535+0000 7f444cb69700 1 -- 172.21.15.69:0/1606374641 >> 172.21.15.69:0/1606374641 conn(0x7f444806d7b0 msgr2=0x7f44480af810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:46.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.535+0000 7f444cb69700 1 -- 172.21.15.69:0/1606374641 shutdown_connections 2023-10-06T01:38:46.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.535+0000 7f444cb69700 1 -- 172.21.15.69:0/1606374641 wait complete. 2023-10-06T01:38:46.548 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:38:46.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.664+0000 7effa0d91700 1 Processor -- start 2023-10-06T01:38:46.666 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.664+0000 7effa0d91700 1 -- start start 2023-10-06T01:38:46.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.665+0000 7effa0d91700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7eff9c159530 0x7eff9c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:46.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.665+0000 7effa0d91700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff9c0ccfd0 con 0x7eff9c06dc70 2023-10-06T01:38:46.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.665+0000 7effa0d91700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff9c0cf0e0 con 0x7eff9c06e0e0 2023-10-06T01:38:46.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.665+0000 7effa0d91700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff9c15a3d0 con 0x7eff9c159530 2023-10-06T01:38:46.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.665+0000 7eff9a59c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7eff9c159530 0x7eff9c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:46.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.665+0000 7eff91d9b700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7eff9c06dc70 0x7eff9c159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:46198/0 (socket says 172.21.15.69:46198) 2023-10-06T01:38:46.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.665+0000 7eff91d9b700 1 -- 172.21.15.69:0/2163990909 learned_addr learned my addr 172.21.15.69:0/2163990909 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:38:46.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.665+0000 7eff9a59c700 1 -- 172.21.15.69:0/2163990909 >> v1:172.21.15.88:6789/0 conn(0x7eff9c06e0e0 legacy=0x7eff9c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:46.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.665+0000 7eff9a59c700 1 -- 172.21.15.69:0/2163990909 >> v1:172.21.15.69:6789/0 conn(0x7eff9c06dc70 legacy=0x7eff9c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:46.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.665+0000 7eff99d9b700 1 -- 172.21.15.69:0/2163990909 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4188468347 0 0) 0x7eff9c0ccfd0 con 0x7eff9c06dc70 2023-10-06T01:38:46.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.665+0000 7eff9a59c700 1 -- 172.21.15.69:0/2163990909 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff9c15a6b0 con 0x7eff9c159530 2023-10-06T01:38:46.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.665+0000 7eff9a59c700 1 --2- 172.21.15.69:0/2163990909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff9c159530 0x7eff9c0ceba0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0098e0 tx=0x7eff8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23048bd272dd87eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:46.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.666+0000 7eff99d9b700 1 -- 172.21.15.69:0/2163990909 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c009e80 con 0x7eff9c159530 2023-10-06T01:38:46.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.666+0000 7eff99d9b700 1 -- 172.21.15.69:0/2163990909 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8c00b820 con 0x7eff9c159530 2023-10-06T01:38:46.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.666+0000 7eff99d9b700 1 -- 172.21.15.69:0/2163990909 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c00bba0 con 0x7eff9c159530 2023-10-06T01:38:46.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.666+0000 7effa0d91700 1 -- 172.21.15.69:0/2163990909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff9c159530 msgr2=0x7eff9c0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:46.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.666+0000 7effa0d91700 1 --2- 172.21.15.69:0/2163990909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff9c159530 0x7eff9c0ceba0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0098e0 tx=0x7eff8c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.666+0000 7effa0d91700 1 -- 172.21.15.69:0/2163990909 shutdown_connections 2023-10-06T01:38:46.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.666+0000 7effa0d91700 1 --2- 172.21.15.69:0/2163990909 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff9c159530 0x7eff9c0ceba0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.666+0000 7effa0d91700 1 -- 172.21.15.69:0/2163990909 >> 172.21.15.69:0/2163990909 conn(0x7eff9c0703a0 msgr2=0x7eff9c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:46.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.666+0000 7effa0d91700 1 -- 172.21.15.69:0/2163990909 shutdown_connections 2023-10-06T01:38:46.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.666+0000 7effa0d91700 1 -- 172.21.15.69:0/2163990909 wait complete. 2023-10-06T01:38:46.672 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.667+0000 7effa0d91700 1 Processor -- start 2023-10-06T01:38:46.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.667+0000 7effa0d91700 1 -- start start 2023-10-06T01:38:46.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.668+0000 7effa0d91700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff9c06dc70 0x7eff9c15e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:46.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.668+0000 7effa0d91700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff9c06e0e0 0x7eff9c16afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:46.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.668+0000 7effa0d91700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7eff9c159530 0x7eff9c16b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:46.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.668+0000 7effa0d91700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c15e070 con 0x7eff9c06dc70 2023-10-06T01:38:46.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.668+0000 7effa0d91700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c15d460 con 0x7eff9c06e0e0 2023-10-06T01:38:46.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.668+0000 7effa0d91700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff9c15d740 con 0x7eff9c159530 2023-10-06T01:38:46.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.668+0000 7eff9a59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff9c06dc70 0x7eff9c15e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:46.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.668+0000 7eff9a59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff9c06dc70 0x7eff9c15e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58020/0 (socket says 172.21.15.69:58020) 2023-10-06T01:38:46.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.668+0000 7eff9a59c700 1 -- 172.21.15.69:0/1048908107 learned_addr learned my addr 172.21.15.69:0/1048908107 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:46.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.668+0000 7eff91d9b700 1 --2- 172.21.15.69:0/1048908107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff9c06e0e0 0x7eff9c16afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:46.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.668+0000 7eff9ad9d700 1 --2- 172.21.15.69:0/1048908107 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7eff9c159530 0x7eff9c16b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:46.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.668+0000 7eff9a59c700 1 -- 172.21.15.69:0/1048908107 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7eff9c159530 msgr2=0x7eff9c16b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:46.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.668+0000 7eff9a59c700 1 --2- 172.21.15.69:0/1048908107 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7eff9c159530 0x7eff9c16b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.668+0000 7eff9a59c700 1 -- 172.21.15.69:0/1048908107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff9c06e0e0 msgr2=0x7eff9c16afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:46.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.668+0000 7eff9a59c700 1 --2- 172.21.15.69:0/1048908107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff9c06e0e0 0x7eff9c16afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.668+0000 7eff9a59c700 1 -- 172.21.15.69:0/1048908107 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c009420 con 0x7eff9c06dc70 2023-10-06T01:38:46.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.669+0000 7eff9a59c700 1 --2- 172.21.15.69:0/1048908107 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff9c06dc70 0x7eff9c15e500 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0030c0 tx=0x7eff8c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:46.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.669+0000 7eff92ffd700 1 -- 172.21.15.69:0/1048908107 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c00ba60 con 0x7eff9c06dc70 2023-10-06T01:38:46.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.669+0000 7eff92ffd700 1 -- 172.21.15.69:0/1048908107 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8c020070 con 0x7eff9c06dc70 2023-10-06T01:38:46.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.669+0000 7effa0d91700 1 -- 172.21.15.69:0/1048908107 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff9c15da20 con 0x7eff9c06dc70 2023-10-06T01:38:46.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.669+0000 7eff92ffd700 1 -- 172.21.15.69:0/1048908107 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8c01b6a0 con 0x7eff9c06dc70 2023-10-06T01:38:46.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.669+0000 7effa0d91700 1 -- 172.21.15.69:0/1048908107 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff9c0b6090 con 0x7eff9c06dc70 2023-10-06T01:38:46.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.670+0000 7effa0d91700 1 -- 172.21.15.69:0/1048908107 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff9c04c3c0 con 0x7eff9c06dc70 2023-10-06T01:38:46.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.670+0000 7eff92ffd700 1 -- 172.21.15.69:0/1048908107 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7eff8c022030 con 0x7eff9c06dc70 2023-10-06T01:38:46.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.670+0000 7eff92ffd700 1 --2- 172.21.15.69:0/1048908107 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7eff7c066f30 0x7eff7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:46.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.670+0000 7eff92ffd700 1 -- 172.21.15.69:0/1048908107 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7eff8c086260 con 0x7eff9c06dc70 2023-10-06T01:38:46.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.671+0000 7eff91d9b700 1 --2- 172.21.15.69:0/1048908107 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7eff7c066f30 0x7eff7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:46.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.671+0000 7eff91d9b700 1 --2- 172.21.15.69:0/1048908107 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7eff7c066f30 0x7eff7c0693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7eff9c15cd60 tx=0x7eff84007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:46.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.675+0000 7eff92ffd700 1 -- 172.21.15.69:0/1048908107 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff8c0536c0 con 0x7eff9c06dc70 2023-10-06T01:38:46.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.856+0000 7effa0d91700 1 -- 172.21.15.69:0/1048908107 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7eff9c04c3c0 con 0x7eff9c06dc70 2023-10-06T01:38:46.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.856+0000 7eff92ffd700 1 -- 172.21.15.69:0/1048908107 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v20) v1 ==== 92+0+10 (secure 0 0 0) 0x7eff8c056ce0 con 0x7eff9c06dc70 2023-10-06T01:38:46.858 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 8 2023-10-06T01:38:46.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.858+0000 7effa0d91700 1 -- 172.21.15.69:0/1048908107 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7eff7c066f30 msgr2=0x7eff7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:46.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.858+0000 7effa0d91700 1 --2- 172.21.15.69:0/1048908107 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7eff7c066f30 0x7eff7c0693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7eff9c15cd60 tx=0x7eff84007d30 comp rx=0 tx=0).stop 2023-10-06T01:38:46.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.858+0000 7effa0d91700 1 -- 172.21.15.69:0/1048908107 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff9c06dc70 msgr2=0x7eff9c15e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:46.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.858+0000 7effa0d91700 1 --2- 172.21.15.69:0/1048908107 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff9c06dc70 0x7eff9c15e500 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0030c0 tx=0x7eff8c016000 comp rx=0 tx=0).stop 2023-10-06T01:38:46.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.858+0000 7effa0d91700 1 -- 172.21.15.69:0/1048908107 shutdown_connections 2023-10-06T01:38:46.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.858+0000 7effa0d91700 1 --2- 172.21.15.69:0/1048908107 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7eff7c066f30 0x7eff7c0693e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.859+0000 7effa0d91700 1 --2- 172.21.15.69:0/1048908107 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7eff9c159530 0x7eff9c16b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.859+0000 7effa0d91700 1 --2- 172.21.15.69:0/1048908107 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff9c06dc70 0x7eff9c15e500 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.859+0000 7effa0d91700 1 --2- 172.21.15.69:0/1048908107 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7eff9c06e0e0 0x7eff9c16afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.859+0000 7effa0d91700 1 -- 172.21.15.69:0/1048908107 >> 172.21.15.69:0/1048908107 conn(0x7eff9c0703a0 msgr2=0x7eff9c0cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:46.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.859+0000 7effa0d91700 1 -- 172.21.15.69:0/1048908107 shutdown_connections 2023-10-06T01:38:46.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.859+0000 7effa0d91700 1 -- 172.21.15.69:0/1048908107 wait complete. 2023-10-06T01:38:46.872 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T01:38:46.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.984+0000 7fa7558eb700 1 Processor -- start 2023-10-06T01:38:46.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.984+0000 7fa7558eb700 1 -- start start 2023-10-06T01:38:46.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.985+0000 7fa7558eb700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa7500cb5a0 0x7fa7500cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:46.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.985+0000 7fa7558eb700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa7500cd9e0 0x7fa750159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:46.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.985+0000 7fa7558eb700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa75015ae40 con 0x7fa7500cde50 2023-10-06T01:38:46.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.985+0000 7fa7558eb700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7500d13f0 con 0x7fa7500cb5a0 2023-10-06T01:38:46.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.985+0000 7fa7558eb700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75015ab60 con 0x7fa7500cd9e0 2023-10-06T01:38:46.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.985+0000 7fa74effd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa7500cb5a0 0x7fa7500cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:46.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.985+0000 7fa74f7fe700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fa7500cde50 0x7fa750156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:46208/0 (socket says 172.21.15.69:46208) 2023-10-06T01:38:46.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.985+0000 7fa74effd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa7500cb5a0 0x7fa7500cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58030/0 (socket says 172.21.15.69:58030) 2023-10-06T01:38:46.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.985+0000 7fa74f7fe700 1 -- 172.21.15.69:0/4229840004 learned_addr learned my addr 172.21.15.69:0/4229840004 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:38:46.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.985+0000 7fa74e7fc700 1 --2- 172.21.15.69:0/4229840004 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa7500cd9e0 0x7fa750159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:46.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.985+0000 7fa74effd700 1 -- 172.21.15.69:0/4229840004 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa7500cd9e0 msgr2=0x7fa750159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:46.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.985+0000 7fa74effd700 1 --2- 172.21.15.69:0/4229840004 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa7500cd9e0 0x7fa750159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.985+0000 7fa74effd700 1 -- 172.21.15.69:0/4229840004 >> v1:172.21.15.69:6789/0 conn(0x7fa7500cde50 legacy=0x7fa750156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:46.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.985+0000 7fa74dffb700 1 -- 172.21.15.69:0/4229840004 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3264531924 0 0) 0x7fa75015ae40 con 0x7fa7500cde50 2023-10-06T01:38:46.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.985+0000 7fa74effd700 1 -- 172.21.15.69:0/4229840004 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7500ccf00 con 0x7fa7500cb5a0 2023-10-06T01:38:46.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.985+0000 7fa74e7fc700 1 --2- 172.21.15.69:0/4229840004 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa7500cd9e0 0x7fa750159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:38:46.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.985+0000 7fa74effd700 1 --2- 172.21.15.69:0/4229840004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7500cb5a0 0x7fa7500cb970 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa7480098e0 tx=0x7fa7480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eccca71cacafa8c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:46.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.985+0000 7fa74dffb700 1 -- 172.21.15.69:0/4229840004 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748009e80 con 0x7fa7500cb5a0 2023-10-06T01:38:46.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.985+0000 7fa74dffb700 1 -- 172.21.15.69:0/4229840004 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74800b860 con 0x7fa7500cb5a0 2023-10-06T01:38:46.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.985+0000 7fa74dffb700 1 -- 172.21.15.69:0/4229840004 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74800bbe0 con 0x7fa7500cb5a0 2023-10-06T01:38:46.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.986+0000 7fa7558eb700 1 -- 172.21.15.69:0/4229840004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7500cb5a0 msgr2=0x7fa7500cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:46.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.986+0000 7fa7558eb700 1 --2- 172.21.15.69:0/4229840004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7500cb5a0 0x7fa7500cb970 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fa7480098e0 tx=0x7fa7480091a0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.986+0000 7fa7558eb700 1 -- 172.21.15.69:0/4229840004 shutdown_connections 2023-10-06T01:38:46.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.986+0000 7fa7558eb700 1 --2- 172.21.15.69:0/4229840004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7500cb5a0 0x7fa7500cb970 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.986+0000 7fa7558eb700 1 --2- 172.21.15.69:0/4229840004 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa7500cd9e0 0x7fa750159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.986+0000 7fa7558eb700 1 -- 172.21.15.69:0/4229840004 >> 172.21.15.69:0/4229840004 conn(0x7fa750070e30 msgr2=0x7fa7500d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:46.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.986+0000 7fa7558eb700 1 -- 172.21.15.69:0/4229840004 shutdown_connections 2023-10-06T01:38:46.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.986+0000 7fa7558eb700 1 -- 172.21.15.69:0/4229840004 wait complete. 2023-10-06T01:38:46.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.987+0000 7fa7558eb700 1 Processor -- start 2023-10-06T01:38:46.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.987+0000 7fa7558eb700 1 -- start start 2023-10-06T01:38:46.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.988+0000 7fa7558eb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7500cb5a0 0x7fa750142730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:46.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.988+0000 7fa7558eb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7500cd9e0 0x7fa75015b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:46.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.988+0000 7fa7558eb700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa750150e00 0x7fa750152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:46.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.988+0000 7fa7558eb700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa75013fa80 con 0x7fa7500cd9e0 2023-10-06T01:38:46.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.988+0000 7fa7558eb700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa750142c70 con 0x7fa7500cb5a0 2023-10-06T01:38:46.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.988+0000 7fa7558eb700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7500b4de0 con 0x7fa750150e00 2023-10-06T01:38:46.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.988+0000 7fa74e7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7500cd9e0 0x7fa75015b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:46.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.988+0000 7fa74e7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7500cd9e0 0x7fa75015b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58040/0 (socket says 172.21.15.69:58040) 2023-10-06T01:38:46.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.988+0000 7fa74e7fc700 1 -- 172.21.15.69:0/3793794828 learned_addr learned my addr 172.21.15.69:0/3793794828 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:46.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.988+0000 7fa74f7fe700 1 --2- 172.21.15.69:0/3793794828 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa750150e00 0x7fa750152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:46.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.988+0000 7fa74effd700 1 --2- 172.21.15.69:0/3793794828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7500cb5a0 0x7fa750142730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:46.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.988+0000 7fa74e7fc700 1 -- 172.21.15.69:0/3793794828 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa750150e00 msgr2=0x7fa750152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:46.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.988+0000 7fa74e7fc700 1 --2- 172.21.15.69:0/3793794828 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa750150e00 0x7fa750152d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.988+0000 7fa74e7fc700 1 -- 172.21.15.69:0/3793794828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7500cb5a0 msgr2=0x7fa750142730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:46.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.988+0000 7fa74e7fc700 1 --2- 172.21.15.69:0/3793794828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7500cb5a0 0x7fa750142730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:46.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.988+0000 7fa74e7fc700 1 -- 172.21.15.69:0/3793794828 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa748009420 con 0x7fa7500cd9e0 2023-10-06T01:38:46.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.988+0000 7fa74e7fc700 1 --2- 172.21.15.69:0/3793794828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7500cd9e0 0x7fa75015b070 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa74400e8d0 tx=0x7fa744008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:46.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.989+0000 7fa736ffd700 1 -- 172.21.15.69:0/3793794828 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74400ee70 con 0x7fa7500cd9e0 2023-10-06T01:38:46.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.989+0000 7fa736ffd700 1 -- 172.21.15.69:0/3793794828 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74400c5e0 con 0x7fa7500cd9e0 2023-10-06T01:38:46.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.989+0000 7fa7558eb700 1 -- 172.21.15.69:0/3793794828 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa75015b5b0 con 0x7fa7500cd9e0 2023-10-06T01:38:46.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.989+0000 7fa736ffd700 1 -- 172.21.15.69:0/3793794828 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74400c980 con 0x7fa7500cd9e0 2023-10-06T01:38:46.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.989+0000 7fa7558eb700 1 -- 172.21.15.69:0/3793794828 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa75015bb10 con 0x7fa7500cd9e0 2023-10-06T01:38:46.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.989+0000 7fa7558eb700 1 -- 172.21.15.69:0/3793794828 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa75004c3c0 con 0x7fa7500cd9e0 2023-10-06T01:38:46.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.990+0000 7fa736ffd700 1 -- 172.21.15.69:0/3793794828 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa74400cd30 con 0x7fa7500cd9e0 2023-10-06T01:38:46.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.990+0000 7fa736ffd700 1 --2- 172.21.15.69:0/3793794828 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa73c066f30 0x7fa73c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:46.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.990+0000 7fa736ffd700 1 -- 172.21.15.69:0/3793794828 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fa7440840e0 con 0x7fa7500cd9e0 2023-10-06T01:38:46.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.990+0000 7fa74effd700 1 --2- 172.21.15.69:0/3793794828 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa73c066f30 0x7fa73c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:46.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.991+0000 7fa74effd700 1 --2- 172.21.15.69:0/3793794828 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa73c066f30 0x7fa73c0693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa7480091e0 tx=0x7fa748017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:46.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:46.994+0000 7fa736ffd700 1 -- 172.21.15.69:0/3793794828 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa744051540 con 0x7fa7500cd9e0 2023-10-06T01:38:47.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.181+0000 7fa7558eb700 1 -- 172.21.15.69:0/3793794828 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa7500cd1e0 con 0x7fa7500cd9e0 2023-10-06T01:38:47.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.182+0000 7fa736ffd700 1 -- 172.21.15.69:0/3793794828 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v20) v1 ==== 84+0+126 (secure 0 0 0) 0x7fa744054b60 con 0x7fa7500cd9e0 2023-10-06T01:38:47.184 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:38:47.184 INFO:teuthology.orchestra.run.smithi069.stdout:[ 2023-10-06T01:38:47.184 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:38:47.184 INFO:teuthology.orchestra.run.smithi069.stdout: "poolnum": 1, 2023-10-06T01:38:47.184 INFO:teuthology.orchestra.run.smithi069.stdout: "poolname": ".mgr" 2023-10-06T01:38:47.184 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:38:47.184 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:38:47.184 INFO:teuthology.orchestra.run.smithi069.stdout: "poolnum": 2, 2023-10-06T01:38:47.184 INFO:teuthology.orchestra.run.smithi069.stdout: "poolname": "rbd" 2023-10-06T01:38:47.185 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:38:47.185 INFO:teuthology.orchestra.run.smithi069.stdout:] 2023-10-06T01:38:47.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.184+0000 7fa7558eb700 1 -- 172.21.15.69:0/3793794828 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa73c066f30 msgr2=0x7fa73c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:47.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.184+0000 7fa7558eb700 1 --2- 172.21.15.69:0/3793794828 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa73c066f30 0x7fa73c0693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa7480091e0 tx=0x7fa748017000 comp rx=0 tx=0).stop 2023-10-06T01:38:47.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.184+0000 7fa7558eb700 1 -- 172.21.15.69:0/3793794828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7500cd9e0 msgr2=0x7fa75015b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:47.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.184+0000 7fa7558eb700 1 --2- 172.21.15.69:0/3793794828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7500cd9e0 0x7fa75015b070 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa74400e8d0 tx=0x7fa744008040 comp rx=0 tx=0).stop 2023-10-06T01:38:47.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.184+0000 7fa7558eb700 1 -- 172.21.15.69:0/3793794828 shutdown_connections 2023-10-06T01:38:47.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.184+0000 7fa7558eb700 1 --2- 172.21.15.69:0/3793794828 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa73c066f30 0x7fa73c0693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:47.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.184+0000 7fa7558eb700 1 --2- 172.21.15.69:0/3793794828 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa750150e00 0x7fa750152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:47.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.184+0000 7fa7558eb700 1 --2- 172.21.15.69:0/3793794828 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa7500cb5a0 0x7fa750142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:47.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.184+0000 7fa7558eb700 1 --2- 172.21.15.69:0/3793794828 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa7500cd9e0 0x7fa75015b070 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:47.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.184+0000 7fa7558eb700 1 -- 172.21.15.69:0/3793794828 >> 172.21.15.69:0/3793794828 conn(0x7fa750070e30 msgr2=0x7fa7500ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:47.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.184+0000 7fa7558eb700 1 -- 172.21.15.69:0/3793794828 shutdown_connections 2023-10-06T01:38:47.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.184+0000 7fa7558eb700 1 -- 172.21.15.69:0/3793794828 wait complete. 2023-10-06T01:38:47.197 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T01:38:47.197 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T01:38:47.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.315+0000 7fc83bbfb700 1 Processor -- start 2023-10-06T01:38:47.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.315+0000 7fc83bbfb700 1 -- start start 2023-10-06T01:38:47.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.316+0000 7fc83bbfb700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8340cb880 0x7fc8340cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:47.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.316+0000 7fc83bbfb700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc8340b04f0 0x7fc8340cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:47.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.316+0000 7fc83bbfb700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8340cf330 con 0x7fc8340cd5a0 2023-10-06T01:38:47.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.316+0000 7fc83bbfb700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8340cead0 con 0x7fc8340b04f0 2023-10-06T01:38:47.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.316+0000 7fc83bbfb700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8340cddd0 con 0x7fc8340cb880 2023-10-06T01:38:47.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.316+0000 7fc839997700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8340cb880 0x7fc8340cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:47.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.316+0000 7fc839196700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc8340b04f0 0x7fc8340cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:47.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.316+0000 7fc839997700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8340cb880 0x7fc8340cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.69:51116/0 (socket says 172.21.15.69:51116) 2023-10-06T01:38:47.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.316+0000 7fc839196700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc8340b04f0 0x7fc8340cd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.69:57504/0 (socket says 172.21.15.69:57504) 2023-10-06T01:38:47.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.316+0000 7fc839997700 1 -- 172.21.15.69:0/3563628960 learned_addr learned my addr 172.21.15.69:0/3563628960 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:47.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.316+0000 7fc83a198700 1 --1- 172.21.15.69:0/3563628960 >> v1:172.21.15.88:6789/0 conn(0x7fc8340cd5a0 0x7fc8341591e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.69:53502/0 (socket says 172.21.15.69:53502) 2023-10-06T01:38:47.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.316+0000 7fc839997700 1 -- 172.21.15.69:0/3563628960 >> v2:172.21.15.88:3300/0 conn(0x7fc8340b04f0 msgr2=0x7fc8340cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:47.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.316+0000 7fc839997700 1 --2- 172.21.15.69:0/3563628960 >> v2:172.21.15.88:3300/0 conn(0x7fc8340b04f0 0x7fc8340cd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:47.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.316+0000 7fc839997700 1 -- 172.21.15.69:0/3563628960 >> v1:172.21.15.88:6789/0 conn(0x7fc8340cd5a0 legacy=0x7fc8341591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:47.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.316+0000 7fc839997700 1 -- 172.21.15.69:0/3563628960 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8340cece0 con 0x7fc8340cb880 2023-10-06T01:38:47.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.316+0000 7fc839196700 1 --2- 172.21.15.69:0/3563628960 >> v2:172.21.15.88:3300/0 conn(0x7fc8340b04f0 0x7fc8340cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:38:47.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.316+0000 7fc839997700 1 --2- 172.21.15.69:0/3563628960 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8340cb880 0x7fc8340cbc50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc8300099b0 tx=0x7fc830009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1deec396551aed5c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:47.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.317+0000 7fc838995700 1 -- 172.21.15.69:0/3563628960 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc830009ea0 con 0x7fc8340cb880 2023-10-06T01:38:47.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.317+0000 7fc838995700 1 -- 172.21.15.69:0/3563628960 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83000b860 con 0x7fc8340cb880 2023-10-06T01:38:47.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.317+0000 7fc838995700 1 -- 172.21.15.69:0/3563628960 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83000bc00 con 0x7fc8340cb880 2023-10-06T01:38:47.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.317+0000 7fc83bbfb700 1 -- 172.21.15.69:0/3563628960 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8340cb880 msgr2=0x7fc8340cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:47.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.317+0000 7fc83bbfb700 1 --2- 172.21.15.69:0/3563628960 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8340cb880 0x7fc8340cbc50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc8300099b0 tx=0x7fc830009250 comp rx=0 tx=0).stop 2023-10-06T01:38:47.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.317+0000 7fc83bbfb700 1 -- 172.21.15.69:0/3563628960 shutdown_connections 2023-10-06T01:38:47.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.317+0000 7fc83bbfb700 1 --2- 172.21.15.69:0/3563628960 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8340cb880 0x7fc8340cbc50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:47.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.317+0000 7fc83bbfb700 1 --2- 172.21.15.69:0/3563628960 >> v2:172.21.15.88:3300/0 conn(0x7fc8340b04f0 0x7fc8340cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:47.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.317+0000 7fc83bbfb700 1 -- 172.21.15.69:0/3563628960 >> 172.21.15.69:0/3563628960 conn(0x7fc8340703a0 msgr2=0x7fc8340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:47.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.317+0000 7fc83bbfb700 1 -- 172.21.15.69:0/3563628960 shutdown_connections 2023-10-06T01:38:47.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.317+0000 7fc83bbfb700 1 -- 172.21.15.69:0/3563628960 wait complete. 2023-10-06T01:38:47.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.318+0000 7fc83bbfb700 1 Processor -- start 2023-10-06T01:38:47.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.318+0000 7fc83bbfb700 1 -- start start 2023-10-06T01:38:47.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.319+0000 7fc83bbfb700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8340b04f0 0x7fc834157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:47.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.319+0000 7fc83bbfb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8340cb880 0x7fc8340ae860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:47.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.319+0000 7fc83bbfb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8340cd5a0 0x7fc8340c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:47.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.319+0000 7fc83bbfb700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8340c8440 con 0x7fc8340cd5a0 2023-10-06T01:38:47.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.319+0000 7fc83bbfb700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc834157740 con 0x7fc8340cb880 2023-10-06T01:38:47.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.319+0000 7fc83bbfb700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8340aeda0 con 0x7fc8340b04f0 2023-10-06T01:38:47.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.319+0000 7fc83a198700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8340cd5a0 0x7fc8340c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:47.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.319+0000 7fc83a198700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8340cd5a0 0x7fc8340c88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58044/0 (socket says 172.21.15.69:58044) 2023-10-06T01:38:47.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.319+0000 7fc83a198700 1 -- 172.21.15.69:0/413804292 learned_addr learned my addr 172.21.15.69:0/413804292 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:47.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.319+0000 7fc839997700 1 --2- 172.21.15.69:0/413804292 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8340b04f0 0x7fc834157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:47.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.319+0000 7fc839196700 1 --2- 172.21.15.69:0/413804292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8340cb880 0x7fc8340ae860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:47.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.320+0000 7fc83a198700 1 -- 172.21.15.69:0/413804292 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8340b04f0 msgr2=0x7fc834157200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:47.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.320+0000 7fc83a198700 1 --2- 172.21.15.69:0/413804292 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8340b04f0 0x7fc834157200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:47.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.320+0000 7fc83a198700 1 -- 172.21.15.69:0/413804292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8340cb880 msgr2=0x7fc8340ae860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:47.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.320+0000 7fc83a198700 1 --2- 172.21.15.69:0/413804292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8340cb880 0x7fc8340ae860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:47.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.320+0000 7fc83a198700 1 -- 172.21.15.69:0/413804292 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc824009420 con 0x7fc8340cd5a0 2023-10-06T01:38:47.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.320+0000 7fc83a198700 1 --2- 172.21.15.69:0/413804292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8340cd5a0 0x7fc8340c88d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00cd00 tx=0x7fc82c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:47.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.320+0000 7fc829ffb700 1 -- 172.21.15.69:0/413804292 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00ce60 con 0x7fc8340cd5a0 2023-10-06T01:38:47.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.320+0000 7fc829ffb700 1 -- 172.21.15.69:0/413804292 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc82c005df0 con 0x7fc8340cd5a0 2023-10-06T01:38:47.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.320+0000 7fc83bbfb700 1 -- 172.21.15.69:0/413804292 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8300094f0 con 0x7fc8340cd5a0 2023-10-06T01:38:47.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.320+0000 7fc829ffb700 1 -- 172.21.15.69:0/413804292 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc82c00ab00 con 0x7fc8340cd5a0 2023-10-06T01:38:47.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.320+0000 7fc83bbfb700 1 -- 172.21.15.69:0/413804292 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8340c7b10 con 0x7fc8340cd5a0 2023-10-06T01:38:47.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.321+0000 7fc83bbfb700 1 -- 172.21.15.69:0/413804292 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83404c3c0 con 0x7fc8340cd5a0 2023-10-06T01:38:47.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.321+0000 7fc829ffb700 1 -- 172.21.15.69:0/413804292 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc82c0070f0 con 0x7fc8340cd5a0 2023-10-06T01:38:47.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.322+0000 7fc829ffb700 1 --2- 172.21.15.69:0/413804292 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc818066f30 0x7fc8180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:47.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.322+0000 7fc829ffb700 1 -- 172.21.15.69:0/413804292 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fc82c0843a0 con 0x7fc8340cd5a0 2023-10-06T01:38:47.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.322+0000 7fc839997700 1 --2- 172.21.15.69:0/413804292 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc818066f30 0x7fc8180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:47.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.322+0000 7fc839997700 1 --2- 172.21.15.69:0/413804292 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc818066f30 0x7fc8180693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc8300099b0 tx=0x7fc830017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:47.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.326+0000 7fc829ffb700 1 -- 172.21.15.69:0/413804292 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc82c051880 con 0x7fc8340cd5a0 2023-10-06T01:38:47.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.507+0000 7fc83bbfb700 1 -- 172.21.15.69:0/413804292 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc8340ce680 con 0x7fc8340cd5a0 2023-10-06T01:38:47.642 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.641+0000 7fc829ffb700 1 -- 172.21.15.69:0/413804292 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v21) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc82c054ea0 con 0x7fc8340cd5a0 2023-10-06T01:38:47.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.644+0000 7fc83bbfb700 1 -- 172.21.15.69:0/413804292 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc818066f30 msgr2=0x7fc8180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:47.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.644+0000 7fc83bbfb700 1 --2- 172.21.15.69:0/413804292 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc818066f30 0x7fc8180693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc8300099b0 tx=0x7fc830017000 comp rx=0 tx=0).stop 2023-10-06T01:38:47.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.644+0000 7fc83bbfb700 1 -- 172.21.15.69:0/413804292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8340cd5a0 msgr2=0x7fc8340c88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:47.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.644+0000 7fc83bbfb700 1 --2- 172.21.15.69:0/413804292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8340cd5a0 0x7fc8340c88d0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc82c00cd00 tx=0x7fc82c001b10 comp rx=0 tx=0).stop 2023-10-06T01:38:47.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.645+0000 7fc83bbfb700 1 -- 172.21.15.69:0/413804292 shutdown_connections 2023-10-06T01:38:47.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.645+0000 7fc83bbfb700 1 --2- 172.21.15.69:0/413804292 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc818066f30 0x7fc8180693e0 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc8300099b0 tx=0x7fc830017000 comp rx=0 tx=0).stop 2023-10-06T01:38:47.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.645+0000 7fc83bbfb700 1 --2- 172.21.15.69:0/413804292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8340cd5a0 0x7fc8340c88d0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:47.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.645+0000 7fc83bbfb700 1 --2- 172.21.15.69:0/413804292 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8340b04f0 0x7fc834157200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:47.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.645+0000 7fc83bbfb700 1 --2- 172.21.15.69:0/413804292 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8340cb880 0x7fc8340ae860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:47.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.645+0000 7fc83bbfb700 1 -- 172.21.15.69:0/413804292 >> 172.21.15.69:0/413804292 conn(0x7fc8340703a0 msgr2=0x7fc8340b5e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:47.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.645+0000 7fc83bbfb700 1 -- 172.21.15.69:0/413804292 shutdown_connections 2023-10-06T01:38:47.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.645+0000 7fc83bbfb700 1 -- 172.21.15.69:0/413804292 wait complete. 2023-10-06T01:38:47.648 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_metadata' created 2023-10-06T01:38:47.659 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T01:38:47.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.780+0000 7f5a67be1700 1 Processor -- start 2023-10-06T01:38:47.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.780+0000 7f5a67be1700 1 -- start start 2023-10-06T01:38:47.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.781+0000 7f5a67be1700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5a60159530 0x7f5a600ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:47.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.781+0000 7f5a67be1700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5a6006dc70 0x7f5a60159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:47.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.781+0000 7f5a67be1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5a6006e0e0 0x7f5a600cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:47.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.781+0000 7f5a67be1700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a600ccfd0 con 0x7f5a60159530 2023-10-06T01:38:47.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.781+0000 7f5a67be1700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a600cf0e0 con 0x7f5a6006e0e0 2023-10-06T01:38:47.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.781+0000 7f5a67be1700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6015a3d0 con 0x7f5a6006dc70 2023-10-06T01:38:47.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.781+0000 7f5a6597d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5a60159530 0x7f5a600ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:47.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.781+0000 7f5a6597d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5a60159530 0x7f5a600ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32810/0 (socket says 172.21.15.69:32810) 2023-10-06T01:38:47.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.781+0000 7f5a6597d700 1 -- 172.21.15.69:0/3287377199 learned_addr learned my addr 172.21.15.69:0/3287377199 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:47.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.781+0000 7f5a6517c700 1 --2- 172.21.15.69:0/3287377199 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5a6006dc70 0x7f5a60159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:47.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.781+0000 7f5a6617e700 1 --2- 172.21.15.69:0/3287377199 >> v2:172.21.15.88:3300/0 conn(0x7f5a6006e0e0 0x7f5a600cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:47.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.781+0000 7f5a6597d700 1 -- 172.21.15.69:0/3287377199 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5a6006dc70 msgr2=0x7f5a60159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:47.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.781+0000 7f5a6597d700 1 --2- 172.21.15.69:0/3287377199 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5a6006dc70 0x7f5a60159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:47.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.781+0000 7f5a6597d700 1 -- 172.21.15.69:0/3287377199 >> v2:172.21.15.88:3300/0 conn(0x7f5a6006e0e0 msgr2=0x7f5a600cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:47.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.781+0000 7f5a6597d700 1 --2- 172.21.15.69:0/3287377199 >> v2:172.21.15.88:3300/0 conn(0x7f5a6006e0e0 0x7f5a600cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:47.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.781+0000 7f5a6597d700 1 -- 172.21.15.69:0/3287377199 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a6015a6b0 con 0x7f5a60159530 2023-10-06T01:38:47.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.781+0000 7f5a6517c700 1 --2- 172.21.15.69:0/3287377199 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5a6006dc70 0x7f5a60159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:38:47.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.781+0000 7f5a6617e700 1 --2- 172.21.15.69:0/3287377199 >> v2:172.21.15.88:3300/0 conn(0x7f5a6006e0e0 0x7f5a600cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:38:47.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.781+0000 7f5a6597d700 1 --2- 172.21.15.69:0/3287377199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a60159530 0x7f5a600ceba0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5a60089880 tx=0x7f5a58009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cfca2eb48660a5f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:47.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.781+0000 7f5a6497b700 1 -- 172.21.15.69:0/3287377199 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5800b860 con 0x7f5a60159530 2023-10-06T01:38:47.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.781+0000 7f5a6497b700 1 -- 172.21.15.69:0/3287377199 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a5800b9c0 con 0x7f5a60159530 2023-10-06T01:38:47.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.781+0000 7f5a6497b700 1 -- 172.21.15.69:0/3287377199 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a5800bd60 con 0x7f5a60159530 2023-10-06T01:38:47.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.782+0000 7f5a67be1700 1 -- 172.21.15.69:0/3287377199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a60159530 msgr2=0x7f5a600ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:47.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.782+0000 7f5a67be1700 1 --2- 172.21.15.69:0/3287377199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a60159530 0x7f5a600ceba0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5a60089880 tx=0x7f5a58009250 comp rx=0 tx=0).stop 2023-10-06T01:38:47.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.782+0000 7f5a67be1700 1 -- 172.21.15.69:0/3287377199 shutdown_connections 2023-10-06T01:38:47.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.782+0000 7f5a67be1700 1 --2- 172.21.15.69:0/3287377199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a60159530 0x7f5a600ceba0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:47.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.782+0000 7f5a67be1700 1 --2- 172.21.15.69:0/3287377199 >> v2:172.21.15.88:3300/0 conn(0x7f5a6006e0e0 0x7f5a600cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:47.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.782+0000 7f5a67be1700 1 --2- 172.21.15.69:0/3287377199 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5a6006dc70 0x7f5a60159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:47.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.782+0000 7f5a67be1700 1 -- 172.21.15.69:0/3287377199 >> 172.21.15.69:0/3287377199 conn(0x7f5a600703a0 msgr2=0x7f5a600707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:47.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.782+0000 7f5a67be1700 1 -- 172.21.15.69:0/3287377199 shutdown_connections 2023-10-06T01:38:47.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.782+0000 7f5a67be1700 1 -- 172.21.15.69:0/3287377199 wait complete. 2023-10-06T01:38:47.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.783+0000 7f5a67be1700 1 Processor -- start 2023-10-06T01:38:47.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.783+0000 7f5a67be1700 1 -- start start 2023-10-06T01:38:47.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.784+0000 7f5a67be1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a6006dc70 0x7f5a6014c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:47.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.784+0000 7f5a67be1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6006e0e0 0x7f5a6015dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:47.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.784+0000 7f5a67be1700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5a60159530 0x7f5a600cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:47.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.784+0000 7f5a67be1700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6015e980 con 0x7f5a6006dc70 2023-10-06T01:38:47.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.784+0000 7f5a67be1700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6014c7a0 con 0x7f5a6006e0e0 2023-10-06T01:38:47.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.784+0000 7f5a67be1700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6015e6a0 con 0x7f5a60159530 2023-10-06T01:38:47.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.784+0000 7f5a6597d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a6006dc70 0x7f5a6014c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:47.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.784+0000 7f5a6597d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a6006dc70 0x7f5a6014c260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32818/0 (socket says 172.21.15.69:32818) 2023-10-06T01:38:47.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.784+0000 7f5a6597d700 1 -- 172.21.15.69:0/2920974823 learned_addr learned my addr 172.21.15.69:0/2920974823 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:47.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.784+0000 7f5a6517c700 1 --2- 172.21.15.69:0/2920974823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6006e0e0 0x7f5a6015dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:47.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.784+0000 7f5a6617e700 1 --2- 172.21.15.69:0/2920974823 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5a60159530 0x7f5a600cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:47.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.784+0000 7f5a6597d700 1 -- 172.21.15.69:0/2920974823 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5a60159530 msgr2=0x7f5a600cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:47.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.784+0000 7f5a6597d700 1 --2- 172.21.15.69:0/2920974823 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5a60159530 0x7f5a600cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:47.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.784+0000 7f5a6597d700 1 -- 172.21.15.69:0/2920974823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6006e0e0 msgr2=0x7f5a6015dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:47.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.784+0000 7f5a6597d700 1 --2- 172.21.15.69:0/2920974823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6006e0e0 0x7f5a6015dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:47.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.784+0000 7f5a6597d700 1 -- 172.21.15.69:0/2920974823 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a580094f0 con 0x7f5a6006dc70 2023-10-06T01:38:47.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.784+0000 7f5a6517c700 1 --2- 172.21.15.69:0/2920974823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6006e0e0 0x7f5a6015dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:38:47.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.784+0000 7f5a6617e700 1 --2- 172.21.15.69:0/2920974823 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5a60159530 0x7f5a600cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:38:47.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.784+0000 7f5a6597d700 1 --2- 172.21.15.69:0/2920974823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a6006dc70 0x7f5a6014c260 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5a60089650 tx=0x7f5a58017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:47.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.784+0000 7f5a5dffb700 1 -- 172.21.15.69:0/2920974823 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a58024440 con 0x7f5a6006dc70 2023-10-06T01:38:47.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.785+0000 7f5a5dffb700 1 -- 172.21.15.69:0/2920974823 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a580245a0 con 0x7f5a6006dc70 2023-10-06T01:38:47.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.785+0000 7f5a67be1700 1 -- 172.21.15.69:0/2920974823 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a6016d150 con 0x7f5a6006dc70 2023-10-06T01:38:47.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.785+0000 7f5a5dffb700 1 -- 172.21.15.69:0/2920974823 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a58024960 con 0x7f5a6006dc70 2023-10-06T01:38:47.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.785+0000 7f5a67be1700 1 -- 172.21.15.69:0/2920974823 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a6016d710 con 0x7f5a6006dc70 2023-10-06T01:38:47.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.786+0000 7f5a67be1700 1 -- 172.21.15.69:0/2920974823 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a6016cfb0 con 0x7f5a6006dc70 2023-10-06T01:38:47.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.786+0000 7f5a5dffb700 1 -- 172.21.15.69:0/2920974823 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5a5801a420 con 0x7f5a6006dc70 2023-10-06T01:38:47.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.786+0000 7f5a5dffb700 1 --2- 172.21.15.69:0/2920974823 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5a4c066f30 0x7f5a4c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:47.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.786+0000 7f5a5dffb700 1 -- 172.21.15.69:0/2920974823 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5576+0+0 (secure 0 0 0) 0x7f5a58086280 con 0x7f5a6006dc70 2023-10-06T01:38:47.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.787+0000 7f5a6517c700 1 --2- 172.21.15.69:0/2920974823 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5a4c066f30 0x7f5a4c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:47.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.787+0000 7f5a6517c700 1 --2- 172.21.15.69:0/2920974823 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5a4c066f30 0x7f5a4c0693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5a6015cb90 tx=0x7f5a54007710 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:47.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.791+0000 7f5a5dffb700 1 -- 172.21.15.69:0/2920974823 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a6016cfb0 con 0x7f5a6006dc70 2023-10-06T01:38:47.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:47.973+0000 7f5a67be1700 1 -- 172.21.15.69:0/2920974823 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5a6016cfb0 con 0x7f5a6006dc70 2023-10-06T01:38:48.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.646+0000 7f5a5dffb700 1 -- 172.21.15.69:0/2920974823 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v22) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5a6016cfb0 con 0x7f5a6006dc70 2023-10-06T01:38:48.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.655+0000 7f5a67be1700 1 -- 172.21.15.69:0/2920974823 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5a4c066f30 msgr2=0x7f5a4c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:48.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.655+0000 7f5a67be1700 1 --2- 172.21.15.69:0/2920974823 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5a4c066f30 0x7f5a4c0693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5a6015cb90 tx=0x7f5a54007710 comp rx=0 tx=0).stop 2023-10-06T01:38:48.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.655+0000 7f5a67be1700 1 -- 172.21.15.69:0/2920974823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a6006dc70 msgr2=0x7f5a6014c260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:48.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.655+0000 7f5a67be1700 1 --2- 172.21.15.69:0/2920974823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a6006dc70 0x7f5a6014c260 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5a60089650 tx=0x7f5a58017000 comp rx=0 tx=0).stop 2023-10-06T01:38:48.657 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:38:48.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.655+0000 7f5a67be1700 1 -- 172.21.15.69:0/2920974823 shutdown_connections 2023-10-06T01:38:48.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.655+0000 7f5a67be1700 1 --2- 172.21.15.69:0/2920974823 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5a4c066f30 0x7f5a4c0693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:48.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.655+0000 7f5a67be1700 1 --2- 172.21.15.69:0/2920974823 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5a60159530 0x7f5a600cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:48.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.655+0000 7f5a67be1700 1 --2- 172.21.15.69:0/2920974823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5a6006dc70 0x7f5a6014c260 secure :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5a60089650 tx=0x7f5a58017000 comp rx=0 tx=0).stop 2023-10-06T01:38:48.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.655+0000 7f5a67be1700 1 --2- 172.21.15.69:0/2920974823 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5a6006e0e0 0x7f5a6015dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:48.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.655+0000 7f5a67be1700 1 -- 172.21.15.69:0/2920974823 >> 172.21.15.69:0/2920974823 conn(0x7f5a600703a0 msgr2=0x7f5a60070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:48.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.655+0000 7f5a67be1700 1 -- 172.21.15.69:0/2920974823 shutdown_connections 2023-10-06T01:38:48.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.655+0000 7f5a67be1700 1 -- 172.21.15.69:0/2920974823 wait complete. 2023-10-06T01:38:48.659 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_data' created 2023-10-06T01:38:48.660 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:38:48.676 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T01:38:48.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.832+0000 7fea38478700 1 Processor -- start 2023-10-06T01:38:48.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.832+0000 7fea38478700 1 -- start start 2023-10-06T01:38:48.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.833+0000 7fea38478700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fea3006dc70 0x7fea30159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:48.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.833+0000 7fea38478700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fea3006e0e0 0x7fea300cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:48.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.833+0000 7fea38478700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea300ccfd0 con 0x7fea30159530 2023-10-06T01:38:48.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.833+0000 7fea38478700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea3015a3d0 con 0x7fea3006e0e0 2023-10-06T01:38:48.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.833+0000 7fea38478700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea3015a6b0 con 0x7fea3006dc70 2023-10-06T01:38:48.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.833+0000 7fea36a15700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fea3006e0e0 0x7fea300cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:48.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.833+0000 7fea36214700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fea30159530 0x7fea300ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37998/0 (socket says 172.21.15.69:37998) 2023-10-06T01:38:48.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.833+0000 7fea36214700 1 -- 172.21.15.69:0/1516336980 learned_addr learned my addr 172.21.15.69:0/1516336980 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:38:48.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.833+0000 7fea35a13700 1 --2- 172.21.15.69:0/1516336980 >> v2:172.21.15.88:3300/0 conn(0x7fea3006dc70 0x7fea30159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:48.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.833+0000 7fea36a15700 1 -- 172.21.15.69:0/1516336980 >> v2:172.21.15.88:3300/0 conn(0x7fea3006dc70 msgr2=0x7fea30159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:48.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.833+0000 7fea36a15700 1 --2- 172.21.15.69:0/1516336980 >> v2:172.21.15.88:3300/0 conn(0x7fea3006dc70 0x7fea30159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:48.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.833+0000 7fea36a15700 1 -- 172.21.15.69:0/1516336980 >> v1:172.21.15.69:6789/0 conn(0x7fea30159530 legacy=0x7fea300ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:48.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.833+0000 7fea35212700 1 -- 172.21.15.69:0/1516336980 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2974827830 0 0) 0x7fea300ccfd0 con 0x7fea30159530 2023-10-06T01:38:48.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.833+0000 7fea36a15700 1 -- 172.21.15.69:0/1516336980 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3015a990 con 0x7fea3006e0e0 2023-10-06T01:38:48.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.833+0000 7fea36a15700 1 --2- 172.21.15.69:0/1516336980 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea3006e0e0 0x7fea300cb6f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fea300b66e0 tx=0x7fea28009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cada68abe6b5a649 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:48.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.833+0000 7fea35212700 1 -- 172.21.15.69:0/1516336980 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2800e070 con 0x7fea3006e0e0 2023-10-06T01:38:48.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.833+0000 7fea35212700 1 -- 172.21.15.69:0/1516336980 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2800bc30 con 0x7fea3006e0e0 2023-10-06T01:38:48.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.833+0000 7fea35212700 1 -- 172.21.15.69:0/1516336980 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea28012430 con 0x7fea3006e0e0 2023-10-06T01:38:48.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.834+0000 7fea38478700 1 -- 172.21.15.69:0/1516336980 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea3006e0e0 msgr2=0x7fea300cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:48.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.834+0000 7fea38478700 1 --2- 172.21.15.69:0/1516336980 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea3006e0e0 0x7fea300cb6f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fea300b66e0 tx=0x7fea28009780 comp rx=0 tx=0).stop 2023-10-06T01:38:48.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.834+0000 7fea38478700 1 -- 172.21.15.69:0/1516336980 shutdown_connections 2023-10-06T01:38:48.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.834+0000 7fea38478700 1 --2- 172.21.15.69:0/1516336980 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea3006e0e0 0x7fea300cb6f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:48.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.834+0000 7fea38478700 1 --2- 172.21.15.69:0/1516336980 >> v2:172.21.15.88:3300/0 conn(0x7fea3006dc70 0x7fea30159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:48.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.834+0000 7fea38478700 1 -- 172.21.15.69:0/1516336980 >> 172.21.15.69:0/1516336980 conn(0x7fea300703a0 msgr2=0x7fea300707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:48.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.834+0000 7fea38478700 1 -- 172.21.15.69:0/1516336980 shutdown_connections 2023-10-06T01:38:48.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.834+0000 7fea38478700 1 -- 172.21.15.69:0/1516336980 wait complete. 2023-10-06T01:38:48.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.835+0000 7fea38478700 1 Processor -- start 2023-10-06T01:38:48.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.835+0000 7fea38478700 1 -- start start 2023-10-06T01:38:48.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.836+0000 7fea38478700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea3006dc70 0x7fea300b41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:48.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.836+0000 7fea38478700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea3006e0e0 0x7fea3013db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:48.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.836+0000 7fea38478700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fea30159530 0x7fea3015d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:48.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.836+0000 7fea38478700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea300b47d0 con 0x7fea3006dc70 2023-10-06T01:38:48.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.836+0000 7fea38478700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea300b4ab0 con 0x7fea3006e0e0 2023-10-06T01:38:48.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.836+0000 7fea38478700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea300b4d90 con 0x7fea30159530 2023-10-06T01:38:48.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.836+0000 7fea36214700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea3006dc70 0x7fea300b41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:48.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.836+0000 7fea36214700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea3006dc70 0x7fea300b41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32840/0 (socket says 172.21.15.69:32840) 2023-10-06T01:38:48.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.836+0000 7fea36214700 1 -- 172.21.15.69:0/37548998 learned_addr learned my addr 172.21.15.69:0/37548998 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:48.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.836+0000 7fea35a13700 1 --2- 172.21.15.69:0/37548998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea3006e0e0 0x7fea3013db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:48.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.836+0000 7fea36a15700 1 --2- 172.21.15.69:0/37548998 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fea30159530 0x7fea3015d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:48.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.836+0000 7fea36214700 1 -- 172.21.15.69:0/37548998 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fea30159530 msgr2=0x7fea3015d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:48.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.836+0000 7fea36214700 1 --2- 172.21.15.69:0/37548998 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fea30159530 0x7fea3015d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:48.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.836+0000 7fea36214700 1 -- 172.21.15.69:0/37548998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea3006e0e0 msgr2=0x7fea3013db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:48.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.836+0000 7fea36214700 1 --2- 172.21.15.69:0/37548998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea3006e0e0 0x7fea3013db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:48.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.836+0000 7fea36214700 1 -- 172.21.15.69:0/37548998 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea28009a20 con 0x7fea3006dc70 2023-10-06T01:38:48.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.836+0000 7fea36a15700 1 --2- 172.21.15.69:0/37548998 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fea30159530 0x7fea3015d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:38:48.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.836+0000 7fea36214700 1 --2- 172.21.15.69:0/37548998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea3006dc70 0x7fea300b41c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fea2c00c5b0 tx=0x7fea2c001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:48.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.836+0000 7fea267fc700 1 -- 172.21.15.69:0/37548998 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c005b30 con 0x7fea3006dc70 2023-10-06T01:38:48.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.836+0000 7fea267fc700 1 -- 172.21.15.69:0/37548998 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2c005c90 con 0x7fea3006dc70 2023-10-06T01:38:48.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.836+0000 7fea38478700 1 -- 172.21.15.69:0/37548998 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea300b5070 con 0x7fea3006dc70 2023-10-06T01:38:48.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.836+0000 7fea267fc700 1 -- 172.21.15.69:0/37548998 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2c007300 con 0x7fea3006dc70 2023-10-06T01:38:48.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.837+0000 7fea38478700 1 -- 172.21.15.69:0/37548998 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea3013e070 con 0x7fea3006dc70 2023-10-06T01:38:48.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.837+0000 7fea38478700 1 -- 172.21.15.69:0/37548998 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea300b5590 con 0x7fea3006dc70 2023-10-06T01:38:48.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.838+0000 7fea267fc700 1 -- 172.21.15.69:0/37548998 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fea2c01b3b0 con 0x7fea3006dc70 2023-10-06T01:38:48.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.838+0000 7fea267fc700 1 --2- 172.21.15.69:0/37548998 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fea14066f30 0x7fea140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:48.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.838+0000 7fea35a13700 1 --2- 172.21.15.69:0/37548998 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fea14066f30 0x7fea140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:48.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.838+0000 7fea267fc700 1 -- 172.21.15.69:0/37548998 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5958+0+0 (secure 0 0 0) 0x7fea2c083b10 con 0x7fea3006dc70 2023-10-06T01:38:48.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.839+0000 7fea35a13700 1 --2- 172.21.15.69:0/37548998 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fea14066f30 0x7fea140693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fea300b4700 tx=0x7fea20008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:48.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:48.843+0000 7fea267fc700 1 -- 172.21.15.69:0/37548998 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea300b5590 con 0x7fea3006dc70 2023-10-06T01:38:49.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.070+0000 7fea38478700 1 -- 172.21.15.69:0/37548998 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fea300b5590 con 0x7fea3006dc70 2023-10-06T01:38:49.647 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.646+0000 7fea267fc700 1 -- 172.21.15.69:0/37548998 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fea300b5590 con 0x7fea3006dc70 2023-10-06T01:38:49.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.648+0000 7fea38478700 1 -- 172.21.15.69:0/37548998 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fea14066f30 msgr2=0x7fea140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:49.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.648+0000 7fea38478700 1 --2- 172.21.15.69:0/37548998 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fea14066f30 0x7fea140693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fea300b4700 tx=0x7fea20008040 comp rx=0 tx=0).stop 2023-10-06T01:38:49.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.648+0000 7fea38478700 1 -- 172.21.15.69:0/37548998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea3006dc70 msgr2=0x7fea300b41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:49.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.648+0000 7fea38478700 1 --2- 172.21.15.69:0/37548998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea3006dc70 0x7fea300b41c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fea2c00c5b0 tx=0x7fea2c001070 comp rx=0 tx=0).stop 2023-10-06T01:38:49.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.648+0000 7fea38478700 1 -- 172.21.15.69:0/37548998 shutdown_connections 2023-10-06T01:38:49.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.648+0000 7fea38478700 1 --2- 172.21.15.69:0/37548998 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fea14066f30 0x7fea140693e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:49.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.648+0000 7fea38478700 1 --2- 172.21.15.69:0/37548998 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fea30159530 0x7fea3015d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:49.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.648+0000 7fea38478700 1 --2- 172.21.15.69:0/37548998 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fea3006dc70 0x7fea300b41c0 secure :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fea2c00c5b0 tx=0x7fea2c001070 comp rx=0 tx=0).stop 2023-10-06T01:38:49.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.648+0000 7fea38478700 1 --2- 172.21.15.69:0/37548998 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fea3006e0e0 0x7fea3013db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:49.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.648+0000 7fea38478700 1 -- 172.21.15.69:0/37548998 >> 172.21.15.69:0/37548998 conn(0x7fea300703a0 msgr2=0x7fea300ceea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:49.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.650+0000 7fea38478700 1 -- 172.21.15.69:0/37548998 shutdown_connections 2023-10-06T01:38:49.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.650+0000 7fea38478700 1 -- 172.21.15.69:0/37548998 wait complete. 2023-10-06T01:38:49.652 INFO:teuthology.orchestra.run.smithi069.stderr:new fs with metadata pool 3 and data pool 4 2023-10-06T01:38:49.665 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:38:49.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.778+0000 7f64894d2700 1 Processor -- start 2023-10-06T01:38:49.780 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.778+0000 7f64894d2700 1 -- start start 2023-10-06T01:38:49.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.779+0000 7f64894d2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f64840cb5a0 0x7f64840cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:49.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.779+0000 7f64894d2700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f648415a5d0 0x7f6484156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:49.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.779+0000 7f64894d2700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f648415ae40 con 0x7f64840cd9e0 2023-10-06T01:38:49.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.779+0000 7f64894d2700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64840d13f0 con 0x7f648415a5d0 2023-10-06T01:38:49.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.779+0000 7f64894d2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f648415ab60 con 0x7f64840cb5a0 2023-10-06T01:38:49.782 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.779+0000 7f64837fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f648415a5d0 0x7f6484156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:49.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.779+0000 7f64827fc700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f64840cd9e0 0x7f6484159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38004/0 (socket says 172.21.15.69:38004) 2023-10-06T01:38:49.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.779+0000 7f64827fc700 1 -- 172.21.15.69:0/178082887 learned_addr learned my addr 172.21.15.69:0/178082887 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:38:49.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.779+0000 7f6482ffd700 1 --2- 172.21.15.69:0/178082887 >> v2:172.21.15.88:3300/0 conn(0x7f64840cb5a0 0x7f64840cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:49.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.779+0000 7f64837fe700 1 -- 172.21.15.69:0/178082887 >> v2:172.21.15.88:3300/0 conn(0x7f64840cb5a0 msgr2=0x7f64840cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:49.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.779+0000 7f64837fe700 1 --2- 172.21.15.69:0/178082887 >> v2:172.21.15.88:3300/0 conn(0x7f64840cb5a0 0x7f64840cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:49.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.779+0000 7f64837fe700 1 -- 172.21.15.69:0/178082887 >> v1:172.21.15.69:6789/0 conn(0x7f64840cd9e0 legacy=0x7f6484159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:49.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.779+0000 7f64837fe700 1 -- 172.21.15.69:0/178082887 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64840ccf00 con 0x7f648415a5d0 2023-10-06T01:38:49.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.780+0000 7f6482ffd700 1 --2- 172.21.15.69:0/178082887 >> v2:172.21.15.88:3300/0 conn(0x7f64840cb5a0 0x7f64840cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:38:49.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.780+0000 7f64837fe700 1 --2- 172.21.15.69:0/178082887 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f648415a5d0 0x7f6484156e90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f647c0098e0 tx=0x7f647c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acc71c17d4f1255b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:49.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.780+0000 7f6481ffb700 1 -- 172.21.15.69:0/178082887 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c009e80 con 0x7f648415a5d0 2023-10-06T01:38:49.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.780+0000 7f6481ffb700 1 -- 172.21.15.69:0/178082887 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f647c00b820 con 0x7f648415a5d0 2023-10-06T01:38:49.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.780+0000 7f6481ffb700 1 -- 172.21.15.69:0/178082887 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f647c00bba0 con 0x7f648415a5d0 2023-10-06T01:38:49.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.780+0000 7f64894d2700 1 -- 172.21.15.69:0/178082887 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f648415a5d0 msgr2=0x7f6484156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:49.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.780+0000 7f64894d2700 1 --2- 172.21.15.69:0/178082887 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f648415a5d0 0x7f6484156e90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f647c0098e0 tx=0x7f647c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:38:49.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.780+0000 7f64894d2700 1 -- 172.21.15.69:0/178082887 shutdown_connections 2023-10-06T01:38:49.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.780+0000 7f64894d2700 1 --2- 172.21.15.69:0/178082887 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f648415a5d0 0x7f6484156e90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:49.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.780+0000 7f64894d2700 1 --2- 172.21.15.69:0/178082887 >> v2:172.21.15.88:3300/0 conn(0x7f64840cb5a0 0x7f64840cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:49.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.780+0000 7f64894d2700 1 -- 172.21.15.69:0/178082887 >> 172.21.15.69:0/178082887 conn(0x7f6484070e30 msgr2=0x7f64840d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:49.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.780+0000 7f64894d2700 1 -- 172.21.15.69:0/178082887 shutdown_connections 2023-10-06T01:38:49.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.780+0000 7f64894d2700 1 -- 172.21.15.69:0/178082887 wait complete. 2023-10-06T01:38:49.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.781+0000 7f64894d2700 1 Processor -- start 2023-10-06T01:38:49.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.782+0000 7f64894d2700 1 -- start start 2023-10-06T01:38:49.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.782+0000 7f64894d2700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f64840cb5a0 0x7f64840c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:49.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.782+0000 7f64894d2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64840cd9e0 0x7f64841513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:49.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.782+0000 7f64894d2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f648415a5d0 0x7f64840ca000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:49.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.782+0000 7f64894d2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6484156fb0 con 0x7f64840cd9e0 2023-10-06T01:38:49.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.782+0000 7f64894d2700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6484157cd0 con 0x7f648415a5d0 2023-10-06T01:38:49.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.782+0000 7f64894d2700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64840c8f50 con 0x7f64840cb5a0 2023-10-06T01:38:49.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.782+0000 7f64827fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64840cd9e0 0x7f64841513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:49.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.782+0000 7f64827fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64840cd9e0 0x7f64841513f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32858/0 (socket says 172.21.15.69:32858) 2023-10-06T01:38:49.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.782+0000 7f64827fc700 1 -- 172.21.15.69:0/3749216428 learned_addr learned my addr 172.21.15.69:0/3749216428 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:49.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.782+0000 7f64837fe700 1 --2- 172.21.15.69:0/3749216428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f648415a5d0 0x7f64840ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:49.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.782+0000 7f6482ffd700 1 --2- 172.21.15.69:0/3749216428 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f64840cb5a0 0x7f64840c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:49.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.783+0000 7f64827fc700 1 -- 172.21.15.69:0/3749216428 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f64840cb5a0 msgr2=0x7f64840c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:49.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.783+0000 7f64827fc700 1 --2- 172.21.15.69:0/3749216428 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f64840cb5a0 0x7f64840c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:49.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.783+0000 7f64827fc700 1 -- 172.21.15.69:0/3749216428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f648415a5d0 msgr2=0x7f64840ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:49.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.783+0000 7f64827fc700 1 --2- 172.21.15.69:0/3749216428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f648415a5d0 0x7f64840ca000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:49.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.783+0000 7f64827fc700 1 -- 172.21.15.69:0/3749216428 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f647c009420 con 0x7f64840cd9e0 2023-10-06T01:38:49.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.783+0000 7f64827fc700 1 --2- 172.21.15.69:0/3749216428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64840cd9e0 0x7f64841513f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f647800c7c0 tx=0x7f6478007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:49.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.783+0000 7f646affd700 1 -- 172.21.15.69:0/3749216428 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6478005b30 con 0x7f64840cd9e0 2023-10-06T01:38:49.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.783+0000 7f646affd700 1 -- 172.21.15.69:0/3749216428 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6478005c90 con 0x7f64840cd9e0 2023-10-06T01:38:49.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.783+0000 7f64894d2700 1 -- 172.21.15.69:0/3749216428 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64841579f0 con 0x7f64840cd9e0 2023-10-06T01:38:49.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.783+0000 7f646affd700 1 -- 172.21.15.69:0/3749216428 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6478004a80 con 0x7f64840cd9e0 2023-10-06T01:38:49.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.783+0000 7f64894d2700 1 -- 172.21.15.69:0/3749216428 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64840c8be0 con 0x7f64840cd9e0 2023-10-06T01:38:49.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.784+0000 7f64894d2700 1 -- 172.21.15.69:0/3749216428 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f648404c3c0 con 0x7f64840cd9e0 2023-10-06T01:38:49.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.784+0000 7f646affd700 1 -- 172.21.15.69:0/3749216428 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f64780070d0 con 0x7f64840cd9e0 2023-10-06T01:38:49.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.785+0000 7f646affd700 1 --2- 172.21.15.69:0/3749216428 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6470066f30 0x7f64700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:49.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.785+0000 7f646affd700 1 -- 172.21.15.69:0/3749216428 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6478083980 con 0x7f64840cd9e0 2023-10-06T01:38:49.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.785+0000 7f6482ffd700 1 --2- 172.21.15.69:0/3749216428 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6470066f30 0x7f64700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:49.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.785+0000 7f6482ffd700 1 --2- 172.21.15.69:0/3749216428 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6470066f30 0x7f64700693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f647400d6e0 tx=0x7f6474007850 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:49.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.790+0000 7f646affd700 1 -- 172.21.15.69:0/3749216428 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f647804b5a0 con 0x7f64840cd9e0 2023-10-06T01:38:49.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.974+0000 7f64894d2700 1 -- 172.21.15.69:0/3749216428 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f64840c9090 con 0x7f64840cd9e0 2023-10-06T01:38:49.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.975+0000 7f646affd700 1 -- 172.21.15.69:0/3749216428 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16831 (secure 0 0 0) 0x7f6478050a90 con 0x7f64840cd9e0 2023-10-06T01:38:49.976 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:38:49.976 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":23,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:38:49.072203+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:38:43.046056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:38:47.525023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:38:47.992048+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:38:49.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.977+0000 7f64894d2700 1 -- 172.21.15.69:0/3749216428 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6470066f30 msgr2=0x7f64700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:49.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.977+0000 7f64894d2700 1 --2- 172.21.15.69:0/3749216428 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6470066f30 0x7f64700693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f647400d6e0 tx=0x7f6474007850 comp rx=0 tx=0).stop 2023-10-06T01:38:49.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.977+0000 7f64894d2700 1 -- 172.21.15.69:0/3749216428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64840cd9e0 msgr2=0x7f64841513f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:49.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.977+0000 7f64894d2700 1 --2- 172.21.15.69:0/3749216428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64840cd9e0 0x7f64841513f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f647800c7c0 tx=0x7f6478007f70 comp rx=0 tx=0).stop 2023-10-06T01:38:49.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.977+0000 7f64894d2700 1 -- 172.21.15.69:0/3749216428 shutdown_connections 2023-10-06T01:38:49.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.977+0000 7f64894d2700 1 --2- 172.21.15.69:0/3749216428 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6470066f30 0x7f64700693e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:49.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.977+0000 7f64894d2700 1 --2- 172.21.15.69:0/3749216428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f648415a5d0 0x7f64840ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:49.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.977+0000 7f64894d2700 1 --2- 172.21.15.69:0/3749216428 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f64840cb5a0 0x7f64840c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:49.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.977+0000 7f64894d2700 1 --2- 172.21.15.69:0/3749216428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64840cd9e0 0x7f64841513f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:49.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.977+0000 7f64894d2700 1 -- 172.21.15.69:0/3749216428 >> 172.21.15.69:0/3749216428 conn(0x7f6484070e30 msgr2=0x7f6484155e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:49.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.977+0000 7f64894d2700 1 -- 172.21.15.69:0/3749216428 shutdown_connections 2023-10-06T01:38:49.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:49.977+0000 7f64894d2700 1 -- 172.21.15.69:0/3749216428 wait complete. 2023-10-06T01:38:49.991 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:38:50.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.104+0000 7f7de891c700 1 Processor -- start 2023-10-06T01:38:50.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.104+0000 7f7de891c700 1 -- start start 2023-10-06T01:38:50.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.104+0000 7f7de891c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7de40a90d0 0x7f7de406de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:50.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.104+0000 7f7de891c700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de406e7f0 con 0x7f7de406e380 2023-10-06T01:38:50.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.104+0000 7f7de891c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7de40aeee0 con 0x7f7de40a8d00 2023-10-06T01:38:50.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.104+0000 7f7de891c700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de40ae680 con 0x7f7de40a90d0 2023-10-06T01:38:50.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.104+0000 7f7de2d9d700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f7de406e380 0x7f7de40af370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38012/0 (socket says 172.21.15.69:38012) 2023-10-06T01:38:50.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.105+0000 7f7de2d9d700 1 -- 172.21.15.69:0/2752510531 learned_addr learned my addr 172.21.15.69:0/2752510531 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:38:50.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.105+0000 7f7de1d9b700 1 --2- 172.21.15.69:0/2752510531 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7de40a90d0 0x7f7de406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:50.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.105+0000 7f7de159a700 1 -- 172.21.15.69:0/2752510531 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590426076 0 0) 0x7f7de406e7f0 con 0x7f7de406e380 2023-10-06T01:38:50.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.105+0000 7f7de159a700 1 -- 172.21.15.69:0/2752510531 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7dcc003570 con 0x7f7de406e380 2023-10-06T01:38:50.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.105+0000 7f7de159a700 1 -- 172.21.15.69:0/2752510531 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2485029687 0 0) 0x7f7dcc003570 con 0x7f7de406e380 2023-10-06T01:38:50.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.105+0000 7f7de1d9b700 1 -- 172.21.15.69:0/2752510531 >> v1:172.21.15.88:6789/0 conn(0x7f7de40a8d00 legacy=0x7f7de40cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:50.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.105+0000 7f7de1d9b700 1 -- 172.21.15.69:0/2752510531 >> v1:172.21.15.69:6789/0 conn(0x7f7de406e380 legacy=0x7f7de40af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:50.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.105+0000 7f7de1d9b700 1 -- 172.21.15.69:0/2752510531 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7de40cf490 con 0x7f7de40a90d0 2023-10-06T01:38:50.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.105+0000 7f7de1d9b700 1 --2- 172.21.15.69:0/2752510531 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7de40a90d0 0x7f7de406de40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009900 tx=0x7f7dd8009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=22a3f487e986ac7f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:50.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.105+0000 7f7de159a700 1 -- 172.21.15.69:0/2752510531 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc001470 con 0x7f7de40a90d0 2023-10-06T01:38:50.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.105+0000 7f7de159a700 1 -- 172.21.15.69:0/2752510531 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dd8011420 con 0x7f7de40a90d0 2023-10-06T01:38:50.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.105+0000 7f7de159a700 1 -- 172.21.15.69:0/2752510531 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dd80117a0 con 0x7f7de40a90d0 2023-10-06T01:38:50.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.106+0000 7f7de891c700 1 -- 172.21.15.69:0/2752510531 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7de40a90d0 msgr2=0x7f7de406de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:50.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.106+0000 7f7de891c700 1 --2- 172.21.15.69:0/2752510531 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7de40a90d0 0x7f7de406de40 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7dd8009900 tx=0x7f7dd8009120 comp rx=0 tx=0).stop 2023-10-06T01:38:50.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.106+0000 7f7de891c700 1 -- 172.21.15.69:0/2752510531 shutdown_connections 2023-10-06T01:38:50.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.106+0000 7f7de891c700 1 --2- 172.21.15.69:0/2752510531 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7de40a90d0 0x7f7de406de40 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:50.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.106+0000 7f7de891c700 1 -- 172.21.15.69:0/2752510531 >> 172.21.15.69:0/2752510531 conn(0x7f7de406ce80 msgr2=0x7f7de40ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:50.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.106+0000 7f7de891c700 1 -- 172.21.15.69:0/2752510531 shutdown_connections 2023-10-06T01:38:50.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.106+0000 7f7de891c700 1 -- 172.21.15.69:0/2752510531 wait complete. 2023-10-06T01:38:50.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.107+0000 7f7de891c700 1 Processor -- start 2023-10-06T01:38:50.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.107+0000 7f7de891c700 1 -- start start 2023-10-06T01:38:50.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.108+0000 7f7de891c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7de406e380 0x7f7de41573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:50.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.108+0000 7f7de891c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7de40a8d00 0x7f7de415c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:50.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.108+0000 7f7de891c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7de40a90d0 0x7f7de4068460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:50.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.108+0000 7f7de891c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de416a640 con 0x7f7de40a90d0 2023-10-06T01:38:50.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.108+0000 7f7de891c700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7de416a920 con 0x7f7de40a8d00 2023-10-06T01:38:50.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.108+0000 7f7de891c700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7de416ac00 con 0x7f7de406e380 2023-10-06T01:38:50.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.108+0000 7f7de2d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7de40a90d0 0x7f7de4068460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:50.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.108+0000 7f7de2d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7de40a90d0 0x7f7de4068460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32860/0 (socket says 172.21.15.69:32860) 2023-10-06T01:38:50.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.108+0000 7f7de2d9d700 1 -- 172.21.15.69:0/617180704 learned_addr learned my addr 172.21.15.69:0/617180704 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:50.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.108+0000 7f7de259c700 1 --2- 172.21.15.69:0/617180704 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7de406e380 0x7f7de41573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:50.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.108+0000 7f7de1d9b700 1 --2- 172.21.15.69:0/617180704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7de40a8d00 0x7f7de415c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:50.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.108+0000 7f7de2d9d700 1 -- 172.21.15.69:0/617180704 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7de406e380 msgr2=0x7f7de41573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:50.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.108+0000 7f7de2d9d700 1 --2- 172.21.15.69:0/617180704 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7de406e380 0x7f7de41573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:50.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.108+0000 7f7de2d9d700 1 -- 172.21.15.69:0/617180704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7de40a8d00 msgr2=0x7f7de415c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:50.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.108+0000 7f7de2d9d700 1 --2- 172.21.15.69:0/617180704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7de40a8d00 0x7f7de415c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:50.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.108+0000 7f7de2d9d700 1 -- 172.21.15.69:0/617180704 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd80093c0 con 0x7f7de40a90d0 2023-10-06T01:38:50.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.108+0000 7f7de2d9d700 1 --2- 172.21.15.69:0/617180704 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7de40a90d0 0x7f7de4068460 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00c7f0 tx=0x7f7ddc001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:50.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.108+0000 7f7dd27fc700 1 -- 172.21.15.69:0/617180704 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc007360 con 0x7f7de40a90d0 2023-10-06T01:38:50.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.108+0000 7f7dd27fc700 1 -- 172.21.15.69:0/617180704 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ddc0074e0 con 0x7f7de40a90d0 2023-10-06T01:38:50.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.108+0000 7f7dd27fc700 1 -- 172.21.15.69:0/617180704 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc004830 con 0x7f7de40a90d0 2023-10-06T01:38:50.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.108+0000 7f7de891c700 1 -- 172.21.15.69:0/617180704 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7de416aee0 con 0x7f7de40a90d0 2023-10-06T01:38:50.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.109+0000 7f7de891c700 1 -- 172.21.15.69:0/617180704 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7de416a3e0 con 0x7f7de40a90d0 2023-10-06T01:38:50.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.109+0000 7f7de891c700 1 -- 172.21.15.69:0/617180704 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7de404c3c0 con 0x7f7de40a90d0 2023-10-06T01:38:50.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.110+0000 7f7dd27fc700 1 -- 172.21.15.69:0/617180704 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ddc004c20 con 0x7f7de40a90d0 2023-10-06T01:38:50.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.110+0000 7f7dd27fc700 1 --2- 172.21.15.69:0/617180704 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7dc4066f30 0x7f7dc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:50.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.110+0000 7f7de259c700 1 --2- 172.21.15.69:0/617180704 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7dc4066f30 0x7f7dc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:50.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.110+0000 7f7dd27fc700 1 -- 172.21.15.69:0/617180704 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7ddc083890 con 0x7f7de40a90d0 2023-10-06T01:38:50.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.111+0000 7f7de259c700 1 --2- 172.21.15.69:0/617180704 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7dc4066f30 0x7f7dc40693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7de415bd10 tx=0x7f7dd4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:50.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.115+0000 7f7dd27fc700 1 -- 172.21.15.69:0/617180704 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ddc050a20 con 0x7f7de40a90d0 2023-10-06T01:38:50.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.299+0000 7f7de891c700 1 -- 172.21.15.69:0/617180704 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7de40b42f0 con 0x7f7de40a90d0 2023-10-06T01:38:50.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.300+0000 7f7dd27fc700 1 -- 172.21.15.69:0/617180704 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+16831 (secure 0 0 0) 0x7f7ddc018020 con 0x7f7de40a90d0 2023-10-06T01:38:50.301 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:38:50.302 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":23,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:38:49.072203+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:38:43.046056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:38:47.525023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:38:47.992048+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:38:50.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.302+0000 7f7de891c700 1 -- 172.21.15.69:0/617180704 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7dc4066f30 msgr2=0x7f7dc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:50.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.302+0000 7f7de891c700 1 --2- 172.21.15.69:0/617180704 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7dc4066f30 0x7f7dc40693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7de415bd10 tx=0x7f7dd4009040 comp rx=0 tx=0).stop 2023-10-06T01:38:50.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.302+0000 7f7de891c700 1 -- 172.21.15.69:0/617180704 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7de40a90d0 msgr2=0x7f7de4068460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:50.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.302+0000 7f7de891c700 1 --2- 172.21.15.69:0/617180704 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7de40a90d0 0x7f7de4068460 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00c7f0 tx=0x7f7ddc001a00 comp rx=0 tx=0).stop 2023-10-06T01:38:50.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.302+0000 7f7de891c700 1 -- 172.21.15.69:0/617180704 shutdown_connections 2023-10-06T01:38:50.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.302+0000 7f7de891c700 1 --2- 172.21.15.69:0/617180704 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7dc4066f30 0x7f7dc40693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:50.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.302+0000 7f7de891c700 1 --2- 172.21.15.69:0/617180704 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7de40a90d0 0x7f7de4068460 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:50.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.302+0000 7f7de891c700 1 --2- 172.21.15.69:0/617180704 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7de406e380 0x7f7de41573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:50.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.302+0000 7f7de891c700 1 --2- 172.21.15.69:0/617180704 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7de40a8d00 0x7f7de415c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:50.304 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.302+0000 7f7de891c700 1 -- 172.21.15.69:0/617180704 >> 172.21.15.69:0/617180704 conn(0x7f7de406ce80 msgr2=0x7f7de4158100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:50.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.302+0000 7f7de891c700 1 -- 172.21.15.69:0/617180704 shutdown_connections 2023-10-06T01:38:50.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.302+0000 7f7de891c700 1 -- 172.21.15.69:0/617180704 wait complete. 2023-10-06T01:38:50.316 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T01:38:50.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.433+0000 7fe2c5b14700 1 Processor -- start 2023-10-06T01:38:50.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.433+0000 7fe2c5b14700 1 -- start start 2023-10-06T01:38:50.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.434+0000 7fe2c5b14700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2c0159530 0x7fe2c00ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:50.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.434+0000 7fe2c5b14700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c00ccfd0 con 0x7fe2c006e0e0 2023-10-06T01:38:50.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.434+0000 7fe2c5b14700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2c00cf0e0 con 0x7fe2c006dc70 2023-10-06T01:38:50.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.434+0000 7fe2c5b14700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c015a3d0 con 0x7fe2c0159530 2023-10-06T01:38:50.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.434+0000 7fe2bffff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fe2c006e0e0 0x7fe2c00cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38018/0 (socket says 172.21.15.69:38018) 2023-10-06T01:38:50.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.434+0000 7fe2bffff700 1 -- 172.21.15.69:0/1788133161 learned_addr learned my addr 172.21.15.69:0/1788133161 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:38:50.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.434+0000 7fe2bf7fe700 1 --2- 172.21.15.69:0/1788133161 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2c0159530 0x7fe2c00ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:50.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.434+0000 7fe2be7fc700 1 -- 172.21.15.69:0/1788133161 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 967496267 0 0) 0x7fe2c00ccfd0 con 0x7fe2c006e0e0 2023-10-06T01:38:50.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.434+0000 7fe2be7fc700 1 -- 172.21.15.69:0/1788133161 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2a8003570 con 0x7fe2c006e0e0 2023-10-06T01:38:50.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.434+0000 7fe2be7fc700 1 -- 172.21.15.69:0/1788133161 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3936624811 0 0) 0x7fe2c00cf0e0 con 0x7fe2c006dc70 2023-10-06T01:38:50.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.434+0000 7fe2bf7fe700 1 -- 172.21.15.69:0/1788133161 >> v1:172.21.15.88:6789/0 conn(0x7fe2c006dc70 legacy=0x7fe2c0159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:50.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.434+0000 7fe2bf7fe700 1 -- 172.21.15.69:0/1788133161 >> v1:172.21.15.69:6789/0 conn(0x7fe2c006e0e0 legacy=0x7fe2c00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:50.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.434+0000 7fe2bf7fe700 1 -- 172.21.15.69:0/1788133161 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2c015a6b0 con 0x7fe2c0159530 2023-10-06T01:38:50.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.434+0000 7fe2bf7fe700 1 --2- 172.21.15.69:0/1788133161 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2c0159530 0x7fe2c00ceba0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8009e90 tx=0x7fe2b8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0ae7c39bc040721 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:50.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.434+0000 7fe2be7fc700 1 -- 172.21.15.69:0/1788133161 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b800e070 con 0x7fe2c0159530 2023-10-06T01:38:50.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.435+0000 7fe2be7fc700 1 -- 172.21.15.69:0/1788133161 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b800bc30 con 0x7fe2c0159530 2023-10-06T01:38:50.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.435+0000 7fe2be7fc700 1 -- 172.21.15.69:0/1788133161 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8012430 con 0x7fe2c0159530 2023-10-06T01:38:50.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.435+0000 7fe2c5b14700 1 -- 172.21.15.69:0/1788133161 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2c0159530 msgr2=0x7fe2c00ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:50.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.435+0000 7fe2c5b14700 1 --2- 172.21.15.69:0/1788133161 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2c0159530 0x7fe2c00ceba0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8009e90 tx=0x7fe2b8009780 comp rx=0 tx=0).stop 2023-10-06T01:38:50.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.435+0000 7fe2c5b14700 1 -- 172.21.15.69:0/1788133161 shutdown_connections 2023-10-06T01:38:50.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.435+0000 7fe2c5b14700 1 --2- 172.21.15.69:0/1788133161 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2c0159530 0x7fe2c00ceba0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:50.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.435+0000 7fe2c5b14700 1 -- 172.21.15.69:0/1788133161 >> 172.21.15.69:0/1788133161 conn(0x7fe2c00703a0 msgr2=0x7fe2c00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:50.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.435+0000 7fe2c5b14700 1 -- 172.21.15.69:0/1788133161 shutdown_connections 2023-10-06T01:38:50.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.435+0000 7fe2c5b14700 1 -- 172.21.15.69:0/1788133161 wait complete. 2023-10-06T01:38:50.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.436+0000 7fe2c5b14700 1 Processor -- start 2023-10-06T01:38:50.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.436+0000 7fe2c5b14700 1 -- start start 2023-10-06T01:38:50.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.437+0000 7fe2c5b14700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe2c006dc70 0x7fe2c00c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:50.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.437+0000 7fe2c5b14700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2c006e0e0 0x7fe2c00b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:50.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.437+0000 7fe2c5b14700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2c0159530 0x7fe2c0147ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:50.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.437+0000 7fe2c5b14700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c00c8ad0 con 0x7fe2c006dc70 2023-10-06T01:38:50.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.437+0000 7fe2c5b14700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c00b3520 con 0x7fe2c0159530 2023-10-06T01:38:50.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.437+0000 7fe2c5b14700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2c00b3800 con 0x7fe2c006e0e0 2023-10-06T01:38:50.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.437+0000 7fe2bf7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe2c006dc70 0x7fe2c00c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:50.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.437+0000 7fe2bf7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe2c006dc70 0x7fe2c00c81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32866/0 (socket says 172.21.15.69:32866) 2023-10-06T01:38:50.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.437+0000 7fe2bf7fe700 1 -- 172.21.15.69:0/4103730421 learned_addr learned my addr 172.21.15.69:0/4103730421 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:50.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.437+0000 7fe2beffd700 1 --2- 172.21.15.69:0/4103730421 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2c006e0e0 0x7fe2c00b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:50.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.437+0000 7fe2bffff700 1 --2- 172.21.15.69:0/4103730421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2c0159530 0x7fe2c0147ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:50.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.437+0000 7fe2bf7fe700 1 -- 172.21.15.69:0/4103730421 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2c006e0e0 msgr2=0x7fe2c00b5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:50.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.437+0000 7fe2bf7fe700 1 --2- 172.21.15.69:0/4103730421 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2c006e0e0 0x7fe2c00b5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:50.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.437+0000 7fe2bf7fe700 1 -- 172.21.15.69:0/4103730421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2c0159530 msgr2=0x7fe2c0147ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:50.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.437+0000 7fe2bf7fe700 1 --2- 172.21.15.69:0/4103730421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2c0159530 0x7fe2c0147ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:50.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.437+0000 7fe2bf7fe700 1 -- 172.21.15.69:0/4103730421 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2b8009a20 con 0x7fe2c006dc70 2023-10-06T01:38:50.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.437+0000 7fe2bffff700 1 --2- 172.21.15.69:0/4103730421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2c0159530 0x7fe2c0147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:38:50.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.438+0000 7fe2bf7fe700 1 --2- 172.21.15.69:0/4103730421 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe2c006dc70 0x7fe2c00c81a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0089650 tx=0x7fe2b8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:50.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.438+0000 7fe2a77fe700 1 -- 172.21.15.69:0/4103730421 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b801b420 con 0x7fe2c006dc70 2023-10-06T01:38:50.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.438+0000 7fe2a77fe700 1 -- 172.21.15.69:0/4103730421 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b801b5a0 con 0x7fe2c006dc70 2023-10-06T01:38:50.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.438+0000 7fe2a77fe700 1 -- 172.21.15.69:0/4103730421 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b801b960 con 0x7fe2c006dc70 2023-10-06T01:38:50.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.438+0000 7fe2c5b14700 1 -- 172.21.15.69:0/4103730421 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2c00b3ae0 con 0x7fe2c006dc70 2023-10-06T01:38:50.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.438+0000 7fe2c5b14700 1 -- 172.21.15.69:0/4103730421 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2c00c86e0 con 0x7fe2c006dc70 2023-10-06T01:38:50.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.439+0000 7fe2c5b14700 1 -- 172.21.15.69:0/4103730421 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2c00b3cd0 con 0x7fe2c006dc70 2023-10-06T01:38:50.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.439+0000 7fe2a77fe700 1 -- 172.21.15.69:0/4103730421 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe2b801c400 con 0x7fe2c006dc70 2023-10-06T01:38:50.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.439+0000 7fe2a77fe700 1 --2- 172.21.15.69:0/4103730421 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe2ac066f30 0x7fe2ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:50.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.440+0000 7fe2beffd700 1 --2- 172.21.15.69:0/4103730421 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe2ac066f30 0x7fe2ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:50.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.440+0000 7fe2a77fe700 1 -- 172.21.15.69:0/4103730421 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe2b8086380 con 0x7fe2c006dc70 2023-10-06T01:38:50.443 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.440+0000 7fe2beffd700 1 --2- 172.21.15.69:0/4103730421 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe2ac066f30 0x7fe2ac0693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4007fd0 tx=0x7fe2b4007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:50.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.444+0000 7fe2a77fe700 1 -- 172.21.15.69:0/4103730421 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2b8053490 con 0x7fe2c006dc70 2023-10-06T01:38:50.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:50.675+0000 7fe2c5b14700 1 -- 172.21.15.69:0/4103730421 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe2c004c3c0 con 0x7fe2c006dc70 2023-10-06T01:38:51.660 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.659+0000 7fe2a77fe700 1 -- 172.21.15.69:0/4103730421 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe2b8056ab0 con 0x7fe2c006dc70 2023-10-06T01:38:51.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.661+0000 7fe2c5b14700 1 -- 172.21.15.69:0/4103730421 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe2ac066f30 msgr2=0x7fe2ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:51.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.661+0000 7fe2c5b14700 1 --2- 172.21.15.69:0/4103730421 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe2ac066f30 0x7fe2ac0693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe2b4007fd0 tx=0x7fe2b4007d30 comp rx=0 tx=0).stop 2023-10-06T01:38:51.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.661+0000 7fe2c5b14700 1 -- 172.21.15.69:0/4103730421 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe2c006dc70 msgr2=0x7fe2c00c81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:51.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.661+0000 7fe2c5b14700 1 --2- 172.21.15.69:0/4103730421 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe2c006dc70 0x7fe2c00c81a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0089650 tx=0x7fe2b8019000 comp rx=0 tx=0).stop 2023-10-06T01:38:51.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.662+0000 7fe2c5b14700 1 -- 172.21.15.69:0/4103730421 shutdown_connections 2023-10-06T01:38:51.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.662+0000 7fe2c5b14700 1 --2- 172.21.15.69:0/4103730421 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe2ac066f30 0x7fe2ac0693e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:51.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.662+0000 7fe2c5b14700 1 --2- 172.21.15.69:0/4103730421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe2c0159530 0x7fe2c0147ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:51.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.662+0000 7fe2c5b14700 1 --2- 172.21.15.69:0/4103730421 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe2c006dc70 0x7fe2c00c81a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:51.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.662+0000 7fe2c5b14700 1 --2- 172.21.15.69:0/4103730421 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe2c006e0e0 0x7fe2c00b5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:51.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.662+0000 7fe2c5b14700 1 -- 172.21.15.69:0/4103730421 >> 172.21.15.69:0/4103730421 conn(0x7fe2c00703a0 msgr2=0x7fe2c00cb6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:51.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.662+0000 7fe2c5b14700 1 -- 172.21.15.69:0/4103730421 shutdown_connections 2023-10-06T01:38:51.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.662+0000 7fe2c5b14700 1 -- 172.21.15.69:0/4103730421 wait complete. 2023-10-06T01:38:51.675 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T01:38:51.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.793+0000 7f6076579700 1 Processor -- start 2023-10-06T01:38:51.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.793+0000 7f6076579700 1 -- start start 2023-10-06T01:38:51.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.794+0000 7f6076579700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6070159530 0x7f60700ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:51.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.794+0000 7f6076579700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f607006dc70 0x7f6070159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:51.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.794+0000 7f6076579700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60700ccfd0 con 0x7f607006e0e0 2023-10-06T01:38:51.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.794+0000 7f6076579700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60700cf0e0 con 0x7f607006dc70 2023-10-06T01:38:51.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.794+0000 7f6076579700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607015a3d0 con 0x7f6070159530 2023-10-06T01:38:51.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.794+0000 7f6074b16700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f607006e0e0 0x7f60700cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38034/0 (socket says 172.21.15.69:38034) 2023-10-06T01:38:51.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.794+0000 7f6074b16700 1 -- 172.21.15.69:0/77214767 learned_addr learned my addr 172.21.15.69:0/77214767 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:38:51.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.794+0000 7f606ffff700 1 --2- 172.21.15.69:0/77214767 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6070159530 0x7f60700ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:51.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.794+0000 7f606f7fe700 1 --2- 172.21.15.69:0/77214767 >> v2:172.21.15.88:3300/0 conn(0x7f607006dc70 0x7f6070159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:51.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.794+0000 7f606effd700 1 -- 172.21.15.69:0/77214767 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2948656440 0 0) 0x7f60700ccfd0 con 0x7f607006e0e0 2023-10-06T01:38:51.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.794+0000 7f606effd700 1 -- 172.21.15.69:0/77214767 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6058003570 con 0x7f607006e0e0 2023-10-06T01:38:51.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.795+0000 7f606effd700 1 -- 172.21.15.69:0/77214767 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 861652243 0 0) 0x7f6058003570 con 0x7f607006e0e0 2023-10-06T01:38:51.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.795+0000 7f606effd700 1 -- 172.21.15.69:0/77214767 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6070159530 msgr2=0x7f60700ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:51.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.795+0000 7f606effd700 1 --2- 172.21.15.69:0/77214767 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6070159530 0x7f60700ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:51.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.795+0000 7f606effd700 1 -- 172.21.15.69:0/77214767 >> v2:172.21.15.88:3300/0 conn(0x7f607006dc70 msgr2=0x7f6070159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:51.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.795+0000 7f606effd700 1 --2- 172.21.15.69:0/77214767 >> v2:172.21.15.88:3300/0 conn(0x7f607006dc70 0x7f6070159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:51.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.795+0000 7f606effd700 1 -- 172.21.15.69:0/77214767 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f607015a6b0 con 0x7f607006e0e0 2023-10-06T01:38:51.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.795+0000 7f606effd700 1 -- 172.21.15.69:0/77214767 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f60680017f0 con 0x7f607006e0e0 2023-10-06T01:38:51.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.795+0000 7f606effd700 1 -- 172.21.15.69:0/77214767 >> v1:172.21.15.69:6789/0 conn(0x7f607006e0e0 legacy=0x7f60700cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:51.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.795+0000 7f606effd700 1 --2- 172.21.15.69:0/77214767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6058003a60 0x7f6058003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:51.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.795+0000 7f606effd700 1 --2- 172.21.15.69:0/77214767 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6058004810 0x7f6058004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:51.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.795+0000 7f606effd700 1 --2- 172.21.15.69:0/77214767 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6070159530 0x7f60580051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:51.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.795+0000 7f606effd700 1 -- 172.21.15.69:0/77214767 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60700cf0e0 con 0x7f6058004810 2023-10-06T01:38:51.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.795+0000 7f606effd700 1 -- 172.21.15.69:0/77214767 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607015a3d0 con 0x7f6058003a60 2023-10-06T01:38:51.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.795+0000 7f606effd700 1 -- 172.21.15.69:0/77214767 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605800ba60 con 0x7f6070159530 2023-10-06T01:38:51.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.795+0000 7f606f7fe700 1 --2- 172.21.15.69:0/77214767 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6058004810 0x7f6058004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:51.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.795+0000 7f606ffff700 1 --2- 172.21.15.69:0/77214767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6058003a60 0x7f6058003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:51.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.795+0000 7f6074b16700 1 --2- 172.21.15.69:0/77214767 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6070159530 0x7f60580051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:51.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.795+0000 7f606f7fe700 1 -- 172.21.15.69:0/77214767 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6070159530 msgr2=0x7f60580051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:51.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.795+0000 7f606f7fe700 1 --2- 172.21.15.69:0/77214767 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6070159530 0x7f60580051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:51.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.795+0000 7f606f7fe700 1 -- 172.21.15.69:0/77214767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6058003a60 msgr2=0x7f6058003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:51.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.795+0000 7f606f7fe700 1 --2- 172.21.15.69:0/77214767 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6058003a60 0x7f6058003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:51.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.795+0000 7f606f7fe700 1 -- 172.21.15.69:0/77214767 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6058003570 con 0x7f6058004810 2023-10-06T01:38:51.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.795+0000 7f6074b16700 1 --2- 172.21.15.69:0/77214767 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6070159530 0x7f60580051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:38:51.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.795+0000 7f606f7fe700 1 --2- 172.21.15.69:0/77214767 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6058004810 0x7f6058004c80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6064009c30 tx=0x7f60640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5ba8c0e3d9b536a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:51.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.795+0000 7f606effd700 1 -- 172.21.15.69:0/77214767 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606400e710 con 0x7f6058004810 2023-10-06T01:38:51.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.795+0000 7f606effd700 1 -- 172.21.15.69:0/77214767 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606400e870 con 0x7f6058004810 2023-10-06T01:38:51.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.795+0000 7f606effd700 1 -- 172.21.15.69:0/77214767 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606400ec30 con 0x7f6058004810 2023-10-06T01:38:51.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.796+0000 7f6076579700 1 -- 172.21.15.69:0/77214767 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6058004810 msgr2=0x7f6058004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:51.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.796+0000 7f6076579700 1 --2- 172.21.15.69:0/77214767 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6058004810 0x7f6058004c80 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6064009c30 tx=0x7f60640091a0 comp rx=0 tx=0).stop 2023-10-06T01:38:51.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.796+0000 7f6074b16700 1 -- 172.21.15.69:0/77214767 reap_dead start 2023-10-06T01:38:51.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.796+0000 7f6076579700 1 -- 172.21.15.69:0/77214767 shutdown_connections 2023-10-06T01:38:51.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.796+0000 7f6076579700 1 -- 172.21.15.69:0/77214767 >> 172.21.15.69:0/77214767 conn(0x7f60700703a0 msgr2=0x7f60700707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:51.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.796+0000 7f6076579700 1 -- 172.21.15.69:0/77214767 shutdown_connections 2023-10-06T01:38:51.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.796+0000 7f6076579700 1 -- 172.21.15.69:0/77214767 wait complete. 2023-10-06T01:38:51.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.797+0000 7f6076579700 1 Processor -- start 2023-10-06T01:38:51.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.797+0000 7f6076579700 1 -- start start 2023-10-06T01:38:51.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.798+0000 7f6076579700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6058004810 0x7f6070156890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:51.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.798+0000 7f6076579700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60700ca4f0 0x7f607016a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:51.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.798+0000 7f6076579700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6070169460 0x7f60701573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:51.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.798+0000 7f6076579700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60701555b0 con 0x7f60700ca4f0 2023-10-06T01:38:51.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.798+0000 7f6076579700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f607016ac30 con 0x7f6058004810 2023-10-06T01:38:51.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.798+0000 7f6076579700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60701557f0 con 0x7f6070169460 2023-10-06T01:38:51.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.798+0000 7f606f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60700ca4f0 0x7f607016a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:51.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.798+0000 7f606f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60700ca4f0 0x7f607016a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32880/0 (socket says 172.21.15.69:32880) 2023-10-06T01:38:51.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.798+0000 7f606f7fe700 1 -- 172.21.15.69:0/2880196917 learned_addr learned my addr 172.21.15.69:0/2880196917 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:51.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.798+0000 7f6074b16700 1 --2- 172.21.15.69:0/2880196917 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6070169460 0x7f60701573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:51.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.798+0000 7f606ffff700 1 --2- 172.21.15.69:0/2880196917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6058004810 0x7f6070156890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:51.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.798+0000 7f606f7fe700 1 -- 172.21.15.69:0/2880196917 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6070169460 msgr2=0x7f60701573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:51.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.798+0000 7f606f7fe700 1 --2- 172.21.15.69:0/2880196917 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6070169460 0x7f60701573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:51.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.798+0000 7f606f7fe700 1 -- 172.21.15.69:0/2880196917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6058004810 msgr2=0x7f6070156890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:51.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.798+0000 7f606f7fe700 1 --2- 172.21.15.69:0/2880196917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6058004810 0x7f6070156890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:51.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.798+0000 7f606f7fe700 1 -- 172.21.15.69:0/2880196917 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6070155ad0 con 0x7f60700ca4f0 2023-10-06T01:38:51.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.798+0000 7f606f7fe700 1 --2- 172.21.15.69:0/2880196917 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60700ca4f0 0x7f607016a6f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f60580046d0 tx=0x7f606401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:51.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.798+0000 7f6057fff700 1 -- 172.21.15.69:0/2880196917 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6064022070 con 0x7f60700ca4f0 2023-10-06T01:38:51.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.798+0000 7f6057fff700 1 -- 172.21.15.69:0/2880196917 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606400e9e0 con 0x7f60700ca4f0 2023-10-06T01:38:51.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.798+0000 7f6057fff700 1 -- 172.21.15.69:0/2880196917 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606401c450 con 0x7f60700ca4f0 2023-10-06T01:38:51.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.798+0000 7f6076579700 1 -- 172.21.15.69:0/2880196917 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6070155db0 con 0x7f60700ca4f0 2023-10-06T01:38:51.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.799+0000 7f6076579700 1 -- 172.21.15.69:0/2880196917 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6070156370 con 0x7f60700ca4f0 2023-10-06T01:38:51.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.799+0000 7f6076579700 1 -- 172.21.15.69:0/2880196917 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f607004c3c0 con 0x7f60700ca4f0 2023-10-06T01:38:51.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.800+0000 7f6057fff700 1 -- 172.21.15.69:0/2880196917 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f606401c840 con 0x7f60700ca4f0 2023-10-06T01:38:51.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.800+0000 7f6057fff700 1 --2- 172.21.15.69:0/2880196917 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f605c066f30 0x7f605c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:51.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.800+0000 7f6057fff700 1 -- 172.21.15.69:0/2880196917 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6064085d60 con 0x7f60700ca4f0 2023-10-06T01:38:51.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.800+0000 7f606ffff700 1 --2- 172.21.15.69:0/2880196917 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f605c066f30 0x7f605c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:51.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.800+0000 7f606ffff700 1 --2- 172.21.15.69:0/2880196917 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f605c066f30 0x7f605c0693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6070158fe0 tx=0x7f60600091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:51.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:51.804+0000 7f6057fff700 1 -- 172.21.15.69:0/2880196917 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6064052f30 con 0x7f60700ca4f0 2023-10-06T01:38:52.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.028+0000 7f6076579700 1 -- 172.21.15.69:0/2880196917 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f607015a990 con 0x7f60700ca4f0 2023-10-06T01:38:52.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.664+0000 7f6057fff700 1 -- 172.21.15.69:0/2880196917 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f606402b0c0 con 0x7f60700ca4f0 2023-10-06T01:38:52.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.666+0000 7f6076579700 1 -- 172.21.15.69:0/2880196917 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f605c066f30 msgr2=0x7f605c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:52.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.666+0000 7f6076579700 1 --2- 172.21.15.69:0/2880196917 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f605c066f30 0x7f605c0693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6070158fe0 tx=0x7f60600091a0 comp rx=0 tx=0).stop 2023-10-06T01:38:52.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.666+0000 7f6076579700 1 -- 172.21.15.69:0/2880196917 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60700ca4f0 msgr2=0x7f607016a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:52.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.666+0000 7f6076579700 1 --2- 172.21.15.69:0/2880196917 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60700ca4f0 0x7f607016a6f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f60580046d0 tx=0x7f606401a000 comp rx=0 tx=0).stop 2023-10-06T01:38:52.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.666+0000 7f6076579700 1 -- 172.21.15.69:0/2880196917 shutdown_connections 2023-10-06T01:38:52.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.666+0000 7f6076579700 1 --2- 172.21.15.69:0/2880196917 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f605c066f30 0x7f605c0693e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:52.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.666+0000 7f6076579700 1 --2- 172.21.15.69:0/2880196917 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6070169460 0x7f60701573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:52.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.666+0000 7f6076579700 1 --2- 172.21.15.69:0/2880196917 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6058004810 0x7f6070156890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:52.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.666+0000 7f6076579700 1 --2- 172.21.15.69:0/2880196917 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60700ca4f0 0x7f607016a6f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:52.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.666+0000 7f6076579700 1 -- 172.21.15.69:0/2880196917 >> 172.21.15.69:0/2880196917 conn(0x7f60700703a0 msgr2=0x7f60700b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:52.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.667+0000 7f6076579700 1 -- 172.21.15.69:0/2880196917 shutdown_connections 2023-10-06T01:38:52.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.667+0000 7f6076579700 1 -- 172.21.15.69:0/2880196917 wait complete. 2023-10-06T01:38:52.680 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:38:52.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.794+0000 7f3654e4e700 1 Processor -- start 2023-10-06T01:38:52.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.794+0000 7f3654e4e700 1 -- start start 2023-10-06T01:38:52.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.795+0000 7f3654e4e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f36500cb5a0 0x7f36500cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:52.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.795+0000 7f3654e4e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f36500cd9e0 0x7f3650159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:52.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.795+0000 7f3654e4e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f365015ae40 con 0x7f365015a400 2023-10-06T01:38:52.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.795+0000 7f3654e4e700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36500d13f0 con 0x7f36500cb5a0 2023-10-06T01:38:52.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.795+0000 7f3654e4e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f365015ab60 con 0x7f36500cd9e0 2023-10-06T01:38:52.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.796+0000 7f364e59c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f36500cb5a0 0x7f36500cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:52.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.796+0000 7f364e59c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f36500cb5a0 0x7f36500cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32886/0 (socket says 172.21.15.69:32886) 2023-10-06T01:38:52.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.796+0000 7f364e59c700 1 -- 172.21.15.69:0/1829809550 learned_addr learned my addr 172.21.15.69:0/1829809550 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:52.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.796+0000 7f364e59c700 1 -- 172.21.15.69:0/1829809550 >> v2:172.21.15.88:3300/0 conn(0x7f36500cd9e0 msgr2=0x7f3650159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:52.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.796+0000 7f364e59c700 1 --2- 172.21.15.69:0/1829809550 >> v2:172.21.15.88:3300/0 conn(0x7f36500cd9e0 0x7f3650159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:52.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.796+0000 7f364e59c700 1 -- 172.21.15.69:0/1829809550 >> v1:172.21.15.88:6789/0 conn(0x7f365015a400 legacy=0x7f3650156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:52.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.796+0000 7f364e59c700 1 -- 172.21.15.69:0/1829809550 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36500ccf00 con 0x7f36500cb5a0 2023-10-06T01:38:52.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.796+0000 7f364e59c700 1 --2- 172.21.15.69:0/1829809550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36500cb5a0 0x7f36500cb970 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f36400099b0 tx=0x7f3640009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac28358cd7095f8a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:52.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.796+0000 7f364d59a700 1 -- 172.21.15.69:0/1829809550 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364000b7e0 con 0x7f36500cb5a0 2023-10-06T01:38:52.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.796+0000 7f364d59a700 1 -- 172.21.15.69:0/1829809550 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364000b940 con 0x7f36500cb5a0 2023-10-06T01:38:52.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.796+0000 7f364d59a700 1 -- 172.21.15.69:0/1829809550 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364000bce0 con 0x7f36500cb5a0 2023-10-06T01:38:52.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.797+0000 7f3654e4e700 1 -- 172.21.15.69:0/1829809550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36500cb5a0 msgr2=0x7f36500cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:52.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.797+0000 7f3654e4e700 1 --2- 172.21.15.69:0/1829809550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36500cb5a0 0x7f36500cb970 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f36400099b0 tx=0x7f3640009250 comp rx=0 tx=0).stop 2023-10-06T01:38:52.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.797+0000 7f3654e4e700 1 -- 172.21.15.69:0/1829809550 shutdown_connections 2023-10-06T01:38:52.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.797+0000 7f3654e4e700 1 --2- 172.21.15.69:0/1829809550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36500cb5a0 0x7f36500cb970 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:52.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.797+0000 7f3654e4e700 1 --2- 172.21.15.69:0/1829809550 >> v2:172.21.15.88:3300/0 conn(0x7f36500cd9e0 0x7f3650159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:52.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.797+0000 7f3654e4e700 1 -- 172.21.15.69:0/1829809550 >> 172.21.15.69:0/1829809550 conn(0x7f3650070e30 msgr2=0x7f36500d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:52.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.797+0000 7f3654e4e700 1 -- 172.21.15.69:0/1829809550 shutdown_connections 2023-10-06T01:38:52.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.797+0000 7f3654e4e700 1 -- 172.21.15.69:0/1829809550 wait complete. 2023-10-06T01:38:52.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.798+0000 7f3654e4e700 1 Processor -- start 2023-10-06T01:38:52.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.798+0000 7f3654e4e700 1 -- start start 2023-10-06T01:38:52.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.799+0000 7f3654e4e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36500cb5a0 0x7f36501522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:52.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.799+0000 7f3654e4e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36500cd9e0 0x7f3650151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:52.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.799+0000 7f3654e4e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f365015a400 0x7f3650155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:52.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.799+0000 7f3654e4e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36500af250 con 0x7f36500cd9e0 2023-10-06T01:38:52.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.799+0000 7f3654e4e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36500af810 con 0x7f36500cb5a0 2023-10-06T01:38:52.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.799+0000 7f3654e4e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36500afca0 con 0x7f365015a400 2023-10-06T01:38:52.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.799+0000 7f364dd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36500cd9e0 0x7f3650151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:52.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.799+0000 7f364dd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36500cd9e0 0x7f3650151c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32898/0 (socket says 172.21.15.69:32898) 2023-10-06T01:38:52.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.799+0000 7f364dd9b700 1 -- 172.21.15.69:0/2682677236 learned_addr learned my addr 172.21.15.69:0/2682677236 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:52.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.799+0000 7f364e59c700 1 --2- 172.21.15.69:0/2682677236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36500cb5a0 0x7f36501522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:52.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.799+0000 7f364ed9d700 1 --2- 172.21.15.69:0/2682677236 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f365015a400 0x7f3650155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:52.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.799+0000 7f364dd9b700 1 -- 172.21.15.69:0/2682677236 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f365015a400 msgr2=0x7f3650155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:52.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.799+0000 7f364dd9b700 1 --2- 172.21.15.69:0/2682677236 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f365015a400 0x7f3650155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:52.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.799+0000 7f364dd9b700 1 -- 172.21.15.69:0/2682677236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36500cb5a0 msgr2=0x7f36501522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:52.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.799+0000 7f364dd9b700 1 --2- 172.21.15.69:0/2682677236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36500cb5a0 0x7f36501522a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:52.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.799+0000 7f364dd9b700 1 -- 172.21.15.69:0/2682677236 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36400094f0 con 0x7f36500cd9e0 2023-10-06T01:38:52.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.799+0000 7f364e59c700 1 --2- 172.21.15.69:0/2682677236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36500cb5a0 0x7f36501522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:38:52.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.799+0000 7f364dd9b700 1 --2- 172.21.15.69:0/2682677236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36500cd9e0 0x7f3650151c90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f363800b810 tx=0x7f3638009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:52.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.799+0000 7f36467fc700 1 -- 172.21.15.69:0/2682677236 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363800f5f0 con 0x7f36500cd9e0 2023-10-06T01:38:52.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.799+0000 7f36467fc700 1 -- 172.21.15.69:0/2682677236 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f363800f770 con 0x7f36500cd9e0 2023-10-06T01:38:52.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.799+0000 7f3654e4e700 1 -- 172.21.15.69:0/2682677236 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36500ca300 con 0x7f36500cd9e0 2023-10-06T01:38:52.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.799+0000 7f36467fc700 1 -- 172.21.15.69:0/2682677236 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f363800fb30 con 0x7f36500cd9e0 2023-10-06T01:38:52.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.799+0000 7f3654e4e700 1 -- 172.21.15.69:0/2682677236 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3650152890 con 0x7f36500cd9e0 2023-10-06T01:38:52.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.800+0000 7f3654e4e700 1 -- 172.21.15.69:0/2682677236 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f365004c3c0 con 0x7f36500cd9e0 2023-10-06T01:38:52.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.801+0000 7f36467fc700 1 -- 172.21.15.69:0/2682677236 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3638010480 con 0x7f36500cd9e0 2023-10-06T01:38:52.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.801+0000 7f36467fc700 1 --2- 172.21.15.69:0/2682677236 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3630066f30 0x7f36300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:52.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.801+0000 7f36467fc700 1 -- 172.21.15.69:0/2682677236 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f36380845c0 con 0x7f36500cd9e0 2023-10-06T01:38:52.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.801+0000 7f364e59c700 1 --2- 172.21.15.69:0/2682677236 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3630066f30 0x7f36300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:52.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.801+0000 7f364e59c700 1 --2- 172.21.15.69:0/2682677236 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3630066f30 0x7f36300693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f36400099b0 tx=0x7f3640016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:52.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:52.805+0000 7f36467fc700 1 -- 172.21.15.69:0/2682677236 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3638051750 con 0x7f36500cd9e0 2023-10-06T01:38:53.028 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.028+0000 7f3654e4e700 1 -- 172.21.15.69:0/2682677236 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f36500cd1e0 con 0x7f36500cd9e0 2023-10-06T01:38:53.029 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.028+0000 7f36467fc700 1 -- 172.21.15.69:0/2682677236 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f3638054d70 con 0x7f36500cd9e0 2023-10-06T01:38:53.029 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:38:53.029 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6836/2049506781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2049506781},{"type":"v1","addr":"172.21.15.69:6836","nonce":2049506781}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3367080201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6835","nonce":3367080201},{"type":"v1","addr":"172.21.15.69:6837","nonce":3367080201}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2692995813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":2692995813},{"type":"v1","addr":"172.21.15.88:6835","nonce":2692995813}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:38:49.072564+0000","modified":"2023-10-06T01:38:52.659297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6834/2097597935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":2097597935},{"type":"v1","addr":"172.21.15.88:6834","nonce":2097597935}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T01:38:53.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.030+0000 7f3654e4e700 1 -- 172.21.15.69:0/2682677236 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3630066f30 msgr2=0x7f36300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:53.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.030+0000 7f3654e4e700 1 --2- 172.21.15.69:0/2682677236 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3630066f30 0x7f36300693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f36400099b0 tx=0x7f3640016000 comp rx=0 tx=0).stop 2023-10-06T01:38:53.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.030+0000 7f3654e4e700 1 -- 172.21.15.69:0/2682677236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36500cd9e0 msgr2=0x7f3650151c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:53.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.030+0000 7f3654e4e700 1 --2- 172.21.15.69:0/2682677236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36500cd9e0 0x7f3650151c90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f363800b810 tx=0x7f3638009250 comp rx=0 tx=0).stop 2023-10-06T01:38:53.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.030+0000 7f3654e4e700 1 -- 172.21.15.69:0/2682677236 shutdown_connections 2023-10-06T01:38:53.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.030+0000 7f3654e4e700 1 --2- 172.21.15.69:0/2682677236 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3630066f30 0x7f36300693e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.030+0000 7f3654e4e700 1 --2- 172.21.15.69:0/2682677236 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f365015a400 0x7f3650155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.030+0000 7f3654e4e700 1 --2- 172.21.15.69:0/2682677236 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36500cb5a0 0x7f36501522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.031 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.030+0000 7f3654e4e700 1 --2- 172.21.15.69:0/2682677236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36500cd9e0 0x7f3650151c90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.030+0000 7f3654e4e700 1 -- 172.21.15.69:0/2682677236 >> 172.21.15.69:0/2682677236 conn(0x7f3650070e30 msgr2=0x7f36500b2590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:53.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.030+0000 7f3654e4e700 1 -- 172.21.15.69:0/2682677236 shutdown_connections 2023-10-06T01:38:53.032 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.030+0000 7f3654e4e700 1 -- 172.21.15.69:0/2682677236 wait complete. 2023-10-06T01:38:53.032 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 8 2023-10-06T01:38:53.043 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:38:53.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.155+0000 7fa93819c700 1 Processor -- start 2023-10-06T01:38:53.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.155+0000 7fa93819c700 1 -- start start 2023-10-06T01:38:53.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.156+0000 7fa93819c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa9301508c0 0x7fa930158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:53.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.156+0000 7fa93819c700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa930158c80 con 0x7fa93015a7d0 2023-10-06T01:38:53.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.156+0000 7fa93819c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa930158f60 con 0x7fa930150c90 2023-10-06T01:38:53.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.156+0000 7fa93819c700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa93015afc0 con 0x7fa9301508c0 2023-10-06T01:38:53.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.156+0000 7fa936739700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fa93015a7d0 0x7fa930154700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38046/0 (socket says 172.21.15.69:38046) 2023-10-06T01:38:53.163 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.156+0000 7fa936739700 1 -- 172.21.15.69:0/1089259787 learned_addr learned my addr 172.21.15.69:0/1089259787 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:38:53.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa935f38700 1 --2- 172.21.15.69:0/1089259787 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa9301508c0 0x7fa930158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:53.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa934f36700 1 -- 172.21.15.69:0/1089259787 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3307763681 0 0) 0x7fa930158c80 con 0x7fa93015a7d0 2023-10-06T01:38:53.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa934f36700 1 -- 172.21.15.69:0/1089259787 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa918003570 con 0x7fa93015a7d0 2023-10-06T01:38:53.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa934f36700 1 -- 172.21.15.69:0/1089259787 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236815651 0 0) 0x7fa930158f60 con 0x7fa930150c90 2023-10-06T01:38:53.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa934f36700 1 -- 172.21.15.69:0/1089259787 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa930158c80 con 0x7fa930150c90 2023-10-06T01:38:53.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa934f36700 1 -- 172.21.15.69:0/1089259787 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 621984553 0 0) 0x7fa918003570 con 0x7fa93015a7d0 2023-10-06T01:38:53.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa934f36700 1 -- 172.21.15.69:0/1089259787 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa9301508c0 msgr2=0x7fa930158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:53.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa934f36700 1 --2- 172.21.15.69:0/1089259787 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa9301508c0 0x7fa930158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa934f36700 1 -- 172.21.15.69:0/1089259787 >> v1:172.21.15.88:6789/0 conn(0x7fa930150c90 legacy=0x7fa93015a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:53.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa934f36700 1 -- 172.21.15.69:0/1089259787 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa930159240 con 0x7fa93015a7d0 2023-10-06T01:38:53.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa934f36700 1 -- 172.21.15.69:0/1089259787 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7fa928001470 con 0x7fa93015a7d0 2023-10-06T01:38:53.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa935f38700 1 --2- 172.21.15.69:0/1089259787 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa9301508c0 0x7fa930158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:38:53.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa934f36700 1 -- 172.21.15.69:0/1089259787 >> v1:172.21.15.69:6789/0 conn(0x7fa93015a7d0 legacy=0x7fa930154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:53.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa934f36700 1 --2- 172.21.15.69:0/1089259787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa918003c20 0x7fa918004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:53.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa934f36700 1 --2- 172.21.15.69:0/1089259787 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa9301508c0 0x7fa918004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:53.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa934f36700 1 --2- 172.21.15.69:0/1089259787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa918004d50 0x7fa9180051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:53.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa934f36700 1 -- 172.21.15.69:0/1089259787 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91800bb10 con 0x7fa918003c20 2023-10-06T01:38:53.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa934f36700 1 -- 172.21.15.69:0/1089259787 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91800bc50 con 0x7fa918004d50 2023-10-06T01:38:53.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa934f36700 1 -- 172.21.15.69:0/1089259787 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa91800be10 con 0x7fa9301508c0 2023-10-06T01:38:53.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa935f38700 1 --2- 172.21.15.69:0/1089259787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa918003c20 0x7fa918004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:53.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa935737700 1 --2- 172.21.15.69:0/1089259787 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa9301508c0 0x7fa918004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:53.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa936739700 1 --2- 172.21.15.69:0/1089259787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa918004d50 0x7fa9180051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:53.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa935f38700 1 -- 172.21.15.69:0/1089259787 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa9301508c0 msgr2=0x7fa918004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:53.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa935f38700 1 --2- 172.21.15.69:0/1089259787 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa9301508c0 0x7fa918004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa935f38700 1 -- 172.21.15.69:0/1089259787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa918004d50 msgr2=0x7fa9180051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:53.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa935f38700 1 --2- 172.21.15.69:0/1089259787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa918004d50 0x7fa9180051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa935f38700 1 -- 172.21.15.69:0/1089259787 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa920009a20 con 0x7fa918003c20 2023-10-06T01:38:53.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.157+0000 7fa936739700 1 --2- 172.21.15.69:0/1089259787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa918004d50 0x7fa9180051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:38:53.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.158+0000 7fa935f38700 1 --2- 172.21.15.69:0/1089259787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa918003c20 0x7fa918004010 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa92000e3c0 tx=0x7fa92000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca680f09c201be6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:53.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.158+0000 7fa934f36700 1 -- 172.21.15.69:0/1089259787 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa920009c50 con 0x7fa918003c20 2023-10-06T01:38:53.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.158+0000 7fa934f36700 1 -- 172.21.15.69:0/1089259787 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92000f040 con 0x7fa918003c20 2023-10-06T01:38:53.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.158+0000 7fa934f36700 1 -- 172.21.15.69:0/1089259787 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92000eea0 con 0x7fa918003c20 2023-10-06T01:38:53.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.158+0000 7fa93819c700 1 -- 172.21.15.69:0/1089259787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa918003c20 msgr2=0x7fa918004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:53.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.158+0000 7fa93819c700 1 --2- 172.21.15.69:0/1089259787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa918003c20 0x7fa918004010 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa92000e3c0 tx=0x7fa92000b040 comp rx=0 tx=0).stop 2023-10-06T01:38:53.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.158+0000 7fa936739700 1 -- 172.21.15.69:0/1089259787 reap_dead start 2023-10-06T01:38:53.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.158+0000 7fa93819c700 1 -- 172.21.15.69:0/1089259787 shutdown_connections 2023-10-06T01:38:53.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.158+0000 7fa93819c700 1 -- 172.21.15.69:0/1089259787 >> 172.21.15.69:0/1089259787 conn(0x7fa9300cded0 msgr2=0x7fa93006add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:53.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.158+0000 7fa93819c700 1 -- 172.21.15.69:0/1089259787 shutdown_connections 2023-10-06T01:38:53.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.158+0000 7fa93819c700 1 -- 172.21.15.69:0/1089259787 wait complete. 2023-10-06T01:38:53.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.159+0000 7fa93819c700 1 Processor -- start 2023-10-06T01:38:53.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.159+0000 7fa93819c700 1 -- start start 2023-10-06T01:38:53.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.160+0000 7fa93819c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa918003c20 0x7fa930155120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:53.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.160+0000 7fa93819c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9301511e0 0x7fa9300cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:53.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.160+0000 7fa93819c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa93016b9e0 0x7fa93016be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:53.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.160+0000 7fa93819c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9300c21b0 con 0x7fa9301511e0 2023-10-06T01:38:53.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.160+0000 7fa93819c700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa930152900 con 0x7fa918003c20 2023-10-06T01:38:53.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.160+0000 7fa93819c700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa930155950 con 0x7fa93016b9e0 2023-10-06T01:38:53.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.160+0000 7fa935737700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9301511e0 0x7fa9300cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:53.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.160+0000 7fa935737700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9301511e0 0x7fa9300cb640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32930/0 (socket says 172.21.15.69:32930) 2023-10-06T01:38:53.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.160+0000 7fa935737700 1 -- 172.21.15.69:0/746367504 learned_addr learned my addr 172.21.15.69:0/746367504 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:53.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.160+0000 7fa935f38700 1 --2- 172.21.15.69:0/746367504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa918003c20 0x7fa930155120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:53.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.161+0000 7fa936739700 1 --2- 172.21.15.69:0/746367504 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa93016b9e0 0x7fa93016be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:53.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.161+0000 7fa935737700 1 -- 172.21.15.69:0/746367504 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa93016b9e0 msgr2=0x7fa93016be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:53.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.161+0000 7fa935737700 1 --2- 172.21.15.69:0/746367504 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa93016b9e0 0x7fa93016be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.161+0000 7fa935737700 1 -- 172.21.15.69:0/746367504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa918003c20 msgr2=0x7fa930155120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:53.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.161+0000 7fa935737700 1 --2- 172.21.15.69:0/746367504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa918003c20 0x7fa930155120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.161+0000 7fa935737700 1 -- 172.21.15.69:0/746367504 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa930155c30 con 0x7fa9301511e0 2023-10-06T01:38:53.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.161+0000 7fa935f38700 1 --2- 172.21.15.69:0/746367504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa918003c20 0x7fa930155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:38:53.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.161+0000 7fa935737700 1 --2- 172.21.15.69:0/746367504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9301511e0 0x7fa9300cb640 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa924002c00 tx=0x7fa924007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:53.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.161+0000 7fa92dffb700 1 -- 172.21.15.69:0/746367504 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa924003510 con 0x7fa9301511e0 2023-10-06T01:38:53.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.161+0000 7fa92dffb700 1 -- 172.21.15.69:0/746367504 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa92400fa50 con 0x7fa9301511e0 2023-10-06T01:38:53.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.161+0000 7fa93819c700 1 -- 172.21.15.69:0/746367504 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa930155f10 con 0x7fa9301511e0 2023-10-06T01:38:53.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.161+0000 7fa92dffb700 1 -- 172.21.15.69:0/746367504 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa92400fe10 con 0x7fa9301511e0 2023-10-06T01:38:53.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.161+0000 7fa93819c700 1 -- 172.21.15.69:0/746367504 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa930155660 con 0x7fa9301511e0 2023-10-06T01:38:53.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.162+0000 7fa93819c700 1 -- 172.21.15.69:0/746367504 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa930152d90 con 0x7fa9301511e0 2023-10-06T01:38:53.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.162+0000 7fa92dffb700 1 -- 172.21.15.69:0/746367504 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa924013600 con 0x7fa9301511e0 2023-10-06T01:38:53.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.162+0000 7fa92dffb700 1 --2- 172.21.15.69:0/746367504 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa91c066f30 0x7fa91c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:53.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.163+0000 7fa92dffb700 1 -- 172.21.15.69:0/746367504 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa924084e90 con 0x7fa9301511e0 2023-10-06T01:38:53.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.163+0000 7fa935f38700 1 --2- 172.21.15.69:0/746367504 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa91c066f30 0x7fa91c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:53.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.163+0000 7fa935f38700 1 --2- 172.21.15.69:0/746367504 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa91c066f30 0x7fa91c0693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa9200094a0 tx=0x7fa92001a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:53.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.167+0000 7fa92dffb700 1 -- 172.21.15.69:0/746367504 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa930152d90 con 0x7fa9301511e0 2023-10-06T01:38:53.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.352+0000 7fa93819c700 1 -- 172.21.15.69:0/746367504 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9300b2ee0 con 0x7fa9301511e0 2023-10-06T01:38:53.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.353+0000 7fa92dffb700 1 -- 172.21.15.69:0/746367504 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16818 (secure 0 0 0) 0x7fa924055990 con 0x7fa9301511e0 2023-10-06T01:38:53.354 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:38:53.354 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":24,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:38:50.506861+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:38:43.046056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:38:47.525023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:38:47.992048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:38:53.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.355+0000 7fa93819c700 1 -- 172.21.15.69:0/746367504 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa91c066f30 msgr2=0x7fa91c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:53.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.355+0000 7fa93819c700 1 --2- 172.21.15.69:0/746367504 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa91c066f30 0x7fa91c0693e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa9200094a0 tx=0x7fa92001a000 comp rx=0 tx=0).stop 2023-10-06T01:38:53.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.355+0000 7fa93819c700 1 -- 172.21.15.69:0/746367504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9301511e0 msgr2=0x7fa9300cb640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:53.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.355+0000 7fa93819c700 1 --2- 172.21.15.69:0/746367504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9301511e0 0x7fa9300cb640 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa924002c00 tx=0x7fa924007d30 comp rx=0 tx=0).stop 2023-10-06T01:38:53.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.355+0000 7fa93819c700 1 -- 172.21.15.69:0/746367504 shutdown_connections 2023-10-06T01:38:53.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.355+0000 7fa93819c700 1 --2- 172.21.15.69:0/746367504 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa91c066f30 0x7fa91c0693e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.355+0000 7fa93819c700 1 --2- 172.21.15.69:0/746367504 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa93016b9e0 0x7fa93016be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.355+0000 7fa93819c700 1 --2- 172.21.15.69:0/746367504 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa918003c20 0x7fa930155120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.355+0000 7fa93819c700 1 --2- 172.21.15.69:0/746367504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9301511e0 0x7fa9300cb640 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.355+0000 7fa93819c700 1 -- 172.21.15.69:0/746367504 >> 172.21.15.69:0/746367504 conn(0x7fa9300cded0 msgr2=0x7fa930068eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:53.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.355+0000 7fa93819c700 1 -- 172.21.15.69:0/746367504 shutdown_connections 2023-10-06T01:38:53.357 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.355+0000 7fa93819c700 1 -- 172.21.15.69:0/746367504 wait complete. 2023-10-06T01:38:53.367 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T01:38:53.367 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:38:53.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.482+0000 7fae94a36700 1 Processor -- start 2023-10-06T01:38:53.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.482+0000 7fae94a36700 1 -- start start 2023-10-06T01:38:53.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.483+0000 7fae94a36700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fae900a8d00 0x7fae900cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:53.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.483+0000 7fae94a36700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fae900a90d0 0x7fae9006de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:53.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.483+0000 7fae94a36700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fae9006e380 0x7fae900cc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:53.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.483+0000 7fae94a36700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae900ae680 con 0x7fae9006e380 2023-10-06T01:38:53.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.483+0000 7fae94a36700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae9006e7f0 con 0x7fae900a90d0 2023-10-06T01:38:53.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.483+0000 7fae94a36700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae900aeee0 con 0x7fae900a8d00 2023-10-06T01:38:53.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.483+0000 7fae8ed9d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fae9006e380 0x7fae900cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:53.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.483+0000 7fae8ed9d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fae9006e380 0x7fae900cc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32934/0 (socket says 172.21.15.69:32934) 2023-10-06T01:38:53.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.483+0000 7fae8ed9d700 1 -- 172.21.15.69:0/804459301 learned_addr learned my addr 172.21.15.69:0/804459301 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:53.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.483+0000 7fae8dd9b700 1 --2- 172.21.15.69:0/804459301 >> v2:172.21.15.88:3300/0 conn(0x7fae900a90d0 0x7fae9006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:53.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.483+0000 7fae8e59c700 1 --2- 172.21.15.69:0/804459301 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fae900a8d00 0x7fae900cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:53.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.483+0000 7fae8ed9d700 1 -- 172.21.15.69:0/804459301 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fae900a8d00 msgr2=0x7fae900cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:53.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.483+0000 7fae8ed9d700 1 --2- 172.21.15.69:0/804459301 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fae900a8d00 0x7fae900cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.483+0000 7fae8ed9d700 1 -- 172.21.15.69:0/804459301 >> v2:172.21.15.88:3300/0 conn(0x7fae900a90d0 msgr2=0x7fae9006de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:53.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.483+0000 7fae8ed9d700 1 --2- 172.21.15.69:0/804459301 >> v2:172.21.15.88:3300/0 conn(0x7fae900a90d0 0x7fae9006de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.483+0000 7fae8ed9d700 1 -- 172.21.15.69:0/804459301 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae900cf490 con 0x7fae9006e380 2023-10-06T01:38:53.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.483+0000 7fae8dd9b700 1 --2- 172.21.15.69:0/804459301 >> v2:172.21.15.88:3300/0 conn(0x7fae900a90d0 0x7fae9006de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:38:53.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.483+0000 7fae8ed9d700 1 --2- 172.21.15.69:0/804459301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae9006e380 0x7fae900cc420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fae9006a9e0 tx=0x7fae88009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c7039c60606b65 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:53.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.483+0000 7fae8d59a700 1 -- 172.21.15.69:0/804459301 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8800e070 con 0x7fae9006e380 2023-10-06T01:38:53.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.483+0000 7fae8d59a700 1 -- 172.21.15.69:0/804459301 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8800ba50 con 0x7fae9006e380 2023-10-06T01:38:53.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.483+0000 7fae8d59a700 1 -- 172.21.15.69:0/804459301 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae880092e0 con 0x7fae9006e380 2023-10-06T01:38:53.487 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.484+0000 7fae94a36700 1 -- 172.21.15.69:0/804459301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae9006e380 msgr2=0x7fae900cc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:53.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.484+0000 7fae94a36700 1 --2- 172.21.15.69:0/804459301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae9006e380 0x7fae900cc420 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fae9006a9e0 tx=0x7fae88009840 comp rx=0 tx=0).stop 2023-10-06T01:38:53.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.484+0000 7fae94a36700 1 -- 172.21.15.69:0/804459301 shutdown_connections 2023-10-06T01:38:53.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.484+0000 7fae94a36700 1 --2- 172.21.15.69:0/804459301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae9006e380 0x7fae900cc420 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.484+0000 7fae94a36700 1 --2- 172.21.15.69:0/804459301 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fae900a8d00 0x7fae900cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.488 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.484+0000 7fae94a36700 1 --2- 172.21.15.69:0/804459301 >> v2:172.21.15.88:3300/0 conn(0x7fae900a90d0 0x7fae9006de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.484+0000 7fae94a36700 1 -- 172.21.15.69:0/804459301 >> 172.21.15.69:0/804459301 conn(0x7fae9006ce80 msgr2=0x7fae900ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:53.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.484+0000 7fae94a36700 1 -- 172.21.15.69:0/804459301 shutdown_connections 2023-10-06T01:38:53.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.484+0000 7fae94a36700 1 -- 172.21.15.69:0/804459301 wait complete. 2023-10-06T01:38:53.493 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.485+0000 7fae94a36700 1 Processor -- start 2023-10-06T01:38:53.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.485+0000 7fae94a36700 1 -- start start 2023-10-06T01:38:53.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.486+0000 7fae94a36700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fae9006e380 0x7fae9016a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:53.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.486+0000 7fae94a36700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae900a8d00 0x7fae90153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:53.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.486+0000 7fae94a36700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae900a90d0 0x7fae901575f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:53.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.486+0000 7fae94a36700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae90156300 con 0x7fae900a8d00 2023-10-06T01:38:53.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.486+0000 7fae94a36700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9016ab30 con 0x7fae900a90d0 2023-10-06T01:38:53.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.486+0000 7fae94a36700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae90156550 con 0x7fae9006e380 2023-10-06T01:38:53.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.486+0000 7fae8dd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae900a8d00 0x7fae90153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:53.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.486+0000 7fae8dd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae900a8d00 0x7fae90153850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32940/0 (socket says 172.21.15.69:32940) 2023-10-06T01:38:53.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.486+0000 7fae8dd9b700 1 -- 172.21.15.69:0/4178044071 learned_addr learned my addr 172.21.15.69:0/4178044071 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:53.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.486+0000 7fae8ed9d700 1 --2- 172.21.15.69:0/4178044071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae900a90d0 0x7fae901575f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:53.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.486+0000 7fae8dd9b700 1 -- 172.21.15.69:0/4178044071 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fae9006e380 msgr2=0x7fae9016a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:53.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.486+0000 7fae8e59c700 1 --2- 172.21.15.69:0/4178044071 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fae9006e380 0x7fae9016a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:53.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.486+0000 7fae8dd9b700 1 --2- 172.21.15.69:0/4178044071 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fae9006e380 0x7fae9016a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.486+0000 7fae8dd9b700 1 -- 172.21.15.69:0/4178044071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae900a90d0 msgr2=0x7fae901575f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:53.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.486+0000 7fae8dd9b700 1 --2- 172.21.15.69:0/4178044071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae900a90d0 0x7fae901575f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.486+0000 7fae8dd9b700 1 -- 172.21.15.69:0/4178044071 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae88009ae0 con 0x7fae900a8d00 2023-10-06T01:38:53.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.486+0000 7fae8ed9d700 1 --2- 172.21.15.69:0/4178044071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae900a90d0 0x7fae901575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:38:53.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.486+0000 7fae8dd9b700 1 --2- 172.21.15.69:0/4178044071 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae900a8d00 0x7fae90153850 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fae8400d890 tx=0x7fae84008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:53.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.486+0000 7fae7e7fc700 1 -- 172.21.15.69:0/4178044071 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae84005a00 con 0x7fae900a8d00 2023-10-06T01:38:53.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.486+0000 7fae7e7fc700 1 -- 172.21.15.69:0/4178044071 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae84005b60 con 0x7fae900a8d00 2023-10-06T01:38:53.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.486+0000 7fae7e7fc700 1 -- 172.21.15.69:0/4178044071 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae840125f0 con 0x7fae900a8d00 2023-10-06T01:38:53.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.486+0000 7fae94a36700 1 -- 172.21.15.69:0/4178044071 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae90156830 con 0x7fae900a8d00 2023-10-06T01:38:53.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.487+0000 7fae94a36700 1 -- 172.21.15.69:0/4178044071 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae90156df0 con 0x7fae900a8d00 2023-10-06T01:38:53.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.487+0000 7fae94a36700 1 -- 172.21.15.69:0/4178044071 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae90157440 con 0x7fae900a8d00 2023-10-06T01:38:53.497 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.488+0000 7fae7e7fc700 1 -- 172.21.15.69:0/4178044071 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae840129a0 con 0x7fae900a8d00 2023-10-06T01:38:53.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.488+0000 7fae7e7fc700 1 --2- 172.21.15.69:0/4178044071 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fae70066f30 0x7fae700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:53.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.488+0000 7fae8e59c700 1 --2- 172.21.15.69:0/4178044071 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fae70066f30 0x7fae700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:53.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.488+0000 7fae7e7fc700 1 -- 172.21.15.69:0/4178044071 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fae840848a0 con 0x7fae900a8d00 2023-10-06T01:38:53.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.488+0000 7fae8e59c700 1 --2- 172.21.15.69:0/4178044071 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fae70066f30 0x7fae700693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fae80009970 tx=0x7fae80008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:53.498 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.492+0000 7fae7e7fc700 1 -- 172.21.15.69:0/4178044071 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae840519b0 con 0x7fae900a8d00 2023-10-06T01:38:53.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.674+0000 7fae94a36700 1 -- 172.21.15.69:0/4178044071 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae9004c3c0 con 0x7fae70066f30 2023-10-06T01:38:53.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.682+0000 7fae7e7fc700 1 -- 172.21.15.69:0/4178044071 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+272029 (secure 0 0 0) 0x7fae9004c3c0 con 0x7fae70066f30 2023-10-06T01:38:53.685 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:38:53.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.685+0000 7fae94a36700 1 -- 172.21.15.69:0/4178044071 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fae70066f30 msgr2=0x7fae700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:53.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.685+0000 7fae94a36700 1 --2- 172.21.15.69:0/4178044071 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fae70066f30 0x7fae700693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fae80009970 tx=0x7fae80008040 comp rx=0 tx=0).stop 2023-10-06T01:38:53.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.685+0000 7fae94a36700 1 -- 172.21.15.69:0/4178044071 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae900a8d00 msgr2=0x7fae90153850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:53.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.685+0000 7fae94a36700 1 --2- 172.21.15.69:0/4178044071 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae900a8d00 0x7fae90153850 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fae8400d890 tx=0x7fae84008040 comp rx=0 tx=0).stop 2023-10-06T01:38:53.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.685+0000 7fae94a36700 1 -- 172.21.15.69:0/4178044071 shutdown_connections 2023-10-06T01:38:53.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.685+0000 7fae94a36700 1 --2- 172.21.15.69:0/4178044071 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fae70066f30 0x7fae700693e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.685+0000 7fae94a36700 1 --2- 172.21.15.69:0/4178044071 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae900a90d0 0x7fae901575f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.685+0000 7fae94a36700 1 --2- 172.21.15.69:0/4178044071 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fae9006e380 0x7fae9016a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.685+0000 7fae94a36700 1 --2- 172.21.15.69:0/4178044071 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae900a8d00 0x7fae90153850 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.685+0000 7fae94a36700 1 -- 172.21.15.69:0/4178044071 >> 172.21.15.69:0/4178044071 conn(0x7fae9006ce80 msgr2=0x7fae900696a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:53.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.685+0000 7fae94a36700 1 -- 172.21.15.69:0/4178044071 shutdown_connections 2023-10-06T01:38:53.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.685+0000 7fae94a36700 1 -- 172.21.15.69:0/4178044071 wait complete. 2023-10-06T01:38:53.689 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-10-06T01:38:53.697 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-06T01:38:52.247006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2381064,"kb_used_data":2760,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593656,"statfs":{"total":773094113280,"available":770655903744,"internally_reserved":0,"allocated":2826240,"data_stored":1720376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.605884"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T01:38:44.534735+0000","last_change":"2023-10-06T01:38:44.533111+0000","last_active":"2023-10-06T01:38:44.534735+0000","last_peered":"2023-10-06T01:38:44.534735+0000","last_clean":"2023-10-06T01:38:44.534735+0000","last_became_active":"2023-10-06T01:38:44.532838+0000","last_became_peered":"2023-10-06T01:38:44.532838+0000","last_unstale":"2023-10-06T01:38:44.534735+0000","last_undegraded":"2023-10-06T01:38:44.534735+0000","last_fullsized":"2023-10-06T01:38:44.534735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T01:38:44.535515+0000","last_change":"2023-10-06T01:38:44.533897+0000","last_active":"2023-10-06T01:38:44.535515+0000","last_peered":"2023-10-06T01:38:44.535515+0000","last_clean":"2023-10-06T01:38:44.535515+0000","last_became_active":"2023-10-06T01:38:44.533611+0000","last_became_peered":"2023-10-06T01:38:44.533611+0000","last_unstale":"2023-10-06T01:38:44.535515+0000","last_undegraded":"2023-10-06T01:38:44.535515+0000","last_fullsized":"2023-10-06T01:38:44.535515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:24.411408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T01:38:45.310272+0000","last_change":"2023-10-06T01:38:45.307814+0000","last_active":"2023-10-06T01:38:45.310272+0000","last_peered":"2023-10-06T01:38:45.310272+0000","last_clean":"2023-10-06T01:38:45.310272+0000","last_became_active":"2023-10-06T01:38:45.307536+0000","last_became_peered":"2023-10-06T01:38:45.307536+0000","last_unstale":"2023-10-06T01:38:45.310272+0000","last_undegraded":"2023-10-06T01:38:45.310272+0000","last_fullsized":"2023-10-06T01:38:45.310272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:09.503713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T01:38:44.535546+0000","last_change":"2023-10-06T01:38:44.534507+0000","last_active":"2023-10-06T01:38:44.535546+0000","last_peered":"2023-10-06T01:38:44.535546+0000","last_clean":"2023-10-06T01:38:44.535546+0000","last_became_active":"2023-10-06T01:38:44.534191+0000","last_became_peered":"2023-10-06T01:38:44.534191+0000","last_unstale":"2023-10-06T01:38:44.535546+0000","last_undegraded":"2023-10-06T01:38:44.535546+0000","last_fullsized":"2023-10-06T01:38:44.535546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":162,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T01:38:44.529127+0000","last_change":"2023-10-06T01:38:40.115117+0000","last_active":"2023-10-06T01:38:44.529127+0000","last_peered":"2023-10-06T01:38:44.529127+0000","last_clean":"2023-10-06T01:38:44.529127+0000","last_became_active":"2023-10-06T01:38:40.114142+0000","last_became_peered":"2023-10-06T01:38:40.114142+0000","last_unstale":"2023-10-06T01:38:44.529127+0000","last_undegraded":"2023-10-06T01:38:44.529127+0000","last_fullsized":"2023-10-06T01:38:44.529127+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_clean_scrub_stamp":"2023-10-06T01:38:38.338797+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:52.870262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T01:38:44.533010+0000","last_change":"2023-10-06T01:38:44.531831+0000","last_active":"2023-10-06T01:38:44.533010+0000","last_peered":"2023-10-06T01:38:44.533010+0000","last_clean":"2023-10-06T01:38:44.533010+0000","last_became_active":"2023-10-06T01:38:44.531496+0000","last_became_peered":"2023-10-06T01:38:44.531496+0000","last_unstale":"2023-10-06T01:38:44.533010+0000","last_undegraded":"2023-10-06T01:38:44.533010+0000","last_fullsized":"2023-10-06T01:38:44.533010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:28.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T01:38:44.532370+0000","last_change":"2023-10-06T01:38:44.531335+0000","last_active":"2023-10-06T01:38:44.532370+0000","last_peered":"2023-10-06T01:38:44.532370+0000","last_clean":"2023-10-06T01:38:44.532370+0000","last_became_active":"2023-10-06T01:38:44.530966+0000","last_became_peered":"2023-10-06T01:38:44.530966+0000","last_unstale":"2023-10-06T01:38:44.532370+0000","last_undegraded":"2023-10-06T01:38:44.532370+0000","last_fullsized":"2023-10-06T01:38:44.532370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:33.926180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T01:38:44.534744+0000","last_change":"2023-10-06T01:38:44.533582+0000","last_active":"2023-10-06T01:38:44.534744+0000","last_peered":"2023-10-06T01:38:44.534744+0000","last_clean":"2023-10-06T01:38:44.534744+0000","last_became_active":"2023-10-06T01:38:44.533324+0000","last_became_peered":"2023-10-06T01:38:44.533324+0000","last_unstale":"2023-10-06T01:38:44.534744+0000","last_undegraded":"2023-10-06T01:38:44.534744+0000","last_fullsized":"2023-10-06T01:38:44.534744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T01:38:44.538048+0000","last_change":"2023-10-06T01:38:44.533765+0000","last_active":"2023-10-06T01:38:44.538048+0000","last_peered":"2023-10-06T01:38:44.538048+0000","last_clean":"2023-10-06T01:38:44.538048+0000","last_became_active":"2023-10-06T01:38:44.533406+0000","last_became_peered":"2023-10-06T01:38:44.533406+0000","last_unstale":"2023-10-06T01:38:44.538048+0000","last_undegraded":"2023-10-06T01:38:44.538048+0000","last_fullsized":"2023-10-06T01:38:44.538048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":657823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":67455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":67455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":657823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":67455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":67455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":67455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":67455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:38:53.707 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:38:53.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.850+0000 7f169c5b8700 1 Processor -- start 2023-10-06T01:38:53.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.850+0000 7f169c5b8700 1 -- start start 2023-10-06T01:38:53.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.851+0000 7f169c5b8700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f16940cb5a0 0x7f16940cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:53.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.851+0000 7f169c5b8700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f169415ae40 con 0x7f169415a5d0 2023-10-06T01:38:53.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.851+0000 7f169c5b8700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f169415ab60 con 0x7f16940cd9e0 2023-10-06T01:38:53.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.851+0000 7f169c5b8700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16940d13f0 con 0x7f16940cb5a0 2023-10-06T01:38:53.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.851+0000 7f169ab55700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f169415a5d0 0x7f1694156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38052/0 (socket says 172.21.15.69:38052) 2023-10-06T01:38:53.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.851+0000 7f169ab55700 1 -- 172.21.15.69:0/3340313346 learned_addr learned my addr 172.21.15.69:0/3340313346 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:38:53.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.851+0000 7f169a354700 1 --2- 172.21.15.69:0/3340313346 >> v2:172.21.15.88:3300/0 conn(0x7f16940cb5a0 0x7f16940cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:53.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.852+0000 7f1699352700 1 -- 172.21.15.69:0/3340313346 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679024227 0 0) 0x7f169415ae40 con 0x7f169415a5d0 2023-10-06T01:38:53.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.852+0000 7f1699352700 1 -- 172.21.15.69:0/3340313346 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f167c003570 con 0x7f169415a5d0 2023-10-06T01:38:53.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.852+0000 7f1699352700 1 -- 172.21.15.69:0/3340313346 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2480446481 0 0) 0x7f167c003570 con 0x7f169415a5d0 2023-10-06T01:38:53.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.852+0000 7f1699352700 1 -- 172.21.15.69:0/3340313346 >> v2:172.21.15.88:3300/0 conn(0x7f16940cb5a0 msgr2=0x7f16940cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:53.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.852+0000 7f1699352700 1 --2- 172.21.15.69:0/3340313346 >> v2:172.21.15.88:3300/0 conn(0x7f16940cb5a0 0x7f16940cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.852+0000 7f1699352700 1 -- 172.21.15.69:0/3340313346 >> v1:172.21.15.88:6789/0 conn(0x7f16940cd9e0 legacy=0x7f1694159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:53.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.852+0000 7f1699352700 1 -- 172.21.15.69:0/3340313346 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16940ccf00 con 0x7f169415a5d0 2023-10-06T01:38:53.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.852+0000 7f1699352700 1 -- 172.21.15.69:0/3340313346 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f168c001470 con 0x7f169415a5d0 2023-10-06T01:38:53.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.852+0000 7f1699352700 1 -- 172.21.15.69:0/3340313346 >> v1:172.21.15.69:6789/0 conn(0x7f169415a5d0 legacy=0x7f1694156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:53.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.852+0000 7f1699352700 1 --2- 172.21.15.69:0/3340313346 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f167c003a60 0x7f167c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:53.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.852+0000 7f1699352700 1 --2- 172.21.15.69:0/3340313346 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f167c004810 0x7f167c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:53.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.852+0000 7f1699352700 1 --2- 172.21.15.69:0/3340313346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f167c0051c0 0x7f167c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:53.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.852+0000 7f1699352700 1 -- 172.21.15.69:0/3340313346 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167c00c0a0 con 0x7f167c003a60 2023-10-06T01:38:53.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.852+0000 7f1699352700 1 -- 172.21.15.69:0/3340313346 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f167c00c210 con 0x7f167c0051c0 2023-10-06T01:38:53.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.852+0000 7f1699352700 1 -- 172.21.15.69:0/3340313346 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f167c00c3d0 con 0x7f167c004810 2023-10-06T01:38:53.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.852+0000 7f169a354700 1 --2- 172.21.15.69:0/3340313346 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f167c003a60 0x7f167c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:53.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.852+0000 7f169ab55700 1 --2- 172.21.15.69:0/3340313346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f167c0051c0 0x7f167c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:53.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.852+0000 7f1699b53700 1 --2- 172.21.15.69:0/3340313346 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f167c004810 0x7f167c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:53.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.852+0000 7f169a354700 1 -- 172.21.15.69:0/3340313346 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f167c004810 msgr2=0x7f167c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:53.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.852+0000 7f169a354700 1 --2- 172.21.15.69:0/3340313346 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f167c004810 0x7f167c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.852+0000 7f169a354700 1 -- 172.21.15.69:0/3340313346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f167c0051c0 msgr2=0x7f167c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:53.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.852+0000 7f169a354700 1 --2- 172.21.15.69:0/3340313346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f167c0051c0 0x7f167c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.852+0000 7f169a354700 1 -- 172.21.15.69:0/3340313346 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f167c003570 con 0x7f167c003a60 2023-10-06T01:38:53.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.852+0000 7f169ab55700 1 --2- 172.21.15.69:0/3340313346 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f167c0051c0 0x7f167c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:38:53.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.852+0000 7f169ab55700 1 -- 172.21.15.69:0/3340313346 reap_dead start 2023-10-06T01:38:53.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.852+0000 7f169a354700 1 --2- 172.21.15.69:0/3340313346 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f167c003a60 0x7f167c003e70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f168400e210 tx=0x7f168400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d981031663e2d799 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:53.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.852+0000 7f1699352700 1 -- 172.21.15.69:0/3340313346 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168400eac0 con 0x7f167c003a60 2023-10-06T01:38:53.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.853+0000 7f1699352700 1 -- 172.21.15.69:0/3340313346 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f168400f040 con 0x7f167c003a60 2023-10-06T01:38:53.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.853+0000 7f1699352700 1 -- 172.21.15.69:0/3340313346 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f168400ee70 con 0x7f167c003a60 2023-10-06T01:38:53.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.853+0000 7f169c5b8700 1 -- 172.21.15.69:0/3340313346 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f167c003a60 msgr2=0x7f167c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:53.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.853+0000 7f169c5b8700 1 --2- 172.21.15.69:0/3340313346 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f167c003a60 0x7f167c003e70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f168400e210 tx=0x7f168400b040 comp rx=0 tx=0).stop 2023-10-06T01:38:53.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.853+0000 7f169c5b8700 1 -- 172.21.15.69:0/3340313346 shutdown_connections 2023-10-06T01:38:53.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.853+0000 7f169c5b8700 1 --2- 172.21.15.69:0/3340313346 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f167c003a60 0x7f167c003e70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.853+0000 7f169c5b8700 1 -- 172.21.15.69:0/3340313346 >> 172.21.15.69:0/3340313346 conn(0x7f1694070e30 msgr2=0x7f16940d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:53.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.853+0000 7f169c5b8700 1 -- 172.21.15.69:0/3340313346 shutdown_connections 2023-10-06T01:38:53.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.853+0000 7f169c5b8700 1 -- 172.21.15.69:0/3340313346 wait complete. 2023-10-06T01:38:53.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.854+0000 7f169c5b8700 1 Processor -- start 2023-10-06T01:38:53.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.854+0000 7f169c5b8700 1 -- start start 2023-10-06T01:38:53.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.855+0000 7f169c5b8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f167c003a60 0x7f16940b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:53.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.855+0000 7f169c5b8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f169415b320 0x7f16940b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:53.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.855+0000 7f169c5b8700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1694153030 0x7f16940c8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:53.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.855+0000 7f169c5b8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169415a400 con 0x7f167c003a60 2023-10-06T01:38:53.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.855+0000 7f169c5b8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f169415b790 con 0x7f169415b320 2023-10-06T01:38:53.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.855+0000 7f169c5b8700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16940b5a70 con 0x7f1694153030 2023-10-06T01:38:53.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.855+0000 7f169a354700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f167c003a60 0x7f16940b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:53.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.855+0000 7f169a354700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f167c003a60 0x7f16940b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32960/0 (socket says 172.21.15.69:32960) 2023-10-06T01:38:53.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.855+0000 7f169a354700 1 -- 172.21.15.69:0/1508864258 learned_addr learned my addr 172.21.15.69:0/1508864258 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:53.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.855+0000 7f1699b53700 1 --2- 172.21.15.69:0/1508864258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f169415b320 0x7f16940b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:53.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.855+0000 7f169ab55700 1 --2- 172.21.15.69:0/1508864258 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1694153030 0x7f16940c8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:53.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.855+0000 7f169a354700 1 -- 172.21.15.69:0/1508864258 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1694153030 msgr2=0x7f16940c8bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:53.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.855+0000 7f169a354700 1 --2- 172.21.15.69:0/1508864258 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1694153030 0x7f16940c8bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.855+0000 7f169a354700 1 -- 172.21.15.69:0/1508864258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f169415b320 msgr2=0x7f16940b5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:53.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.855+0000 7f169a354700 1 --2- 172.21.15.69:0/1508864258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f169415b320 0x7f16940b5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:53.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.855+0000 7f169a354700 1 -- 172.21.15.69:0/1508864258 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16940b4e60 con 0x7f167c003a60 2023-10-06T01:38:53.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.855+0000 7f169a354700 1 --2- 172.21.15.69:0/1508864258 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f167c003a60 0x7f16940b47d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f167c00c1e0 tx=0x7f168401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:53.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.856+0000 7f16927fc700 1 -- 172.21.15.69:0/1508864258 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1684029450 con 0x7f167c003a60 2023-10-06T01:38:53.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.856+0000 7f16927fc700 1 -- 172.21.15.69:0/1508864258 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16840295b0 con 0x7f167c003a60 2023-10-06T01:38:53.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.856+0000 7f16927fc700 1 -- 172.21.15.69:0/1508864258 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1684029970 con 0x7f167c003a60 2023-10-06T01:38:53.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.856+0000 7f169c5b8700 1 -- 172.21.15.69:0/1508864258 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16940b5140 con 0x7f167c003a60 2023-10-06T01:38:53.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.856+0000 7f169c5b8700 1 -- 172.21.15.69:0/1508864258 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16940b5700 con 0x7f167c003a60 2023-10-06T01:38:53.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.857+0000 7f169c5b8700 1 -- 172.21.15.69:0/1508864258 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f169404c3c0 con 0x7f167c003a60 2023-10-06T01:38:53.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.857+0000 7f16927fc700 1 -- 172.21.15.69:0/1508864258 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1684003040 con 0x7f167c003a60 2023-10-06T01:38:53.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.857+0000 7f16927fc700 1 --2- 172.21.15.69:0/1508864258 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1680066f30 0x7f16800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:53.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.857+0000 7f16927fc700 1 -- 172.21.15.69:0/1508864258 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1684086810 con 0x7f167c003a60 2023-10-06T01:38:53.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.857+0000 7f1699b53700 1 --2- 172.21.15.69:0/1508864258 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1680066f30 0x7f16800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:53.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.858+0000 7f1699b53700 1 --2- 172.21.15.69:0/1508864258 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1680066f30 0x7f16800693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f16940c9a50 tx=0x7f1688009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:53.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:53.861+0000 7f16927fc700 1 -- 172.21.15.69:0/1508864258 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16840539e0 con 0x7f167c003a60 2023-10-06T01:38:54.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.039+0000 7f169c5b8700 1 -- 172.21.15.69:0/1508864258 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f16940b5bb0 con 0x7f1680066f30 2023-10-06T01:38:54.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.046+0000 7f16927fc700 1 -- 172.21.15.69:0/1508864258 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+272029 (secure 0 0 0) 0x7f16880116a0 con 0x7f1680066f30 2023-10-06T01:38:54.049 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:38:54.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.049+0000 7f169c5b8700 1 -- 172.21.15.69:0/1508864258 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1680066f30 msgr2=0x7f16800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:54.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.049+0000 7f169c5b8700 1 --2- 172.21.15.69:0/1508864258 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1680066f30 0x7f16800693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f16940c9a50 tx=0x7f1688009040 comp rx=0 tx=0).stop 2023-10-06T01:38:54.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.049+0000 7f169c5b8700 1 -- 172.21.15.69:0/1508864258 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f167c003a60 msgr2=0x7f16940b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:54.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.049+0000 7f169c5b8700 1 --2- 172.21.15.69:0/1508864258 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f167c003a60 0x7f16940b47d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f167c00c1e0 tx=0x7f168401a000 comp rx=0 tx=0).stop 2023-10-06T01:38:54.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.049+0000 7f169c5b8700 1 -- 172.21.15.69:0/1508864258 shutdown_connections 2023-10-06T01:38:54.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.049+0000 7f169c5b8700 1 --2- 172.21.15.69:0/1508864258 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1680066f30 0x7f16800693e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.049+0000 7f169c5b8700 1 --2- 172.21.15.69:0/1508864258 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1694153030 0x7f16940c8bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.049+0000 7f169c5b8700 1 --2- 172.21.15.69:0/1508864258 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f167c003a60 0x7f16940b47d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.052 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.049+0000 7f169c5b8700 1 --2- 172.21.15.69:0/1508864258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f169415b320 0x7f16940b5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.049+0000 7f169c5b8700 1 -- 172.21.15.69:0/1508864258 >> 172.21.15.69:0/1508864258 conn(0x7f1694070e30 msgr2=0x7f16940cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:54.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.049+0000 7f169c5b8700 1 -- 172.21.15.69:0/1508864258 shutdown_connections 2023-10-06T01:38:54.053 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.049+0000 7f169c5b8700 1 -- 172.21.15.69:0/1508864258 wait complete. 2023-10-06T01:38:54.053 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-10-06T01:38:54.061 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-10-06T01:38:52.247006+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":17,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2381064,"kb_used_data":2760,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593656,"statfs":{"total":773094113280,"available":770655903744,"internally_reserved":0,"allocated":2826240,"data_stored":1720376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.605884"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T01:38:44.534735+0000","last_change":"2023-10-06T01:38:44.533111+0000","last_active":"2023-10-06T01:38:44.534735+0000","last_peered":"2023-10-06T01:38:44.534735+0000","last_clean":"2023-10-06T01:38:44.534735+0000","last_became_active":"2023-10-06T01:38:44.532838+0000","last_became_peered":"2023-10-06T01:38:44.532838+0000","last_unstale":"2023-10-06T01:38:44.534735+0000","last_undegraded":"2023-10-06T01:38:44.534735+0000","last_fullsized":"2023-10-06T01:38:44.534735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T01:38:44.535515+0000","last_change":"2023-10-06T01:38:44.533897+0000","last_active":"2023-10-06T01:38:44.535515+0000","last_peered":"2023-10-06T01:38:44.535515+0000","last_clean":"2023-10-06T01:38:44.535515+0000","last_became_active":"2023-10-06T01:38:44.533611+0000","last_became_peered":"2023-10-06T01:38:44.533611+0000","last_unstale":"2023-10-06T01:38:44.535515+0000","last_undegraded":"2023-10-06T01:38:44.535515+0000","last_fullsized":"2023-10-06T01:38:44.535515+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:24.411408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T01:38:45.310272+0000","last_change":"2023-10-06T01:38:45.307814+0000","last_active":"2023-10-06T01:38:45.310272+0000","last_peered":"2023-10-06T01:38:45.310272+0000","last_clean":"2023-10-06T01:38:45.310272+0000","last_became_active":"2023-10-06T01:38:45.307536+0000","last_became_peered":"2023-10-06T01:38:45.307536+0000","last_unstale":"2023-10-06T01:38:45.310272+0000","last_undegraded":"2023-10-06T01:38:45.310272+0000","last_fullsized":"2023-10-06T01:38:45.310272+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:09.503713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T01:38:44.535546+0000","last_change":"2023-10-06T01:38:44.534507+0000","last_active":"2023-10-06T01:38:44.535546+0000","last_peered":"2023-10-06T01:38:44.535546+0000","last_clean":"2023-10-06T01:38:44.535546+0000","last_became_active":"2023-10-06T01:38:44.534191+0000","last_became_peered":"2023-10-06T01:38:44.534191+0000","last_unstale":"2023-10-06T01:38:44.535546+0000","last_undegraded":"2023-10-06T01:38:44.535546+0000","last_fullsized":"2023-10-06T01:38:44.535546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":162,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T01:38:44.529127+0000","last_change":"2023-10-06T01:38:40.115117+0000","last_active":"2023-10-06T01:38:44.529127+0000","last_peered":"2023-10-06T01:38:44.529127+0000","last_clean":"2023-10-06T01:38:44.529127+0000","last_became_active":"2023-10-06T01:38:40.114142+0000","last_became_peered":"2023-10-06T01:38:40.114142+0000","last_unstale":"2023-10-06T01:38:44.529127+0000","last_undegraded":"2023-10-06T01:38:44.529127+0000","last_fullsized":"2023-10-06T01:38:44.529127+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_clean_scrub_stamp":"2023-10-06T01:38:38.338797+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:52.870262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T01:38:44.533010+0000","last_change":"2023-10-06T01:38:44.531831+0000","last_active":"2023-10-06T01:38:44.533010+0000","last_peered":"2023-10-06T01:38:44.533010+0000","last_clean":"2023-10-06T01:38:44.533010+0000","last_became_active":"2023-10-06T01:38:44.531496+0000","last_became_peered":"2023-10-06T01:38:44.531496+0000","last_unstale":"2023-10-06T01:38:44.533010+0000","last_undegraded":"2023-10-06T01:38:44.533010+0000","last_fullsized":"2023-10-06T01:38:44.533010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:28.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T01:38:44.532370+0000","last_change":"2023-10-06T01:38:44.531335+0000","last_active":"2023-10-06T01:38:44.532370+0000","last_peered":"2023-10-06T01:38:44.532370+0000","last_clean":"2023-10-06T01:38:44.532370+0000","last_became_active":"2023-10-06T01:38:44.530966+0000","last_became_peered":"2023-10-06T01:38:44.530966+0000","last_unstale":"2023-10-06T01:38:44.532370+0000","last_undegraded":"2023-10-06T01:38:44.532370+0000","last_fullsized":"2023-10-06T01:38:44.532370+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:33.926180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T01:38:44.534744+0000","last_change":"2023-10-06T01:38:44.533582+0000","last_active":"2023-10-06T01:38:44.534744+0000","last_peered":"2023-10-06T01:38:44.534744+0000","last_clean":"2023-10-06T01:38:44.534744+0000","last_became_active":"2023-10-06T01:38:44.533324+0000","last_became_peered":"2023-10-06T01:38:44.533324+0000","last_unstale":"2023-10-06T01:38:44.534744+0000","last_undegraded":"2023-10-06T01:38:44.534744+0000","last_fullsized":"2023-10-06T01:38:44.534744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-06T01:38:44.538048+0000","last_change":"2023-10-06T01:38:44.533765+0000","last_active":"2023-10-06T01:38:44.538048+0000","last_peered":"2023-10-06T01:38:44.538048+0000","last_clean":"2023-10-06T01:38:44.538048+0000","last_became_active":"2023-10-06T01:38:44.533406+0000","last_became_peered":"2023-10-06T01:38:44.533406+0000","last_unstale":"2023-10-06T01:38:44.538048+0000","last_undegraded":"2023-10-06T01:38:44.538048+0000","last_fullsized":"2023-10-06T01:38:44.538048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:47.638867+0000","last_change":"2023-10-06T01:38:47.638867+0000","last_active":"2023-10-06T01:38:47.638867+0000","last_peered":"2023-10-06T01:38:47.638867+0000","last_clean":"2023-10-06T01:38:47.638867+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:47.638867+0000","last_undegraded":"2023-10-06T01:38:47.638867+0000","last_fullsized":"2023-10-06T01:38:47.638867+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:38:48.640632+0000","last_change":"2023-10-06T01:38:48.640632+0000","last_active":"2023-10-06T01:38:48.640632+0000","last_peered":"2023-10-06T01:38:48.640632+0000","last_clean":"2023-10-06T01:38:48.640632+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:38:48.640632+0000","last_undegraded":"2023-10-06T01:38:48.640632+0000","last_fullsized":"2023-10-06T01:38:48.640632+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":657823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80200000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84099999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":67455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":67455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298068,"kb_used_data":780,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073772,"statfs":{"total":96636764160,"available":96331542528,"internally_reserved":0,"allocated":798720,"data_stored":657823,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70099999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72099999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":67455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":67455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.307}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66400000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":67455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47499999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61899999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":67455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:38:54.067 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:38:54.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.217+0000 7f3f9acfa700 1 Processor -- start 2023-10-06T01:38:54.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.218+0000 7f3f9acfa700 1 -- start start 2023-10-06T01:38:54.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.218+0000 7f3f9acfa700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f3f940aee90 0x7f3f940a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:54.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.218+0000 7f3f9acfa700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3f9406d280 0x7f3f940b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:54.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.218+0000 7f3f9acfa700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f940ce1a0 con 0x7f3f940a8be0 2023-10-06T01:38:54.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.218+0000 7f3f9acfa700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f940cd5d0 con 0x7f3f940aee90 2023-10-06T01:38:54.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.218+0000 7f3f9acfa700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f940cd870 con 0x7f3f9406d280 2023-10-06T01:38:54.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.218+0000 7f3f98a96700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f3f940a8be0 0x7f3f940ae780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38064/0 (socket says 172.21.15.69:38064) 2023-10-06T01:38:54.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.218+0000 7f3f93fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f3f940aee90 0x7f3f940a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:54.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.218+0000 7f3f98a96700 1 -- 172.21.15.69:0/324358569 learned_addr learned my addr 172.21.15.69:0/324358569 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:38:54.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.219+0000 7f3f99297700 1 --2- 172.21.15.69:0/324358569 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3f9406d280 0x7f3f940b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:54.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.219+0000 7f3f93fff700 1 -- 172.21.15.69:0/324358569 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3f9406d280 msgr2=0x7f3f940b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:54.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.219+0000 7f3f93fff700 1 --2- 172.21.15.69:0/324358569 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3f9406d280 0x7f3f940b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.219+0000 7f3f93fff700 1 -- 172.21.15.69:0/324358569 >> v1:172.21.15.69:6789/0 conn(0x7f3f940a8be0 legacy=0x7f3f940ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:54.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.219+0000 7f3f937fe700 1 -- 172.21.15.69:0/324358569 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1841161210 0 0) 0x7f3f940ce1a0 con 0x7f3f940a8be0 2023-10-06T01:38:54.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.219+0000 7f3f93fff700 1 -- 172.21.15.69:0/324358569 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f940cdb50 con 0x7f3f940aee90 2023-10-06T01:38:54.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.219+0000 7f3f93fff700 1 --2- 172.21.15.69:0/324358569 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f940aee90 0x7f3f940a8fb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3f880098d0 tx=0x7f3f88009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aadab21ccc5ece2e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:54.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.219+0000 7f3f937fe700 1 -- 172.21.15.69:0/324358569 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f88009e70 con 0x7f3f940aee90 2023-10-06T01:38:54.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.219+0000 7f3f937fe700 1 -- 172.21.15.69:0/324358569 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f88005c10 con 0x7f3f940aee90 2023-10-06T01:38:54.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.219+0000 7f3f937fe700 1 -- 172.21.15.69:0/324358569 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8800b6e0 con 0x7f3f940aee90 2023-10-06T01:38:54.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.219+0000 7f3f9acfa700 1 -- 172.21.15.69:0/324358569 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f940aee90 msgr2=0x7f3f940a8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:54.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.219+0000 7f3f9acfa700 1 --2- 172.21.15.69:0/324358569 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f940aee90 0x7f3f940a8fb0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f3f880098d0 tx=0x7f3f88009120 comp rx=0 tx=0).stop 2023-10-06T01:38:54.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.219+0000 7f3f9acfa700 1 -- 172.21.15.69:0/324358569 shutdown_connections 2023-10-06T01:38:54.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.219+0000 7f3f9acfa700 1 --2- 172.21.15.69:0/324358569 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3f9406d280 0x7f3f940b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.220+0000 7f3f9acfa700 1 --2- 172.21.15.69:0/324358569 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f940aee90 0x7f3f940a8fb0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.220+0000 7f3f9acfa700 1 -- 172.21.15.69:0/324358569 >> 172.21.15.69:0/324358569 conn(0x7f3f9406ce80 msgr2=0x7f3f940ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:54.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.220+0000 7f3f9acfa700 1 -- 172.21.15.69:0/324358569 shutdown_connections 2023-10-06T01:38:54.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.220+0000 7f3f9acfa700 1 -- 172.21.15.69:0/324358569 wait complete. 2023-10-06T01:38:54.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.221+0000 7f3f9acfa700 1 Processor -- start 2023-10-06T01:38:54.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.221+0000 7f3f9acfa700 1 -- start start 2023-10-06T01:38:54.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.221+0000 7f3f9acfa700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f9406d280 0x7f3f94156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:54.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.221+0000 7f3f9acfa700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3f940a8be0 0x7f3f9415b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:54.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.221+0000 7f3f9acfa700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f940aee90 0x7f3f94099e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:54.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.222+0000 7f3f9acfa700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9415d0a0 con 0x7f3f940aee90 2023-10-06T01:38:54.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.222+0000 7f3f9acfa700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f9415cc10 con 0x7f3f9406d280 2023-10-06T01:38:54.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.222+0000 7f3f9acfa700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f94157080 con 0x7f3f940a8be0 2023-10-06T01:38:54.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.222+0000 7f3f99297700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f940aee90 0x7f3f94099e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:54.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.222+0000 7f3f99297700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f940aee90 0x7f3f94099e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32976/0 (socket says 172.21.15.69:32976) 2023-10-06T01:38:54.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.222+0000 7f3f99297700 1 -- 172.21.15.69:0/602067649 learned_addr learned my addr 172.21.15.69:0/602067649 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:54.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.222+0000 7f3f98a96700 1 --2- 172.21.15.69:0/602067649 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f9406d280 0x7f3f94156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:54.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.222+0000 7f3f93fff700 1 --2- 172.21.15.69:0/602067649 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3f940a8be0 0x7f3f9415b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:54.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.222+0000 7f3f99297700 1 -- 172.21.15.69:0/602067649 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3f940a8be0 msgr2=0x7f3f9415b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:54.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.222+0000 7f3f99297700 1 --2- 172.21.15.69:0/602067649 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3f940a8be0 0x7f3f9415b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.222+0000 7f3f99297700 1 -- 172.21.15.69:0/602067649 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f9406d280 msgr2=0x7f3f94156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:54.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.222+0000 7f3f99297700 1 --2- 172.21.15.69:0/602067649 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f9406d280 0x7f3f94156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.222+0000 7f3f99297700 1 -- 172.21.15.69:0/602067649 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f880093c0 con 0x7f3f940aee90 2023-10-06T01:38:54.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.222+0000 7f3f93fff700 1 --2- 172.21.15.69:0/602067649 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3f940a8be0 0x7f3f9415b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:38:54.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.222+0000 7f3f99297700 1 --2- 172.21.15.69:0/602067649 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f940aee90 0x7f3f94099e90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00d8c0 tx=0x7f3f8c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:54.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.222+0000 7f3f90ff9700 1 -- 172.21.15.69:0/602067649 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c014620 con 0x7f3f940aee90 2023-10-06T01:38:54.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.222+0000 7f3f90ff9700 1 -- 172.21.15.69:0/602067649 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f8c014780 con 0x7f3f940aee90 2023-10-06T01:38:54.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.222+0000 7f3f90ff9700 1 -- 172.21.15.69:0/602067649 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f8c014b40 con 0x7f3f940aee90 2023-10-06T01:38:54.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.222+0000 7f3f9acfa700 1 -- 172.21.15.69:0/602067649 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f9415c000 con 0x7f3f940aee90 2023-10-06T01:38:54.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.222+0000 7f3f9acfa700 1 -- 172.21.15.69:0/602067649 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f9415c5c0 con 0x7f3f940aee90 2023-10-06T01:38:54.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.223+0000 7f3f9acfa700 1 -- 172.21.15.69:0/602067649 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f940af320 con 0x7f3f940aee90 2023-10-06T01:38:54.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.224+0000 7f3f90ff9700 1 -- 172.21.15.69:0/602067649 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3f8c0123e0 con 0x7f3f940aee90 2023-10-06T01:38:54.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.224+0000 7f3f90ff9700 1 --2- 172.21.15.69:0/602067649 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3f80066fb0 0x7f3f80069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:54.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.224+0000 7f3f90ff9700 1 -- 172.21.15.69:0/602067649 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3f8c084b10 con 0x7f3f940aee90 2023-10-06T01:38:54.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.224+0000 7f3f98a96700 1 --2- 172.21.15.69:0/602067649 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3f80066fb0 0x7f3f80069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:54.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.225+0000 7f3f98a96700 1 --2- 172.21.15.69:0/602067649 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3f80066fb0 0x7f3f80069460 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3f84007fd0 tx=0x7f3f84009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:54.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.228+0000 7f3f90ff9700 1 -- 172.21.15.69:0/602067649 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f8c051c30 con 0x7f3f940aee90 2023-10-06T01:38:54.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.407+0000 7f3f9acfa700 1 -- 172.21.15.69:0/602067649 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3f9404c3c0 con 0x7f3f80066fb0 2023-10-06T01:38:54.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.415+0000 7f3f90ff9700 1 -- 172.21.15.69:0/602067649 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286693 (secure 0 0 0) 0x7f3f9404c3c0 con 0x7f3f80066fb0 2023-10-06T01:38:54.418 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:38:54.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.418+0000 7f3f9acfa700 1 -- 172.21.15.69:0/602067649 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3f80066fb0 msgr2=0x7f3f80069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:54.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.418+0000 7f3f9acfa700 1 --2- 172.21.15.69:0/602067649 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3f80066fb0 0x7f3f80069460 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3f84007fd0 tx=0x7f3f84009040 comp rx=0 tx=0).stop 2023-10-06T01:38:54.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.418+0000 7f3f9acfa700 1 -- 172.21.15.69:0/602067649 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f940aee90 msgr2=0x7f3f94099e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:54.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.418+0000 7f3f9acfa700 1 --2- 172.21.15.69:0/602067649 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f940aee90 0x7f3f94099e90 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f3f8c00d8c0 tx=0x7f3f8c008040 comp rx=0 tx=0).stop 2023-10-06T01:38:54.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.418+0000 7f3f9acfa700 1 -- 172.21.15.69:0/602067649 shutdown_connections 2023-10-06T01:38:54.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.418+0000 7f3f9acfa700 1 --2- 172.21.15.69:0/602067649 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3f80066fb0 0x7f3f80069460 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.418+0000 7f3f9acfa700 1 --2- 172.21.15.69:0/602067649 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3f940aee90 0x7f3f94099e90 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.418+0000 7f3f9acfa700 1 --2- 172.21.15.69:0/602067649 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3f9406d280 0x7f3f94156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.418+0000 7f3f9acfa700 1 --2- 172.21.15.69:0/602067649 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3f940a8be0 0x7f3f9415b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.418+0000 7f3f9acfa700 1 -- 172.21.15.69:0/602067649 >> 172.21.15.69:0/602067649 conn(0x7f3f9406ce80 msgr2=0x7f3f940b18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:54.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.418+0000 7f3f9acfa700 1 -- 172.21.15.69:0/602067649 shutdown_connections 2023-10-06T01:38:54.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.418+0000 7f3f9acfa700 1 -- 172.21.15.69:0/602067649 wait complete. 2023-10-06T01:38:54.422 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-10-06T01:38:54.430 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-10-06T01:38:54.247552+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381512,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593208,"statfs":{"total":773094113280,"available":770655444992,"internally_reserved":0,"allocated":3284992,"data_stored":1937172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001314"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524056+0000","last_change":"2023-10-06T01:38:49.517903+0000","last_active":"2023-10-06T01:38:49.524056+0000","last_peered":"2023-10-06T01:38:49.524056+0000","last_clean":"2023-10-06T01:38:49.524056+0000","last_became_active":"2023-10-06T01:38:49.517634+0000","last_became_peered":"2023-10-06T01:38:49.517634+0000","last_unstale":"2023-10-06T01:38:49.524056+0000","last_undegraded":"2023-10-06T01:38:49.524056+0000","last_fullsized":"2023-10-06T01:38:49.524056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:04.939212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527124+0000","last_change":"2023-10-06T01:38:49.523256+0000","last_active":"2023-10-06T01:38:49.527124+0000","last_peered":"2023-10-06T01:38:49.527124+0000","last_clean":"2023-10-06T01:38:49.527124+0000","last_became_active":"2023-10-06T01:38:49.522954+0000","last_became_peered":"2023-10-06T01:38:49.522954+0000","last_unstale":"2023-10-06T01:38:49.527124+0000","last_undegraded":"2023-10-06T01:38:49.527124+0000","last_fullsized":"2023-10-06T01:38:49.527124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532807+0000","last_change":"2023-10-06T01:38:49.528144+0000","last_active":"2023-10-06T01:38:49.532807+0000","last_peered":"2023-10-06T01:38:49.532807+0000","last_clean":"2023-10-06T01:38:49.532807+0000","last_became_active":"2023-10-06T01:38:49.527476+0000","last_became_peered":"2023-10-06T01:38:49.527476+0000","last_unstale":"2023-10-06T01:38:49.532807+0000","last_undegraded":"2023-10-06T01:38:49.532807+0000","last_fullsized":"2023-10-06T01:38:49.532807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:49.294618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.528235+0000","last_change":"2023-10-06T01:38:49.526214+0000","last_active":"2023-10-06T01:38:49.528235+0000","last_peered":"2023-10-06T01:38:49.528235+0000","last_clean":"2023-10-06T01:38:49.528235+0000","last_became_active":"2023-10-06T01:38:49.525926+0000","last_became_peered":"2023-10-06T01:38:49.525926+0000","last_unstale":"2023-10-06T01:38:49.528235+0000","last_undegraded":"2023-10-06T01:38:49.528235+0000","last_fullsized":"2023-10-06T01:38:49.528235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:57:08.899972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524841+0000","last_change":"2023-10-06T01:38:49.522000+0000","last_active":"2023-10-06T01:38:49.524841+0000","last_peered":"2023-10-06T01:38:49.524841+0000","last_clean":"2023-10-06T01:38:49.524841+0000","last_became_active":"2023-10-06T01:38:49.521580+0000","last_became_peered":"2023-10-06T01:38:49.521580+0000","last_unstale":"2023-10-06T01:38:49.524841+0000","last_undegraded":"2023-10-06T01:38:49.524841+0000","last_fullsized":"2023-10-06T01:38:49.524841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:21.430025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532735+0000","last_change":"2023-10-06T01:38:49.527658+0000","last_active":"2023-10-06T01:38:49.532735+0000","last_peered":"2023-10-06T01:38:49.532735+0000","last_clean":"2023-10-06T01:38:49.532735+0000","last_became_active":"2023-10-06T01:38:49.527109+0000","last_became_peered":"2023-10-06T01:38:49.527109+0000","last_unstale":"2023-10-06T01:38:49.532735+0000","last_undegraded":"2023-10-06T01:38:49.532735+0000","last_fullsized":"2023-10-06T01:38:49.532735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:41.094305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.529246+0000","last_change":"2023-10-06T01:38:49.526274+0000","last_active":"2023-10-06T01:38:49.529246+0000","last_peered":"2023-10-06T01:38:49.529246+0000","last_clean":"2023-10-06T01:38:49.529246+0000","last_became_active":"2023-10-06T01:38:49.526058+0000","last_became_peered":"2023-10-06T01:38:49.526058+0000","last_unstale":"2023-10-06T01:38:49.529246+0000","last_undegraded":"2023-10-06T01:38:49.529246+0000","last_fullsized":"2023-10-06T01:38:49.529246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.529633+0000","last_change":"2023-10-06T01:38:49.527609+0000","last_active":"2023-10-06T01:38:49.529633+0000","last_peered":"2023-10-06T01:38:49.529633+0000","last_clean":"2023-10-06T01:38:49.529633+0000","last_became_active":"2023-10-06T01:38:49.527309+0000","last_became_peered":"2023-10-06T01:38:49.527309+0000","last_unstale":"2023-10-06T01:38:49.529633+0000","last_undegraded":"2023-10-06T01:38:49.529633+0000","last_fullsized":"2023-10-06T01:38:49.529633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:04.188051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524708+0000","last_change":"2023-10-06T01:38:49.519471+0000","last_active":"2023-10-06T01:38:49.524708+0000","last_peered":"2023-10-06T01:38:49.524708+0000","last_clean":"2023-10-06T01:38:49.524708+0000","last_became_active":"2023-10-06T01:38:49.519232+0000","last_became_peered":"2023-10-06T01:38:49.519232+0000","last_unstale":"2023-10-06T01:38:49.524708+0000","last_undegraded":"2023-10-06T01:38:49.524708+0000","last_fullsized":"2023-10-06T01:38:49.524708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:11.839303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527105+0000","last_change":"2023-10-06T01:38:49.519625+0000","last_active":"2023-10-06T01:38:49.527105+0000","last_peered":"2023-10-06T01:38:49.527105+0000","last_clean":"2023-10-06T01:38:49.527105+0000","last_became_active":"2023-10-06T01:38:49.519350+0000","last_became_peered":"2023-10-06T01:38:49.519350+0000","last_unstale":"2023-10-06T01:38:49.527105+0000","last_undegraded":"2023-10-06T01:38:49.527105+0000","last_fullsized":"2023-10-06T01:38:49.527105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:21.430025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532757+0000","last_change":"2023-10-06T01:38:49.527759+0000","last_active":"2023-10-06T01:38:49.532757+0000","last_peered":"2023-10-06T01:38:49.532757+0000","last_clean":"2023-10-06T01:38:49.532757+0000","last_became_active":"2023-10-06T01:38:49.527046+0000","last_became_peered":"2023-10-06T01:38:49.527046+0000","last_unstale":"2023-10-06T01:38:49.532757+0000","last_undegraded":"2023-10-06T01:38:49.532757+0000","last_fullsized":"2023-10-06T01:38:49.532757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:04.140534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531758+0000","last_change":"2023-10-06T01:38:49.527553+0000","last_active":"2023-10-06T01:38:49.531758+0000","last_peered":"2023-10-06T01:38:49.531758+0000","last_clean":"2023-10-06T01:38:49.531758+0000","last_became_active":"2023-10-06T01:38:49.527370+0000","last_became_peered":"2023-10-06T01:38:49.527370+0000","last_unstale":"2023-10-06T01:38:49.531758+0000","last_undegraded":"2023-10-06T01:38:49.531758+0000","last_fullsized":"2023-10-06T01:38:49.531758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:55.861597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.523956+0000","last_change":"2023-10-06T01:38:49.517619+0000","last_active":"2023-10-06T01:38:49.523956+0000","last_peered":"2023-10-06T01:38:49.523956+0000","last_clean":"2023-10-06T01:38:49.523956+0000","last_became_active":"2023-10-06T01:38:49.517323+0000","last_became_peered":"2023-10-06T01:38:49.517323+0000","last_unstale":"2023-10-06T01:38:49.523956+0000","last_undegraded":"2023-10-06T01:38:49.523956+0000","last_fullsized":"2023-10-06T01:38:49.523956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:35.290053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.523783+0000","last_change":"2023-10-06T01:38:49.518132+0000","last_active":"2023-10-06T01:38:49.523783+0000","last_peered":"2023-10-06T01:38:49.523783+0000","last_clean":"2023-10-06T01:38:49.523783+0000","last_became_active":"2023-10-06T01:38:49.517901+0000","last_became_peered":"2023-10-06T01:38:49.517901+0000","last_unstale":"2023-10-06T01:38:49.523783+0000","last_undegraded":"2023-10-06T01:38:49.523783+0000","last_fullsized":"2023-10-06T01:38:49.523783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:57.306692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.529431+0000","last_change":"2023-10-06T01:38:49.526480+0000","last_active":"2023-10-06T01:38:49.529431+0000","last_peered":"2023-10-06T01:38:49.529431+0000","last_clean":"2023-10-06T01:38:49.529431+0000","last_became_active":"2023-10-06T01:38:49.526183+0000","last_became_peered":"2023-10-06T01:38:49.526183+0000","last_unstale":"2023-10-06T01:38:49.529431+0000","last_undegraded":"2023-10-06T01:38:49.529431+0000","last_fullsized":"2023-10-06T01:38:49.529431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:57.306692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.528330+0000","last_change":"2023-10-06T01:38:49.525375+0000","last_active":"2023-10-06T01:38:49.528330+0000","last_peered":"2023-10-06T01:38:49.528330+0000","last_clean":"2023-10-06T01:38:49.528330+0000","last_became_active":"2023-10-06T01:38:49.525091+0000","last_became_peered":"2023-10-06T01:38:49.525091+0000","last_unstale":"2023-10-06T01:38:49.528330+0000","last_undegraded":"2023-10-06T01:38:49.528330+0000","last_fullsized":"2023-10-06T01:38:49.528330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:44.668443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524727+0000","last_change":"2023-10-06T01:38:49.520872+0000","last_active":"2023-10-06T01:38:49.524727+0000","last_peered":"2023-10-06T01:38:49.524727+0000","last_clean":"2023-10-06T01:38:49.524727+0000","last_became_active":"2023-10-06T01:38:49.520588+0000","last_became_peered":"2023-10-06T01:38:49.520588+0000","last_unstale":"2023-10-06T01:38:49.524727+0000","last_undegraded":"2023-10-06T01:38:49.524727+0000","last_fullsized":"2023-10-06T01:38:49.524727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:57.494182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532943+0000","last_change":"2023-10-06T01:38:49.528700+0000","last_active":"2023-10-06T01:38:49.532943+0000","last_peered":"2023-10-06T01:38:49.532943+0000","last_clean":"2023-10-06T01:38:49.532943+0000","last_became_active":"2023-10-06T01:38:49.527947+0000","last_became_peered":"2023-10-06T01:38:49.527947+0000","last_unstale":"2023-10-06T01:38:49.532943+0000","last_undegraded":"2023-10-06T01:38:49.532943+0000","last_fullsized":"2023-10-06T01:38:49.532943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:22.289895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.528863+0000","last_change":"2023-10-06T01:38:49.524738+0000","last_active":"2023-10-06T01:38:49.528863+0000","last_peered":"2023-10-06T01:38:49.528863+0000","last_clean":"2023-10-06T01:38:49.528863+0000","last_became_active":"2023-10-06T01:38:49.524478+0000","last_became_peered":"2023-10-06T01:38:49.524478+0000","last_unstale":"2023-10-06T01:38:49.528863+0000","last_undegraded":"2023-10-06T01:38:49.528863+0000","last_fullsized":"2023-10-06T01:38:49.528863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:05.235173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533032+0000","last_change":"2023-10-06T01:38:49.528930+0000","last_active":"2023-10-06T01:38:49.533032+0000","last_peered":"2023-10-06T01:38:49.533032+0000","last_clean":"2023-10-06T01:38:49.533032+0000","last_became_active":"2023-10-06T01:38:49.528446+0000","last_became_peered":"2023-10-06T01:38:49.528446+0000","last_unstale":"2023-10-06T01:38:49.533032+0000","last_undegraded":"2023-10-06T01:38:49.533032+0000","last_fullsized":"2023-10-06T01:38:49.533032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:58.019042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532838+0000","last_change":"2023-10-06T01:38:49.530433+0000","last_active":"2023-10-06T01:38:49.532838+0000","last_peered":"2023-10-06T01:38:49.532838+0000","last_clean":"2023-10-06T01:38:49.532838+0000","last_became_active":"2023-10-06T01:38:49.530161+0000","last_became_peered":"2023-10-06T01:38:49.530161+0000","last_unstale":"2023-10-06T01:38:49.532838+0000","last_undegraded":"2023-10-06T01:38:49.532838+0000","last_fullsized":"2023-10-06T01:38:49.532838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:38:23.293524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526894+0000","last_change":"2023-10-06T01:38:49.523986+0000","last_active":"2023-10-06T01:38:49.526894+0000","last_peered":"2023-10-06T01:38:49.526894+0000","last_clean":"2023-10-06T01:38:49.526894+0000","last_became_active":"2023-10-06T01:38:49.523736+0000","last_became_peered":"2023-10-06T01:38:49.523736+0000","last_unstale":"2023-10-06T01:38:49.526894+0000","last_undegraded":"2023-10-06T01:38:49.526894+0000","last_fullsized":"2023-10-06T01:38:49.526894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:57.306692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526902+0000","last_change":"2023-10-06T01:38:49.517570+0000","last_active":"2023-10-06T01:38:49.526902+0000","last_peered":"2023-10-06T01:38:49.526902+0000","last_clean":"2023-10-06T01:38:49.526902+0000","last_became_active":"2023-10-06T01:38:49.517319+0000","last_became_peered":"2023-10-06T01:38:49.517319+0000","last_unstale":"2023-10-06T01:38:49.526902+0000","last_undegraded":"2023-10-06T01:38:49.526902+0000","last_fullsized":"2023-10-06T01:38:49.526902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:22.060988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.529224+0000","last_change":"2023-10-06T01:38:49.524486+0000","last_active":"2023-10-06T01:38:49.529224+0000","last_peered":"2023-10-06T01:38:49.529224+0000","last_clean":"2023-10-06T01:38:49.529224+0000","last_became_active":"2023-10-06T01:38:49.524244+0000","last_became_peered":"2023-10-06T01:38:49.524244+0000","last_unstale":"2023-10-06T01:38:49.529224+0000","last_undegraded":"2023-10-06T01:38:49.529224+0000","last_fullsized":"2023-10-06T01:38:49.529224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:22.814342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.525649+0000","last_change":"2023-10-06T01:38:49.521288+0000","last_active":"2023-10-06T01:38:49.525649+0000","last_peered":"2023-10-06T01:38:49.525649+0000","last_clean":"2023-10-06T01:38:49.525649+0000","last_became_active":"2023-10-06T01:38:49.520995+0000","last_became_peered":"2023-10-06T01:38:49.520995+0000","last_unstale":"2023-10-06T01:38:49.525649+0000","last_undegraded":"2023-10-06T01:38:49.525649+0000","last_fullsized":"2023-10-06T01:38:49.525649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:06.793193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.525993+0000","last_change":"2023-10-06T01:38:49.521528+0000","last_active":"2023-10-06T01:38:49.525993+0000","last_peered":"2023-10-06T01:38:49.525993+0000","last_clean":"2023-10-06T01:38:49.525993+0000","last_became_active":"2023-10-06T01:38:49.520274+0000","last_became_peered":"2023-10-06T01:38:49.520274+0000","last_unstale":"2023-10-06T01:38:49.525993+0000","last_undegraded":"2023-10-06T01:38:49.525993+0000","last_fullsized":"2023-10-06T01:38:49.525993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:31:19.856103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527242+0000","last_change":"2023-10-06T01:38:49.519548+0000","last_active":"2023-10-06T01:38:49.527242+0000","last_peered":"2023-10-06T01:38:49.527242+0000","last_clean":"2023-10-06T01:38:49.527242+0000","last_became_active":"2023-10-06T01:38:49.519249+0000","last_became_peered":"2023-10-06T01:38:49.519249+0000","last_unstale":"2023-10-06T01:38:49.527242+0000","last_undegraded":"2023-10-06T01:38:49.527242+0000","last_fullsized":"2023-10-06T01:38:49.527242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:57.494182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.656554+0000","last_change":"2023-10-06T01:38:48.666150+0000","last_active":"2023-10-06T01:38:49.656554+0000","last_peered":"2023-10-06T01:38:49.656554+0000","last_clean":"2023-10-06T01:38:49.656554+0000","last_became_active":"2023-10-06T01:38:48.663061+0000","last_became_peered":"2023-10-06T01:38:48.663061+0000","last_unstale":"2023-10-06T01:38:49.656554+0000","last_undegraded":"2023-10-06T01:38:49.656554+0000","last_fullsized":"2023-10-06T01:38:49.656554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:07:41.517375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531425+0000","last_change":"2023-10-06T01:38:49.520719+0000","last_active":"2023-10-06T01:38:49.531425+0000","last_peered":"2023-10-06T01:38:49.531425+0000","last_clean":"2023-10-06T01:38:49.531425+0000","last_became_active":"2023-10-06T01:38:49.520470+0000","last_became_peered":"2023-10-06T01:38:49.520470+0000","last_unstale":"2023-10-06T01:38:49.531425+0000","last_undegraded":"2023-10-06T01:38:49.531425+0000","last_fullsized":"2023-10-06T01:38:49.531425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:11.839303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515999+0000","last_change":"2023-10-06T01:38:48.666186+0000","last_active":"2023-10-06T01:38:49.515999+0000","last_peered":"2023-10-06T01:38:49.515999+0000","last_clean":"2023-10-06T01:38:49.515999+0000","last_became_active":"2023-10-06T01:38:48.665875+0000","last_became_peered":"2023-10-06T01:38:48.665875+0000","last_unstale":"2023-10-06T01:38:49.515999+0000","last_undegraded":"2023-10-06T01:38:49.515999+0000","last_fullsized":"2023-10-06T01:38:49.515999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:09.299545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524755+0000","last_change":"2023-10-06T01:38:49.518381+0000","last_active":"2023-10-06T01:38:49.524755+0000","last_peered":"2023-10-06T01:38:49.524755+0000","last_clean":"2023-10-06T01:38:49.524755+0000","last_became_active":"2023-10-06T01:38:49.518041+0000","last_became_peered":"2023-10-06T01:38:49.518041+0000","last_unstale":"2023-10-06T01:38:49.524755+0000","last_undegraded":"2023-10-06T01:38:49.524755+0000","last_fullsized":"2023-10-06T01:38:49.524755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.508966+0000","last_change":"2023-10-06T01:38:48.665041+0000","last_active":"2023-10-06T01:38:49.508966+0000","last_peered":"2023-10-06T01:38:49.508966+0000","last_clean":"2023-10-06T01:38:49.508966+0000","last_became_active":"2023-10-06T01:38:48.664783+0000","last_became_peered":"2023-10-06T01:38:48.664783+0000","last_unstale":"2023-10-06T01:38:49.508966+0000","last_undegraded":"2023-10-06T01:38:49.508966+0000","last_fullsized":"2023-10-06T01:38:49.508966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:52.982952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.528203+0000","last_change":"2023-10-06T01:38:49.524574+0000","last_active":"2023-10-06T01:38:49.528203+0000","last_peered":"2023-10-06T01:38:49.528203+0000","last_clean":"2023-10-06T01:38:49.528203+0000","last_became_active":"2023-10-06T01:38:49.524266+0000","last_became_peered":"2023-10-06T01:38:49.524266+0000","last_unstale":"2023-10-06T01:38:49.528203+0000","last_undegraded":"2023-10-06T01:38:49.528203+0000","last_fullsized":"2023-10-06T01:38:49.528203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:27.853451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.512647+0000","last_change":"2023-10-06T01:38:48.662259+0000","last_active":"2023-10-06T01:38:49.512647+0000","last_peered":"2023-10-06T01:38:49.512647+0000","last_clean":"2023-10-06T01:38:49.512647+0000","last_became_active":"2023-10-06T01:38:48.661993+0000","last_became_peered":"2023-10-06T01:38:48.661993+0000","last_unstale":"2023-10-06T01:38:49.512647+0000","last_undegraded":"2023-10-06T01:38:49.512647+0000","last_fullsized":"2023-10-06T01:38:49.512647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:04.233408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526872+0000","last_change":"2023-10-06T01:38:49.518829+0000","last_active":"2023-10-06T01:38:49.526872+0000","last_peered":"2023-10-06T01:38:49.526872+0000","last_clean":"2023-10-06T01:38:49.526872+0000","last_became_active":"2023-10-06T01:38:49.517297+0000","last_became_peered":"2023-10-06T01:38:49.517297+0000","last_unstale":"2023-10-06T01:38:49.526872+0000","last_undegraded":"2023-10-06T01:38:49.526872+0000","last_fullsized":"2023-10-06T01:38:49.526872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.513481+0000","last_change":"2023-10-06T01:38:48.662679+0000","last_active":"2023-10-06T01:38:49.513481+0000","last_peered":"2023-10-06T01:38:49.513481+0000","last_clean":"2023-10-06T01:38:49.513481+0000","last_became_active":"2023-10-06T01:38:48.662335+0000","last_became_peered":"2023-10-06T01:38:48.662335+0000","last_unstale":"2023-10-06T01:38:49.513481+0000","last_undegraded":"2023-10-06T01:38:49.513481+0000","last_fullsized":"2023-10-06T01:38:49.513481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:52.982952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526925+0000","last_change":"2023-10-06T01:38:49.518684+0000","last_active":"2023-10-06T01:38:49.526925+0000","last_peered":"2023-10-06T01:38:49.526925+0000","last_clean":"2023-10-06T01:38:49.526925+0000","last_became_active":"2023-10-06T01:38:49.518436+0000","last_became_peered":"2023-10-06T01:38:49.518436+0000","last_unstale":"2023-10-06T01:38:49.526925+0000","last_undegraded":"2023-10-06T01:38:49.526925+0000","last_fullsized":"2023-10-06T01:38:49.526925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:42.707474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.659791+0000","last_change":"2023-10-06T01:38:48.667307+0000","last_active":"2023-10-06T01:38:49.659791+0000","last_peered":"2023-10-06T01:38:49.659791+0000","last_clean":"2023-10-06T01:38:49.659791+0000","last_became_active":"2023-10-06T01:38:48.667032+0000","last_became_peered":"2023-10-06T01:38:48.667032+0000","last_unstale":"2023-10-06T01:38:49.659791+0000","last_undegraded":"2023-10-06T01:38:49.659791+0000","last_fullsized":"2023-10-06T01:38:49.659791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:26.851686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527967+0000","last_change":"2023-10-06T01:38:49.525949+0000","last_active":"2023-10-06T01:38:49.527967+0000","last_peered":"2023-10-06T01:38:49.527967+0000","last_clean":"2023-10-06T01:38:49.527967+0000","last_became_active":"2023-10-06T01:38:49.525063+0000","last_became_peered":"2023-10-06T01:38:49.525063+0000","last_unstale":"2023-10-06T01:38:49.527967+0000","last_undegraded":"2023-10-06T01:38:49.527967+0000","last_fullsized":"2023-10-06T01:38:49.527967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:31.040385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.659104+0000","last_change":"2023-10-06T01:38:48.666319+0000","last_active":"2023-10-06T01:38:49.659104+0000","last_peered":"2023-10-06T01:38:49.659104+0000","last_clean":"2023-10-06T01:38:49.659104+0000","last_became_active":"2023-10-06T01:38:48.666058+0000","last_became_peered":"2023-10-06T01:38:48.666058+0000","last_unstale":"2023-10-06T01:38:49.659104+0000","last_undegraded":"2023-10-06T01:38:49.659104+0000","last_fullsized":"2023-10-06T01:38:49.659104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:09.299545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532960+0000","last_change":"2023-10-06T01:38:49.528713+0000","last_active":"2023-10-06T01:38:49.532960+0000","last_peered":"2023-10-06T01:38:49.532960+0000","last_clean":"2023-10-06T01:38:49.532960+0000","last_became_active":"2023-10-06T01:38:49.528396+0000","last_became_peered":"2023-10-06T01:38:49.528396+0000","last_unstale":"2023-10-06T01:38:49.532960+0000","last_undegraded":"2023-10-06T01:38:49.532960+0000","last_fullsized":"2023-10-06T01:38:49.532960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:22.060988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.657311+0000","last_change":"2023-10-06T01:38:48.669666+0000","last_active":"2023-10-06T01:38:49.657311+0000","last_peered":"2023-10-06T01:38:49.657311+0000","last_clean":"2023-10-06T01:38:49.657311+0000","last_became_active":"2023-10-06T01:38:48.669403+0000","last_became_peered":"2023-10-06T01:38:48.669403+0000","last_unstale":"2023-10-06T01:38:49.657311+0000","last_undegraded":"2023-10-06T01:38:49.657311+0000","last_fullsized":"2023-10-06T01:38:49.657311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:11.825838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531689+0000","last_change":"2023-10-06T01:38:49.522550+0000","last_active":"2023-10-06T01:38:49.531689+0000","last_peered":"2023-10-06T01:38:49.531689+0000","last_clean":"2023-10-06T01:38:49.531689+0000","last_became_active":"2023-10-06T01:38:49.521718+0000","last_became_peered":"2023-10-06T01:38:49.521718+0000","last_unstale":"2023-10-06T01:38:49.531689+0000","last_undegraded":"2023-10-06T01:38:49.531689+0000","last_fullsized":"2023-10-06T01:38:49.531689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:38:23.293524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.512791+0000","last_change":"2023-10-06T01:38:48.657883+0000","last_active":"2023-10-06T01:38:49.512791+0000","last_peered":"2023-10-06T01:38:49.512791+0000","last_clean":"2023-10-06T01:38:49.512791+0000","last_became_active":"2023-10-06T01:38:48.656431+0000","last_became_peered":"2023-10-06T01:38:48.656431+0000","last_unstale":"2023-10-06T01:38:49.512791+0000","last_undegraded":"2023-10-06T01:38:49.512791+0000","last_fullsized":"2023-10-06T01:38:49.512791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:52.982952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.523875+0000","last_change":"2023-10-06T01:38:49.516970+0000","last_active":"2023-10-06T01:38:49.523875+0000","last_peered":"2023-10-06T01:38:49.523875+0000","last_clean":"2023-10-06T01:38:49.523875+0000","last_became_active":"2023-10-06T01:38:49.516721+0000","last_became_peered":"2023-10-06T01:38:49.516721+0000","last_unstale":"2023-10-06T01:38:49.523875+0000","last_undegraded":"2023-10-06T01:38:49.523875+0000","last_fullsized":"2023-10-06T01:38:49.523875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:38:23.293524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.514766+0000","last_change":"2023-10-06T01:38:48.667484+0000","last_active":"2023-10-06T01:38:49.514766+0000","last_peered":"2023-10-06T01:38:49.514766+0000","last_clean":"2023-10-06T01:38:49.514766+0000","last_became_active":"2023-10-06T01:38:48.667215+0000","last_became_peered":"2023-10-06T01:38:48.667215+0000","last_unstale":"2023-10-06T01:38:49.514766+0000","last_undegraded":"2023-10-06T01:38:49.514766+0000","last_fullsized":"2023-10-06T01:38:49.514766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:57:07.898207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526925+0000","last_change":"2023-10-06T01:38:49.523815+0000","last_active":"2023-10-06T01:38:49.526925+0000","last_peered":"2023-10-06T01:38:49.526925+0000","last_clean":"2023-10-06T01:38:49.526925+0000","last_became_active":"2023-10-06T01:38:49.520967+0000","last_became_peered":"2023-10-06T01:38:49.520967+0000","last_unstale":"2023-10-06T01:38:49.526925+0000","last_undegraded":"2023-10-06T01:38:49.526925+0000","last_fullsized":"2023-10-06T01:38:49.526925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:04.188051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.659578+0000","last_change":"2023-10-06T01:38:48.665231+0000","last_active":"2023-10-06T01:38:49.659578+0000","last_peered":"2023-10-06T01:38:49.659578+0000","last_clean":"2023-10-06T01:38:49.659578+0000","last_became_active":"2023-10-06T01:38:48.664910+0000","last_became_peered":"2023-10-06T01:38:48.664910+0000","last_unstale":"2023-10-06T01:38:49.659578+0000","last_undegraded":"2023-10-06T01:38:49.659578+0000","last_fullsized":"2023-10-06T01:38:49.659578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:50.373603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526858+0000","last_change":"2023-10-06T01:38:49.519035+0000","last_active":"2023-10-06T01:38:49.526858+0000","last_peered":"2023-10-06T01:38:49.526858+0000","last_clean":"2023-10-06T01:38:49.526858+0000","last_became_active":"2023-10-06T01:38:49.518788+0000","last_became_peered":"2023-10-06T01:38:49.518788+0000","last_unstale":"2023-10-06T01:38:49.526858+0000","last_undegraded":"2023-10-06T01:38:49.526858+0000","last_fullsized":"2023-10-06T01:38:49.526858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:21.430025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.656778+0000","last_change":"2023-10-06T01:38:48.669414+0000","last_active":"2023-10-06T01:38:49.656778+0000","last_peered":"2023-10-06T01:38:49.656778+0000","last_clean":"2023-10-06T01:38:49.656778+0000","last_became_active":"2023-10-06T01:38:48.669152+0000","last_became_peered":"2023-10-06T01:38:48.669152+0000","last_unstale":"2023-10-06T01:38:49.656778+0000","last_undegraded":"2023-10-06T01:38:49.656778+0000","last_fullsized":"2023-10-06T01:38:49.656778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:31.036573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.523629+0000","last_change":"2023-10-06T01:38:49.515615+0000","last_active":"2023-10-06T01:38:49.523629+0000","last_peered":"2023-10-06T01:38:49.523629+0000","last_clean":"2023-10-06T01:38:49.523629+0000","last_became_active":"2023-10-06T01:38:49.515307+0000","last_became_peered":"2023-10-06T01:38:49.515307+0000","last_unstale":"2023-10-06T01:38:49.523629+0000","last_undegraded":"2023-10-06T01:38:49.523629+0000","last_fullsized":"2023-10-06T01:38:49.523629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:31.040385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.657257+0000","last_change":"2023-10-06T01:38:48.669339+0000","last_active":"2023-10-06T01:38:49.657257+0000","last_peered":"2023-10-06T01:38:49.657257+0000","last_clean":"2023-10-06T01:38:49.657257+0000","last_became_active":"2023-10-06T01:38:48.668855+0000","last_became_peered":"2023-10-06T01:38:48.668855+0000","last_unstale":"2023-10-06T01:38:49.657257+0000","last_undegraded":"2023-10-06T01:38:49.657257+0000","last_fullsized":"2023-10-06T01:38:49.657257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:33.441697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533008+0000","last_change":"2023-10-06T01:38:49.528804+0000","last_active":"2023-10-06T01:38:49.533008+0000","last_peered":"2023-10-06T01:38:49.533008+0000","last_clean":"2023-10-06T01:38:49.533008+0000","last_became_active":"2023-10-06T01:38:49.528188+0000","last_became_peered":"2023-10-06T01:38:49.528188+0000","last_unstale":"2023-10-06T01:38:49.533008+0000","last_undegraded":"2023-10-06T01:38:49.533008+0000","last_fullsized":"2023-10-06T01:38:49.533008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:42.707474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.656825+0000","last_change":"2023-10-06T01:38:48.662704+0000","last_active":"2023-10-06T01:38:49.656825+0000","last_peered":"2023-10-06T01:38:49.656825+0000","last_clean":"2023-10-06T01:38:49.656825+0000","last_became_active":"2023-10-06T01:38:48.662445+0000","last_became_peered":"2023-10-06T01:38:48.662445+0000","last_unstale":"2023-10-06T01:38:49.656825+0000","last_undegraded":"2023-10-06T01:38:49.656825+0000","last_fullsized":"2023-10-06T01:38:49.656825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:21:02.893859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.529784+0000","last_change":"2023-10-06T01:38:49.524878+0000","last_active":"2023-10-06T01:38:49.529784+0000","last_peered":"2023-10-06T01:38:49.529784+0000","last_clean":"2023-10-06T01:38:49.529784+0000","last_became_active":"2023-10-06T01:38:49.524606+0000","last_became_peered":"2023-10-06T01:38:49.524606+0000","last_unstale":"2023-10-06T01:38:49.529784+0000","last_undegraded":"2023-10-06T01:38:49.529784+0000","last_fullsized":"2023-10-06T01:38:49.529784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:32.038338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.513006+0000","last_change":"2023-10-06T01:38:48.669114+0000","last_active":"2023-10-06T01:38:49.513006+0000","last_peered":"2023-10-06T01:38:49.513006+0000","last_clean":"2023-10-06T01:38:49.513006+0000","last_became_active":"2023-10-06T01:38:48.668855+0000","last_became_peered":"2023-10-06T01:38:48.668855+0000","last_unstale":"2023-10-06T01:38:49.513006+0000","last_undegraded":"2023-10-06T01:38:49.513006+0000","last_fullsized":"2023-10-06T01:38:49.513006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:04.233408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524798+0000","last_change":"2023-10-06T01:38:49.521828+0000","last_active":"2023-10-06T01:38:49.524798+0000","last_peered":"2023-10-06T01:38:49.524798+0000","last_clean":"2023-10-06T01:38:49.524798+0000","last_became_active":"2023-10-06T01:38:49.521245+0000","last_became_peered":"2023-10-06T01:38:49.521245+0000","last_unstale":"2023-10-06T01:38:49.524798+0000","last_undegraded":"2023-10-06T01:38:49.524798+0000","last_fullsized":"2023-10-06T01:38:49.524798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:22.814342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.654286+0000","last_change":"2023-10-06T01:38:48.665908+0000","last_active":"2023-10-06T01:38:49.654286+0000","last_peered":"2023-10-06T01:38:49.654286+0000","last_clean":"2023-10-06T01:38:49.654286+0000","last_became_active":"2023-10-06T01:38:48.665663+0000","last_became_peered":"2023-10-06T01:38:48.665663+0000","last_unstale":"2023-10-06T01:38:49.654286+0000","last_undegraded":"2023-10-06T01:38:49.654286+0000","last_fullsized":"2023-10-06T01:38:49.654286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:04.233408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533179+0000","last_change":"2023-10-06T01:38:49.532282+0000","last_active":"2023-10-06T01:38:49.533179+0000","last_peered":"2023-10-06T01:38:49.533179+0000","last_clean":"2023-10-06T01:38:49.533179+0000","last_became_active":"2023-10-06T01:38:49.532000+0000","last_became_peered":"2023-10-06T01:38:49.532000+0000","last_unstale":"2023-10-06T01:38:49.533179+0000","last_undegraded":"2023-10-06T01:38:49.533179+0000","last_fullsized":"2023-10-06T01:38:49.533179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:43.950553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.517541+0000","last_change":"2023-10-06T01:38:48.668151+0000","last_active":"2023-10-06T01:38:49.517541+0000","last_peered":"2023-10-06T01:38:49.517541+0000","last_clean":"2023-10-06T01:38:49.517541+0000","last_became_active":"2023-10-06T01:38:48.667870+0000","last_became_peered":"2023-10-06T01:38:48.667870+0000","last_unstale":"2023-10-06T01:38:49.517541+0000","last_undegraded":"2023-10-06T01:38:49.517541+0000","last_fullsized":"2023-10-06T01:38:49.517541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:07:41.517375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532859+0000","last_change":"2023-10-06T01:38:49.528292+0000","last_active":"2023-10-06T01:38:49.532859+0000","last_peered":"2023-10-06T01:38:49.532859+0000","last_clean":"2023-10-06T01:38:49.532859+0000","last_became_active":"2023-10-06T01:38:49.527980+0000","last_became_peered":"2023-10-06T01:38:49.527980+0000","last_unstale":"2023-10-06T01:38:49.532859+0000","last_undegraded":"2023-10-06T01:38:49.532859+0000","last_fullsized":"2023-10-06T01:38:49.532859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:24.795745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.521291+0000","last_change":"2023-10-06T01:38:48.659921+0000","last_active":"2023-10-06T01:38:49.521291+0000","last_peered":"2023-10-06T01:38:49.521291+0000","last_clean":"2023-10-06T01:38:49.521291+0000","last_became_active":"2023-10-06T01:38:48.659640+0000","last_became_peered":"2023-10-06T01:38:48.659640+0000","last_unstale":"2023-10-06T01:38:49.521291+0000","last_undegraded":"2023-10-06T01:38:49.521291+0000","last_fullsized":"2023-10-06T01:38:49.521291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:03.937447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533026+0000","last_change":"2023-10-06T01:38:49.528830+0000","last_active":"2023-10-06T01:38:49.533026+0000","last_peered":"2023-10-06T01:38:49.533026+0000","last_clean":"2023-10-06T01:38:49.533026+0000","last_became_active":"2023-10-06T01:38:49.528523+0000","last_became_peered":"2023-10-06T01:38:49.528523+0000","last_unstale":"2023-10-06T01:38:49.533026+0000","last_undegraded":"2023-10-06T01:38:49.533026+0000","last_fullsized":"2023-10-06T01:38:49.533026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:04.188051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.508523+0000","last_change":"2023-10-06T01:38:48.661605+0000","last_active":"2023-10-06T01:38:49.508523+0000","last_peered":"2023-10-06T01:38:49.508523+0000","last_clean":"2023-10-06T01:38:49.508523+0000","last_became_active":"2023-10-06T01:38:48.661424+0000","last_became_peered":"2023-10-06T01:38:48.661424+0000","last_unstale":"2023-10-06T01:38:49.508523+0000","last_undegraded":"2023-10-06T01:38:49.508523+0000","last_fullsized":"2023-10-06T01:38:49.508523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:34.288288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526228+0000","last_change":"2023-10-06T01:38:49.524678+0000","last_active":"2023-10-06T01:38:49.526228+0000","last_peered":"2023-10-06T01:38:49.526228+0000","last_clean":"2023-10-06T01:38:49.526228+0000","last_became_active":"2023-10-06T01:38:49.522598+0000","last_became_peered":"2023-10-06T01:38:49.522598+0000","last_unstale":"2023-10-06T01:38:49.526228+0000","last_undegraded":"2023-10-06T01:38:49.526228+0000","last_fullsized":"2023-10-06T01:38:49.526228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515842+0000","last_change":"2023-10-06T01:38:44.533111+0000","last_active":"2023-10-06T01:38:49.515842+0000","last_peered":"2023-10-06T01:38:49.515842+0000","last_clean":"2023-10-06T01:38:49.515842+0000","last_became_active":"2023-10-06T01:38:44.532838+0000","last_became_peered":"2023-10-06T01:38:44.532838+0000","last_unstale":"2023-10-06T01:38:49.515842+0000","last_undegraded":"2023-10-06T01:38:49.515842+0000","last_fullsized":"2023-10-06T01:38:49.515842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.513492+0000","last_change":"2023-10-06T01:38:48.666716+0000","last_active":"2023-10-06T01:38:49.513492+0000","last_peered":"2023-10-06T01:38:49.513492+0000","last_clean":"2023-10-06T01:38:49.513492+0000","last_became_active":"2023-10-06T01:38:48.666431+0000","last_became_peered":"2023-10-06T01:38:48.666431+0000","last_unstale":"2023-10-06T01:38:49.513492+0000","last_undegraded":"2023-10-06T01:38:49.513492+0000","last_fullsized":"2023-10-06T01:38:49.513492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:33.441697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526310+0000","last_change":"2023-10-06T01:38:49.524629+0000","last_active":"2023-10-06T01:38:49.526310+0000","last_peered":"2023-10-06T01:38:49.526310+0000","last_clean":"2023-10-06T01:38:49.526310+0000","last_became_active":"2023-10-06T01:38:49.524372+0000","last_became_peered":"2023-10-06T01:38:49.524372+0000","last_unstale":"2023-10-06T01:38:49.526310+0000","last_undegraded":"2023-10-06T01:38:49.526310+0000","last_fullsized":"2023-10-06T01:38:49.526310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:22.814342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.512226+0000","last_change":"2023-10-06T01:38:44.533897+0000","last_active":"2023-10-06T01:38:49.512226+0000","last_peered":"2023-10-06T01:38:49.512226+0000","last_clean":"2023-10-06T01:38:49.512226+0000","last_became_active":"2023-10-06T01:38:44.533611+0000","last_became_peered":"2023-10-06T01:38:44.533611+0000","last_unstale":"2023-10-06T01:38:49.512226+0000","last_undegraded":"2023-10-06T01:38:49.512226+0000","last_fullsized":"2023-10-06T01:38:49.512226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:24.411408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.520109+0000","last_change":"2023-10-06T01:38:48.666784+0000","last_active":"2023-10-06T01:38:49.520109+0000","last_peered":"2023-10-06T01:38:49.520109+0000","last_clean":"2023-10-06T01:38:49.520109+0000","last_became_active":"2023-10-06T01:38:48.666228+0000","last_became_peered":"2023-10-06T01:38:48.666228+0000","last_unstale":"2023-10-06T01:38:49.520109+0000","last_undegraded":"2023-10-06T01:38:49.520109+0000","last_fullsized":"2023-10-06T01:38:49.520109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:34.288288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526238+0000","last_change":"2023-10-06T01:38:49.520640+0000","last_active":"2023-10-06T01:38:49.526238+0000","last_peered":"2023-10-06T01:38:49.526238+0000","last_clean":"2023-10-06T01:38:49.526238+0000","last_became_active":"2023-10-06T01:38:49.520050+0000","last_became_peered":"2023-10-06T01:38:49.520050+0000","last_unstale":"2023-10-06T01:38:49.526238+0000","last_undegraded":"2023-10-06T01:38:49.526238+0000","last_fullsized":"2023-10-06T01:38:49.526238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:27.494951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.513741+0000","last_change":"2023-10-06T01:38:45.307814+0000","last_active":"2023-10-06T01:38:49.513741+0000","last_peered":"2023-10-06T01:38:49.513741+0000","last_clean":"2023-10-06T01:38:49.513741+0000","last_became_active":"2023-10-06T01:38:45.307536+0000","last_became_peered":"2023-10-06T01:38:45.307536+0000","last_unstale":"2023-10-06T01:38:49.513741+0000","last_undegraded":"2023-10-06T01:38:49.513741+0000","last_fullsized":"2023-10-06T01:38:49.513741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:09.503713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515587+0000","last_change":"2023-10-06T01:38:48.656055+0000","last_active":"2023-10-06T01:38:49.515587+0000","last_peered":"2023-10-06T01:38:49.515587+0000","last_clean":"2023-10-06T01:38:49.515587+0000","last_became_active":"2023-10-06T01:38:48.655769+0000","last_became_peered":"2023-10-06T01:38:48.655769+0000","last_unstale":"2023-10-06T01:38:49.515587+0000","last_undegraded":"2023-10-06T01:38:49.515587+0000","last_fullsized":"2023-10-06T01:38:49.515587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:34.288288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527622+0000","last_change":"2023-10-06T01:38:49.524773+0000","last_active":"2023-10-06T01:38:49.527622+0000","last_peered":"2023-10-06T01:38:49.527622+0000","last_clean":"2023-10-06T01:38:49.527622+0000","last_became_active":"2023-10-06T01:38:49.524515+0000","last_became_peered":"2023-10-06T01:38:49.524515+0000","last_unstale":"2023-10-06T01:38:49.527622+0000","last_undegraded":"2023-10-06T01:38:49.527622+0000","last_fullsized":"2023-10-06T01:38:49.527622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:57.306692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.512742+0000","last_change":"2023-10-06T01:38:44.534507+0000","last_active":"2023-10-06T01:38:49.512742+0000","last_peered":"2023-10-06T01:38:49.512742+0000","last_clean":"2023-10-06T01:38:49.512742+0000","last_became_active":"2023-10-06T01:38:44.534191+0000","last_became_peered":"2023-10-06T01:38:44.534191+0000","last_unstale":"2023-10-06T01:38:49.512742+0000","last_undegraded":"2023-10-06T01:38:49.512742+0000","last_fullsized":"2023-10-06T01:38:49.512742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.514777+0000","last_change":"2023-10-06T01:38:40.115117+0000","last_active":"2023-10-06T01:38:49.514777+0000","last_peered":"2023-10-06T01:38:49.514777+0000","last_clean":"2023-10-06T01:38:49.514777+0000","last_became_active":"2023-10-06T01:38:40.114142+0000","last_became_peered":"2023-10-06T01:38:40.114142+0000","last_unstale":"2023-10-06T01:38:49.514777+0000","last_undegraded":"2023-10-06T01:38:49.514777+0000","last_fullsized":"2023-10-06T01:38:49.514777+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_clean_scrub_stamp":"2023-10-06T01:38:38.338797+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:52.870262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.508643+0000","last_change":"2023-10-06T01:38:48.663223+0000","last_active":"2023-10-06T01:38:49.508643+0000","last_peered":"2023-10-06T01:38:49.508643+0000","last_clean":"2023-10-06T01:38:49.508643+0000","last_became_active":"2023-10-06T01:38:48.662956+0000","last_became_peered":"2023-10-06T01:38:48.662956+0000","last_unstale":"2023-10-06T01:38:49.508643+0000","last_undegraded":"2023-10-06T01:38:49.508643+0000","last_fullsized":"2023-10-06T01:38:49.508643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:54.859831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531599+0000","last_change":"2023-10-06T01:38:49.530401+0000","last_active":"2023-10-06T01:38:49.531599+0000","last_peered":"2023-10-06T01:38:49.531599+0000","last_clean":"2023-10-06T01:38:49.531599+0000","last_became_active":"2023-10-06T01:38:49.530107+0000","last_became_peered":"2023-10-06T01:38:49.530107+0000","last_unstale":"2023-10-06T01:38:49.531599+0000","last_undegraded":"2023-10-06T01:38:49.531599+0000","last_fullsized":"2023-10-06T01:38:49.531599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:12.827603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515221+0000","last_change":"2023-10-06T01:38:44.531831+0000","last_active":"2023-10-06T01:38:49.515221+0000","last_peered":"2023-10-06T01:38:49.515221+0000","last_clean":"2023-10-06T01:38:49.515221+0000","last_became_active":"2023-10-06T01:38:44.531496+0000","last_became_peered":"2023-10-06T01:38:44.531496+0000","last_unstale":"2023-10-06T01:38:49.515221+0000","last_undegraded":"2023-10-06T01:38:49.515221+0000","last_fullsized":"2023-10-06T01:38:49.515221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:28.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.512340+0000","last_change":"2023-10-06T01:38:48.667413+0000","last_active":"2023-10-06T01:38:49.512340+0000","last_peered":"2023-10-06T01:38:49.512340+0000","last_clean":"2023-10-06T01:38:49.512340+0000","last_became_active":"2023-10-06T01:38:48.667114+0000","last_became_peered":"2023-10-06T01:38:48.667114+0000","last_unstale":"2023-10-06T01:38:49.512340+0000","last_undegraded":"2023-10-06T01:38:49.512340+0000","last_fullsized":"2023-10-06T01:38:49.512340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:03.937447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531783+0000","last_change":"2023-10-06T01:38:49.524239+0000","last_active":"2023-10-06T01:38:49.531783+0000","last_peered":"2023-10-06T01:38:49.531783+0000","last_clean":"2023-10-06T01:38:49.531783+0000","last_became_active":"2023-10-06T01:38:49.523994+0000","last_became_peered":"2023-10-06T01:38:49.523994+0000","last_unstale":"2023-10-06T01:38:49.531783+0000","last_undegraded":"2023-10-06T01:38:49.531783+0000","last_fullsized":"2023-10-06T01:38:49.531783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:31:19.856103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515175+0000","last_change":"2023-10-06T01:38:44.531335+0000","last_active":"2023-10-06T01:38:49.515175+0000","last_peered":"2023-10-06T01:38:49.515175+0000","last_clean":"2023-10-06T01:38:49.515175+0000","last_became_active":"2023-10-06T01:38:44.530966+0000","last_became_peered":"2023-10-06T01:38:44.530966+0000","last_unstale":"2023-10-06T01:38:49.515175+0000","last_undegraded":"2023-10-06T01:38:49.515175+0000","last_fullsized":"2023-10-06T01:38:49.515175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:33.926180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515942+0000","last_change":"2023-10-06T01:38:48.660438+0000","last_active":"2023-10-06T01:38:49.515942+0000","last_peered":"2023-10-06T01:38:49.515942+0000","last_clean":"2023-10-06T01:38:49.515942+0000","last_became_active":"2023-10-06T01:38:48.660222+0000","last_became_peered":"2023-10-06T01:38:48.660222+0000","last_unstale":"2023-10-06T01:38:49.515942+0000","last_undegraded":"2023-10-06T01:38:49.515942+0000","last_fullsized":"2023-10-06T01:38:49.515942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:03.937447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524781+0000","last_change":"2023-10-06T01:38:49.517014+0000","last_active":"2023-10-06T01:38:49.524781+0000","last_peered":"2023-10-06T01:38:49.524781+0000","last_clean":"2023-10-06T01:38:49.524781+0000","last_became_active":"2023-10-06T01:38:49.516679+0000","last_became_peered":"2023-10-06T01:38:49.516679+0000","last_unstale":"2023-10-06T01:38:49.524781+0000","last_undegraded":"2023-10-06T01:38:49.524781+0000","last_fullsized":"2023-10-06T01:38:49.524781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:38:23.293524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.658035+0000","last_change":"2023-10-06T01:38:48.663372+0000","last_active":"2023-10-06T01:38:49.658035+0000","last_peered":"2023-10-06T01:38:49.658035+0000","last_clean":"2023-10-06T01:38:49.658035+0000","last_became_active":"2023-10-06T01:38:48.663074+0000","last_became_peered":"2023-10-06T01:38:48.663074+0000","last_unstale":"2023-10-06T01:38:49.658035+0000","last_undegraded":"2023-10-06T01:38:49.658035+0000","last_fullsized":"2023-10-06T01:38:49.658035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:09.299545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.516315+0000","last_change":"2023-10-06T01:38:44.533582+0000","last_active":"2023-10-06T01:38:49.516315+0000","last_peered":"2023-10-06T01:38:49.516315+0000","last_clean":"2023-10-06T01:38:49.516315+0000","last_became_active":"2023-10-06T01:38:44.533324+0000","last_became_peered":"2023-10-06T01:38:44.533324+0000","last_unstale":"2023-10-06T01:38:49.516315+0000","last_undegraded":"2023-10-06T01:38:49.516315+0000","last_fullsized":"2023-10-06T01:38:49.516315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.519956+0000","last_change":"2023-10-06T01:38:49.516429+0000","last_active":"2023-10-06T01:38:49.519956+0000","last_peered":"2023-10-06T01:38:49.519956+0000","last_clean":"2023-10-06T01:38:49.519956+0000","last_became_active":"2023-10-06T01:38:49.515639+0000","last_became_peered":"2023-10-06T01:38:49.515639+0000","last_unstale":"2023-10-06T01:38:49.519956+0000","last_undegraded":"2023-10-06T01:38:49.519956+0000","last_fullsized":"2023-10-06T01:38:49.519956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:22.814342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.516330+0000","last_change":"2023-10-06T01:38:44.533765+0000","last_active":"2023-10-06T01:38:49.516330+0000","last_peered":"2023-10-06T01:38:49.516330+0000","last_clean":"2023-10-06T01:38:49.516330+0000","last_became_active":"2023-10-06T01:38:44.533406+0000","last_became_peered":"2023-10-06T01:38:44.533406+0000","last_unstale":"2023-10-06T01:38:49.516330+0000","last_undegraded":"2023-10-06T01:38:49.516330+0000","last_fullsized":"2023-10-06T01:38:49.516330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.512682+0000","last_change":"2023-10-06T01:38:48.659164+0000","last_active":"2023-10-06T01:38:49.512682+0000","last_peered":"2023-10-06T01:38:49.512682+0000","last_clean":"2023-10-06T01:38:49.512682+0000","last_became_active":"2023-10-06T01:38:48.658890+0000","last_became_peered":"2023-10-06T01:38:48.658890+0000","last_unstale":"2023-10-06T01:38:49.512682+0000","last_undegraded":"2023-10-06T01:38:49.512682+0000","last_fullsized":"2023-10-06T01:38:49.512682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:34.288288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533074+0000","last_change":"2023-10-06T01:38:49.529282+0000","last_active":"2023-10-06T01:38:49.533074+0000","last_peered":"2023-10-06T01:38:49.533074+0000","last_clean":"2023-10-06T01:38:49.533074+0000","last_became_active":"2023-10-06T01:38:49.528544+0000","last_became_peered":"2023-10-06T01:38:49.528544+0000","last_unstale":"2023-10-06T01:38:49.533074+0000","last_undegraded":"2023-10-06T01:38:49.533074+0000","last_fullsized":"2023-10-06T01:38:49.533074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:21.430025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.656041+0000","last_change":"2023-10-06T01:38:48.668953+0000","last_active":"2023-10-06T01:38:49.656041+0000","last_peered":"2023-10-06T01:38:49.656041+0000","last_clean":"2023-10-06T01:38:49.656041+0000","last_became_active":"2023-10-06T01:38:48.668711+0000","last_became_peered":"2023-10-06T01:38:48.668711+0000","last_unstale":"2023-10-06T01:38:49.656041+0000","last_undegraded":"2023-10-06T01:38:49.656041+0000","last_fullsized":"2023-10-06T01:38:49.656041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:07:41.517375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527535+0000","last_change":"2023-10-06T01:38:49.523156+0000","last_active":"2023-10-06T01:38:49.527535+0000","last_peered":"2023-10-06T01:38:49.527535+0000","last_clean":"2023-10-06T01:38:49.527535+0000","last_became_active":"2023-10-06T01:38:49.522238+0000","last_became_peered":"2023-10-06T01:38:49.522238+0000","last_unstale":"2023-10-06T01:38:49.527535+0000","last_undegraded":"2023-10-06T01:38:49.527535+0000","last_fullsized":"2023-10-06T01:38:49.527535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:53.984718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.657984+0000","last_change":"2023-10-06T01:38:48.669432+0000","last_active":"2023-10-06T01:38:49.657984+0000","last_peered":"2023-10-06T01:38:49.657984+0000","last_clean":"2023-10-06T01:38:49.657984+0000","last_became_active":"2023-10-06T01:38:48.669170+0000","last_became_peered":"2023-10-06T01:38:48.669170+0000","last_unstale":"2023-10-06T01:38:49.657984+0000","last_undegraded":"2023-10-06T01:38:49.657984+0000","last_fullsized":"2023-10-06T01:38:49.657984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:31.036573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533202+0000","last_change":"2023-10-06T01:38:49.532440+0000","last_active":"2023-10-06T01:38:49.533202+0000","last_peered":"2023-10-06T01:38:49.533202+0000","last_clean":"2023-10-06T01:38:49.533202+0000","last_became_active":"2023-10-06T01:38:49.532184+0000","last_became_peered":"2023-10-06T01:38:49.532184+0000","last_unstale":"2023-10-06T01:38:49.533202+0000","last_undegraded":"2023-10-06T01:38:49.533202+0000","last_fullsized":"2023-10-06T01:38:49.533202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:57.688866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.657725+0000","last_change":"2023-10-06T01:38:48.668877+0000","last_active":"2023-10-06T01:38:49.657725+0000","last_peered":"2023-10-06T01:38:49.657725+0000","last_clean":"2023-10-06T01:38:49.657725+0000","last_became_active":"2023-10-06T01:38:48.668564+0000","last_became_peered":"2023-10-06T01:38:48.668564+0000","last_unstale":"2023-10-06T01:38:49.657725+0000","last_undegraded":"2023-10-06T01:38:49.657725+0000","last_fullsized":"2023-10-06T01:38:49.657725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:54.859831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533193+0000","last_change":"2023-10-06T01:38:49.532416+0000","last_active":"2023-10-06T01:38:49.533193+0000","last_peered":"2023-10-06T01:38:49.533193+0000","last_clean":"2023-10-06T01:38:49.533193+0000","last_became_active":"2023-10-06T01:38:49.532101+0000","last_became_peered":"2023-10-06T01:38:49.532101+0000","last_unstale":"2023-10-06T01:38:49.533193+0000","last_undegraded":"2023-10-06T01:38:49.533193+0000","last_fullsized":"2023-10-06T01:38:49.533193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.654641+0000","last_change":"2023-10-06T01:38:48.665065+0000","last_active":"2023-10-06T01:38:49.654641+0000","last_peered":"2023-10-06T01:38:49.654641+0000","last_clean":"2023-10-06T01:38:49.654641+0000","last_became_active":"2023-10-06T01:38:48.664769+0000","last_became_peered":"2023-10-06T01:38:48.664769+0000","last_unstale":"2023-10-06T01:38:49.654641+0000","last_undegraded":"2023-10-06T01:38:49.654641+0000","last_fullsized":"2023-10-06T01:38:49.654641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:33.441697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526916+0000","last_change":"2023-10-06T01:38:49.518384+0000","last_active":"2023-10-06T01:38:49.526916+0000","last_peered":"2023-10-06T01:38:49.526916+0000","last_clean":"2023-10-06T01:38:49.526916+0000","last_became_active":"2023-10-06T01:38:49.518100+0000","last_became_peered":"2023-10-06T01:38:49.518100+0000","last_unstale":"2023-10-06T01:38:49.526916+0000","last_undegraded":"2023-10-06T01:38:49.526916+0000","last_fullsized":"2023-10-06T01:38:49.526916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:57.494182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.655794+0000","last_change":"2023-10-06T01:38:48.662504+0000","last_active":"2023-10-06T01:38:49.655794+0000","last_peered":"2023-10-06T01:38:49.655794+0000","last_clean":"2023-10-06T01:38:49.655794+0000","last_became_active":"2023-10-06T01:38:48.662220+0000","last_became_peered":"2023-10-06T01:38:48.662220+0000","last_unstale":"2023-10-06T01:38:49.655794+0000","last_undegraded":"2023-10-06T01:38:49.655794+0000","last_fullsized":"2023-10-06T01:38:49.655794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:54.859831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533135+0000","last_change":"2023-10-06T01:38:49.531208+0000","last_active":"2023-10-06T01:38:49.533135+0000","last_peered":"2023-10-06T01:38:49.533135+0000","last_clean":"2023-10-06T01:38:49.533135+0000","last_became_active":"2023-10-06T01:38:49.530797+0000","last_became_peered":"2023-10-06T01:38:49.530797+0000","last_unstale":"2023-10-06T01:38:49.533135+0000","last_undegraded":"2023-10-06T01:38:49.533135+0000","last_fullsized":"2023-10-06T01:38:49.533135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:57.494182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527811+0000","last_change":"2023-10-06T01:38:49.521503+0000","last_active":"2023-10-06T01:38:49.527811+0000","last_peered":"2023-10-06T01:38:49.527811+0000","last_clean":"2023-10-06T01:38:49.527811+0000","last_became_active":"2023-10-06T01:38:49.521219+0000","last_became_peered":"2023-10-06T01:38:49.521219+0000","last_unstale":"2023-10-06T01:38:49.527811+0000","last_undegraded":"2023-10-06T01:38:49.527811+0000","last_fullsized":"2023-10-06T01:38:49.527811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:34.443462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531744+0000","last_change":"2023-10-06T01:38:49.522310+0000","last_active":"2023-10-06T01:38:49.531744+0000","last_peered":"2023-10-06T01:38:49.531744+0000","last_clean":"2023-10-06T01:38:49.531744+0000","last_became_active":"2023-10-06T01:38:49.522062+0000","last_became_peered":"2023-10-06T01:38:49.522062+0000","last_unstale":"2023-10-06T01:38:49.531744+0000","last_undegraded":"2023-10-06T01:38:49.531744+0000","last_fullsized":"2023-10-06T01:38:49.531744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:04.188051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532797+0000","last_change":"2023-10-06T01:38:49.527987+0000","last_active":"2023-10-06T01:38:49.532797+0000","last_peered":"2023-10-06T01:38:49.532797+0000","last_clean":"2023-10-06T01:38:49.532797+0000","last_became_active":"2023-10-06T01:38:49.527716+0000","last_became_peered":"2023-10-06T01:38:49.527716+0000","last_unstale":"2023-10-06T01:38:49.532797+0000","last_undegraded":"2023-10-06T01:38:49.532797+0000","last_fullsized":"2023-10-06T01:38:49.532797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:11.839303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526877+0000","last_change":"2023-10-06T01:38:49.519300+0000","last_active":"2023-10-06T01:38:49.526877+0000","last_peered":"2023-10-06T01:38:49.526877+0000","last_clean":"2023-10-06T01:38:49.526877+0000","last_became_active":"2023-10-06T01:38:49.519069+0000","last_became_peered":"2023-10-06T01:38:49.519069+0000","last_unstale":"2023-10-06T01:38:49.526877+0000","last_undegraded":"2023-10-06T01:38:49.526877+0000","last_fullsized":"2023-10-06T01:38:49.526877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:04.140534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527983+0000","last_change":"2023-10-06T01:38:49.526134+0000","last_active":"2023-10-06T01:38:49.527983+0000","last_peered":"2023-10-06T01:38:49.527983+0000","last_clean":"2023-10-06T01:38:49.527983+0000","last_became_active":"2023-10-06T01:38:49.524965+0000","last_became_peered":"2023-10-06T01:38:49.524965+0000","last_unstale":"2023-10-06T01:38:49.527983+0000","last_undegraded":"2023-10-06T01:38:49.527983+0000","last_fullsized":"2023-10-06T01:38:49.527983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:27.359068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":876544,"data_stored":686098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298120,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073720,"statfs":{"total":96636764160,"available":96331489280,"internally_reserved":0,"allocated":851968,"data_stored":684900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297540,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074300,"statfs":{"total":96636764160,"available":96332083200,"internally_reserved":0,"allocated":258048,"data_stored":94068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":95570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":94602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:38:54.442 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T01:38:54.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.584+0000 7fa56efd5700 1 Processor -- start 2023-10-06T01:38:54.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.584+0000 7fa56efd5700 1 -- start start 2023-10-06T01:38:54.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.585+0000 7fa56efd5700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa56806d280 0x7fa5680a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:54.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.585+0000 7fa56efd5700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5680ce1a0 con 0x7fa5680aee90 2023-10-06T01:38:54.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.585+0000 7fa56efd5700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5680cd5d0 con 0x7fa5680a8be0 2023-10-06T01:38:54.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.585+0000 7fa56efd5700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5680cd870 con 0x7fa56806d280 2023-10-06T01:38:54.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.585+0000 7fa567fff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fa5680aee90 0x7fa5680b1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38074/0 (socket says 172.21.15.69:38074) 2023-10-06T01:38:54.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.585+0000 7fa567fff700 1 -- 172.21.15.69:0/682622513 learned_addr learned my addr 172.21.15.69:0/682622513 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:38:54.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.585+0000 7fa56d572700 1 --2- 172.21.15.69:0/682622513 >> v2:172.21.15.88:3300/0 conn(0x7fa56806d280 0x7fa5680a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:54.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.586+0000 7fa5677fe700 1 -- 172.21.15.69:0/682622513 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1052357083 0 0) 0x7fa5680ce1a0 con 0x7fa5680aee90 2023-10-06T01:38:54.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.586+0000 7fa5677fe700 1 -- 172.21.15.69:0/682622513 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa550003570 con 0x7fa5680aee90 2023-10-06T01:38:54.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.586+0000 7fa5677fe700 1 -- 172.21.15.69:0/682622513 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4091284417 0 0) 0x7fa550003570 con 0x7fa5680aee90 2023-10-06T01:38:54.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.586+0000 7fa5677fe700 1 -- 172.21.15.69:0/682622513 >> v2:172.21.15.88:3300/0 conn(0x7fa56806d280 msgr2=0x7fa5680a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:54.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.586+0000 7fa5677fe700 1 --2- 172.21.15.69:0/682622513 >> v2:172.21.15.88:3300/0 conn(0x7fa56806d280 0x7fa5680a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.586+0000 7fa5677fe700 1 -- 172.21.15.69:0/682622513 >> v1:172.21.15.88:6789/0 conn(0x7fa5680a8be0 legacy=0x7fa5680ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:54.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.586+0000 7fa5677fe700 1 -- 172.21.15.69:0/682622513 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5680cdb50 con 0x7fa5680aee90 2023-10-06T01:38:54.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.586+0000 7fa5677fe700 1 -- 172.21.15.69:0/682622513 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7fa55c001970 con 0x7fa5680aee90 2023-10-06T01:38:54.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.586+0000 7fa5677fe700 1 -- 172.21.15.69:0/682622513 >> v1:172.21.15.69:6789/0 conn(0x7fa5680aee90 legacy=0x7fa5680b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:54.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.586+0000 7fa5677fe700 1 --2- 172.21.15.69:0/682622513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa550003a60 0x7fa550003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:54.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.586+0000 7fa5677fe700 1 --2- 172.21.15.69:0/682622513 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa550004810 0x7fa550004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:54.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.586+0000 7fa5677fe700 1 --2- 172.21.15.69:0/682622513 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa5500051c0 0x7fa55000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:54.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.586+0000 7fa5677fe700 1 -- 172.21.15.69:0/682622513 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5680cd870 con 0x7fa550004810 2023-10-06T01:38:54.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.586+0000 7fa5677fe700 1 -- 172.21.15.69:0/682622513 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55000c050 con 0x7fa550003a60 2023-10-06T01:38:54.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.586+0000 7fa5677fe700 1 -- 172.21.15.69:0/682622513 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55000c210 con 0x7fa5500051c0 2023-10-06T01:38:54.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.586+0000 7fa567fff700 1 --2- 172.21.15.69:0/682622513 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa550004810 0x7fa550004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:54.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.586+0000 7fa56cd71700 1 --2- 172.21.15.69:0/682622513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa550003a60 0x7fa550003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:54.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.586+0000 7fa56d572700 1 --2- 172.21.15.69:0/682622513 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa5500051c0 0x7fa55000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:54.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.586+0000 7fa567fff700 1 -- 172.21.15.69:0/682622513 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa5500051c0 msgr2=0x7fa55000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:54.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.586+0000 7fa567fff700 1 --2- 172.21.15.69:0/682622513 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa5500051c0 0x7fa55000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.586+0000 7fa567fff700 1 -- 172.21.15.69:0/682622513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa550003a60 msgr2=0x7fa550003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:54.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.586+0000 7fa567fff700 1 --2- 172.21.15.69:0/682622513 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa550003a60 0x7fa550003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.586+0000 7fa567fff700 1 -- 172.21.15.69:0/682622513 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa550003570 con 0x7fa550004810 2023-10-06T01:38:54.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.586+0000 7fa56d572700 1 --2- 172.21.15.69:0/682622513 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa5500051c0 0x7fa55000ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:38:54.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.586+0000 7fa56d572700 1 -- 172.21.15.69:0/682622513 reap_dead start 2023-10-06T01:38:54.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.586+0000 7fa567fff700 1 --2- 172.21.15.69:0/682622513 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa550004810 0x7fa550004c80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00c660 tx=0x7fa55c007ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1aae0c80c6eb95e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:54.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.586+0000 7fa5677fe700 1 -- 172.21.15.69:0/682622513 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c005b70 con 0x7fa550004810 2023-10-06T01:38:54.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.587+0000 7fa5677fe700 1 -- 172.21.15.69:0/682622513 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c005d10 con 0x7fa550004810 2023-10-06T01:38:54.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.587+0000 7fa5677fe700 1 -- 172.21.15.69:0/682622513 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c007360 con 0x7fa550004810 2023-10-06T01:38:54.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.587+0000 7fa56efd5700 1 -- 172.21.15.69:0/682622513 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa550004810 msgr2=0x7fa550004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:54.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.587+0000 7fa56efd5700 1 --2- 172.21.15.69:0/682622513 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa550004810 0x7fa550004c80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa55c00c660 tx=0x7fa55c007ca0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.587+0000 7fa56efd5700 1 -- 172.21.15.69:0/682622513 shutdown_connections 2023-10-06T01:38:54.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.587+0000 7fa56efd5700 1 --2- 172.21.15.69:0/682622513 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa550004810 0x7fa550004c80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.587+0000 7fa56efd5700 1 -- 172.21.15.69:0/682622513 >> 172.21.15.69:0/682622513 conn(0x7fa56806ce80 msgr2=0x7fa5680ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:54.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.587+0000 7fa56efd5700 1 -- 172.21.15.69:0/682622513 shutdown_connections 2023-10-06T01:38:54.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.587+0000 7fa56efd5700 1 -- 172.21.15.69:0/682622513 wait complete. 2023-10-06T01:38:54.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.588+0000 7fa56efd5700 1 Processor -- start 2023-10-06T01:38:54.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.588+0000 7fa56efd5700 1 -- start start 2023-10-06T01:38:54.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.589+0000 7fa56efd5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa550004810 0x7fa56816a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:54.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.589+0000 7fa56efd5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa56815a9f0 0x7fa56809b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:54.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.589+0000 7fa56efd5700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa56809b6b0 0x7fa56816cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:54.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.589+0000 7fa56efd5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa568099ba0 con 0x7fa56815a9f0 2023-10-06T01:38:54.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.589+0000 7fa56efd5700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56809bb00 con 0x7fa550004810 2023-10-06T01:38:54.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.589+0000 7fa56efd5700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa56816a8f0 con 0x7fa56809b6b0 2023-10-06T01:38:54.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.589+0000 7fa567fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa56815a9f0 0x7fa56809b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:54.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.589+0000 7fa567fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa56815a9f0 0x7fa56809b170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32992/0 (socket says 172.21.15.69:32992) 2023-10-06T01:38:54.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.589+0000 7fa567fff700 1 -- 172.21.15.69:0/2120900486 learned_addr learned my addr 172.21.15.69:0/2120900486 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:54.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.589+0000 7fa56cd71700 1 --2- 172.21.15.69:0/2120900486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa550004810 0x7fa56816a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:54.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.589+0000 7fa56d572700 1 --2- 172.21.15.69:0/2120900486 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa56809b6b0 0x7fa56816cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:54.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.589+0000 7fa567fff700 1 -- 172.21.15.69:0/2120900486 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa56809b6b0 msgr2=0x7fa56816cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:54.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.589+0000 7fa567fff700 1 --2- 172.21.15.69:0/2120900486 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa56809b6b0 0x7fa56816cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.589+0000 7fa567fff700 1 -- 172.21.15.69:0/2120900486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa550004810 msgr2=0x7fa56816a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:54.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.589+0000 7fa567fff700 1 --2- 172.21.15.69:0/2120900486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa550004810 0x7fa56816a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.589+0000 7fa567fff700 1 -- 172.21.15.69:0/2120900486 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa56809a030 con 0x7fa56815a9f0 2023-10-06T01:38:54.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.590+0000 7fa567fff700 1 --2- 172.21.15.69:0/2120900486 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa56815a9f0 0x7fa56809b170 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa55c001270 tx=0x7fa55c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:54.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.590+0000 7fa564ff9700 1 -- 172.21.15.69:0/2120900486 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c001a40 con 0x7fa56815a9f0 2023-10-06T01:38:54.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.590+0000 7fa564ff9700 1 -- 172.21.15.69:0/2120900486 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55c007110 con 0x7fa56815a9f0 2023-10-06T01:38:54.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.590+0000 7fa56efd5700 1 -- 172.21.15.69:0/2120900486 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa568098f90 con 0x7fa56815a9f0 2023-10-06T01:38:54.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.590+0000 7fa564ff9700 1 -- 172.21.15.69:0/2120900486 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55c014420 con 0x7fa56815a9f0 2023-10-06T01:38:54.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.590+0000 7fa56efd5700 1 -- 172.21.15.69:0/2120900486 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa568099550 con 0x7fa56815a9f0 2023-10-06T01:38:54.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.591+0000 7fa56efd5700 1 -- 172.21.15.69:0/2120900486 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56804c3c0 con 0x7fa56815a9f0 2023-10-06T01:38:54.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.591+0000 7fa564ff9700 1 -- 172.21.15.69:0/2120900486 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa55c0147f0 con 0x7fa56815a9f0 2023-10-06T01:38:54.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.591+0000 7fa564ff9700 1 --2- 172.21.15.69:0/2120900486 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa554066f30 0x7fa5540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:54.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.591+0000 7fa564ff9700 1 -- 172.21.15.69:0/2120900486 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa55c086890 con 0x7fa56815a9f0 2023-10-06T01:38:54.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.591+0000 7fa56cd71700 1 --2- 172.21.15.69:0/2120900486 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa554066f30 0x7fa5540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:54.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.592+0000 7fa56cd71700 1 --2- 172.21.15.69:0/2120900486 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa554066f30 0x7fa5540693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa558007fd0 tx=0x7fa558007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:54.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.596+0000 7fa564ff9700 1 -- 172.21.15.69:0/2120900486 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa55c053900 con 0x7fa56815a9f0 2023-10-06T01:38:54.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.858+0000 7fa56efd5700 1 -- 172.21.15.69:0/2120900486 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fa56804c3c0 con 0x7fa56815a9f0 2023-10-06T01:38:54.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.859+0000 7fa564ff9700 1 -- 172.21.15.69:0/2120900486 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1015 (secure 0 0 0) 0x7fa55c056f20 con 0x7fa56815a9f0 2023-10-06T01:38:54.859 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:38:54.859 INFO:teuthology.orchestra.run.smithi069.stdout:{"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":30,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":24,"num_osds":8,"num_up_osds":8,"osd_up_since":1696556316,"num_in_osds":8,"osd_in_since":1696556307,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":23,"data_bytes":592674,"bytes_used":2438668288,"bytes_avail":770655444992,"bytes_total":773094113280,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4302}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-06T01:38:24.734649+0000","services":{}},"progress_events":{}} 2023-10-06T01:38:54.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.861+0000 7fa56efd5700 1 -- 172.21.15.69:0/2120900486 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa554066f30 msgr2=0x7fa5540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:54.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.861+0000 7fa56efd5700 1 --2- 172.21.15.69:0/2120900486 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa554066f30 0x7fa5540693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa558007fd0 tx=0x7fa558007d60 comp rx=0 tx=0).stop 2023-10-06T01:38:54.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.861+0000 7fa56efd5700 1 -- 172.21.15.69:0/2120900486 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa56815a9f0 msgr2=0x7fa56809b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:54.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.861+0000 7fa56efd5700 1 --2- 172.21.15.69:0/2120900486 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa56815a9f0 0x7fa56809b170 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa55c001270 tx=0x7fa55c015000 comp rx=0 tx=0).stop 2023-10-06T01:38:54.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.861+0000 7fa56efd5700 1 -- 172.21.15.69:0/2120900486 shutdown_connections 2023-10-06T01:38:54.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.861+0000 7fa56efd5700 1 --2- 172.21.15.69:0/2120900486 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa554066f30 0x7fa5540693e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.861+0000 7fa56efd5700 1 --2- 172.21.15.69:0/2120900486 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa56809b6b0 0x7fa56816cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.861+0000 7fa56efd5700 1 --2- 172.21.15.69:0/2120900486 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa550004810 0x7fa56816a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.861+0000 7fa56efd5700 1 --2- 172.21.15.69:0/2120900486 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa56815a9f0 0x7fa56809b170 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.861+0000 7fa56efd5700 1 -- 172.21.15.69:0/2120900486 >> 172.21.15.69:0/2120900486 conn(0x7fa56806ce80 msgr2=0x7fa5680695f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:54.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.861+0000 7fa56efd5700 1 -- 172.21.15.69:0/2120900486 shutdown_connections 2023-10-06T01:38:54.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.861+0000 7fa56efd5700 1 -- 172.21.15.69:0/2120900486 wait complete. 2023-10-06T01:38:54.873 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T01:38:54.873 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:38:54.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.986+0000 7fcaac5f5700 1 Processor -- start 2023-10-06T01:38:54.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.986+0000 7fcaac5f5700 1 -- start start 2023-10-06T01:38:54.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.987+0000 7fcaac5f5700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcaa40cb5a0 0x7fcaa40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:54.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.987+0000 7fcaac5f5700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa415ae40 con 0x7fcaa40cd9e0 2023-10-06T01:38:54.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.987+0000 7fcaac5f5700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa415ab60 con 0x7fcaa415a5d0 2023-10-06T01:38:54.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.987+0000 7fcaac5f5700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa40d13f0 con 0x7fcaa40cb5a0 2023-10-06T01:38:54.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.987+0000 7fcaa9b90700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fcaa40cd9e0 0x7fcaa4159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38082/0 (socket says 172.21.15.69:38082) 2023-10-06T01:38:54.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.987+0000 7fcaa9b90700 1 -- 172.21.15.69:0/3616083074 learned_addr learned my addr 172.21.15.69:0/3616083074 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:38:54.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.987+0000 7fcaaa391700 1 --2- 172.21.15.69:0/3616083074 >> v2:172.21.15.88:3300/0 conn(0x7fcaa40cb5a0 0x7fcaa40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:54.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.987+0000 7fcaa938f700 1 -- 172.21.15.69:0/3616083074 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246666872 0 0) 0x7fcaa415ae40 con 0x7fcaa40cd9e0 2023-10-06T01:38:54.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.988+0000 7fcaa938f700 1 -- 172.21.15.69:0/3616083074 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca90003570 con 0x7fcaa40cd9e0 2023-10-06T01:38:54.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.988+0000 7fcaa938f700 1 -- 172.21.15.69:0/3616083074 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 810764287 0 0) 0x7fca90003570 con 0x7fcaa40cd9e0 2023-10-06T01:38:54.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.988+0000 7fcaa938f700 1 -- 172.21.15.69:0/3616083074 >> v2:172.21.15.88:3300/0 conn(0x7fcaa40cb5a0 msgr2=0x7fcaa40cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:54.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.988+0000 7fcaa938f700 1 --2- 172.21.15.69:0/3616083074 >> v2:172.21.15.88:3300/0 conn(0x7fcaa40cb5a0 0x7fcaa40cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.988+0000 7fcaa938f700 1 -- 172.21.15.69:0/3616083074 >> v1:172.21.15.88:6789/0 conn(0x7fcaa415a5d0 legacy=0x7fcaa4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:54.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.988+0000 7fcaa938f700 1 -- 172.21.15.69:0/3616083074 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa40ccf00 con 0x7fcaa40cd9e0 2023-10-06T01:38:54.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.988+0000 7fcaa938f700 1 -- 172.21.15.69:0/3616083074 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7fca94001470 con 0x7fcaa40cd9e0 2023-10-06T01:38:54.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.988+0000 7fcaa938f700 1 -- 172.21.15.69:0/3616083074 >> v1:172.21.15.69:6789/0 conn(0x7fcaa40cd9e0 legacy=0x7fcaa4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:54.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.988+0000 7fcaa938f700 1 --2- 172.21.15.69:0/3616083074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca90003a60 0x7fca90003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:54.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.988+0000 7fcaa938f700 1 --2- 172.21.15.69:0/3616083074 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fca90004810 0x7fca90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:54.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.988+0000 7fcaa938f700 1 --2- 172.21.15.69:0/3616083074 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca900051c0 0x7fca9000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:54.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.988+0000 7fcaa938f700 1 -- 172.21.15.69:0/3616083074 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9000c0a0 con 0x7fca900051c0 2023-10-06T01:38:54.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.988+0000 7fcaa938f700 1 -- 172.21.15.69:0/3616083074 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9000c210 con 0x7fca90003a60 2023-10-06T01:38:54.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.988+0000 7fcaa938f700 1 -- 172.21.15.69:0/3616083074 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9000c3d0 con 0x7fca90004810 2023-10-06T01:38:54.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.988+0000 7fcaaab92700 1 --2- 172.21.15.69:0/3616083074 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca900051c0 0x7fca9000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:54.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.988+0000 7fcaaa391700 1 --2- 172.21.15.69:0/3616083074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca90003a60 0x7fca90003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:54.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.988+0000 7fcaa9b90700 1 --2- 172.21.15.69:0/3616083074 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fca90004810 0x7fca90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:54.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.988+0000 7fcaaab92700 1 -- 172.21.15.69:0/3616083074 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fca90004810 msgr2=0x7fca90004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:54.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.988+0000 7fcaaab92700 1 --2- 172.21.15.69:0/3616083074 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fca90004810 0x7fca90004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.988+0000 7fcaaab92700 1 -- 172.21.15.69:0/3616083074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca90003a60 msgr2=0x7fca90003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:54.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.988+0000 7fcaaab92700 1 --2- 172.21.15.69:0/3616083074 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca90003a60 0x7fca90003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.988+0000 7fcaaab92700 1 -- 172.21.15.69:0/3616083074 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca90003570 con 0x7fca900051c0 2023-10-06T01:38:54.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.988+0000 7fcaaab92700 1 -- 172.21.15.69:0/3616083074 reap_dead start 2023-10-06T01:38:54.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.988+0000 7fcaaab92700 1 --2- 172.21.15.69:0/3616083074 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca900051c0 0x7fca9000ba60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fca9c0018b0 tx=0x7fca9c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3523805b06f2651c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:54.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.988+0000 7fcaa938f700 1 -- 172.21.15.69:0/3616083074 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c012420 con 0x7fca900051c0 2023-10-06T01:38:54.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.989+0000 7fcaa938f700 1 -- 172.21.15.69:0/3616083074 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9c012580 con 0x7fca900051c0 2023-10-06T01:38:54.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.989+0000 7fcaa938f700 1 -- 172.21.15.69:0/3616083074 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9c012920 con 0x7fca900051c0 2023-10-06T01:38:54.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.989+0000 7fcaac5f5700 1 -- 172.21.15.69:0/3616083074 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca900051c0 msgr2=0x7fca9000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:54.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.989+0000 7fcaac5f5700 1 --2- 172.21.15.69:0/3616083074 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca900051c0 0x7fca9000ba60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fca9c0018b0 tx=0x7fca9c007d30 comp rx=0 tx=0).stop 2023-10-06T01:38:54.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.989+0000 7fcaac5f5700 1 -- 172.21.15.69:0/3616083074 shutdown_connections 2023-10-06T01:38:54.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.989+0000 7fcaac5f5700 1 --2- 172.21.15.69:0/3616083074 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca900051c0 0x7fca9000ba60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:54.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.989+0000 7fcaac5f5700 1 -- 172.21.15.69:0/3616083074 >> 172.21.15.69:0/3616083074 conn(0x7fcaa4070e30 msgr2=0x7fcaa40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:54.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.989+0000 7fcaac5f5700 1 -- 172.21.15.69:0/3616083074 shutdown_connections 2023-10-06T01:38:54.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.989+0000 7fcaac5f5700 1 -- 172.21.15.69:0/3616083074 wait complete. 2023-10-06T01:38:54.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.990+0000 7fcaac5f5700 1 Processor -- start 2023-10-06T01:38:54.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.990+0000 7fcaac5f5700 1 -- start start 2023-10-06T01:38:54.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.991+0000 7fcaac5f5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca900051c0 0x7fcaa40c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:54.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.991+0000 7fcaac5f5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcaa41512b0 0x7fcaa4152450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:55.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.991+0000 7fcaac5f5700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcaa40b05b0 0x7fcaa40b0a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:55.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.991+0000 7fcaac5f5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40b0f60 con 0x7fcaa41512b0 2023-10-06T01:38:55.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.991+0000 7fcaac5f5700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa4152990 con 0x7fca900051c0 2023-10-06T01:38:55.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.991+0000 7fcaac5f5700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa40c9620 con 0x7fcaa40b05b0 2023-10-06T01:38:55.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.991+0000 7fcaa9b90700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcaa41512b0 0x7fcaa4152450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:55.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.991+0000 7fcaa9b90700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcaa41512b0 0x7fcaa4152450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33004/0 (socket says 172.21.15.69:33004) 2023-10-06T01:38:55.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.991+0000 7fcaa9b90700 1 -- 172.21.15.69:0/4181065227 learned_addr learned my addr 172.21.15.69:0/4181065227 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:55.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.991+0000 7fcaaa391700 1 --2- 172.21.15.69:0/4181065227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca900051c0 0x7fcaa40c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:55.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.991+0000 7fcaa9b90700 1 -- 172.21.15.69:0/4181065227 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcaa40b05b0 msgr2=0x7fcaa40b0a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:55.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.991+0000 7fcaaab92700 1 --2- 172.21.15.69:0/4181065227 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcaa40b05b0 0x7fcaa40b0a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:55.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.991+0000 7fcaa9b90700 1 --2- 172.21.15.69:0/4181065227 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcaa40b05b0 0x7fcaa40b0a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:55.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.991+0000 7fcaa9b90700 1 -- 172.21.15.69:0/4181065227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca900051c0 msgr2=0x7fcaa40c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:55.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.991+0000 7fcaa9b90700 1 --2- 172.21.15.69:0/4181065227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca900051c0 0x7fcaa40c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:55.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.991+0000 7fcaa9b90700 1 -- 172.21.15.69:0/4181065227 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa40c9900 con 0x7fcaa41512b0 2023-10-06T01:38:55.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.991+0000 7fcaa9b90700 1 --2- 172.21.15.69:0/4181065227 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcaa41512b0 0x7fcaa4152450 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fca940073c0 tx=0x7fca94001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:55.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.992+0000 7fca9a7fc700 1 -- 172.21.15.69:0/4181065227 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca94018030 con 0x7fcaa41512b0 2023-10-06T01:38:55.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.992+0000 7fca9a7fc700 1 -- 172.21.15.69:0/4181065227 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca9400f9a0 con 0x7fcaa41512b0 2023-10-06T01:38:55.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.992+0000 7fca9a7fc700 1 -- 172.21.15.69:0/4181065227 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca9400fd60 con 0x7fcaa41512b0 2023-10-06T01:38:55.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.992+0000 7fcaac5f5700 1 -- 172.21.15.69:0/4181065227 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa40c9be0 con 0x7fcaa41512b0 2023-10-06T01:38:55.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.992+0000 7fcaac5f5700 1 -- 172.21.15.69:0/4181065227 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa40b4210 con 0x7fcaa41512b0 2023-10-06T01:38:55.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.993+0000 7fcaac5f5700 1 -- 172.21.15.69:0/4181065227 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa40ca080 con 0x7fcaa41512b0 2023-10-06T01:38:55.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.993+0000 7fca9a7fc700 1 -- 172.21.15.69:0/4181065227 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca9401b070 con 0x7fcaa41512b0 2023-10-06T01:38:55.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.993+0000 7fca9a7fc700 1 --2- 172.21.15.69:0/4181065227 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fca88066f30 0x7fca880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:55.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.993+0000 7fcaaa391700 1 --2- 172.21.15.69:0/4181065227 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fca88066f30 0x7fca880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:55.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.993+0000 7fca9a7fc700 1 -- 172.21.15.69:0/4181065227 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fca94019070 con 0x7fcaa41512b0 2023-10-06T01:38:55.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.994+0000 7fcaaa391700 1 --2- 172.21.15.69:0/4181065227 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fca88066f30 0x7fca880693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0009750 tx=0x7fcaa000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:55.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:54.997+0000 7fca9a7fc700 1 -- 172.21.15.69:0/4181065227 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca94051780 con 0x7fcaa41512b0 2023-10-06T01:38:55.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:55.178+0000 7fcaac5f5700 1 -- 172.21.15.69:0/4181065227 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fcaa404c3c0 con 0x7fca88066f30 2023-10-06T01:38:55.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:55.185+0000 7fca9a7fc700 1 -- 172.21.15.69:0/4181065227 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286693 (secure 0 0 0) 0x7fcaa404c3c0 con 0x7fca88066f30 2023-10-06T01:38:55.189 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:38:55.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:55.189+0000 7fcaac5f5700 1 -- 172.21.15.69:0/4181065227 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fca88066f30 msgr2=0x7fca880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:55.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:55.189+0000 7fcaac5f5700 1 --2- 172.21.15.69:0/4181065227 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fca88066f30 0x7fca880693e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0009750 tx=0x7fcaa000b040 comp rx=0 tx=0).stop 2023-10-06T01:38:55.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:55.189+0000 7fcaac5f5700 1 -- 172.21.15.69:0/4181065227 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcaa41512b0 msgr2=0x7fcaa4152450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:55.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:55.189+0000 7fcaac5f5700 1 --2- 172.21.15.69:0/4181065227 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcaa41512b0 0x7fcaa4152450 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fca940073c0 tx=0x7fca94001e50 comp rx=0 tx=0).stop 2023-10-06T01:38:55.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:55.189+0000 7fcaac5f5700 1 -- 172.21.15.69:0/4181065227 shutdown_connections 2023-10-06T01:38:55.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:55.189+0000 7fcaac5f5700 1 --2- 172.21.15.69:0/4181065227 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fca88066f30 0x7fca880693e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:55.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:55.189+0000 7fcaac5f5700 1 --2- 172.21.15.69:0/4181065227 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcaa40b05b0 0x7fcaa40b0a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:55.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:55.189+0000 7fcaac5f5700 1 --2- 172.21.15.69:0/4181065227 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca900051c0 0x7fcaa40c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:55.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:55.189+0000 7fcaac5f5700 1 --2- 172.21.15.69:0/4181065227 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcaa41512b0 0x7fcaa4152450 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:55.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:55.189+0000 7fcaac5f5700 1 -- 172.21.15.69:0/4181065227 >> 172.21.15.69:0/4181065227 conn(0x7fcaa4070e30 msgr2=0x7fcaa4153ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:55.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:55.189+0000 7fcaac5f5700 1 -- 172.21.15.69:0/4181065227 shutdown_connections 2023-10-06T01:38:55.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:55.189+0000 7fcaac5f5700 1 -- 172.21.15.69:0/4181065227 wait complete. 2023-10-06T01:38:55.192 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-10-06T01:38:55.201 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-10-06T01:38:54.247552+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381512,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593208,"statfs":{"total":773094113280,"available":770655444992,"internally_reserved":0,"allocated":3284992,"data_stored":1937172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001314"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524056+0000","last_change":"2023-10-06T01:38:49.517903+0000","last_active":"2023-10-06T01:38:49.524056+0000","last_peered":"2023-10-06T01:38:49.524056+0000","last_clean":"2023-10-06T01:38:49.524056+0000","last_became_active":"2023-10-06T01:38:49.517634+0000","last_became_peered":"2023-10-06T01:38:49.517634+0000","last_unstale":"2023-10-06T01:38:49.524056+0000","last_undegraded":"2023-10-06T01:38:49.524056+0000","last_fullsized":"2023-10-06T01:38:49.524056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:04.939212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527124+0000","last_change":"2023-10-06T01:38:49.523256+0000","last_active":"2023-10-06T01:38:49.527124+0000","last_peered":"2023-10-06T01:38:49.527124+0000","last_clean":"2023-10-06T01:38:49.527124+0000","last_became_active":"2023-10-06T01:38:49.522954+0000","last_became_peered":"2023-10-06T01:38:49.522954+0000","last_unstale":"2023-10-06T01:38:49.527124+0000","last_undegraded":"2023-10-06T01:38:49.527124+0000","last_fullsized":"2023-10-06T01:38:49.527124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532807+0000","last_change":"2023-10-06T01:38:49.528144+0000","last_active":"2023-10-06T01:38:49.532807+0000","last_peered":"2023-10-06T01:38:49.532807+0000","last_clean":"2023-10-06T01:38:49.532807+0000","last_became_active":"2023-10-06T01:38:49.527476+0000","last_became_peered":"2023-10-06T01:38:49.527476+0000","last_unstale":"2023-10-06T01:38:49.532807+0000","last_undegraded":"2023-10-06T01:38:49.532807+0000","last_fullsized":"2023-10-06T01:38:49.532807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:49.294618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.528235+0000","last_change":"2023-10-06T01:38:49.526214+0000","last_active":"2023-10-06T01:38:49.528235+0000","last_peered":"2023-10-06T01:38:49.528235+0000","last_clean":"2023-10-06T01:38:49.528235+0000","last_became_active":"2023-10-06T01:38:49.525926+0000","last_became_peered":"2023-10-06T01:38:49.525926+0000","last_unstale":"2023-10-06T01:38:49.528235+0000","last_undegraded":"2023-10-06T01:38:49.528235+0000","last_fullsized":"2023-10-06T01:38:49.528235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:57:08.899972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524841+0000","last_change":"2023-10-06T01:38:49.522000+0000","last_active":"2023-10-06T01:38:49.524841+0000","last_peered":"2023-10-06T01:38:49.524841+0000","last_clean":"2023-10-06T01:38:49.524841+0000","last_became_active":"2023-10-06T01:38:49.521580+0000","last_became_peered":"2023-10-06T01:38:49.521580+0000","last_unstale":"2023-10-06T01:38:49.524841+0000","last_undegraded":"2023-10-06T01:38:49.524841+0000","last_fullsized":"2023-10-06T01:38:49.524841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:21.430025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532735+0000","last_change":"2023-10-06T01:38:49.527658+0000","last_active":"2023-10-06T01:38:49.532735+0000","last_peered":"2023-10-06T01:38:49.532735+0000","last_clean":"2023-10-06T01:38:49.532735+0000","last_became_active":"2023-10-06T01:38:49.527109+0000","last_became_peered":"2023-10-06T01:38:49.527109+0000","last_unstale":"2023-10-06T01:38:49.532735+0000","last_undegraded":"2023-10-06T01:38:49.532735+0000","last_fullsized":"2023-10-06T01:38:49.532735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:41.094305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.529246+0000","last_change":"2023-10-06T01:38:49.526274+0000","last_active":"2023-10-06T01:38:49.529246+0000","last_peered":"2023-10-06T01:38:49.529246+0000","last_clean":"2023-10-06T01:38:49.529246+0000","last_became_active":"2023-10-06T01:38:49.526058+0000","last_became_peered":"2023-10-06T01:38:49.526058+0000","last_unstale":"2023-10-06T01:38:49.529246+0000","last_undegraded":"2023-10-06T01:38:49.529246+0000","last_fullsized":"2023-10-06T01:38:49.529246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.529633+0000","last_change":"2023-10-06T01:38:49.527609+0000","last_active":"2023-10-06T01:38:49.529633+0000","last_peered":"2023-10-06T01:38:49.529633+0000","last_clean":"2023-10-06T01:38:49.529633+0000","last_became_active":"2023-10-06T01:38:49.527309+0000","last_became_peered":"2023-10-06T01:38:49.527309+0000","last_unstale":"2023-10-06T01:38:49.529633+0000","last_undegraded":"2023-10-06T01:38:49.529633+0000","last_fullsized":"2023-10-06T01:38:49.529633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:04.188051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524708+0000","last_change":"2023-10-06T01:38:49.519471+0000","last_active":"2023-10-06T01:38:49.524708+0000","last_peered":"2023-10-06T01:38:49.524708+0000","last_clean":"2023-10-06T01:38:49.524708+0000","last_became_active":"2023-10-06T01:38:49.519232+0000","last_became_peered":"2023-10-06T01:38:49.519232+0000","last_unstale":"2023-10-06T01:38:49.524708+0000","last_undegraded":"2023-10-06T01:38:49.524708+0000","last_fullsized":"2023-10-06T01:38:49.524708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:11.839303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527105+0000","last_change":"2023-10-06T01:38:49.519625+0000","last_active":"2023-10-06T01:38:49.527105+0000","last_peered":"2023-10-06T01:38:49.527105+0000","last_clean":"2023-10-06T01:38:49.527105+0000","last_became_active":"2023-10-06T01:38:49.519350+0000","last_became_peered":"2023-10-06T01:38:49.519350+0000","last_unstale":"2023-10-06T01:38:49.527105+0000","last_undegraded":"2023-10-06T01:38:49.527105+0000","last_fullsized":"2023-10-06T01:38:49.527105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:21.430025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532757+0000","last_change":"2023-10-06T01:38:49.527759+0000","last_active":"2023-10-06T01:38:49.532757+0000","last_peered":"2023-10-06T01:38:49.532757+0000","last_clean":"2023-10-06T01:38:49.532757+0000","last_became_active":"2023-10-06T01:38:49.527046+0000","last_became_peered":"2023-10-06T01:38:49.527046+0000","last_unstale":"2023-10-06T01:38:49.532757+0000","last_undegraded":"2023-10-06T01:38:49.532757+0000","last_fullsized":"2023-10-06T01:38:49.532757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:04.140534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531758+0000","last_change":"2023-10-06T01:38:49.527553+0000","last_active":"2023-10-06T01:38:49.531758+0000","last_peered":"2023-10-06T01:38:49.531758+0000","last_clean":"2023-10-06T01:38:49.531758+0000","last_became_active":"2023-10-06T01:38:49.527370+0000","last_became_peered":"2023-10-06T01:38:49.527370+0000","last_unstale":"2023-10-06T01:38:49.531758+0000","last_undegraded":"2023-10-06T01:38:49.531758+0000","last_fullsized":"2023-10-06T01:38:49.531758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:55.861597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.523956+0000","last_change":"2023-10-06T01:38:49.517619+0000","last_active":"2023-10-06T01:38:49.523956+0000","last_peered":"2023-10-06T01:38:49.523956+0000","last_clean":"2023-10-06T01:38:49.523956+0000","last_became_active":"2023-10-06T01:38:49.517323+0000","last_became_peered":"2023-10-06T01:38:49.517323+0000","last_unstale":"2023-10-06T01:38:49.523956+0000","last_undegraded":"2023-10-06T01:38:49.523956+0000","last_fullsized":"2023-10-06T01:38:49.523956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:35.290053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.523783+0000","last_change":"2023-10-06T01:38:49.518132+0000","last_active":"2023-10-06T01:38:49.523783+0000","last_peered":"2023-10-06T01:38:49.523783+0000","last_clean":"2023-10-06T01:38:49.523783+0000","last_became_active":"2023-10-06T01:38:49.517901+0000","last_became_peered":"2023-10-06T01:38:49.517901+0000","last_unstale":"2023-10-06T01:38:49.523783+0000","last_undegraded":"2023-10-06T01:38:49.523783+0000","last_fullsized":"2023-10-06T01:38:49.523783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:57.306692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.529431+0000","last_change":"2023-10-06T01:38:49.526480+0000","last_active":"2023-10-06T01:38:49.529431+0000","last_peered":"2023-10-06T01:38:49.529431+0000","last_clean":"2023-10-06T01:38:49.529431+0000","last_became_active":"2023-10-06T01:38:49.526183+0000","last_became_peered":"2023-10-06T01:38:49.526183+0000","last_unstale":"2023-10-06T01:38:49.529431+0000","last_undegraded":"2023-10-06T01:38:49.529431+0000","last_fullsized":"2023-10-06T01:38:49.529431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:57.306692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.528330+0000","last_change":"2023-10-06T01:38:49.525375+0000","last_active":"2023-10-06T01:38:49.528330+0000","last_peered":"2023-10-06T01:38:49.528330+0000","last_clean":"2023-10-06T01:38:49.528330+0000","last_became_active":"2023-10-06T01:38:49.525091+0000","last_became_peered":"2023-10-06T01:38:49.525091+0000","last_unstale":"2023-10-06T01:38:49.528330+0000","last_undegraded":"2023-10-06T01:38:49.528330+0000","last_fullsized":"2023-10-06T01:38:49.528330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:44.668443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524727+0000","last_change":"2023-10-06T01:38:49.520872+0000","last_active":"2023-10-06T01:38:49.524727+0000","last_peered":"2023-10-06T01:38:49.524727+0000","last_clean":"2023-10-06T01:38:49.524727+0000","last_became_active":"2023-10-06T01:38:49.520588+0000","last_became_peered":"2023-10-06T01:38:49.520588+0000","last_unstale":"2023-10-06T01:38:49.524727+0000","last_undegraded":"2023-10-06T01:38:49.524727+0000","last_fullsized":"2023-10-06T01:38:49.524727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:57.494182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532943+0000","last_change":"2023-10-06T01:38:49.528700+0000","last_active":"2023-10-06T01:38:49.532943+0000","last_peered":"2023-10-06T01:38:49.532943+0000","last_clean":"2023-10-06T01:38:49.532943+0000","last_became_active":"2023-10-06T01:38:49.527947+0000","last_became_peered":"2023-10-06T01:38:49.527947+0000","last_unstale":"2023-10-06T01:38:49.532943+0000","last_undegraded":"2023-10-06T01:38:49.532943+0000","last_fullsized":"2023-10-06T01:38:49.532943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:22.289895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.528863+0000","last_change":"2023-10-06T01:38:49.524738+0000","last_active":"2023-10-06T01:38:49.528863+0000","last_peered":"2023-10-06T01:38:49.528863+0000","last_clean":"2023-10-06T01:38:49.528863+0000","last_became_active":"2023-10-06T01:38:49.524478+0000","last_became_peered":"2023-10-06T01:38:49.524478+0000","last_unstale":"2023-10-06T01:38:49.528863+0000","last_undegraded":"2023-10-06T01:38:49.528863+0000","last_fullsized":"2023-10-06T01:38:49.528863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:05.235173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533032+0000","last_change":"2023-10-06T01:38:49.528930+0000","last_active":"2023-10-06T01:38:49.533032+0000","last_peered":"2023-10-06T01:38:49.533032+0000","last_clean":"2023-10-06T01:38:49.533032+0000","last_became_active":"2023-10-06T01:38:49.528446+0000","last_became_peered":"2023-10-06T01:38:49.528446+0000","last_unstale":"2023-10-06T01:38:49.533032+0000","last_undegraded":"2023-10-06T01:38:49.533032+0000","last_fullsized":"2023-10-06T01:38:49.533032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:58.019042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532838+0000","last_change":"2023-10-06T01:38:49.530433+0000","last_active":"2023-10-06T01:38:49.532838+0000","last_peered":"2023-10-06T01:38:49.532838+0000","last_clean":"2023-10-06T01:38:49.532838+0000","last_became_active":"2023-10-06T01:38:49.530161+0000","last_became_peered":"2023-10-06T01:38:49.530161+0000","last_unstale":"2023-10-06T01:38:49.532838+0000","last_undegraded":"2023-10-06T01:38:49.532838+0000","last_fullsized":"2023-10-06T01:38:49.532838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:38:23.293524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526894+0000","last_change":"2023-10-06T01:38:49.523986+0000","last_active":"2023-10-06T01:38:49.526894+0000","last_peered":"2023-10-06T01:38:49.526894+0000","last_clean":"2023-10-06T01:38:49.526894+0000","last_became_active":"2023-10-06T01:38:49.523736+0000","last_became_peered":"2023-10-06T01:38:49.523736+0000","last_unstale":"2023-10-06T01:38:49.526894+0000","last_undegraded":"2023-10-06T01:38:49.526894+0000","last_fullsized":"2023-10-06T01:38:49.526894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:57.306692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526902+0000","last_change":"2023-10-06T01:38:49.517570+0000","last_active":"2023-10-06T01:38:49.526902+0000","last_peered":"2023-10-06T01:38:49.526902+0000","last_clean":"2023-10-06T01:38:49.526902+0000","last_became_active":"2023-10-06T01:38:49.517319+0000","last_became_peered":"2023-10-06T01:38:49.517319+0000","last_unstale":"2023-10-06T01:38:49.526902+0000","last_undegraded":"2023-10-06T01:38:49.526902+0000","last_fullsized":"2023-10-06T01:38:49.526902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:22.060988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.529224+0000","last_change":"2023-10-06T01:38:49.524486+0000","last_active":"2023-10-06T01:38:49.529224+0000","last_peered":"2023-10-06T01:38:49.529224+0000","last_clean":"2023-10-06T01:38:49.529224+0000","last_became_active":"2023-10-06T01:38:49.524244+0000","last_became_peered":"2023-10-06T01:38:49.524244+0000","last_unstale":"2023-10-06T01:38:49.529224+0000","last_undegraded":"2023-10-06T01:38:49.529224+0000","last_fullsized":"2023-10-06T01:38:49.529224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:22.814342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.525649+0000","last_change":"2023-10-06T01:38:49.521288+0000","last_active":"2023-10-06T01:38:49.525649+0000","last_peered":"2023-10-06T01:38:49.525649+0000","last_clean":"2023-10-06T01:38:49.525649+0000","last_became_active":"2023-10-06T01:38:49.520995+0000","last_became_peered":"2023-10-06T01:38:49.520995+0000","last_unstale":"2023-10-06T01:38:49.525649+0000","last_undegraded":"2023-10-06T01:38:49.525649+0000","last_fullsized":"2023-10-06T01:38:49.525649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:06.793193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.525993+0000","last_change":"2023-10-06T01:38:49.521528+0000","last_active":"2023-10-06T01:38:49.525993+0000","last_peered":"2023-10-06T01:38:49.525993+0000","last_clean":"2023-10-06T01:38:49.525993+0000","last_became_active":"2023-10-06T01:38:49.520274+0000","last_became_peered":"2023-10-06T01:38:49.520274+0000","last_unstale":"2023-10-06T01:38:49.525993+0000","last_undegraded":"2023-10-06T01:38:49.525993+0000","last_fullsized":"2023-10-06T01:38:49.525993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:31:19.856103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527242+0000","last_change":"2023-10-06T01:38:49.519548+0000","last_active":"2023-10-06T01:38:49.527242+0000","last_peered":"2023-10-06T01:38:49.527242+0000","last_clean":"2023-10-06T01:38:49.527242+0000","last_became_active":"2023-10-06T01:38:49.519249+0000","last_became_peered":"2023-10-06T01:38:49.519249+0000","last_unstale":"2023-10-06T01:38:49.527242+0000","last_undegraded":"2023-10-06T01:38:49.527242+0000","last_fullsized":"2023-10-06T01:38:49.527242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:57.494182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.656554+0000","last_change":"2023-10-06T01:38:48.666150+0000","last_active":"2023-10-06T01:38:49.656554+0000","last_peered":"2023-10-06T01:38:49.656554+0000","last_clean":"2023-10-06T01:38:49.656554+0000","last_became_active":"2023-10-06T01:38:48.663061+0000","last_became_peered":"2023-10-06T01:38:48.663061+0000","last_unstale":"2023-10-06T01:38:49.656554+0000","last_undegraded":"2023-10-06T01:38:49.656554+0000","last_fullsized":"2023-10-06T01:38:49.656554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:07:41.517375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531425+0000","last_change":"2023-10-06T01:38:49.520719+0000","last_active":"2023-10-06T01:38:49.531425+0000","last_peered":"2023-10-06T01:38:49.531425+0000","last_clean":"2023-10-06T01:38:49.531425+0000","last_became_active":"2023-10-06T01:38:49.520470+0000","last_became_peered":"2023-10-06T01:38:49.520470+0000","last_unstale":"2023-10-06T01:38:49.531425+0000","last_undegraded":"2023-10-06T01:38:49.531425+0000","last_fullsized":"2023-10-06T01:38:49.531425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:11.839303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515999+0000","last_change":"2023-10-06T01:38:48.666186+0000","last_active":"2023-10-06T01:38:49.515999+0000","last_peered":"2023-10-06T01:38:49.515999+0000","last_clean":"2023-10-06T01:38:49.515999+0000","last_became_active":"2023-10-06T01:38:48.665875+0000","last_became_peered":"2023-10-06T01:38:48.665875+0000","last_unstale":"2023-10-06T01:38:49.515999+0000","last_undegraded":"2023-10-06T01:38:49.515999+0000","last_fullsized":"2023-10-06T01:38:49.515999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:09.299545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524755+0000","last_change":"2023-10-06T01:38:49.518381+0000","last_active":"2023-10-06T01:38:49.524755+0000","last_peered":"2023-10-06T01:38:49.524755+0000","last_clean":"2023-10-06T01:38:49.524755+0000","last_became_active":"2023-10-06T01:38:49.518041+0000","last_became_peered":"2023-10-06T01:38:49.518041+0000","last_unstale":"2023-10-06T01:38:49.524755+0000","last_undegraded":"2023-10-06T01:38:49.524755+0000","last_fullsized":"2023-10-06T01:38:49.524755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.508966+0000","last_change":"2023-10-06T01:38:48.665041+0000","last_active":"2023-10-06T01:38:49.508966+0000","last_peered":"2023-10-06T01:38:49.508966+0000","last_clean":"2023-10-06T01:38:49.508966+0000","last_became_active":"2023-10-06T01:38:48.664783+0000","last_became_peered":"2023-10-06T01:38:48.664783+0000","last_unstale":"2023-10-06T01:38:49.508966+0000","last_undegraded":"2023-10-06T01:38:49.508966+0000","last_fullsized":"2023-10-06T01:38:49.508966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:52.982952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.528203+0000","last_change":"2023-10-06T01:38:49.524574+0000","last_active":"2023-10-06T01:38:49.528203+0000","last_peered":"2023-10-06T01:38:49.528203+0000","last_clean":"2023-10-06T01:38:49.528203+0000","last_became_active":"2023-10-06T01:38:49.524266+0000","last_became_peered":"2023-10-06T01:38:49.524266+0000","last_unstale":"2023-10-06T01:38:49.528203+0000","last_undegraded":"2023-10-06T01:38:49.528203+0000","last_fullsized":"2023-10-06T01:38:49.528203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:27.853451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.512647+0000","last_change":"2023-10-06T01:38:48.662259+0000","last_active":"2023-10-06T01:38:49.512647+0000","last_peered":"2023-10-06T01:38:49.512647+0000","last_clean":"2023-10-06T01:38:49.512647+0000","last_became_active":"2023-10-06T01:38:48.661993+0000","last_became_peered":"2023-10-06T01:38:48.661993+0000","last_unstale":"2023-10-06T01:38:49.512647+0000","last_undegraded":"2023-10-06T01:38:49.512647+0000","last_fullsized":"2023-10-06T01:38:49.512647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:04.233408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526872+0000","last_change":"2023-10-06T01:38:49.518829+0000","last_active":"2023-10-06T01:38:49.526872+0000","last_peered":"2023-10-06T01:38:49.526872+0000","last_clean":"2023-10-06T01:38:49.526872+0000","last_became_active":"2023-10-06T01:38:49.517297+0000","last_became_peered":"2023-10-06T01:38:49.517297+0000","last_unstale":"2023-10-06T01:38:49.526872+0000","last_undegraded":"2023-10-06T01:38:49.526872+0000","last_fullsized":"2023-10-06T01:38:49.526872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.513481+0000","last_change":"2023-10-06T01:38:48.662679+0000","last_active":"2023-10-06T01:38:49.513481+0000","last_peered":"2023-10-06T01:38:49.513481+0000","last_clean":"2023-10-06T01:38:49.513481+0000","last_became_active":"2023-10-06T01:38:48.662335+0000","last_became_peered":"2023-10-06T01:38:48.662335+0000","last_unstale":"2023-10-06T01:38:49.513481+0000","last_undegraded":"2023-10-06T01:38:49.513481+0000","last_fullsized":"2023-10-06T01:38:49.513481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:52.982952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526925+0000","last_change":"2023-10-06T01:38:49.518684+0000","last_active":"2023-10-06T01:38:49.526925+0000","last_peered":"2023-10-06T01:38:49.526925+0000","last_clean":"2023-10-06T01:38:49.526925+0000","last_became_active":"2023-10-06T01:38:49.518436+0000","last_became_peered":"2023-10-06T01:38:49.518436+0000","last_unstale":"2023-10-06T01:38:49.526925+0000","last_undegraded":"2023-10-06T01:38:49.526925+0000","last_fullsized":"2023-10-06T01:38:49.526925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:42.707474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.659791+0000","last_change":"2023-10-06T01:38:48.667307+0000","last_active":"2023-10-06T01:38:49.659791+0000","last_peered":"2023-10-06T01:38:49.659791+0000","last_clean":"2023-10-06T01:38:49.659791+0000","last_became_active":"2023-10-06T01:38:48.667032+0000","last_became_peered":"2023-10-06T01:38:48.667032+0000","last_unstale":"2023-10-06T01:38:49.659791+0000","last_undegraded":"2023-10-06T01:38:49.659791+0000","last_fullsized":"2023-10-06T01:38:49.659791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:26.851686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527967+0000","last_change":"2023-10-06T01:38:49.525949+0000","last_active":"2023-10-06T01:38:49.527967+0000","last_peered":"2023-10-06T01:38:49.527967+0000","last_clean":"2023-10-06T01:38:49.527967+0000","last_became_active":"2023-10-06T01:38:49.525063+0000","last_became_peered":"2023-10-06T01:38:49.525063+0000","last_unstale":"2023-10-06T01:38:49.527967+0000","last_undegraded":"2023-10-06T01:38:49.527967+0000","last_fullsized":"2023-10-06T01:38:49.527967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:31.040385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.659104+0000","last_change":"2023-10-06T01:38:48.666319+0000","last_active":"2023-10-06T01:38:49.659104+0000","last_peered":"2023-10-06T01:38:49.659104+0000","last_clean":"2023-10-06T01:38:49.659104+0000","last_became_active":"2023-10-06T01:38:48.666058+0000","last_became_peered":"2023-10-06T01:38:48.666058+0000","last_unstale":"2023-10-06T01:38:49.659104+0000","last_undegraded":"2023-10-06T01:38:49.659104+0000","last_fullsized":"2023-10-06T01:38:49.659104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:09.299545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532960+0000","last_change":"2023-10-06T01:38:49.528713+0000","last_active":"2023-10-06T01:38:49.532960+0000","last_peered":"2023-10-06T01:38:49.532960+0000","last_clean":"2023-10-06T01:38:49.532960+0000","last_became_active":"2023-10-06T01:38:49.528396+0000","last_became_peered":"2023-10-06T01:38:49.528396+0000","last_unstale":"2023-10-06T01:38:49.532960+0000","last_undegraded":"2023-10-06T01:38:49.532960+0000","last_fullsized":"2023-10-06T01:38:49.532960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:22.060988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.657311+0000","last_change":"2023-10-06T01:38:48.669666+0000","last_active":"2023-10-06T01:38:49.657311+0000","last_peered":"2023-10-06T01:38:49.657311+0000","last_clean":"2023-10-06T01:38:49.657311+0000","last_became_active":"2023-10-06T01:38:48.669403+0000","last_became_peered":"2023-10-06T01:38:48.669403+0000","last_unstale":"2023-10-06T01:38:49.657311+0000","last_undegraded":"2023-10-06T01:38:49.657311+0000","last_fullsized":"2023-10-06T01:38:49.657311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:11.825838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531689+0000","last_change":"2023-10-06T01:38:49.522550+0000","last_active":"2023-10-06T01:38:49.531689+0000","last_peered":"2023-10-06T01:38:49.531689+0000","last_clean":"2023-10-06T01:38:49.531689+0000","last_became_active":"2023-10-06T01:38:49.521718+0000","last_became_peered":"2023-10-06T01:38:49.521718+0000","last_unstale":"2023-10-06T01:38:49.531689+0000","last_undegraded":"2023-10-06T01:38:49.531689+0000","last_fullsized":"2023-10-06T01:38:49.531689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:38:23.293524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.512791+0000","last_change":"2023-10-06T01:38:48.657883+0000","last_active":"2023-10-06T01:38:49.512791+0000","last_peered":"2023-10-06T01:38:49.512791+0000","last_clean":"2023-10-06T01:38:49.512791+0000","last_became_active":"2023-10-06T01:38:48.656431+0000","last_became_peered":"2023-10-06T01:38:48.656431+0000","last_unstale":"2023-10-06T01:38:49.512791+0000","last_undegraded":"2023-10-06T01:38:49.512791+0000","last_fullsized":"2023-10-06T01:38:49.512791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:52.982952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.523875+0000","last_change":"2023-10-06T01:38:49.516970+0000","last_active":"2023-10-06T01:38:49.523875+0000","last_peered":"2023-10-06T01:38:49.523875+0000","last_clean":"2023-10-06T01:38:49.523875+0000","last_became_active":"2023-10-06T01:38:49.516721+0000","last_became_peered":"2023-10-06T01:38:49.516721+0000","last_unstale":"2023-10-06T01:38:49.523875+0000","last_undegraded":"2023-10-06T01:38:49.523875+0000","last_fullsized":"2023-10-06T01:38:49.523875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:38:23.293524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.514766+0000","last_change":"2023-10-06T01:38:48.667484+0000","last_active":"2023-10-06T01:38:49.514766+0000","last_peered":"2023-10-06T01:38:49.514766+0000","last_clean":"2023-10-06T01:38:49.514766+0000","last_became_active":"2023-10-06T01:38:48.667215+0000","last_became_peered":"2023-10-06T01:38:48.667215+0000","last_unstale":"2023-10-06T01:38:49.514766+0000","last_undegraded":"2023-10-06T01:38:49.514766+0000","last_fullsized":"2023-10-06T01:38:49.514766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:57:07.898207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526925+0000","last_change":"2023-10-06T01:38:49.523815+0000","last_active":"2023-10-06T01:38:49.526925+0000","last_peered":"2023-10-06T01:38:49.526925+0000","last_clean":"2023-10-06T01:38:49.526925+0000","last_became_active":"2023-10-06T01:38:49.520967+0000","last_became_peered":"2023-10-06T01:38:49.520967+0000","last_unstale":"2023-10-06T01:38:49.526925+0000","last_undegraded":"2023-10-06T01:38:49.526925+0000","last_fullsized":"2023-10-06T01:38:49.526925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:04.188051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.659578+0000","last_change":"2023-10-06T01:38:48.665231+0000","last_active":"2023-10-06T01:38:49.659578+0000","last_peered":"2023-10-06T01:38:49.659578+0000","last_clean":"2023-10-06T01:38:49.659578+0000","last_became_active":"2023-10-06T01:38:48.664910+0000","last_became_peered":"2023-10-06T01:38:48.664910+0000","last_unstale":"2023-10-06T01:38:49.659578+0000","last_undegraded":"2023-10-06T01:38:49.659578+0000","last_fullsized":"2023-10-06T01:38:49.659578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:50.373603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526858+0000","last_change":"2023-10-06T01:38:49.519035+0000","last_active":"2023-10-06T01:38:49.526858+0000","last_peered":"2023-10-06T01:38:49.526858+0000","last_clean":"2023-10-06T01:38:49.526858+0000","last_became_active":"2023-10-06T01:38:49.518788+0000","last_became_peered":"2023-10-06T01:38:49.518788+0000","last_unstale":"2023-10-06T01:38:49.526858+0000","last_undegraded":"2023-10-06T01:38:49.526858+0000","last_fullsized":"2023-10-06T01:38:49.526858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:21.430025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.656778+0000","last_change":"2023-10-06T01:38:48.669414+0000","last_active":"2023-10-06T01:38:49.656778+0000","last_peered":"2023-10-06T01:38:49.656778+0000","last_clean":"2023-10-06T01:38:49.656778+0000","last_became_active":"2023-10-06T01:38:48.669152+0000","last_became_peered":"2023-10-06T01:38:48.669152+0000","last_unstale":"2023-10-06T01:38:49.656778+0000","last_undegraded":"2023-10-06T01:38:49.656778+0000","last_fullsized":"2023-10-06T01:38:49.656778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:31.036573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.523629+0000","last_change":"2023-10-06T01:38:49.515615+0000","last_active":"2023-10-06T01:38:49.523629+0000","last_peered":"2023-10-06T01:38:49.523629+0000","last_clean":"2023-10-06T01:38:49.523629+0000","last_became_active":"2023-10-06T01:38:49.515307+0000","last_became_peered":"2023-10-06T01:38:49.515307+0000","last_unstale":"2023-10-06T01:38:49.523629+0000","last_undegraded":"2023-10-06T01:38:49.523629+0000","last_fullsized":"2023-10-06T01:38:49.523629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:31.040385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.657257+0000","last_change":"2023-10-06T01:38:48.669339+0000","last_active":"2023-10-06T01:38:49.657257+0000","last_peered":"2023-10-06T01:38:49.657257+0000","last_clean":"2023-10-06T01:38:49.657257+0000","last_became_active":"2023-10-06T01:38:48.668855+0000","last_became_peered":"2023-10-06T01:38:48.668855+0000","last_unstale":"2023-10-06T01:38:49.657257+0000","last_undegraded":"2023-10-06T01:38:49.657257+0000","last_fullsized":"2023-10-06T01:38:49.657257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:33.441697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533008+0000","last_change":"2023-10-06T01:38:49.528804+0000","last_active":"2023-10-06T01:38:49.533008+0000","last_peered":"2023-10-06T01:38:49.533008+0000","last_clean":"2023-10-06T01:38:49.533008+0000","last_became_active":"2023-10-06T01:38:49.528188+0000","last_became_peered":"2023-10-06T01:38:49.528188+0000","last_unstale":"2023-10-06T01:38:49.533008+0000","last_undegraded":"2023-10-06T01:38:49.533008+0000","last_fullsized":"2023-10-06T01:38:49.533008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:42.707474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.656825+0000","last_change":"2023-10-06T01:38:48.662704+0000","last_active":"2023-10-06T01:38:49.656825+0000","last_peered":"2023-10-06T01:38:49.656825+0000","last_clean":"2023-10-06T01:38:49.656825+0000","last_became_active":"2023-10-06T01:38:48.662445+0000","last_became_peered":"2023-10-06T01:38:48.662445+0000","last_unstale":"2023-10-06T01:38:49.656825+0000","last_undegraded":"2023-10-06T01:38:49.656825+0000","last_fullsized":"2023-10-06T01:38:49.656825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:21:02.893859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.529784+0000","last_change":"2023-10-06T01:38:49.524878+0000","last_active":"2023-10-06T01:38:49.529784+0000","last_peered":"2023-10-06T01:38:49.529784+0000","last_clean":"2023-10-06T01:38:49.529784+0000","last_became_active":"2023-10-06T01:38:49.524606+0000","last_became_peered":"2023-10-06T01:38:49.524606+0000","last_unstale":"2023-10-06T01:38:49.529784+0000","last_undegraded":"2023-10-06T01:38:49.529784+0000","last_fullsized":"2023-10-06T01:38:49.529784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:32.038338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.513006+0000","last_change":"2023-10-06T01:38:48.669114+0000","last_active":"2023-10-06T01:38:49.513006+0000","last_peered":"2023-10-06T01:38:49.513006+0000","last_clean":"2023-10-06T01:38:49.513006+0000","last_became_active":"2023-10-06T01:38:48.668855+0000","last_became_peered":"2023-10-06T01:38:48.668855+0000","last_unstale":"2023-10-06T01:38:49.513006+0000","last_undegraded":"2023-10-06T01:38:49.513006+0000","last_fullsized":"2023-10-06T01:38:49.513006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:04.233408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524798+0000","last_change":"2023-10-06T01:38:49.521828+0000","last_active":"2023-10-06T01:38:49.524798+0000","last_peered":"2023-10-06T01:38:49.524798+0000","last_clean":"2023-10-06T01:38:49.524798+0000","last_became_active":"2023-10-06T01:38:49.521245+0000","last_became_peered":"2023-10-06T01:38:49.521245+0000","last_unstale":"2023-10-06T01:38:49.524798+0000","last_undegraded":"2023-10-06T01:38:49.524798+0000","last_fullsized":"2023-10-06T01:38:49.524798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:22.814342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.654286+0000","last_change":"2023-10-06T01:38:48.665908+0000","last_active":"2023-10-06T01:38:49.654286+0000","last_peered":"2023-10-06T01:38:49.654286+0000","last_clean":"2023-10-06T01:38:49.654286+0000","last_became_active":"2023-10-06T01:38:48.665663+0000","last_became_peered":"2023-10-06T01:38:48.665663+0000","last_unstale":"2023-10-06T01:38:49.654286+0000","last_undegraded":"2023-10-06T01:38:49.654286+0000","last_fullsized":"2023-10-06T01:38:49.654286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:04.233408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533179+0000","last_change":"2023-10-06T01:38:49.532282+0000","last_active":"2023-10-06T01:38:49.533179+0000","last_peered":"2023-10-06T01:38:49.533179+0000","last_clean":"2023-10-06T01:38:49.533179+0000","last_became_active":"2023-10-06T01:38:49.532000+0000","last_became_peered":"2023-10-06T01:38:49.532000+0000","last_unstale":"2023-10-06T01:38:49.533179+0000","last_undegraded":"2023-10-06T01:38:49.533179+0000","last_fullsized":"2023-10-06T01:38:49.533179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:43.950553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.517541+0000","last_change":"2023-10-06T01:38:48.668151+0000","last_active":"2023-10-06T01:38:49.517541+0000","last_peered":"2023-10-06T01:38:49.517541+0000","last_clean":"2023-10-06T01:38:49.517541+0000","last_became_active":"2023-10-06T01:38:48.667870+0000","last_became_peered":"2023-10-06T01:38:48.667870+0000","last_unstale":"2023-10-06T01:38:49.517541+0000","last_undegraded":"2023-10-06T01:38:49.517541+0000","last_fullsized":"2023-10-06T01:38:49.517541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:07:41.517375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532859+0000","last_change":"2023-10-06T01:38:49.528292+0000","last_active":"2023-10-06T01:38:49.532859+0000","last_peered":"2023-10-06T01:38:49.532859+0000","last_clean":"2023-10-06T01:38:49.532859+0000","last_became_active":"2023-10-06T01:38:49.527980+0000","last_became_peered":"2023-10-06T01:38:49.527980+0000","last_unstale":"2023-10-06T01:38:49.532859+0000","last_undegraded":"2023-10-06T01:38:49.532859+0000","last_fullsized":"2023-10-06T01:38:49.532859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:24.795745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.521291+0000","last_change":"2023-10-06T01:38:48.659921+0000","last_active":"2023-10-06T01:38:49.521291+0000","last_peered":"2023-10-06T01:38:49.521291+0000","last_clean":"2023-10-06T01:38:49.521291+0000","last_became_active":"2023-10-06T01:38:48.659640+0000","last_became_peered":"2023-10-06T01:38:48.659640+0000","last_unstale":"2023-10-06T01:38:49.521291+0000","last_undegraded":"2023-10-06T01:38:49.521291+0000","last_fullsized":"2023-10-06T01:38:49.521291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:03.937447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533026+0000","last_change":"2023-10-06T01:38:49.528830+0000","last_active":"2023-10-06T01:38:49.533026+0000","last_peered":"2023-10-06T01:38:49.533026+0000","last_clean":"2023-10-06T01:38:49.533026+0000","last_became_active":"2023-10-06T01:38:49.528523+0000","last_became_peered":"2023-10-06T01:38:49.528523+0000","last_unstale":"2023-10-06T01:38:49.533026+0000","last_undegraded":"2023-10-06T01:38:49.533026+0000","last_fullsized":"2023-10-06T01:38:49.533026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:04.188051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.508523+0000","last_change":"2023-10-06T01:38:48.661605+0000","last_active":"2023-10-06T01:38:49.508523+0000","last_peered":"2023-10-06T01:38:49.508523+0000","last_clean":"2023-10-06T01:38:49.508523+0000","last_became_active":"2023-10-06T01:38:48.661424+0000","last_became_peered":"2023-10-06T01:38:48.661424+0000","last_unstale":"2023-10-06T01:38:49.508523+0000","last_undegraded":"2023-10-06T01:38:49.508523+0000","last_fullsized":"2023-10-06T01:38:49.508523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:34.288288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526228+0000","last_change":"2023-10-06T01:38:49.524678+0000","last_active":"2023-10-06T01:38:49.526228+0000","last_peered":"2023-10-06T01:38:49.526228+0000","last_clean":"2023-10-06T01:38:49.526228+0000","last_became_active":"2023-10-06T01:38:49.522598+0000","last_became_peered":"2023-10-06T01:38:49.522598+0000","last_unstale":"2023-10-06T01:38:49.526228+0000","last_undegraded":"2023-10-06T01:38:49.526228+0000","last_fullsized":"2023-10-06T01:38:49.526228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515842+0000","last_change":"2023-10-06T01:38:44.533111+0000","last_active":"2023-10-06T01:38:49.515842+0000","last_peered":"2023-10-06T01:38:49.515842+0000","last_clean":"2023-10-06T01:38:49.515842+0000","last_became_active":"2023-10-06T01:38:44.532838+0000","last_became_peered":"2023-10-06T01:38:44.532838+0000","last_unstale":"2023-10-06T01:38:49.515842+0000","last_undegraded":"2023-10-06T01:38:49.515842+0000","last_fullsized":"2023-10-06T01:38:49.515842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.513492+0000","last_change":"2023-10-06T01:38:48.666716+0000","last_active":"2023-10-06T01:38:49.513492+0000","last_peered":"2023-10-06T01:38:49.513492+0000","last_clean":"2023-10-06T01:38:49.513492+0000","last_became_active":"2023-10-06T01:38:48.666431+0000","last_became_peered":"2023-10-06T01:38:48.666431+0000","last_unstale":"2023-10-06T01:38:49.513492+0000","last_undegraded":"2023-10-06T01:38:49.513492+0000","last_fullsized":"2023-10-06T01:38:49.513492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:33.441697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526310+0000","last_change":"2023-10-06T01:38:49.524629+0000","last_active":"2023-10-06T01:38:49.526310+0000","last_peered":"2023-10-06T01:38:49.526310+0000","last_clean":"2023-10-06T01:38:49.526310+0000","last_became_active":"2023-10-06T01:38:49.524372+0000","last_became_peered":"2023-10-06T01:38:49.524372+0000","last_unstale":"2023-10-06T01:38:49.526310+0000","last_undegraded":"2023-10-06T01:38:49.526310+0000","last_fullsized":"2023-10-06T01:38:49.526310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:22.814342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.512226+0000","last_change":"2023-10-06T01:38:44.533897+0000","last_active":"2023-10-06T01:38:49.512226+0000","last_peered":"2023-10-06T01:38:49.512226+0000","last_clean":"2023-10-06T01:38:49.512226+0000","last_became_active":"2023-10-06T01:38:44.533611+0000","last_became_peered":"2023-10-06T01:38:44.533611+0000","last_unstale":"2023-10-06T01:38:49.512226+0000","last_undegraded":"2023-10-06T01:38:49.512226+0000","last_fullsized":"2023-10-06T01:38:49.512226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:24.411408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.520109+0000","last_change":"2023-10-06T01:38:48.666784+0000","last_active":"2023-10-06T01:38:49.520109+0000","last_peered":"2023-10-06T01:38:49.520109+0000","last_clean":"2023-10-06T01:38:49.520109+0000","last_became_active":"2023-10-06T01:38:48.666228+0000","last_became_peered":"2023-10-06T01:38:48.666228+0000","last_unstale":"2023-10-06T01:38:49.520109+0000","last_undegraded":"2023-10-06T01:38:49.520109+0000","last_fullsized":"2023-10-06T01:38:49.520109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:34.288288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526238+0000","last_change":"2023-10-06T01:38:49.520640+0000","last_active":"2023-10-06T01:38:49.526238+0000","last_peered":"2023-10-06T01:38:49.526238+0000","last_clean":"2023-10-06T01:38:49.526238+0000","last_became_active":"2023-10-06T01:38:49.520050+0000","last_became_peered":"2023-10-06T01:38:49.520050+0000","last_unstale":"2023-10-06T01:38:49.526238+0000","last_undegraded":"2023-10-06T01:38:49.526238+0000","last_fullsized":"2023-10-06T01:38:49.526238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:27.494951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.513741+0000","last_change":"2023-10-06T01:38:45.307814+0000","last_active":"2023-10-06T01:38:49.513741+0000","last_peered":"2023-10-06T01:38:49.513741+0000","last_clean":"2023-10-06T01:38:49.513741+0000","last_became_active":"2023-10-06T01:38:45.307536+0000","last_became_peered":"2023-10-06T01:38:45.307536+0000","last_unstale":"2023-10-06T01:38:49.513741+0000","last_undegraded":"2023-10-06T01:38:49.513741+0000","last_fullsized":"2023-10-06T01:38:49.513741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:09.503713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515587+0000","last_change":"2023-10-06T01:38:48.656055+0000","last_active":"2023-10-06T01:38:49.515587+0000","last_peered":"2023-10-06T01:38:49.515587+0000","last_clean":"2023-10-06T01:38:49.515587+0000","last_became_active":"2023-10-06T01:38:48.655769+0000","last_became_peered":"2023-10-06T01:38:48.655769+0000","last_unstale":"2023-10-06T01:38:49.515587+0000","last_undegraded":"2023-10-06T01:38:49.515587+0000","last_fullsized":"2023-10-06T01:38:49.515587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:34.288288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527622+0000","last_change":"2023-10-06T01:38:49.524773+0000","last_active":"2023-10-06T01:38:49.527622+0000","last_peered":"2023-10-06T01:38:49.527622+0000","last_clean":"2023-10-06T01:38:49.527622+0000","last_became_active":"2023-10-06T01:38:49.524515+0000","last_became_peered":"2023-10-06T01:38:49.524515+0000","last_unstale":"2023-10-06T01:38:49.527622+0000","last_undegraded":"2023-10-06T01:38:49.527622+0000","last_fullsized":"2023-10-06T01:38:49.527622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:57.306692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.512742+0000","last_change":"2023-10-06T01:38:44.534507+0000","last_active":"2023-10-06T01:38:49.512742+0000","last_peered":"2023-10-06T01:38:49.512742+0000","last_clean":"2023-10-06T01:38:49.512742+0000","last_became_active":"2023-10-06T01:38:44.534191+0000","last_became_peered":"2023-10-06T01:38:44.534191+0000","last_unstale":"2023-10-06T01:38:49.512742+0000","last_undegraded":"2023-10-06T01:38:49.512742+0000","last_fullsized":"2023-10-06T01:38:49.512742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.514777+0000","last_change":"2023-10-06T01:38:40.115117+0000","last_active":"2023-10-06T01:38:49.514777+0000","last_peered":"2023-10-06T01:38:49.514777+0000","last_clean":"2023-10-06T01:38:49.514777+0000","last_became_active":"2023-10-06T01:38:40.114142+0000","last_became_peered":"2023-10-06T01:38:40.114142+0000","last_unstale":"2023-10-06T01:38:49.514777+0000","last_undegraded":"2023-10-06T01:38:49.514777+0000","last_fullsized":"2023-10-06T01:38:49.514777+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_clean_scrub_stamp":"2023-10-06T01:38:38.338797+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:52.870262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.508643+0000","last_change":"2023-10-06T01:38:48.663223+0000","last_active":"2023-10-06T01:38:49.508643+0000","last_peered":"2023-10-06T01:38:49.508643+0000","last_clean":"2023-10-06T01:38:49.508643+0000","last_became_active":"2023-10-06T01:38:48.662956+0000","last_became_peered":"2023-10-06T01:38:48.662956+0000","last_unstale":"2023-10-06T01:38:49.508643+0000","last_undegraded":"2023-10-06T01:38:49.508643+0000","last_fullsized":"2023-10-06T01:38:49.508643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:54.859831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531599+0000","last_change":"2023-10-06T01:38:49.530401+0000","last_active":"2023-10-06T01:38:49.531599+0000","last_peered":"2023-10-06T01:38:49.531599+0000","last_clean":"2023-10-06T01:38:49.531599+0000","last_became_active":"2023-10-06T01:38:49.530107+0000","last_became_peered":"2023-10-06T01:38:49.530107+0000","last_unstale":"2023-10-06T01:38:49.531599+0000","last_undegraded":"2023-10-06T01:38:49.531599+0000","last_fullsized":"2023-10-06T01:38:49.531599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:12.827603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515221+0000","last_change":"2023-10-06T01:38:44.531831+0000","last_active":"2023-10-06T01:38:49.515221+0000","last_peered":"2023-10-06T01:38:49.515221+0000","last_clean":"2023-10-06T01:38:49.515221+0000","last_became_active":"2023-10-06T01:38:44.531496+0000","last_became_peered":"2023-10-06T01:38:44.531496+0000","last_unstale":"2023-10-06T01:38:49.515221+0000","last_undegraded":"2023-10-06T01:38:49.515221+0000","last_fullsized":"2023-10-06T01:38:49.515221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:28.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.512340+0000","last_change":"2023-10-06T01:38:48.667413+0000","last_active":"2023-10-06T01:38:49.512340+0000","last_peered":"2023-10-06T01:38:49.512340+0000","last_clean":"2023-10-06T01:38:49.512340+0000","last_became_active":"2023-10-06T01:38:48.667114+0000","last_became_peered":"2023-10-06T01:38:48.667114+0000","last_unstale":"2023-10-06T01:38:49.512340+0000","last_undegraded":"2023-10-06T01:38:49.512340+0000","last_fullsized":"2023-10-06T01:38:49.512340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:03.937447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531783+0000","last_change":"2023-10-06T01:38:49.524239+0000","last_active":"2023-10-06T01:38:49.531783+0000","last_peered":"2023-10-06T01:38:49.531783+0000","last_clean":"2023-10-06T01:38:49.531783+0000","last_became_active":"2023-10-06T01:38:49.523994+0000","last_became_peered":"2023-10-06T01:38:49.523994+0000","last_unstale":"2023-10-06T01:38:49.531783+0000","last_undegraded":"2023-10-06T01:38:49.531783+0000","last_fullsized":"2023-10-06T01:38:49.531783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:31:19.856103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515175+0000","last_change":"2023-10-06T01:38:44.531335+0000","last_active":"2023-10-06T01:38:49.515175+0000","last_peered":"2023-10-06T01:38:49.515175+0000","last_clean":"2023-10-06T01:38:49.515175+0000","last_became_active":"2023-10-06T01:38:44.530966+0000","last_became_peered":"2023-10-06T01:38:44.530966+0000","last_unstale":"2023-10-06T01:38:49.515175+0000","last_undegraded":"2023-10-06T01:38:49.515175+0000","last_fullsized":"2023-10-06T01:38:49.515175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:33.926180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515942+0000","last_change":"2023-10-06T01:38:48.660438+0000","last_active":"2023-10-06T01:38:49.515942+0000","last_peered":"2023-10-06T01:38:49.515942+0000","last_clean":"2023-10-06T01:38:49.515942+0000","last_became_active":"2023-10-06T01:38:48.660222+0000","last_became_peered":"2023-10-06T01:38:48.660222+0000","last_unstale":"2023-10-06T01:38:49.515942+0000","last_undegraded":"2023-10-06T01:38:49.515942+0000","last_fullsized":"2023-10-06T01:38:49.515942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:03.937447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524781+0000","last_change":"2023-10-06T01:38:49.517014+0000","last_active":"2023-10-06T01:38:49.524781+0000","last_peered":"2023-10-06T01:38:49.524781+0000","last_clean":"2023-10-06T01:38:49.524781+0000","last_became_active":"2023-10-06T01:38:49.516679+0000","last_became_peered":"2023-10-06T01:38:49.516679+0000","last_unstale":"2023-10-06T01:38:49.524781+0000","last_undegraded":"2023-10-06T01:38:49.524781+0000","last_fullsized":"2023-10-06T01:38:49.524781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:38:23.293524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.658035+0000","last_change":"2023-10-06T01:38:48.663372+0000","last_active":"2023-10-06T01:38:49.658035+0000","last_peered":"2023-10-06T01:38:49.658035+0000","last_clean":"2023-10-06T01:38:49.658035+0000","last_became_active":"2023-10-06T01:38:48.663074+0000","last_became_peered":"2023-10-06T01:38:48.663074+0000","last_unstale":"2023-10-06T01:38:49.658035+0000","last_undegraded":"2023-10-06T01:38:49.658035+0000","last_fullsized":"2023-10-06T01:38:49.658035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:09.299545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.516315+0000","last_change":"2023-10-06T01:38:44.533582+0000","last_active":"2023-10-06T01:38:49.516315+0000","last_peered":"2023-10-06T01:38:49.516315+0000","last_clean":"2023-10-06T01:38:49.516315+0000","last_became_active":"2023-10-06T01:38:44.533324+0000","last_became_peered":"2023-10-06T01:38:44.533324+0000","last_unstale":"2023-10-06T01:38:49.516315+0000","last_undegraded":"2023-10-06T01:38:49.516315+0000","last_fullsized":"2023-10-06T01:38:49.516315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.519956+0000","last_change":"2023-10-06T01:38:49.516429+0000","last_active":"2023-10-06T01:38:49.519956+0000","last_peered":"2023-10-06T01:38:49.519956+0000","last_clean":"2023-10-06T01:38:49.519956+0000","last_became_active":"2023-10-06T01:38:49.515639+0000","last_became_peered":"2023-10-06T01:38:49.515639+0000","last_unstale":"2023-10-06T01:38:49.519956+0000","last_undegraded":"2023-10-06T01:38:49.519956+0000","last_fullsized":"2023-10-06T01:38:49.519956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:22.814342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.516330+0000","last_change":"2023-10-06T01:38:44.533765+0000","last_active":"2023-10-06T01:38:49.516330+0000","last_peered":"2023-10-06T01:38:49.516330+0000","last_clean":"2023-10-06T01:38:49.516330+0000","last_became_active":"2023-10-06T01:38:44.533406+0000","last_became_peered":"2023-10-06T01:38:44.533406+0000","last_unstale":"2023-10-06T01:38:49.516330+0000","last_undegraded":"2023-10-06T01:38:49.516330+0000","last_fullsized":"2023-10-06T01:38:49.516330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.512682+0000","last_change":"2023-10-06T01:38:48.659164+0000","last_active":"2023-10-06T01:38:49.512682+0000","last_peered":"2023-10-06T01:38:49.512682+0000","last_clean":"2023-10-06T01:38:49.512682+0000","last_became_active":"2023-10-06T01:38:48.658890+0000","last_became_peered":"2023-10-06T01:38:48.658890+0000","last_unstale":"2023-10-06T01:38:49.512682+0000","last_undegraded":"2023-10-06T01:38:49.512682+0000","last_fullsized":"2023-10-06T01:38:49.512682+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:34.288288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533074+0000","last_change":"2023-10-06T01:38:49.529282+0000","last_active":"2023-10-06T01:38:49.533074+0000","last_peered":"2023-10-06T01:38:49.533074+0000","last_clean":"2023-10-06T01:38:49.533074+0000","last_became_active":"2023-10-06T01:38:49.528544+0000","last_became_peered":"2023-10-06T01:38:49.528544+0000","last_unstale":"2023-10-06T01:38:49.533074+0000","last_undegraded":"2023-10-06T01:38:49.533074+0000","last_fullsized":"2023-10-06T01:38:49.533074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:21.430025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.656041+0000","last_change":"2023-10-06T01:38:48.668953+0000","last_active":"2023-10-06T01:38:49.656041+0000","last_peered":"2023-10-06T01:38:49.656041+0000","last_clean":"2023-10-06T01:38:49.656041+0000","last_became_active":"2023-10-06T01:38:48.668711+0000","last_became_peered":"2023-10-06T01:38:48.668711+0000","last_unstale":"2023-10-06T01:38:49.656041+0000","last_undegraded":"2023-10-06T01:38:49.656041+0000","last_fullsized":"2023-10-06T01:38:49.656041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:07:41.517375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527535+0000","last_change":"2023-10-06T01:38:49.523156+0000","last_active":"2023-10-06T01:38:49.527535+0000","last_peered":"2023-10-06T01:38:49.527535+0000","last_clean":"2023-10-06T01:38:49.527535+0000","last_became_active":"2023-10-06T01:38:49.522238+0000","last_became_peered":"2023-10-06T01:38:49.522238+0000","last_unstale":"2023-10-06T01:38:49.527535+0000","last_undegraded":"2023-10-06T01:38:49.527535+0000","last_fullsized":"2023-10-06T01:38:49.527535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:53.984718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.657984+0000","last_change":"2023-10-06T01:38:48.669432+0000","last_active":"2023-10-06T01:38:49.657984+0000","last_peered":"2023-10-06T01:38:49.657984+0000","last_clean":"2023-10-06T01:38:49.657984+0000","last_became_active":"2023-10-06T01:38:48.669170+0000","last_became_peered":"2023-10-06T01:38:48.669170+0000","last_unstale":"2023-10-06T01:38:49.657984+0000","last_undegraded":"2023-10-06T01:38:49.657984+0000","last_fullsized":"2023-10-06T01:38:49.657984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:31.036573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533202+0000","last_change":"2023-10-06T01:38:49.532440+0000","last_active":"2023-10-06T01:38:49.533202+0000","last_peered":"2023-10-06T01:38:49.533202+0000","last_clean":"2023-10-06T01:38:49.533202+0000","last_became_active":"2023-10-06T01:38:49.532184+0000","last_became_peered":"2023-10-06T01:38:49.532184+0000","last_unstale":"2023-10-06T01:38:49.533202+0000","last_undegraded":"2023-10-06T01:38:49.533202+0000","last_fullsized":"2023-10-06T01:38:49.533202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:57.688866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.657725+0000","last_change":"2023-10-06T01:38:48.668877+0000","last_active":"2023-10-06T01:38:49.657725+0000","last_peered":"2023-10-06T01:38:49.657725+0000","last_clean":"2023-10-06T01:38:49.657725+0000","last_became_active":"2023-10-06T01:38:48.668564+0000","last_became_peered":"2023-10-06T01:38:48.668564+0000","last_unstale":"2023-10-06T01:38:49.657725+0000","last_undegraded":"2023-10-06T01:38:49.657725+0000","last_fullsized":"2023-10-06T01:38:49.657725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:54.859831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533193+0000","last_change":"2023-10-06T01:38:49.532416+0000","last_active":"2023-10-06T01:38:49.533193+0000","last_peered":"2023-10-06T01:38:49.533193+0000","last_clean":"2023-10-06T01:38:49.533193+0000","last_became_active":"2023-10-06T01:38:49.532101+0000","last_became_peered":"2023-10-06T01:38:49.532101+0000","last_unstale":"2023-10-06T01:38:49.533193+0000","last_undegraded":"2023-10-06T01:38:49.533193+0000","last_fullsized":"2023-10-06T01:38:49.533193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.654641+0000","last_change":"2023-10-06T01:38:48.665065+0000","last_active":"2023-10-06T01:38:49.654641+0000","last_peered":"2023-10-06T01:38:49.654641+0000","last_clean":"2023-10-06T01:38:49.654641+0000","last_became_active":"2023-10-06T01:38:48.664769+0000","last_became_peered":"2023-10-06T01:38:48.664769+0000","last_unstale":"2023-10-06T01:38:49.654641+0000","last_undegraded":"2023-10-06T01:38:49.654641+0000","last_fullsized":"2023-10-06T01:38:49.654641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:33.441697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526916+0000","last_change":"2023-10-06T01:38:49.518384+0000","last_active":"2023-10-06T01:38:49.526916+0000","last_peered":"2023-10-06T01:38:49.526916+0000","last_clean":"2023-10-06T01:38:49.526916+0000","last_became_active":"2023-10-06T01:38:49.518100+0000","last_became_peered":"2023-10-06T01:38:49.518100+0000","last_unstale":"2023-10-06T01:38:49.526916+0000","last_undegraded":"2023-10-06T01:38:49.526916+0000","last_fullsized":"2023-10-06T01:38:49.526916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:57.494182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.655794+0000","last_change":"2023-10-06T01:38:48.662504+0000","last_active":"2023-10-06T01:38:49.655794+0000","last_peered":"2023-10-06T01:38:49.655794+0000","last_clean":"2023-10-06T01:38:49.655794+0000","last_became_active":"2023-10-06T01:38:48.662220+0000","last_became_peered":"2023-10-06T01:38:48.662220+0000","last_unstale":"2023-10-06T01:38:49.655794+0000","last_undegraded":"2023-10-06T01:38:49.655794+0000","last_fullsized":"2023-10-06T01:38:49.655794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:54.859831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533135+0000","last_change":"2023-10-06T01:38:49.531208+0000","last_active":"2023-10-06T01:38:49.533135+0000","last_peered":"2023-10-06T01:38:49.533135+0000","last_clean":"2023-10-06T01:38:49.533135+0000","last_became_active":"2023-10-06T01:38:49.530797+0000","last_became_peered":"2023-10-06T01:38:49.530797+0000","last_unstale":"2023-10-06T01:38:49.533135+0000","last_undegraded":"2023-10-06T01:38:49.533135+0000","last_fullsized":"2023-10-06T01:38:49.533135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:57.494182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527811+0000","last_change":"2023-10-06T01:38:49.521503+0000","last_active":"2023-10-06T01:38:49.527811+0000","last_peered":"2023-10-06T01:38:49.527811+0000","last_clean":"2023-10-06T01:38:49.527811+0000","last_became_active":"2023-10-06T01:38:49.521219+0000","last_became_peered":"2023-10-06T01:38:49.521219+0000","last_unstale":"2023-10-06T01:38:49.527811+0000","last_undegraded":"2023-10-06T01:38:49.527811+0000","last_fullsized":"2023-10-06T01:38:49.527811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:34.443462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531744+0000","last_change":"2023-10-06T01:38:49.522310+0000","last_active":"2023-10-06T01:38:49.531744+0000","last_peered":"2023-10-06T01:38:49.531744+0000","last_clean":"2023-10-06T01:38:49.531744+0000","last_became_active":"2023-10-06T01:38:49.522062+0000","last_became_peered":"2023-10-06T01:38:49.522062+0000","last_unstale":"2023-10-06T01:38:49.531744+0000","last_undegraded":"2023-10-06T01:38:49.531744+0000","last_fullsized":"2023-10-06T01:38:49.531744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:04.188051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532797+0000","last_change":"2023-10-06T01:38:49.527987+0000","last_active":"2023-10-06T01:38:49.532797+0000","last_peered":"2023-10-06T01:38:49.532797+0000","last_clean":"2023-10-06T01:38:49.532797+0000","last_became_active":"2023-10-06T01:38:49.527716+0000","last_became_peered":"2023-10-06T01:38:49.527716+0000","last_unstale":"2023-10-06T01:38:49.532797+0000","last_undegraded":"2023-10-06T01:38:49.532797+0000","last_fullsized":"2023-10-06T01:38:49.532797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:11.839303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526877+0000","last_change":"2023-10-06T01:38:49.519300+0000","last_active":"2023-10-06T01:38:49.526877+0000","last_peered":"2023-10-06T01:38:49.526877+0000","last_clean":"2023-10-06T01:38:49.526877+0000","last_became_active":"2023-10-06T01:38:49.519069+0000","last_became_peered":"2023-10-06T01:38:49.519069+0000","last_unstale":"2023-10-06T01:38:49.526877+0000","last_undegraded":"2023-10-06T01:38:49.526877+0000","last_fullsized":"2023-10-06T01:38:49.526877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:04.140534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527983+0000","last_change":"2023-10-06T01:38:49.526134+0000","last_active":"2023-10-06T01:38:49.527983+0000","last_peered":"2023-10-06T01:38:49.527983+0000","last_clean":"2023-10-06T01:38:49.527983+0000","last_became_active":"2023-10-06T01:38:49.524965+0000","last_became_peered":"2023-10-06T01:38:49.524965+0000","last_unstale":"2023-10-06T01:38:49.527983+0000","last_undegraded":"2023-10-06T01:38:49.527983+0000","last_fullsized":"2023-10-06T01:38:49.527983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:27.359068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":876544,"data_stored":686098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47899999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298120,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073720,"statfs":{"total":96636764160,"available":96331489280,"internally_reserved":0,"allocated":851968,"data_stored":684900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.499}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.373}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36099999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297540,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074300,"statfs":{"total":96636764160,"available":96332083200,"internally_reserved":0,"allocated":258048,"data_stored":94068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":95570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61499999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":94602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.312}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:38:55.643 INFO:tasks.ceph.mds.b.smithi088.stderr:2023-10-06T01:38:55.642+0000 7f54e96be700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T01:38:58.214 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:38:58.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.341+0000 7fe80b222700 1 Processor -- start 2023-10-06T01:38:58.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.341+0000 7fe80b222700 1 -- start start 2023-10-06T01:38:58.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.341+0000 7fe80b222700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe8040cb5a0 0x7fe8040cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:58.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.341+0000 7fe80b222700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe80415a5d0 0x7fe804156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:58.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.341+0000 7fe80b222700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe80415ae40 con 0x7fe8040cd9e0 2023-10-06T01:38:58.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.341+0000 7fe80b222700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8040d13f0 con 0x7fe8040cb5a0 2023-10-06T01:38:58.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.341+0000 7fe80b222700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe80415ab60 con 0x7fe80415a5d0 2023-10-06T01:38:58.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.342+0000 7fe808fbe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe8040cb5a0 0x7fe8040cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:58.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.342+0000 7fe808fbe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe8040cb5a0 0x7fe8040cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56656/0 (socket says 172.21.15.69:56656) 2023-10-06T01:38:58.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.342+0000 7fe808fbe700 1 -- 172.21.15.69:0/3788754965 learned_addr learned my addr 172.21.15.69:0/3788754965 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:58.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.342+0000 7fe8097bf700 1 --2- 172.21.15.69:0/3788754965 >> v2:172.21.15.88:3300/0 conn(0x7fe80415a5d0 0x7fe804156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:58.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.342+0000 7fe808fbe700 1 -- 172.21.15.69:0/3788754965 >> v2:172.21.15.88:3300/0 conn(0x7fe80415a5d0 msgr2=0x7fe804156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:58.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.342+0000 7fe808fbe700 1 --2- 172.21.15.69:0/3788754965 >> v2:172.21.15.88:3300/0 conn(0x7fe80415a5d0 0x7fe804156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:58.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.342+0000 7fe808fbe700 1 -- 172.21.15.69:0/3788754965 >> v1:172.21.15.88:6789/0 conn(0x7fe8040cd9e0 legacy=0x7fe804159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:58.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.342+0000 7fe808fbe700 1 -- 172.21.15.69:0/3788754965 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8040ccf00 con 0x7fe8040cb5a0 2023-10-06T01:38:58.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.342+0000 7fe8097bf700 1 --2- 172.21.15.69:0/3788754965 >> v2:172.21.15.88:3300/0 conn(0x7fe80415a5d0 0x7fe804156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:38:58.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.342+0000 7fe808fbe700 1 --2- 172.21.15.69:0/3788754965 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8040cb5a0 0x7fe8040cb970 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe800009f20 tx=0x7fe800009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bea9f24e143b70c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:58.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.342+0000 7fe7fb7fe700 1 -- 172.21.15.69:0/3788754965 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80000e070 con 0x7fe8040cb5a0 2023-10-06T01:38:58.346 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.342+0000 7fe7fb7fe700 1 -- 172.21.15.69:0/3788754965 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80000ba00 con 0x7fe8040cb5a0 2023-10-06T01:38:58.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.342+0000 7fe7fb7fe700 1 -- 172.21.15.69:0/3788754965 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8000092e0 con 0x7fe8040cb5a0 2023-10-06T01:38:58.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.343+0000 7fe80b222700 1 -- 172.21.15.69:0/3788754965 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8040cb5a0 msgr2=0x7fe8040cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:58.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.343+0000 7fe80b222700 1 --2- 172.21.15.69:0/3788754965 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8040cb5a0 0x7fe8040cb970 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe800009f20 tx=0x7fe800009840 comp rx=0 tx=0).stop 2023-10-06T01:38:58.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.343+0000 7fe80b222700 1 -- 172.21.15.69:0/3788754965 shutdown_connections 2023-10-06T01:38:58.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.343+0000 7fe80b222700 1 --2- 172.21.15.69:0/3788754965 >> v2:172.21.15.88:3300/0 conn(0x7fe80415a5d0 0x7fe804156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:58.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.343+0000 7fe80b222700 1 --2- 172.21.15.69:0/3788754965 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8040cb5a0 0x7fe8040cb970 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:58.347 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.343+0000 7fe80b222700 1 -- 172.21.15.69:0/3788754965 >> 172.21.15.69:0/3788754965 conn(0x7fe804070e30 msgr2=0x7fe8040d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:58.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.343+0000 7fe80b222700 1 -- 172.21.15.69:0/3788754965 shutdown_connections 2023-10-06T01:38:58.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.343+0000 7fe80b222700 1 -- 172.21.15.69:0/3788754965 wait complete. 2023-10-06T01:38:58.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.344+0000 7fe80b222700 1 Processor -- start 2023-10-06T01:38:58.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.344+0000 7fe80b222700 1 -- start start 2023-10-06T01:38:58.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.345+0000 7fe80b222700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8040cb5a0 0x7fe804157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:58.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.345+0000 7fe80b222700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8040cd9e0 0x7fe8040ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:58.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.345+0000 7fe80b222700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe80415a5d0 0x7fe8040c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:58.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.345+0000 7fe80b222700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8040c9d70 con 0x7fe8040cd9e0 2023-10-06T01:38:58.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.345+0000 7fe80b222700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe804157c00 con 0x7fe8040cb5a0 2023-10-06T01:38:58.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.345+0000 7fe80b222700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8040c9720 con 0x7fe80415a5d0 2023-10-06T01:38:58.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.345+0000 7fe7fbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8040cd9e0 0x7fe8040ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:58.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.345+0000 7fe7fbfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8040cd9e0 0x7fe8040ca170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56672/0 (socket says 172.21.15.69:56672) 2023-10-06T01:38:58.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.345+0000 7fe7fbfff700 1 -- 172.21.15.69:0/2103659897 learned_addr learned my addr 172.21.15.69:0/2103659897 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:58.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.345+0000 7fe808fbe700 1 --2- 172.21.15.69:0/2103659897 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8040cb5a0 0x7fe804157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:58.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.345+0000 7fe8097bf700 1 --2- 172.21.15.69:0/2103659897 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe80415a5d0 0x7fe8040c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:58.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.345+0000 7fe7fbfff700 1 -- 172.21.15.69:0/2103659897 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe80415a5d0 msgr2=0x7fe8040c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:58.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.345+0000 7fe7fbfff700 1 --2- 172.21.15.69:0/2103659897 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe80415a5d0 0x7fe8040c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:58.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.345+0000 7fe7fbfff700 1 -- 172.21.15.69:0/2103659897 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8040cb5a0 msgr2=0x7fe804157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:58.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.345+0000 7fe7fbfff700 1 --2- 172.21.15.69:0/2103659897 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8040cb5a0 0x7fe804157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:58.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.345+0000 7fe7fbfff700 1 -- 172.21.15.69:0/2103659897 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe800009ae0 con 0x7fe8040cd9e0 2023-10-06T01:38:58.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.345+0000 7fe8097bf700 1 --2- 172.21.15.69:0/2103659897 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe80415a5d0 0x7fe8040c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:38:58.352 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.345+0000 7fe7fbfff700 1 --2- 172.21.15.69:0/2103659897 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8040cd9e0 0x7fe8040ca170 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe7f400c5d0 tx=0x7fe7f4007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:58.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.345+0000 7fe7f8ff9700 1 -- 172.21.15.69:0/2103659897 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4011590 con 0x7fe8040cd9e0 2023-10-06T01:38:58.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.345+0000 7fe7f8ff9700 1 -- 172.21.15.69:0/2103659897 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7f4011710 con 0x7fe8040cd9e0 2023-10-06T01:38:58.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.345+0000 7fe80b222700 1 -- 172.21.15.69:0/2103659897 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8040c9a00 con 0x7fe8040cd9e0 2023-10-06T01:38:58.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.345+0000 7fe7f8ff9700 1 -- 172.21.15.69:0/2103659897 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7f4011ad0 con 0x7fe8040cd9e0 2023-10-06T01:38:58.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.345+0000 7fe80b222700 1 -- 172.21.15.69:0/2103659897 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8040af990 con 0x7fe8040cd9e0 2023-10-06T01:38:58.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.346+0000 7fe80b222700 1 -- 172.21.15.69:0/2103659897 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe80404c3c0 con 0x7fe8040cd9e0 2023-10-06T01:38:58.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.347+0000 7fe7f8ff9700 1 -- 172.21.15.69:0/2103659897 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe7f401c460 con 0x7fe8040cd9e0 2023-10-06T01:38:58.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.347+0000 7fe7f8ff9700 1 --2- 172.21.15.69:0/2103659897 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe7f0066f30 0x7fe7f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:58.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.347+0000 7fe7f8ff9700 1 -- 172.21.15.69:0/2103659897 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe7f4084490 con 0x7fe8040cd9e0 2023-10-06T01:38:58.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.347+0000 7fe808fbe700 1 --2- 172.21.15.69:0/2103659897 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe7f0066f30 0x7fe7f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:58.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.347+0000 7fe808fbe700 1 --2- 172.21.15.69:0/2103659897 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe7f0066f30 0x7fe7f00693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe800009880 tx=0x7fe800017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:58.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.351+0000 7fe7f8ff9700 1 -- 172.21.15.69:0/2103659897 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7f40515a0 con 0x7fe8040cd9e0 2023-10-06T01:38:58.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.531+0000 7fe80b222700 1 -- 172.21.15.69:0/2103659897 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe8040cd1e0 con 0x7fe7f0066f30 2023-10-06T01:38:58.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.538+0000 7fe7f8ff9700 1 -- 172.21.15.69:0/2103659897 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286641 (secure 0 0 0) 0x7fe8040cd1e0 con 0x7fe7f0066f30 2023-10-06T01:38:58.545 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:38:58.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.542+0000 7fe80b222700 1 -- 172.21.15.69:0/2103659897 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe7f0066f30 msgr2=0x7fe7f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:58.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.542+0000 7fe80b222700 1 --2- 172.21.15.69:0/2103659897 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe7f0066f30 0x7fe7f00693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fe800009880 tx=0x7fe800017000 comp rx=0 tx=0).stop 2023-10-06T01:38:58.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.542+0000 7fe80b222700 1 -- 172.21.15.69:0/2103659897 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8040cd9e0 msgr2=0x7fe8040ca170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:58.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.542+0000 7fe80b222700 1 --2- 172.21.15.69:0/2103659897 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8040cd9e0 0x7fe8040ca170 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe7f400c5d0 tx=0x7fe7f4007f60 comp rx=0 tx=0).stop 2023-10-06T01:38:58.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.542+0000 7fe80b222700 1 -- 172.21.15.69:0/2103659897 shutdown_connections 2023-10-06T01:38:58.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.542+0000 7fe80b222700 1 --2- 172.21.15.69:0/2103659897 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe7f0066f30 0x7fe7f00693e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:58.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.542+0000 7fe80b222700 1 --2- 172.21.15.69:0/2103659897 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe80415a5d0 0x7fe8040c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:58.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.542+0000 7fe80b222700 1 --2- 172.21.15.69:0/2103659897 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe8040cb5a0 0x7fe804157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:58.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.542+0000 7fe80b222700 1 --2- 172.21.15.69:0/2103659897 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe8040cd9e0 0x7fe8040ca170 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:58.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.542+0000 7fe80b222700 1 -- 172.21.15.69:0/2103659897 >> 172.21.15.69:0/2103659897 conn(0x7fe804070e30 msgr2=0x7fe8040b2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:58.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.542+0000 7fe80b222700 1 -- 172.21.15.69:0/2103659897 shutdown_connections 2023-10-06T01:38:58.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.542+0000 7fe80b222700 1 -- 172.21.15.69:0/2103659897 wait complete. 2023-10-06T01:38:58.548 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-10-06T01:38:58.554 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-10-06T01:38:58.248382+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381512,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593208,"statfs":{"total":773094113280,"available":770655444992,"internally_reserved":0,"allocated":3284992,"data_stored":1937172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.741176"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524056+0000","last_change":"2023-10-06T01:38:49.517903+0000","last_active":"2023-10-06T01:38:49.524056+0000","last_peered":"2023-10-06T01:38:49.524056+0000","last_clean":"2023-10-06T01:38:49.524056+0000","last_became_active":"2023-10-06T01:38:49.517634+0000","last_became_peered":"2023-10-06T01:38:49.517634+0000","last_unstale":"2023-10-06T01:38:49.524056+0000","last_undegraded":"2023-10-06T01:38:49.524056+0000","last_fullsized":"2023-10-06T01:38:49.524056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:04.939212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527124+0000","last_change":"2023-10-06T01:38:49.523256+0000","last_active":"2023-10-06T01:38:49.527124+0000","last_peered":"2023-10-06T01:38:49.527124+0000","last_clean":"2023-10-06T01:38:49.527124+0000","last_became_active":"2023-10-06T01:38:49.522954+0000","last_became_peered":"2023-10-06T01:38:49.522954+0000","last_unstale":"2023-10-06T01:38:49.527124+0000","last_undegraded":"2023-10-06T01:38:49.527124+0000","last_fullsized":"2023-10-06T01:38:49.527124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532807+0000","last_change":"2023-10-06T01:38:49.528144+0000","last_active":"2023-10-06T01:38:49.532807+0000","last_peered":"2023-10-06T01:38:49.532807+0000","last_clean":"2023-10-06T01:38:49.532807+0000","last_became_active":"2023-10-06T01:38:49.527476+0000","last_became_peered":"2023-10-06T01:38:49.527476+0000","last_unstale":"2023-10-06T01:38:49.532807+0000","last_undegraded":"2023-10-06T01:38:49.532807+0000","last_fullsized":"2023-10-06T01:38:49.532807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:49.294618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.528235+0000","last_change":"2023-10-06T01:38:49.526214+0000","last_active":"2023-10-06T01:38:49.528235+0000","last_peered":"2023-10-06T01:38:49.528235+0000","last_clean":"2023-10-06T01:38:49.528235+0000","last_became_active":"2023-10-06T01:38:49.525926+0000","last_became_peered":"2023-10-06T01:38:49.525926+0000","last_unstale":"2023-10-06T01:38:49.528235+0000","last_undegraded":"2023-10-06T01:38:49.528235+0000","last_fullsized":"2023-10-06T01:38:49.528235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:57:08.899972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524841+0000","last_change":"2023-10-06T01:38:49.522000+0000","last_active":"2023-10-06T01:38:49.524841+0000","last_peered":"2023-10-06T01:38:49.524841+0000","last_clean":"2023-10-06T01:38:49.524841+0000","last_became_active":"2023-10-06T01:38:49.521580+0000","last_became_peered":"2023-10-06T01:38:49.521580+0000","last_unstale":"2023-10-06T01:38:49.524841+0000","last_undegraded":"2023-10-06T01:38:49.524841+0000","last_fullsized":"2023-10-06T01:38:49.524841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:21.430025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532735+0000","last_change":"2023-10-06T01:38:49.527658+0000","last_active":"2023-10-06T01:38:49.532735+0000","last_peered":"2023-10-06T01:38:49.532735+0000","last_clean":"2023-10-06T01:38:49.532735+0000","last_became_active":"2023-10-06T01:38:49.527109+0000","last_became_peered":"2023-10-06T01:38:49.527109+0000","last_unstale":"2023-10-06T01:38:49.532735+0000","last_undegraded":"2023-10-06T01:38:49.532735+0000","last_fullsized":"2023-10-06T01:38:49.532735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:41.094305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.529246+0000","last_change":"2023-10-06T01:38:49.526274+0000","last_active":"2023-10-06T01:38:49.529246+0000","last_peered":"2023-10-06T01:38:49.529246+0000","last_clean":"2023-10-06T01:38:49.529246+0000","last_became_active":"2023-10-06T01:38:49.526058+0000","last_became_peered":"2023-10-06T01:38:49.526058+0000","last_unstale":"2023-10-06T01:38:49.529246+0000","last_undegraded":"2023-10-06T01:38:49.529246+0000","last_fullsized":"2023-10-06T01:38:49.529246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.529633+0000","last_change":"2023-10-06T01:38:49.527609+0000","last_active":"2023-10-06T01:38:49.529633+0000","last_peered":"2023-10-06T01:38:49.529633+0000","last_clean":"2023-10-06T01:38:49.529633+0000","last_became_active":"2023-10-06T01:38:49.527309+0000","last_became_peered":"2023-10-06T01:38:49.527309+0000","last_unstale":"2023-10-06T01:38:49.529633+0000","last_undegraded":"2023-10-06T01:38:49.529633+0000","last_fullsized":"2023-10-06T01:38:49.529633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:04.188051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524708+0000","last_change":"2023-10-06T01:38:49.519471+0000","last_active":"2023-10-06T01:38:49.524708+0000","last_peered":"2023-10-06T01:38:49.524708+0000","last_clean":"2023-10-06T01:38:49.524708+0000","last_became_active":"2023-10-06T01:38:49.519232+0000","last_became_peered":"2023-10-06T01:38:49.519232+0000","last_unstale":"2023-10-06T01:38:49.524708+0000","last_undegraded":"2023-10-06T01:38:49.524708+0000","last_fullsized":"2023-10-06T01:38:49.524708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:11.839303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527105+0000","last_change":"2023-10-06T01:38:49.519625+0000","last_active":"2023-10-06T01:38:49.527105+0000","last_peered":"2023-10-06T01:38:49.527105+0000","last_clean":"2023-10-06T01:38:49.527105+0000","last_became_active":"2023-10-06T01:38:49.519350+0000","last_became_peered":"2023-10-06T01:38:49.519350+0000","last_unstale":"2023-10-06T01:38:49.527105+0000","last_undegraded":"2023-10-06T01:38:49.527105+0000","last_fullsized":"2023-10-06T01:38:49.527105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:21.430025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532757+0000","last_change":"2023-10-06T01:38:49.527759+0000","last_active":"2023-10-06T01:38:49.532757+0000","last_peered":"2023-10-06T01:38:49.532757+0000","last_clean":"2023-10-06T01:38:49.532757+0000","last_became_active":"2023-10-06T01:38:49.527046+0000","last_became_peered":"2023-10-06T01:38:49.527046+0000","last_unstale":"2023-10-06T01:38:49.532757+0000","last_undegraded":"2023-10-06T01:38:49.532757+0000","last_fullsized":"2023-10-06T01:38:49.532757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:04.140534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531758+0000","last_change":"2023-10-06T01:38:49.527553+0000","last_active":"2023-10-06T01:38:49.531758+0000","last_peered":"2023-10-06T01:38:49.531758+0000","last_clean":"2023-10-06T01:38:49.531758+0000","last_became_active":"2023-10-06T01:38:49.527370+0000","last_became_peered":"2023-10-06T01:38:49.527370+0000","last_unstale":"2023-10-06T01:38:49.531758+0000","last_undegraded":"2023-10-06T01:38:49.531758+0000","last_fullsized":"2023-10-06T01:38:49.531758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:55.861597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.523956+0000","last_change":"2023-10-06T01:38:49.517619+0000","last_active":"2023-10-06T01:38:49.523956+0000","last_peered":"2023-10-06T01:38:49.523956+0000","last_clean":"2023-10-06T01:38:49.523956+0000","last_became_active":"2023-10-06T01:38:49.517323+0000","last_became_peered":"2023-10-06T01:38:49.517323+0000","last_unstale":"2023-10-06T01:38:49.523956+0000","last_undegraded":"2023-10-06T01:38:49.523956+0000","last_fullsized":"2023-10-06T01:38:49.523956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:35.290053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.523783+0000","last_change":"2023-10-06T01:38:49.518132+0000","last_active":"2023-10-06T01:38:49.523783+0000","last_peered":"2023-10-06T01:38:49.523783+0000","last_clean":"2023-10-06T01:38:49.523783+0000","last_became_active":"2023-10-06T01:38:49.517901+0000","last_became_peered":"2023-10-06T01:38:49.517901+0000","last_unstale":"2023-10-06T01:38:49.523783+0000","last_undegraded":"2023-10-06T01:38:49.523783+0000","last_fullsized":"2023-10-06T01:38:49.523783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:57.306692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.529431+0000","last_change":"2023-10-06T01:38:49.526480+0000","last_active":"2023-10-06T01:38:49.529431+0000","last_peered":"2023-10-06T01:38:49.529431+0000","last_clean":"2023-10-06T01:38:49.529431+0000","last_became_active":"2023-10-06T01:38:49.526183+0000","last_became_peered":"2023-10-06T01:38:49.526183+0000","last_unstale":"2023-10-06T01:38:49.529431+0000","last_undegraded":"2023-10-06T01:38:49.529431+0000","last_fullsized":"2023-10-06T01:38:49.529431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:57.306692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.528330+0000","last_change":"2023-10-06T01:38:49.525375+0000","last_active":"2023-10-06T01:38:49.528330+0000","last_peered":"2023-10-06T01:38:49.528330+0000","last_clean":"2023-10-06T01:38:49.528330+0000","last_became_active":"2023-10-06T01:38:49.525091+0000","last_became_peered":"2023-10-06T01:38:49.525091+0000","last_unstale":"2023-10-06T01:38:49.528330+0000","last_undegraded":"2023-10-06T01:38:49.528330+0000","last_fullsized":"2023-10-06T01:38:49.528330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:44.668443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524727+0000","last_change":"2023-10-06T01:38:49.520872+0000","last_active":"2023-10-06T01:38:49.524727+0000","last_peered":"2023-10-06T01:38:49.524727+0000","last_clean":"2023-10-06T01:38:49.524727+0000","last_became_active":"2023-10-06T01:38:49.520588+0000","last_became_peered":"2023-10-06T01:38:49.520588+0000","last_unstale":"2023-10-06T01:38:49.524727+0000","last_undegraded":"2023-10-06T01:38:49.524727+0000","last_fullsized":"2023-10-06T01:38:49.524727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:57.494182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532943+0000","last_change":"2023-10-06T01:38:49.528700+0000","last_active":"2023-10-06T01:38:49.532943+0000","last_peered":"2023-10-06T01:38:49.532943+0000","last_clean":"2023-10-06T01:38:49.532943+0000","last_became_active":"2023-10-06T01:38:49.527947+0000","last_became_peered":"2023-10-06T01:38:49.527947+0000","last_unstale":"2023-10-06T01:38:49.532943+0000","last_undegraded":"2023-10-06T01:38:49.532943+0000","last_fullsized":"2023-10-06T01:38:49.532943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:22.289895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.528863+0000","last_change":"2023-10-06T01:38:49.524738+0000","last_active":"2023-10-06T01:38:49.528863+0000","last_peered":"2023-10-06T01:38:49.528863+0000","last_clean":"2023-10-06T01:38:49.528863+0000","last_became_active":"2023-10-06T01:38:49.524478+0000","last_became_peered":"2023-10-06T01:38:49.524478+0000","last_unstale":"2023-10-06T01:38:49.528863+0000","last_undegraded":"2023-10-06T01:38:49.528863+0000","last_fullsized":"2023-10-06T01:38:49.528863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:05.235173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533032+0000","last_change":"2023-10-06T01:38:49.528930+0000","last_active":"2023-10-06T01:38:49.533032+0000","last_peered":"2023-10-06T01:38:49.533032+0000","last_clean":"2023-10-06T01:38:49.533032+0000","last_became_active":"2023-10-06T01:38:49.528446+0000","last_became_peered":"2023-10-06T01:38:49.528446+0000","last_unstale":"2023-10-06T01:38:49.533032+0000","last_undegraded":"2023-10-06T01:38:49.533032+0000","last_fullsized":"2023-10-06T01:38:49.533032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:58.019042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532838+0000","last_change":"2023-10-06T01:38:49.530433+0000","last_active":"2023-10-06T01:38:49.532838+0000","last_peered":"2023-10-06T01:38:49.532838+0000","last_clean":"2023-10-06T01:38:49.532838+0000","last_became_active":"2023-10-06T01:38:49.530161+0000","last_became_peered":"2023-10-06T01:38:49.530161+0000","last_unstale":"2023-10-06T01:38:49.532838+0000","last_undegraded":"2023-10-06T01:38:49.532838+0000","last_fullsized":"2023-10-06T01:38:49.532838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:38:23.293524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526894+0000","last_change":"2023-10-06T01:38:49.523986+0000","last_active":"2023-10-06T01:38:49.526894+0000","last_peered":"2023-10-06T01:38:49.526894+0000","last_clean":"2023-10-06T01:38:49.526894+0000","last_became_active":"2023-10-06T01:38:49.523736+0000","last_became_peered":"2023-10-06T01:38:49.523736+0000","last_unstale":"2023-10-06T01:38:49.526894+0000","last_undegraded":"2023-10-06T01:38:49.526894+0000","last_fullsized":"2023-10-06T01:38:49.526894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:57.306692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526902+0000","last_change":"2023-10-06T01:38:49.517570+0000","last_active":"2023-10-06T01:38:49.526902+0000","last_peered":"2023-10-06T01:38:49.526902+0000","last_clean":"2023-10-06T01:38:49.526902+0000","last_became_active":"2023-10-06T01:38:49.517319+0000","last_became_peered":"2023-10-06T01:38:49.517319+0000","last_unstale":"2023-10-06T01:38:49.526902+0000","last_undegraded":"2023-10-06T01:38:49.526902+0000","last_fullsized":"2023-10-06T01:38:49.526902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:22.060988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.529224+0000","last_change":"2023-10-06T01:38:49.524486+0000","last_active":"2023-10-06T01:38:49.529224+0000","last_peered":"2023-10-06T01:38:49.529224+0000","last_clean":"2023-10-06T01:38:49.529224+0000","last_became_active":"2023-10-06T01:38:49.524244+0000","last_became_peered":"2023-10-06T01:38:49.524244+0000","last_unstale":"2023-10-06T01:38:49.529224+0000","last_undegraded":"2023-10-06T01:38:49.529224+0000","last_fullsized":"2023-10-06T01:38:49.529224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:22.814342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.525649+0000","last_change":"2023-10-06T01:38:49.521288+0000","last_active":"2023-10-06T01:38:49.525649+0000","last_peered":"2023-10-06T01:38:49.525649+0000","last_clean":"2023-10-06T01:38:49.525649+0000","last_became_active":"2023-10-06T01:38:49.520995+0000","last_became_peered":"2023-10-06T01:38:49.520995+0000","last_unstale":"2023-10-06T01:38:49.525649+0000","last_undegraded":"2023-10-06T01:38:49.525649+0000","last_fullsized":"2023-10-06T01:38:49.525649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:06.793193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.525993+0000","last_change":"2023-10-06T01:38:49.521528+0000","last_active":"2023-10-06T01:38:49.525993+0000","last_peered":"2023-10-06T01:38:49.525993+0000","last_clean":"2023-10-06T01:38:49.525993+0000","last_became_active":"2023-10-06T01:38:49.520274+0000","last_became_peered":"2023-10-06T01:38:49.520274+0000","last_unstale":"2023-10-06T01:38:49.525993+0000","last_undegraded":"2023-10-06T01:38:49.525993+0000","last_fullsized":"2023-10-06T01:38:49.525993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:31:19.856103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527242+0000","last_change":"2023-10-06T01:38:49.519548+0000","last_active":"2023-10-06T01:38:49.527242+0000","last_peered":"2023-10-06T01:38:49.527242+0000","last_clean":"2023-10-06T01:38:49.527242+0000","last_became_active":"2023-10-06T01:38:49.519249+0000","last_became_peered":"2023-10-06T01:38:49.519249+0000","last_unstale":"2023-10-06T01:38:49.527242+0000","last_undegraded":"2023-10-06T01:38:49.527242+0000","last_fullsized":"2023-10-06T01:38:49.527242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:57.494182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.656554+0000","last_change":"2023-10-06T01:38:48.666150+0000","last_active":"2023-10-06T01:38:49.656554+0000","last_peered":"2023-10-06T01:38:49.656554+0000","last_clean":"2023-10-06T01:38:49.656554+0000","last_became_active":"2023-10-06T01:38:48.663061+0000","last_became_peered":"2023-10-06T01:38:48.663061+0000","last_unstale":"2023-10-06T01:38:49.656554+0000","last_undegraded":"2023-10-06T01:38:49.656554+0000","last_fullsized":"2023-10-06T01:38:49.656554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:07:41.517375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531425+0000","last_change":"2023-10-06T01:38:49.520719+0000","last_active":"2023-10-06T01:38:49.531425+0000","last_peered":"2023-10-06T01:38:49.531425+0000","last_clean":"2023-10-06T01:38:49.531425+0000","last_became_active":"2023-10-06T01:38:49.520470+0000","last_became_peered":"2023-10-06T01:38:49.520470+0000","last_unstale":"2023-10-06T01:38:49.531425+0000","last_undegraded":"2023-10-06T01:38:49.531425+0000","last_fullsized":"2023-10-06T01:38:49.531425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:11.839303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515999+0000","last_change":"2023-10-06T01:38:48.666186+0000","last_active":"2023-10-06T01:38:49.515999+0000","last_peered":"2023-10-06T01:38:49.515999+0000","last_clean":"2023-10-06T01:38:49.515999+0000","last_became_active":"2023-10-06T01:38:48.665875+0000","last_became_peered":"2023-10-06T01:38:48.665875+0000","last_unstale":"2023-10-06T01:38:49.515999+0000","last_undegraded":"2023-10-06T01:38:49.515999+0000","last_fullsized":"2023-10-06T01:38:49.515999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:09.299545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524755+0000","last_change":"2023-10-06T01:38:49.518381+0000","last_active":"2023-10-06T01:38:49.524755+0000","last_peered":"2023-10-06T01:38:49.524755+0000","last_clean":"2023-10-06T01:38:49.524755+0000","last_became_active":"2023-10-06T01:38:49.518041+0000","last_became_peered":"2023-10-06T01:38:49.518041+0000","last_unstale":"2023-10-06T01:38:49.524755+0000","last_undegraded":"2023-10-06T01:38:49.524755+0000","last_fullsized":"2023-10-06T01:38:49.524755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.508966+0000","last_change":"2023-10-06T01:38:48.665041+0000","last_active":"2023-10-06T01:38:49.508966+0000","last_peered":"2023-10-06T01:38:49.508966+0000","last_clean":"2023-10-06T01:38:49.508966+0000","last_became_active":"2023-10-06T01:38:48.664783+0000","last_became_peered":"2023-10-06T01:38:48.664783+0000","last_unstale":"2023-10-06T01:38:49.508966+0000","last_undegraded":"2023-10-06T01:38:49.508966+0000","last_fullsized":"2023-10-06T01:38:49.508966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:52.982952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.528203+0000","last_change":"2023-10-06T01:38:49.524574+0000","last_active":"2023-10-06T01:38:49.528203+0000","last_peered":"2023-10-06T01:38:49.528203+0000","last_clean":"2023-10-06T01:38:49.528203+0000","last_became_active":"2023-10-06T01:38:49.524266+0000","last_became_peered":"2023-10-06T01:38:49.524266+0000","last_unstale":"2023-10-06T01:38:49.528203+0000","last_undegraded":"2023-10-06T01:38:49.528203+0000","last_fullsized":"2023-10-06T01:38:49.528203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:27.853451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.512647+0000","last_change":"2023-10-06T01:38:48.662259+0000","last_active":"2023-10-06T01:38:49.512647+0000","last_peered":"2023-10-06T01:38:49.512647+0000","last_clean":"2023-10-06T01:38:49.512647+0000","last_became_active":"2023-10-06T01:38:48.661993+0000","last_became_peered":"2023-10-06T01:38:48.661993+0000","last_unstale":"2023-10-06T01:38:49.512647+0000","last_undegraded":"2023-10-06T01:38:49.512647+0000","last_fullsized":"2023-10-06T01:38:49.512647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:04.233408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526872+0000","last_change":"2023-10-06T01:38:49.518829+0000","last_active":"2023-10-06T01:38:49.526872+0000","last_peered":"2023-10-06T01:38:49.526872+0000","last_clean":"2023-10-06T01:38:49.526872+0000","last_became_active":"2023-10-06T01:38:49.517297+0000","last_became_peered":"2023-10-06T01:38:49.517297+0000","last_unstale":"2023-10-06T01:38:49.526872+0000","last_undegraded":"2023-10-06T01:38:49.526872+0000","last_fullsized":"2023-10-06T01:38:49.526872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.513481+0000","last_change":"2023-10-06T01:38:48.662679+0000","last_active":"2023-10-06T01:38:49.513481+0000","last_peered":"2023-10-06T01:38:49.513481+0000","last_clean":"2023-10-06T01:38:49.513481+0000","last_became_active":"2023-10-06T01:38:48.662335+0000","last_became_peered":"2023-10-06T01:38:48.662335+0000","last_unstale":"2023-10-06T01:38:49.513481+0000","last_undegraded":"2023-10-06T01:38:49.513481+0000","last_fullsized":"2023-10-06T01:38:49.513481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:52.982952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526925+0000","last_change":"2023-10-06T01:38:49.518684+0000","last_active":"2023-10-06T01:38:49.526925+0000","last_peered":"2023-10-06T01:38:49.526925+0000","last_clean":"2023-10-06T01:38:49.526925+0000","last_became_active":"2023-10-06T01:38:49.518436+0000","last_became_peered":"2023-10-06T01:38:49.518436+0000","last_unstale":"2023-10-06T01:38:49.526925+0000","last_undegraded":"2023-10-06T01:38:49.526925+0000","last_fullsized":"2023-10-06T01:38:49.526925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:42.707474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.659791+0000","last_change":"2023-10-06T01:38:48.667307+0000","last_active":"2023-10-06T01:38:49.659791+0000","last_peered":"2023-10-06T01:38:49.659791+0000","last_clean":"2023-10-06T01:38:49.659791+0000","last_became_active":"2023-10-06T01:38:48.667032+0000","last_became_peered":"2023-10-06T01:38:48.667032+0000","last_unstale":"2023-10-06T01:38:49.659791+0000","last_undegraded":"2023-10-06T01:38:49.659791+0000","last_fullsized":"2023-10-06T01:38:49.659791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:26.851686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527967+0000","last_change":"2023-10-06T01:38:49.525949+0000","last_active":"2023-10-06T01:38:49.527967+0000","last_peered":"2023-10-06T01:38:49.527967+0000","last_clean":"2023-10-06T01:38:49.527967+0000","last_became_active":"2023-10-06T01:38:49.525063+0000","last_became_peered":"2023-10-06T01:38:49.525063+0000","last_unstale":"2023-10-06T01:38:49.527967+0000","last_undegraded":"2023-10-06T01:38:49.527967+0000","last_fullsized":"2023-10-06T01:38:49.527967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:31.040385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.659104+0000","last_change":"2023-10-06T01:38:48.666319+0000","last_active":"2023-10-06T01:38:49.659104+0000","last_peered":"2023-10-06T01:38:49.659104+0000","last_clean":"2023-10-06T01:38:49.659104+0000","last_became_active":"2023-10-06T01:38:48.666058+0000","last_became_peered":"2023-10-06T01:38:48.666058+0000","last_unstale":"2023-10-06T01:38:49.659104+0000","last_undegraded":"2023-10-06T01:38:49.659104+0000","last_fullsized":"2023-10-06T01:38:49.659104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:09.299545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532960+0000","last_change":"2023-10-06T01:38:49.528713+0000","last_active":"2023-10-06T01:38:49.532960+0000","last_peered":"2023-10-06T01:38:49.532960+0000","last_clean":"2023-10-06T01:38:49.532960+0000","last_became_active":"2023-10-06T01:38:49.528396+0000","last_became_peered":"2023-10-06T01:38:49.528396+0000","last_unstale":"2023-10-06T01:38:49.532960+0000","last_undegraded":"2023-10-06T01:38:49.532960+0000","last_fullsized":"2023-10-06T01:38:49.532960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:22.060988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.657311+0000","last_change":"2023-10-06T01:38:48.669666+0000","last_active":"2023-10-06T01:38:49.657311+0000","last_peered":"2023-10-06T01:38:49.657311+0000","last_clean":"2023-10-06T01:38:49.657311+0000","last_became_active":"2023-10-06T01:38:48.669403+0000","last_became_peered":"2023-10-06T01:38:48.669403+0000","last_unstale":"2023-10-06T01:38:49.657311+0000","last_undegraded":"2023-10-06T01:38:49.657311+0000","last_fullsized":"2023-10-06T01:38:49.657311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:11.825838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531689+0000","last_change":"2023-10-06T01:38:49.522550+0000","last_active":"2023-10-06T01:38:49.531689+0000","last_peered":"2023-10-06T01:38:49.531689+0000","last_clean":"2023-10-06T01:38:49.531689+0000","last_became_active":"2023-10-06T01:38:49.521718+0000","last_became_peered":"2023-10-06T01:38:49.521718+0000","last_unstale":"2023-10-06T01:38:49.531689+0000","last_undegraded":"2023-10-06T01:38:49.531689+0000","last_fullsized":"2023-10-06T01:38:49.531689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:38:23.293524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.512791+0000","last_change":"2023-10-06T01:38:48.657883+0000","last_active":"2023-10-06T01:38:49.512791+0000","last_peered":"2023-10-06T01:38:49.512791+0000","last_clean":"2023-10-06T01:38:49.512791+0000","last_became_active":"2023-10-06T01:38:48.656431+0000","last_became_peered":"2023-10-06T01:38:48.656431+0000","last_unstale":"2023-10-06T01:38:49.512791+0000","last_undegraded":"2023-10-06T01:38:49.512791+0000","last_fullsized":"2023-10-06T01:38:49.512791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:52.982952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.523875+0000","last_change":"2023-10-06T01:38:49.516970+0000","last_active":"2023-10-06T01:38:49.523875+0000","last_peered":"2023-10-06T01:38:49.523875+0000","last_clean":"2023-10-06T01:38:49.523875+0000","last_became_active":"2023-10-06T01:38:49.516721+0000","last_became_peered":"2023-10-06T01:38:49.516721+0000","last_unstale":"2023-10-06T01:38:49.523875+0000","last_undegraded":"2023-10-06T01:38:49.523875+0000","last_fullsized":"2023-10-06T01:38:49.523875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:38:23.293524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.514766+0000","last_change":"2023-10-06T01:38:48.667484+0000","last_active":"2023-10-06T01:38:49.514766+0000","last_peered":"2023-10-06T01:38:49.514766+0000","last_clean":"2023-10-06T01:38:49.514766+0000","last_became_active":"2023-10-06T01:38:48.667215+0000","last_became_peered":"2023-10-06T01:38:48.667215+0000","last_unstale":"2023-10-06T01:38:49.514766+0000","last_undegraded":"2023-10-06T01:38:49.514766+0000","last_fullsized":"2023-10-06T01:38:49.514766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:57:07.898207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526925+0000","last_change":"2023-10-06T01:38:49.523815+0000","last_active":"2023-10-06T01:38:49.526925+0000","last_peered":"2023-10-06T01:38:49.526925+0000","last_clean":"2023-10-06T01:38:49.526925+0000","last_became_active":"2023-10-06T01:38:49.520967+0000","last_became_peered":"2023-10-06T01:38:49.520967+0000","last_unstale":"2023-10-06T01:38:49.526925+0000","last_undegraded":"2023-10-06T01:38:49.526925+0000","last_fullsized":"2023-10-06T01:38:49.526925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:04.188051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.659578+0000","last_change":"2023-10-06T01:38:48.665231+0000","last_active":"2023-10-06T01:38:49.659578+0000","last_peered":"2023-10-06T01:38:49.659578+0000","last_clean":"2023-10-06T01:38:49.659578+0000","last_became_active":"2023-10-06T01:38:48.664910+0000","last_became_peered":"2023-10-06T01:38:48.664910+0000","last_unstale":"2023-10-06T01:38:49.659578+0000","last_undegraded":"2023-10-06T01:38:49.659578+0000","last_fullsized":"2023-10-06T01:38:49.659578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:50.373603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526858+0000","last_change":"2023-10-06T01:38:49.519035+0000","last_active":"2023-10-06T01:38:49.526858+0000","last_peered":"2023-10-06T01:38:49.526858+0000","last_clean":"2023-10-06T01:38:49.526858+0000","last_became_active":"2023-10-06T01:38:49.518788+0000","last_became_peered":"2023-10-06T01:38:49.518788+0000","last_unstale":"2023-10-06T01:38:49.526858+0000","last_undegraded":"2023-10-06T01:38:49.526858+0000","last_fullsized":"2023-10-06T01:38:49.526858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:21.430025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.656778+0000","last_change":"2023-10-06T01:38:48.669414+0000","last_active":"2023-10-06T01:38:49.656778+0000","last_peered":"2023-10-06T01:38:49.656778+0000","last_clean":"2023-10-06T01:38:49.656778+0000","last_became_active":"2023-10-06T01:38:48.669152+0000","last_became_peered":"2023-10-06T01:38:48.669152+0000","last_unstale":"2023-10-06T01:38:49.656778+0000","last_undegraded":"2023-10-06T01:38:49.656778+0000","last_fullsized":"2023-10-06T01:38:49.656778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:31.036573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.523629+0000","last_change":"2023-10-06T01:38:49.515615+0000","last_active":"2023-10-06T01:38:49.523629+0000","last_peered":"2023-10-06T01:38:49.523629+0000","last_clean":"2023-10-06T01:38:49.523629+0000","last_became_active":"2023-10-06T01:38:49.515307+0000","last_became_peered":"2023-10-06T01:38:49.515307+0000","last_unstale":"2023-10-06T01:38:49.523629+0000","last_undegraded":"2023-10-06T01:38:49.523629+0000","last_fullsized":"2023-10-06T01:38:49.523629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:31.040385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.657257+0000","last_change":"2023-10-06T01:38:48.669339+0000","last_active":"2023-10-06T01:38:49.657257+0000","last_peered":"2023-10-06T01:38:49.657257+0000","last_clean":"2023-10-06T01:38:49.657257+0000","last_became_active":"2023-10-06T01:38:48.668855+0000","last_became_peered":"2023-10-06T01:38:48.668855+0000","last_unstale":"2023-10-06T01:38:49.657257+0000","last_undegraded":"2023-10-06T01:38:49.657257+0000","last_fullsized":"2023-10-06T01:38:49.657257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:33.441697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533008+0000","last_change":"2023-10-06T01:38:49.528804+0000","last_active":"2023-10-06T01:38:49.533008+0000","last_peered":"2023-10-06T01:38:49.533008+0000","last_clean":"2023-10-06T01:38:49.533008+0000","last_became_active":"2023-10-06T01:38:49.528188+0000","last_became_peered":"2023-10-06T01:38:49.528188+0000","last_unstale":"2023-10-06T01:38:49.533008+0000","last_undegraded":"2023-10-06T01:38:49.533008+0000","last_fullsized":"2023-10-06T01:38:49.533008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:42.707474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.656825+0000","last_change":"2023-10-06T01:38:48.662704+0000","last_active":"2023-10-06T01:38:49.656825+0000","last_peered":"2023-10-06T01:38:49.656825+0000","last_clean":"2023-10-06T01:38:49.656825+0000","last_became_active":"2023-10-06T01:38:48.662445+0000","last_became_peered":"2023-10-06T01:38:48.662445+0000","last_unstale":"2023-10-06T01:38:49.656825+0000","last_undegraded":"2023-10-06T01:38:49.656825+0000","last_fullsized":"2023-10-06T01:38:49.656825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:21:02.893859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.529784+0000","last_change":"2023-10-06T01:38:49.524878+0000","last_active":"2023-10-06T01:38:49.529784+0000","last_peered":"2023-10-06T01:38:49.529784+0000","last_clean":"2023-10-06T01:38:49.529784+0000","last_became_active":"2023-10-06T01:38:49.524606+0000","last_became_peered":"2023-10-06T01:38:49.524606+0000","last_unstale":"2023-10-06T01:38:49.529784+0000","last_undegraded":"2023-10-06T01:38:49.529784+0000","last_fullsized":"2023-10-06T01:38:49.529784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:32.038338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.513006+0000","last_change":"2023-10-06T01:38:48.669114+0000","last_active":"2023-10-06T01:38:49.513006+0000","last_peered":"2023-10-06T01:38:49.513006+0000","last_clean":"2023-10-06T01:38:49.513006+0000","last_became_active":"2023-10-06T01:38:48.668855+0000","last_became_peered":"2023-10-06T01:38:48.668855+0000","last_unstale":"2023-10-06T01:38:49.513006+0000","last_undegraded":"2023-10-06T01:38:49.513006+0000","last_fullsized":"2023-10-06T01:38:49.513006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:04.233408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524798+0000","last_change":"2023-10-06T01:38:49.521828+0000","last_active":"2023-10-06T01:38:49.524798+0000","last_peered":"2023-10-06T01:38:49.524798+0000","last_clean":"2023-10-06T01:38:49.524798+0000","last_became_active":"2023-10-06T01:38:49.521245+0000","last_became_peered":"2023-10-06T01:38:49.521245+0000","last_unstale":"2023-10-06T01:38:49.524798+0000","last_undegraded":"2023-10-06T01:38:49.524798+0000","last_fullsized":"2023-10-06T01:38:49.524798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:22.814342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.654286+0000","last_change":"2023-10-06T01:38:48.665908+0000","last_active":"2023-10-06T01:38:49.654286+0000","last_peered":"2023-10-06T01:38:49.654286+0000","last_clean":"2023-10-06T01:38:49.654286+0000","last_became_active":"2023-10-06T01:38:48.665663+0000","last_became_peered":"2023-10-06T01:38:48.665663+0000","last_unstale":"2023-10-06T01:38:49.654286+0000","last_undegraded":"2023-10-06T01:38:49.654286+0000","last_fullsized":"2023-10-06T01:38:49.654286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:04.233408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533179+0000","last_change":"2023-10-06T01:38:49.532282+0000","last_active":"2023-10-06T01:38:49.533179+0000","last_peered":"2023-10-06T01:38:49.533179+0000","last_clean":"2023-10-06T01:38:49.533179+0000","last_became_active":"2023-10-06T01:38:49.532000+0000","last_became_peered":"2023-10-06T01:38:49.532000+0000","last_unstale":"2023-10-06T01:38:49.533179+0000","last_undegraded":"2023-10-06T01:38:49.533179+0000","last_fullsized":"2023-10-06T01:38:49.533179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:43.950553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.517541+0000","last_change":"2023-10-06T01:38:48.668151+0000","last_active":"2023-10-06T01:38:49.517541+0000","last_peered":"2023-10-06T01:38:49.517541+0000","last_clean":"2023-10-06T01:38:49.517541+0000","last_became_active":"2023-10-06T01:38:48.667870+0000","last_became_peered":"2023-10-06T01:38:48.667870+0000","last_unstale":"2023-10-06T01:38:49.517541+0000","last_undegraded":"2023-10-06T01:38:49.517541+0000","last_fullsized":"2023-10-06T01:38:49.517541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:07:41.517375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532859+0000","last_change":"2023-10-06T01:38:49.528292+0000","last_active":"2023-10-06T01:38:49.532859+0000","last_peered":"2023-10-06T01:38:49.532859+0000","last_clean":"2023-10-06T01:38:49.532859+0000","last_became_active":"2023-10-06T01:38:49.527980+0000","last_became_peered":"2023-10-06T01:38:49.527980+0000","last_unstale":"2023-10-06T01:38:49.532859+0000","last_undegraded":"2023-10-06T01:38:49.532859+0000","last_fullsized":"2023-10-06T01:38:49.532859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:24.795745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.521291+0000","last_change":"2023-10-06T01:38:48.659921+0000","last_active":"2023-10-06T01:38:49.521291+0000","last_peered":"2023-10-06T01:38:49.521291+0000","last_clean":"2023-10-06T01:38:49.521291+0000","last_became_active":"2023-10-06T01:38:48.659640+0000","last_became_peered":"2023-10-06T01:38:48.659640+0000","last_unstale":"2023-10-06T01:38:49.521291+0000","last_undegraded":"2023-10-06T01:38:49.521291+0000","last_fullsized":"2023-10-06T01:38:49.521291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:03.937447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533026+0000","last_change":"2023-10-06T01:38:49.528830+0000","last_active":"2023-10-06T01:38:49.533026+0000","last_peered":"2023-10-06T01:38:49.533026+0000","last_clean":"2023-10-06T01:38:49.533026+0000","last_became_active":"2023-10-06T01:38:49.528523+0000","last_became_peered":"2023-10-06T01:38:49.528523+0000","last_unstale":"2023-10-06T01:38:49.533026+0000","last_undegraded":"2023-10-06T01:38:49.533026+0000","last_fullsized":"2023-10-06T01:38:49.533026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:04.188051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.508523+0000","last_change":"2023-10-06T01:38:48.661605+0000","last_active":"2023-10-06T01:38:49.508523+0000","last_peered":"2023-10-06T01:38:49.508523+0000","last_clean":"2023-10-06T01:38:49.508523+0000","last_became_active":"2023-10-06T01:38:48.661424+0000","last_became_peered":"2023-10-06T01:38:48.661424+0000","last_unstale":"2023-10-06T01:38:49.508523+0000","last_undegraded":"2023-10-06T01:38:49.508523+0000","last_fullsized":"2023-10-06T01:38:49.508523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:34.288288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526228+0000","last_change":"2023-10-06T01:38:49.524678+0000","last_active":"2023-10-06T01:38:49.526228+0000","last_peered":"2023-10-06T01:38:49.526228+0000","last_clean":"2023-10-06T01:38:49.526228+0000","last_became_active":"2023-10-06T01:38:49.522598+0000","last_became_peered":"2023-10-06T01:38:49.522598+0000","last_unstale":"2023-10-06T01:38:49.526228+0000","last_undegraded":"2023-10-06T01:38:49.526228+0000","last_fullsized":"2023-10-06T01:38:49.526228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515842+0000","last_change":"2023-10-06T01:38:44.533111+0000","last_active":"2023-10-06T01:38:49.515842+0000","last_peered":"2023-10-06T01:38:49.515842+0000","last_clean":"2023-10-06T01:38:49.515842+0000","last_became_active":"2023-10-06T01:38:44.532838+0000","last_became_peered":"2023-10-06T01:38:44.532838+0000","last_unstale":"2023-10-06T01:38:49.515842+0000","last_undegraded":"2023-10-06T01:38:49.515842+0000","last_fullsized":"2023-10-06T01:38:49.515842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.513492+0000","last_change":"2023-10-06T01:38:48.666716+0000","last_active":"2023-10-06T01:38:49.513492+0000","last_peered":"2023-10-06T01:38:49.513492+0000","last_clean":"2023-10-06T01:38:49.513492+0000","last_became_active":"2023-10-06T01:38:48.666431+0000","last_became_peered":"2023-10-06T01:38:48.666431+0000","last_unstale":"2023-10-06T01:38:49.513492+0000","last_undegraded":"2023-10-06T01:38:49.513492+0000","last_fullsized":"2023-10-06T01:38:49.513492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:33.441697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526310+0000","last_change":"2023-10-06T01:38:49.524629+0000","last_active":"2023-10-06T01:38:49.526310+0000","last_peered":"2023-10-06T01:38:49.526310+0000","last_clean":"2023-10-06T01:38:49.526310+0000","last_became_active":"2023-10-06T01:38:49.524372+0000","last_became_peered":"2023-10-06T01:38:49.524372+0000","last_unstale":"2023-10-06T01:38:49.526310+0000","last_undegraded":"2023-10-06T01:38:49.526310+0000","last_fullsized":"2023-10-06T01:38:49.526310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:22.814342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.512226+0000","last_change":"2023-10-06T01:38:44.533897+0000","last_active":"2023-10-06T01:38:49.512226+0000","last_peered":"2023-10-06T01:38:49.512226+0000","last_clean":"2023-10-06T01:38:49.512226+0000","last_became_active":"2023-10-06T01:38:44.533611+0000","last_became_peered":"2023-10-06T01:38:44.533611+0000","last_unstale":"2023-10-06T01:38:49.512226+0000","last_undegraded":"2023-10-06T01:38:49.512226+0000","last_fullsized":"2023-10-06T01:38:49.512226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:24.411408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.520109+0000","last_change":"2023-10-06T01:38:48.666784+0000","last_active":"2023-10-06T01:38:49.520109+0000","last_peered":"2023-10-06T01:38:49.520109+0000","last_clean":"2023-10-06T01:38:49.520109+0000","last_became_active":"2023-10-06T01:38:48.666228+0000","last_became_peered":"2023-10-06T01:38:48.666228+0000","last_unstale":"2023-10-06T01:38:49.520109+0000","last_undegraded":"2023-10-06T01:38:49.520109+0000","last_fullsized":"2023-10-06T01:38:49.520109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:34.288288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526238+0000","last_change":"2023-10-06T01:38:49.520640+0000","last_active":"2023-10-06T01:38:49.526238+0000","last_peered":"2023-10-06T01:38:49.526238+0000","last_clean":"2023-10-06T01:38:49.526238+0000","last_became_active":"2023-10-06T01:38:49.520050+0000","last_became_peered":"2023-10-06T01:38:49.520050+0000","last_unstale":"2023-10-06T01:38:49.526238+0000","last_undegraded":"2023-10-06T01:38:49.526238+0000","last_fullsized":"2023-10-06T01:38:49.526238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:27.494951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.513741+0000","last_change":"2023-10-06T01:38:45.307814+0000","last_active":"2023-10-06T01:38:49.513741+0000","last_peered":"2023-10-06T01:38:49.513741+0000","last_clean":"2023-10-06T01:38:49.513741+0000","last_became_active":"2023-10-06T01:38:45.307536+0000","last_became_peered":"2023-10-06T01:38:45.307536+0000","last_unstale":"2023-10-06T01:38:49.513741+0000","last_undegraded":"2023-10-06T01:38:49.513741+0000","last_fullsized":"2023-10-06T01:38:49.513741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:09.503713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515587+0000","last_change":"2023-10-06T01:38:48.656055+0000","last_active":"2023-10-06T01:38:49.515587+0000","last_peered":"2023-10-06T01:38:49.515587+0000","last_clean":"2023-10-06T01:38:49.515587+0000","last_became_active":"2023-10-06T01:38:48.655769+0000","last_became_peered":"2023-10-06T01:38:48.655769+0000","last_unstale":"2023-10-06T01:38:49.515587+0000","last_undegraded":"2023-10-06T01:38:49.515587+0000","last_fullsized":"2023-10-06T01:38:49.515587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:34.288288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527622+0000","last_change":"2023-10-06T01:38:49.524773+0000","last_active":"2023-10-06T01:38:49.527622+0000","last_peered":"2023-10-06T01:38:49.527622+0000","last_clean":"2023-10-06T01:38:49.527622+0000","last_became_active":"2023-10-06T01:38:49.524515+0000","last_became_peered":"2023-10-06T01:38:49.524515+0000","last_unstale":"2023-10-06T01:38:49.527622+0000","last_undegraded":"2023-10-06T01:38:49.527622+0000","last_fullsized":"2023-10-06T01:38:49.527622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:57.306692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.512742+0000","last_change":"2023-10-06T01:38:44.534507+0000","last_active":"2023-10-06T01:38:49.512742+0000","last_peered":"2023-10-06T01:38:49.512742+0000","last_clean":"2023-10-06T01:38:49.512742+0000","last_became_active":"2023-10-06T01:38:44.534191+0000","last_became_peered":"2023-10-06T01:38:44.534191+0000","last_unstale":"2023-10-06T01:38:49.512742+0000","last_undegraded":"2023-10-06T01:38:49.512742+0000","last_fullsized":"2023-10-06T01:38:49.512742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.514777+0000","last_change":"2023-10-06T01:38:40.115117+0000","last_active":"2023-10-06T01:38:49.514777+0000","last_peered":"2023-10-06T01:38:49.514777+0000","last_clean":"2023-10-06T01:38:49.514777+0000","last_became_active":"2023-10-06T01:38:40.114142+0000","last_became_peered":"2023-10-06T01:38:40.114142+0000","last_unstale":"2023-10-06T01:38:49.514777+0000","last_undegraded":"2023-10-06T01:38:49.514777+0000","last_fullsized":"2023-10-06T01:38:49.514777+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_clean_scrub_stamp":"2023-10-06T01:38:38.338797+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:52.870262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.508643+0000","last_change":"2023-10-06T01:38:48.663223+0000","last_active":"2023-10-06T01:38:49.508643+0000","last_peered":"2023-10-06T01:38:49.508643+0000","last_clean":"2023-10-06T01:38:49.508643+0000","last_became_active":"2023-10-06T01:38:48.662956+0000","last_became_peered":"2023-10-06T01:38:48.662956+0000","last_unstale":"2023-10-06T01:38:49.508643+0000","last_undegraded":"2023-10-06T01:38:49.508643+0000","last_fullsized":"2023-10-06T01:38:49.508643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:54.859831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531599+0000","last_change":"2023-10-06T01:38:49.530401+0000","last_active":"2023-10-06T01:38:49.531599+0000","last_peered":"2023-10-06T01:38:49.531599+0000","last_clean":"2023-10-06T01:38:49.531599+0000","last_became_active":"2023-10-06T01:38:49.530107+0000","last_became_peered":"2023-10-06T01:38:49.530107+0000","last_unstale":"2023-10-06T01:38:49.531599+0000","last_undegraded":"2023-10-06T01:38:49.531599+0000","last_fullsized":"2023-10-06T01:38:49.531599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:12.827603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515221+0000","last_change":"2023-10-06T01:38:44.531831+0000","last_active":"2023-10-06T01:38:49.515221+0000","last_peered":"2023-10-06T01:38:49.515221+0000","last_clean":"2023-10-06T01:38:49.515221+0000","last_became_active":"2023-10-06T01:38:44.531496+0000","last_became_peered":"2023-10-06T01:38:44.531496+0000","last_unstale":"2023-10-06T01:38:49.515221+0000","last_undegraded":"2023-10-06T01:38:49.515221+0000","last_fullsized":"2023-10-06T01:38:49.515221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:28.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.512340+0000","last_change":"2023-10-06T01:38:48.667413+0000","last_active":"2023-10-06T01:38:49.512340+0000","last_peered":"2023-10-06T01:38:49.512340+0000","last_clean":"2023-10-06T01:38:49.512340+0000","last_became_active":"2023-10-06T01:38:48.667114+0000","last_became_peered":"2023-10-06T01:38:48.667114+0000","last_unstale":"2023-10-06T01:38:49.512340+0000","last_undegraded":"2023-10-06T01:38:49.512340+0000","last_fullsized":"2023-10-06T01:38:49.512340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:03.937447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531783+0000","last_change":"2023-10-06T01:38:49.524239+0000","last_active":"2023-10-06T01:38:49.531783+0000","last_peered":"2023-10-06T01:38:49.531783+0000","last_clean":"2023-10-06T01:38:49.531783+0000","last_became_active":"2023-10-06T01:38:49.523994+0000","last_became_peered":"2023-10-06T01:38:49.523994+0000","last_unstale":"2023-10-06T01:38:49.531783+0000","last_undegraded":"2023-10-06T01:38:49.531783+0000","last_fullsized":"2023-10-06T01:38:49.531783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:31:19.856103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515175+0000","last_change":"2023-10-06T01:38:44.531335+0000","last_active":"2023-10-06T01:38:49.515175+0000","last_peered":"2023-10-06T01:38:49.515175+0000","last_clean":"2023-10-06T01:38:49.515175+0000","last_became_active":"2023-10-06T01:38:44.530966+0000","last_became_peered":"2023-10-06T01:38:44.530966+0000","last_unstale":"2023-10-06T01:38:49.515175+0000","last_undegraded":"2023-10-06T01:38:49.515175+0000","last_fullsized":"2023-10-06T01:38:49.515175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:33.926180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515942+0000","last_change":"2023-10-06T01:38:48.660438+0000","last_active":"2023-10-06T01:38:49.515942+0000","last_peered":"2023-10-06T01:38:49.515942+0000","last_clean":"2023-10-06T01:38:49.515942+0000","last_became_active":"2023-10-06T01:38:48.660222+0000","last_became_peered":"2023-10-06T01:38:48.660222+0000","last_unstale":"2023-10-06T01:38:49.515942+0000","last_undegraded":"2023-10-06T01:38:49.515942+0000","last_fullsized":"2023-10-06T01:38:49.515942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:03.937447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524781+0000","last_change":"2023-10-06T01:38:49.517014+0000","last_active":"2023-10-06T01:38:49.524781+0000","last_peered":"2023-10-06T01:38:49.524781+0000","last_clean":"2023-10-06T01:38:49.524781+0000","last_became_active":"2023-10-06T01:38:49.516679+0000","last_became_peered":"2023-10-06T01:38:49.516679+0000","last_unstale":"2023-10-06T01:38:49.524781+0000","last_undegraded":"2023-10-06T01:38:49.524781+0000","last_fullsized":"2023-10-06T01:38:49.524781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:38:23.293524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.658035+0000","last_change":"2023-10-06T01:38:48.663372+0000","last_active":"2023-10-06T01:38:49.658035+0000","last_peered":"2023-10-06T01:38:49.658035+0000","last_clean":"2023-10-06T01:38:49.658035+0000","last_became_active":"2023-10-06T01:38:48.663074+0000","last_became_peered":"2023-10-06T01:38:48.663074+0000","last_unstale":"2023-10-06T01:38:49.658035+0000","last_undegraded":"2023-10-06T01:38:49.658035+0000","last_fullsized":"2023-10-06T01:38:49.658035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:09.299545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.516315+0000","last_change":"2023-10-06T01:38:44.533582+0000","last_active":"2023-10-06T01:38:49.516315+0000","last_peered":"2023-10-06T01:38:49.516315+0000","last_clean":"2023-10-06T01:38:49.516315+0000","last_became_active":"2023-10-06T01:38:44.533324+0000","last_became_peered":"2023-10-06T01:38:44.533324+0000","last_unstale":"2023-10-06T01:38:49.516315+0000","last_undegraded":"2023-10-06T01:38:49.516315+0000","last_fullsized":"2023-10-06T01:38:49.516315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.519956+0000","last_change":"2023-10-06T01:38:49.516429+0000","last_active":"2023-10-06T01:38:49.519956+0000","last_peered":"2023-10-06T01:38:49.519956+0000","last_clean":"2023-10-06T01:38:49.519956+0000","last_became_active":"2023-10-06T01:38:49.515639+0000","last_became_peered":"2023-10-06T01:38:49.515639+0000","last_unstale":"2023-10-06T01:38:49.519956+0000","last_undegraded":"2023-10-06T01:38:49.519956+0000","last_fullsized":"2023-10-06T01:38:49.519956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:22.814342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.516330+0000","last_change":"2023-10-06T01:38:44.533765+0000","last_active":"2023-10-06T01:38:49.516330+0000","last_peered":"2023-10-06T01:38:49.516330+0000","last_clean":"2023-10-06T01:38:49.516330+0000","last_became_active":"2023-10-06T01:38:44.533406+0000","last_became_peered":"2023-10-06T01:38:44.533406+0000","last_unstale":"2023-10-06T01:38:49.516330+0000","last_undegraded":"2023-10-06T01:38:49.516330+0000","last_fullsized":"2023-10-06T01:38:49.516330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:38:50.515561+0000","last_change":"2023-10-06T01:38:48.659164+0000","last_active":"2023-10-06T01:38:50.515561+0000","last_peered":"2023-10-06T01:38:50.515561+0000","last_clean":"2023-10-06T01:38:50.515561+0000","last_became_active":"2023-10-06T01:38:48.658890+0000","last_became_peered":"2023-10-06T01:38:48.658890+0000","last_unstale":"2023-10-06T01:38:50.515561+0000","last_undegraded":"2023-10-06T01:38:50.515561+0000","last_fullsized":"2023-10-06T01:38:50.515561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:34.288288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533074+0000","last_change":"2023-10-06T01:38:49.529282+0000","last_active":"2023-10-06T01:38:49.533074+0000","last_peered":"2023-10-06T01:38:49.533074+0000","last_clean":"2023-10-06T01:38:49.533074+0000","last_became_active":"2023-10-06T01:38:49.528544+0000","last_became_peered":"2023-10-06T01:38:49.528544+0000","last_unstale":"2023-10-06T01:38:49.533074+0000","last_undegraded":"2023-10-06T01:38:49.533074+0000","last_fullsized":"2023-10-06T01:38:49.533074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:21.430025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.656041+0000","last_change":"2023-10-06T01:38:48.668953+0000","last_active":"2023-10-06T01:38:49.656041+0000","last_peered":"2023-10-06T01:38:49.656041+0000","last_clean":"2023-10-06T01:38:49.656041+0000","last_became_active":"2023-10-06T01:38:48.668711+0000","last_became_peered":"2023-10-06T01:38:48.668711+0000","last_unstale":"2023-10-06T01:38:49.656041+0000","last_undegraded":"2023-10-06T01:38:49.656041+0000","last_fullsized":"2023-10-06T01:38:49.656041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:07:41.517375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527535+0000","last_change":"2023-10-06T01:38:49.523156+0000","last_active":"2023-10-06T01:38:49.527535+0000","last_peered":"2023-10-06T01:38:49.527535+0000","last_clean":"2023-10-06T01:38:49.527535+0000","last_became_active":"2023-10-06T01:38:49.522238+0000","last_became_peered":"2023-10-06T01:38:49.522238+0000","last_unstale":"2023-10-06T01:38:49.527535+0000","last_undegraded":"2023-10-06T01:38:49.527535+0000","last_fullsized":"2023-10-06T01:38:49.527535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:53.984718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.657984+0000","last_change":"2023-10-06T01:38:48.669432+0000","last_active":"2023-10-06T01:38:49.657984+0000","last_peered":"2023-10-06T01:38:49.657984+0000","last_clean":"2023-10-06T01:38:49.657984+0000","last_became_active":"2023-10-06T01:38:48.669170+0000","last_became_peered":"2023-10-06T01:38:48.669170+0000","last_unstale":"2023-10-06T01:38:49.657984+0000","last_undegraded":"2023-10-06T01:38:49.657984+0000","last_fullsized":"2023-10-06T01:38:49.657984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:31.036573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533202+0000","last_change":"2023-10-06T01:38:49.532440+0000","last_active":"2023-10-06T01:38:49.533202+0000","last_peered":"2023-10-06T01:38:49.533202+0000","last_clean":"2023-10-06T01:38:49.533202+0000","last_became_active":"2023-10-06T01:38:49.532184+0000","last_became_peered":"2023-10-06T01:38:49.532184+0000","last_unstale":"2023-10-06T01:38:49.533202+0000","last_undegraded":"2023-10-06T01:38:49.533202+0000","last_fullsized":"2023-10-06T01:38:49.533202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:57.688866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.657725+0000","last_change":"2023-10-06T01:38:48.668877+0000","last_active":"2023-10-06T01:38:49.657725+0000","last_peered":"2023-10-06T01:38:49.657725+0000","last_clean":"2023-10-06T01:38:49.657725+0000","last_became_active":"2023-10-06T01:38:48.668564+0000","last_became_peered":"2023-10-06T01:38:48.668564+0000","last_unstale":"2023-10-06T01:38:49.657725+0000","last_undegraded":"2023-10-06T01:38:49.657725+0000","last_fullsized":"2023-10-06T01:38:49.657725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:54.859831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533193+0000","last_change":"2023-10-06T01:38:49.532416+0000","last_active":"2023-10-06T01:38:49.533193+0000","last_peered":"2023-10-06T01:38:49.533193+0000","last_clean":"2023-10-06T01:38:49.533193+0000","last_became_active":"2023-10-06T01:38:49.532101+0000","last_became_peered":"2023-10-06T01:38:49.532101+0000","last_unstale":"2023-10-06T01:38:49.533193+0000","last_undegraded":"2023-10-06T01:38:49.533193+0000","last_fullsized":"2023-10-06T01:38:49.533193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.654641+0000","last_change":"2023-10-06T01:38:48.665065+0000","last_active":"2023-10-06T01:38:49.654641+0000","last_peered":"2023-10-06T01:38:49.654641+0000","last_clean":"2023-10-06T01:38:49.654641+0000","last_became_active":"2023-10-06T01:38:48.664769+0000","last_became_peered":"2023-10-06T01:38:48.664769+0000","last_unstale":"2023-10-06T01:38:49.654641+0000","last_undegraded":"2023-10-06T01:38:49.654641+0000","last_fullsized":"2023-10-06T01:38:49.654641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:33.441697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526916+0000","last_change":"2023-10-06T01:38:49.518384+0000","last_active":"2023-10-06T01:38:49.526916+0000","last_peered":"2023-10-06T01:38:49.526916+0000","last_clean":"2023-10-06T01:38:49.526916+0000","last_became_active":"2023-10-06T01:38:49.518100+0000","last_became_peered":"2023-10-06T01:38:49.518100+0000","last_unstale":"2023-10-06T01:38:49.526916+0000","last_undegraded":"2023-10-06T01:38:49.526916+0000","last_fullsized":"2023-10-06T01:38:49.526916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:57.494182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.655794+0000","last_change":"2023-10-06T01:38:48.662504+0000","last_active":"2023-10-06T01:38:49.655794+0000","last_peered":"2023-10-06T01:38:49.655794+0000","last_clean":"2023-10-06T01:38:49.655794+0000","last_became_active":"2023-10-06T01:38:48.662220+0000","last_became_peered":"2023-10-06T01:38:48.662220+0000","last_unstale":"2023-10-06T01:38:49.655794+0000","last_undegraded":"2023-10-06T01:38:49.655794+0000","last_fullsized":"2023-10-06T01:38:49.655794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:54.859831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533135+0000","last_change":"2023-10-06T01:38:49.531208+0000","last_active":"2023-10-06T01:38:49.533135+0000","last_peered":"2023-10-06T01:38:49.533135+0000","last_clean":"2023-10-06T01:38:49.533135+0000","last_became_active":"2023-10-06T01:38:49.530797+0000","last_became_peered":"2023-10-06T01:38:49.530797+0000","last_unstale":"2023-10-06T01:38:49.533135+0000","last_undegraded":"2023-10-06T01:38:49.533135+0000","last_fullsized":"2023-10-06T01:38:49.533135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:57.494182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527811+0000","last_change":"2023-10-06T01:38:49.521503+0000","last_active":"2023-10-06T01:38:49.527811+0000","last_peered":"2023-10-06T01:38:49.527811+0000","last_clean":"2023-10-06T01:38:49.527811+0000","last_became_active":"2023-10-06T01:38:49.521219+0000","last_became_peered":"2023-10-06T01:38:49.521219+0000","last_unstale":"2023-10-06T01:38:49.527811+0000","last_undegraded":"2023-10-06T01:38:49.527811+0000","last_fullsized":"2023-10-06T01:38:49.527811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:34.443462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531744+0000","last_change":"2023-10-06T01:38:49.522310+0000","last_active":"2023-10-06T01:38:49.531744+0000","last_peered":"2023-10-06T01:38:49.531744+0000","last_clean":"2023-10-06T01:38:49.531744+0000","last_became_active":"2023-10-06T01:38:49.522062+0000","last_became_peered":"2023-10-06T01:38:49.522062+0000","last_unstale":"2023-10-06T01:38:49.531744+0000","last_undegraded":"2023-10-06T01:38:49.531744+0000","last_fullsized":"2023-10-06T01:38:49.531744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:04.188051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532797+0000","last_change":"2023-10-06T01:38:49.527987+0000","last_active":"2023-10-06T01:38:49.532797+0000","last_peered":"2023-10-06T01:38:49.532797+0000","last_clean":"2023-10-06T01:38:49.532797+0000","last_became_active":"2023-10-06T01:38:49.527716+0000","last_became_peered":"2023-10-06T01:38:49.527716+0000","last_unstale":"2023-10-06T01:38:49.532797+0000","last_undegraded":"2023-10-06T01:38:49.532797+0000","last_fullsized":"2023-10-06T01:38:49.532797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:11.839303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526877+0000","last_change":"2023-10-06T01:38:49.519300+0000","last_active":"2023-10-06T01:38:49.526877+0000","last_peered":"2023-10-06T01:38:49.526877+0000","last_clean":"2023-10-06T01:38:49.526877+0000","last_became_active":"2023-10-06T01:38:49.519069+0000","last_became_peered":"2023-10-06T01:38:49.519069+0000","last_unstale":"2023-10-06T01:38:49.526877+0000","last_undegraded":"2023-10-06T01:38:49.526877+0000","last_fullsized":"2023-10-06T01:38:49.526877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:04.140534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527983+0000","last_change":"2023-10-06T01:38:49.526134+0000","last_active":"2023-10-06T01:38:49.527983+0000","last_peered":"2023-10-06T01:38:49.527983+0000","last_clean":"2023-10-06T01:38:49.527983+0000","last_became_active":"2023-10-06T01:38:49.524965+0000","last_became_peered":"2023-10-06T01:38:49.524965+0000","last_unstale":"2023-10-06T01:38:49.527983+0000","last_undegraded":"2023-10-06T01:38:49.527983+0000","last_fullsized":"2023-10-06T01:38:49.527983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:27.359068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":876544,"data_stored":686098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298120,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073720,"statfs":{"total":96636764160,"available":96331489280,"internally_reserved":0,"allocated":851968,"data_stored":684900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55100000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69199999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58999999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.438}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66300000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297540,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074300,"statfs":{"total":96636764160,"available":96332083200,"internally_reserved":0,"allocated":258048,"data_stored":94068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":95570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":94602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66700000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:38:58.561 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T01:38:58.562 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-06T01:38:58.562 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-06T01:38:58.562 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-06T01:38:58.562 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-06T01:38:58.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.708+0000 7fc55f223700 1 Processor -- start 2023-10-06T01:38:58.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.708+0000 7fc55f223700 1 -- start start 2023-10-06T01:38:58.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.709+0000 7fc55f223700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc5580cb970 0x7fc558159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:58.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.709+0000 7fc55f223700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc55815a400 0x7fc558156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:58.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.709+0000 7fc55f223700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc55815ae40 con 0x7fc5580cb5a0 2023-10-06T01:38:58.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.709+0000 7fc55f223700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5580ce0f0 con 0x7fc55815a400 2023-10-06T01:38:58.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.709+0000 7fc55f223700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5580cbde0 con 0x7fc5580cb970 2023-10-06T01:38:58.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.709+0000 7fc55d7c0700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc55815a400 0x7fc558156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:58.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.709+0000 7fc55d7c0700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc55815a400 0x7fc558156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56682/0 (socket says 172.21.15.69:56682) 2023-10-06T01:38:58.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.709+0000 7fc55d7c0700 1 -- 172.21.15.69:0/418231966 learned_addr learned my addr 172.21.15.69:0/418231966 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:58.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.709+0000 7fc557fff700 1 --2- 172.21.15.69:0/418231966 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc5580cb970 0x7fc558159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:58.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.710+0000 7fc55d7c0700 1 -- 172.21.15.69:0/418231966 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc5580cb970 msgr2=0x7fc558159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:58.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.710+0000 7fc55d7c0700 1 --2- 172.21.15.69:0/418231966 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc5580cb970 0x7fc558159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:58.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.710+0000 7fc55d7c0700 1 -- 172.21.15.69:0/418231966 >> v1:172.21.15.88:6789/0 conn(0x7fc5580cb5a0 legacy=0x7fc5580cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:58.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.710+0000 7fc55d7c0700 1 -- 172.21.15.69:0/418231966 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc55815ab60 con 0x7fc55815a400 2023-10-06T01:38:58.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.710+0000 7fc55d7c0700 1 --2- 172.21.15.69:0/418231966 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc55815a400 0x7fc558156e90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc5500099e0 tx=0x7fc550009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d699c93eba74e31 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:58.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.710+0000 7fc5577fe700 1 -- 172.21.15.69:0/418231966 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55000b820 con 0x7fc55815a400 2023-10-06T01:38:58.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.710+0000 7fc5577fe700 1 -- 172.21.15.69:0/418231966 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55000b980 con 0x7fc55815a400 2023-10-06T01:38:58.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.710+0000 7fc5577fe700 1 -- 172.21.15.69:0/418231966 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55000bd20 con 0x7fc55815a400 2023-10-06T01:38:58.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.710+0000 7fc55f223700 1 -- 172.21.15.69:0/418231966 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc55815a400 msgr2=0x7fc558156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:58.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.710+0000 7fc55f223700 1 --2- 172.21.15.69:0/418231966 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc55815a400 0x7fc558156e90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc5500099e0 tx=0x7fc550009250 comp rx=0 tx=0).stop 2023-10-06T01:38:58.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.710+0000 7fc55f223700 1 -- 172.21.15.69:0/418231966 shutdown_connections 2023-10-06T01:38:58.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.710+0000 7fc55f223700 1 --2- 172.21.15.69:0/418231966 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc55815a400 0x7fc558156e90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:58.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.710+0000 7fc55f223700 1 --2- 172.21.15.69:0/418231966 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc5580cb970 0x7fc558159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:58.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.710+0000 7fc55f223700 1 -- 172.21.15.69:0/418231966 >> 172.21.15.69:0/418231966 conn(0x7fc558070e30 msgr2=0x7fc5580d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:58.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.710+0000 7fc55f223700 1 -- 172.21.15.69:0/418231966 shutdown_connections 2023-10-06T01:38:58.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.710+0000 7fc55f223700 1 -- 172.21.15.69:0/418231966 wait complete. 2023-10-06T01:38:58.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.711+0000 7fc55f223700 1 Processor -- start 2023-10-06T01:38:58.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.712+0000 7fc55f223700 1 -- start start 2023-10-06T01:38:58.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.712+0000 7fc55f223700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc5580cb5a0 0x7fc5580b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:58.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.712+0000 7fc55f223700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5580cb970 0x7fc55816a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:58.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.712+0000 7fc55f223700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc55815a400 0x7fc5580c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:58.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.712+0000 7fc55f223700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5580b5950 con 0x7fc5580cb970 2023-10-06T01:38:58.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.712+0000 7fc55f223700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc55816a890 con 0x7fc55815a400 2023-10-06T01:38:58.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.712+0000 7fc55f223700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5580b4d40 con 0x7fc5580cb5a0 2023-10-06T01:38:58.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.713+0000 7fc557fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5580cb970 0x7fc55816a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:58.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.713+0000 7fc557fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5580cb970 0x7fc55816a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56686/0 (socket says 172.21.15.69:56686) 2023-10-06T01:38:58.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.713+0000 7fc557fff700 1 -- 172.21.15.69:0/3529744950 learned_addr learned my addr 172.21.15.69:0/3529744950 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:58.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.713+0000 7fc55d7c0700 1 --2- 172.21.15.69:0/3529744950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc55815a400 0x7fc5580c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:58.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.713+0000 7fc55cfbf700 1 --2- 172.21.15.69:0/3529744950 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc5580cb5a0 0x7fc5580b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:58.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.713+0000 7fc557fff700 1 -- 172.21.15.69:0/3529744950 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc5580cb5a0 msgr2=0x7fc5580b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:58.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.713+0000 7fc557fff700 1 --2- 172.21.15.69:0/3529744950 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc5580cb5a0 0x7fc5580b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:58.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.713+0000 7fc557fff700 1 -- 172.21.15.69:0/3529744950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc55815a400 msgr2=0x7fc5580c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:58.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.713+0000 7fc557fff700 1 --2- 172.21.15.69:0/3529744950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc55815a400 0x7fc5580c9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:58.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.713+0000 7fc557fff700 1 -- 172.21.15.69:0/3529744950 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5500094f0 con 0x7fc5580cb970 2023-10-06T01:38:58.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.713+0000 7fc55cfbf700 1 --2- 172.21.15.69:0/3529744950 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc5580cb5a0 0x7fc5580b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:38:58.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.713+0000 7fc557fff700 1 --2- 172.21.15.69:0/3529744950 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5580cb970 0x7fc55816a350 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009f20 tx=0x7fc54c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:58.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.713+0000 7fc554ff9700 1 -- 172.21.15.69:0/3529744950 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c00cbd0 con 0x7fc5580cb970 2023-10-06T01:38:58.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.713+0000 7fc554ff9700 1 -- 172.21.15.69:0/3529744950 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc54c00f040 con 0x7fc5580cb970 2023-10-06T01:38:58.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.713+0000 7fc55f223700 1 -- 172.21.15.69:0/3529744950 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5580b5020 con 0x7fc5580cb970 2023-10-06T01:38:58.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.713+0000 7fc554ff9700 1 -- 172.21.15.69:0/3529744950 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc54c014480 con 0x7fc5580cb970 2023-10-06T01:38:58.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.713+0000 7fc55f223700 1 -- 172.21.15.69:0/3529744950 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5580b55e0 con 0x7fc5580cb970 2023-10-06T01:38:58.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.714+0000 7fc55f223700 1 -- 172.21.15.69:0/3529744950 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5580b5ac0 con 0x7fc5580cb970 2023-10-06T01:38:58.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.715+0000 7fc554ff9700 1 -- 172.21.15.69:0/3529744950 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc54c0147f0 con 0x7fc5580cb970 2023-10-06T01:38:58.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.715+0000 7fc554ff9700 1 --2- 172.21.15.69:0/3529744950 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc544066f30 0x7fc5440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:58.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.715+0000 7fc554ff9700 1 -- 172.21.15.69:0/3529744950 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc54c085080 con 0x7fc5580cb970 2023-10-06T01:38:58.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.715+0000 7fc55cfbf700 1 --2- 172.21.15.69:0/3529744950 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc544066f30 0x7fc5440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:58.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.715+0000 7fc55cfbf700 1 --2- 172.21.15.69:0/3529744950 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc544066f30 0x7fc5440693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc548007fd0 tx=0x7fc548009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:58.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.719+0000 7fc554ff9700 1 -- 172.21.15.69:0/3529744950 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc54c052190 con 0x7fc5580cb970 2023-10-06T01:38:58.957 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.956+0000 7fc55f223700 1 -- 172.21.15.69:0/3529744950 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fc55804c3c0 con 0x7fc5580cb970 2023-10-06T01:38:58.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.959+0000 7fc554ff9700 1 -- 172.21.15.69:0/3529744950 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163697 (secure 0 0 0) 0x7fc54c0557b0 con 0x7fc5580cb970 2023-10-06T01:38:58.961 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:38:58.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.961+0000 7fc55f223700 1 -- 172.21.15.69:0/3529744950 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc544066f30 msgr2=0x7fc5440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:58.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.961+0000 7fc55f223700 1 --2- 172.21.15.69:0/3529744950 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc544066f30 0x7fc5440693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc548007fd0 tx=0x7fc548009040 comp rx=0 tx=0).stop 2023-10-06T01:38:58.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.961+0000 7fc55f223700 1 -- 172.21.15.69:0/3529744950 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5580cb970 msgr2=0x7fc55816a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:58.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.961+0000 7fc55f223700 1 --2- 172.21.15.69:0/3529744950 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5580cb970 0x7fc55816a350 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc54c009f20 tx=0x7fc54c00b040 comp rx=0 tx=0).stop 2023-10-06T01:38:58.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.961+0000 7fc55f223700 1 -- 172.21.15.69:0/3529744950 shutdown_connections 2023-10-06T01:38:58.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.961+0000 7fc55f223700 1 --2- 172.21.15.69:0/3529744950 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc544066f30 0x7fc5440693e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:58.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.961+0000 7fc55f223700 1 --2- 172.21.15.69:0/3529744950 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc55815a400 0x7fc5580c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:58.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.961+0000 7fc55f223700 1 --2- 172.21.15.69:0/3529744950 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc5580cb5a0 0x7fc5580b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:58.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.961+0000 7fc55f223700 1 --2- 172.21.15.69:0/3529744950 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc5580cb970 0x7fc55816a350 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:58.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.961+0000 7fc55f223700 1 -- 172.21.15.69:0/3529744950 >> 172.21.15.69:0/3529744950 conn(0x7fc558070e30 msgr2=0x7fc5580ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:58.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.961+0000 7fc55f223700 1 -- 172.21.15.69:0/3529744950 shutdown_connections 2023-10-06T01:38:58.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:58.961+0000 7fc55f223700 1 -- 172.21.15.69:0/3529744950 wait complete. 2023-10-06T01:38:58.973 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":5,"active_gid":4105,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":90441},{"type":"v1","addr":"172.21.15.69:6833","nonce":90441}]},"active_addr":"172.21.15.69:6833/90441","active_change":"2023-10-06T01:38:30.239016+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":480665317}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":2636600286}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":1850425677}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":340606714}]}]} 2023-10-06T01:38:58.978 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-06T01:38:58.978 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-06T01:38:58.978 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:38:59.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.091+0000 7f3fed117700 1 Processor -- start 2023-10-06T01:38:59.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.091+0000 7f3fed117700 1 -- start start 2023-10-06T01:38:59.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.092+0000 7f3fed117700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3fe80cb5a0 0x7f3fe80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.092+0000 7f3fed117700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f3fe815a5d0 0x7f3fe8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.092+0000 7f3fed117700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe815ae40 con 0x7f3fe80cd9e0 2023-10-06T01:38:59.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.092+0000 7f3fed117700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe80d13f0 con 0x7f3fe815a5d0 2023-10-06T01:38:59.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.092+0000 7f3fed117700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe815ab60 con 0x7f3fe80cb5a0 2023-10-06T01:38:59.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.092+0000 7f3fe759e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f3fe815a5d0 0x7f3fe8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.092+0000 7f3fe759e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f3fe815a5d0 0x7f3fe8156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56692/0 (socket says 172.21.15.69:56692) 2023-10-06T01:38:59.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.092+0000 7f3fe6d9d700 1 --2- 172.21.15.69:0/2139753208 >> v2:172.21.15.88:3300/0 conn(0x7f3fe80cb5a0 0x7f3fe80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.092+0000 7f3fe759e700 1 -- 172.21.15.69:0/2139753208 learned_addr learned my addr 172.21.15.69:0/2139753208 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:59.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.092+0000 7f3fe6d9d700 1 -- 172.21.15.69:0/2139753208 >> v2:172.21.15.69:3300/0 conn(0x7f3fe815a5d0 msgr2=0x7f3fe8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:59.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.092+0000 7f3fe6d9d700 1 --2- 172.21.15.69:0/2139753208 >> v2:172.21.15.69:3300/0 conn(0x7f3fe815a5d0 0x7f3fe8156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.092+0000 7f3fe6d9d700 1 -- 172.21.15.69:0/2139753208 >> v1:172.21.15.88:6789/0 conn(0x7f3fe80cd9e0 legacy=0x7f3fe8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.092+0000 7f3fe6d9d700 1 -- 172.21.15.69:0/2139753208 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe80ccf00 con 0x7f3fe80cb5a0 2023-10-06T01:38:59.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.092+0000 7f3fe759e700 1 --2- 172.21.15.69:0/2139753208 >> v2:172.21.15.69:3300/0 conn(0x7f3fe815a5d0 0x7f3fe8156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:38:59.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.093+0000 7f3fe6d9d700 1 --2- 172.21.15.69:0/2139753208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fe80cb5a0 0x7f3fe80cb970 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3fd80098e0 tx=0x7f3fd80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6d7d66a6d1fd6bd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.093+0000 7f3fe659c700 1 -- 172.21.15.69:0/2139753208 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8011630 con 0x7f3fe80cb5a0 2023-10-06T01:38:59.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.093+0000 7f3fe659c700 1 -- 172.21.15.69:0/2139753208 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd8011790 con 0x7f3fe80cb5a0 2023-10-06T01:38:59.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.093+0000 7f3fe659c700 1 -- 172.21.15.69:0/2139753208 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd8011b30 con 0x7f3fe80cb5a0 2023-10-06T01:38:59.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.093+0000 7f3fed117700 1 -- 172.21.15.69:0/2139753208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fe80cb5a0 msgr2=0x7f3fe80cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.093+0000 7f3fed117700 1 --2- 172.21.15.69:0/2139753208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fe80cb5a0 0x7f3fe80cb970 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3fd80098e0 tx=0x7f3fd80091a0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.093+0000 7f3fed117700 1 -- 172.21.15.69:0/2139753208 shutdown_connections 2023-10-06T01:38:59.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.093+0000 7f3fed117700 1 --2- 172.21.15.69:0/2139753208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fe80cb5a0 0x7f3fe80cb970 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.093+0000 7f3fed117700 1 --2- 172.21.15.69:0/2139753208 >> v2:172.21.15.69:3300/0 conn(0x7f3fe815a5d0 0x7f3fe8156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.093+0000 7f3fed117700 1 -- 172.21.15.69:0/2139753208 >> 172.21.15.69:0/2139753208 conn(0x7f3fe8070e30 msgr2=0x7f3fe80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:59.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.093+0000 7f3fed117700 1 -- 172.21.15.69:0/2139753208 shutdown_connections 2023-10-06T01:38:59.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.093+0000 7f3fed117700 1 -- 172.21.15.69:0/2139753208 wait complete. 2023-10-06T01:38:59.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.094+0000 7f3fed117700 1 Processor -- start 2023-10-06T01:38:59.103 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.095+0000 7f3fed117700 1 -- start start 2023-10-06T01:38:59.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.095+0000 7f3fed117700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fe80cb5a0 0x7f3fe815c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.095+0000 7f3fed117700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fe80cd9e0 0x7f3fe8159730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.095+0000 7f3fed117700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3fe815a5d0 0x7f3fe8157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.095+0000 7f3fed117700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe8159330 con 0x7f3fe815a5d0 2023-10-06T01:38:59.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.095+0000 7f3fed117700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe8158410 con 0x7f3fe80cb5a0 2023-10-06T01:38:59.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.095+0000 7f3fed117700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe81586b0 con 0x7f3fe80cd9e0 2023-10-06T01:38:59.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.095+0000 7f3fe759e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3fe815a5d0 0x7f3fe8157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.095+0000 7f3fe759e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3fe815a5d0 0x7f3fe8157ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56702/0 (socket says 172.21.15.69:56702) 2023-10-06T01:38:59.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.095+0000 7f3fe759e700 1 -- 172.21.15.69:0/1272690567 learned_addr learned my addr 172.21.15.69:0/1272690567 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:59.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.095+0000 7f3fe6d9d700 1 --2- 172.21.15.69:0/1272690567 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fe80cb5a0 0x7f3fe815c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.095+0000 7f3fde59c700 1 --2- 172.21.15.69:0/1272690567 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fe80cd9e0 0x7f3fe8159730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.096+0000 7f3fe759e700 1 -- 172.21.15.69:0/1272690567 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fe80cd9e0 msgr2=0x7f3fe8159730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.096+0000 7f3fe759e700 1 --2- 172.21.15.69:0/1272690567 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fe80cd9e0 0x7f3fe8159730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.096+0000 7f3fe759e700 1 -- 172.21.15.69:0/1272690567 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fe80cb5a0 msgr2=0x7f3fe815c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.096+0000 7f3fe759e700 1 --2- 172.21.15.69:0/1272690567 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fe80cb5a0 0x7f3fe815c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.096+0000 7f3fe759e700 1 -- 172.21.15.69:0/1272690567 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe0009ae0 con 0x7f3fe815a5d0 2023-10-06T01:38:59.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.096+0000 7f3fe6d9d700 1 --2- 172.21.15.69:0/1272690567 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fe80cb5a0 0x7f3fe815c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:38:59.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.096+0000 7f3fe759e700 1 --2- 172.21.15.69:0/1272690567 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3fe815a5d0 0x7f3fe8157ed0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0009f30 tx=0x7f3fe000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.096+0000 7f3fdf7fe700 1 -- 172.21.15.69:0/1272690567 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe0018070 con 0x7f3fe815a5d0 2023-10-06T01:38:59.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.096+0000 7f3fdf7fe700 1 -- 172.21.15.69:0/1272690567 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe000f040 con 0x7f3fe815a5d0 2023-10-06T01:38:59.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.096+0000 7f3fdf7fe700 1 -- 172.21.15.69:0/1272690567 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe000ccf0 con 0x7f3fe815a5d0 2023-10-06T01:38:59.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.096+0000 7f3fed117700 1 -- 172.21.15.69:0/1272690567 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd8009420 con 0x7f3fe815a5d0 2023-10-06T01:38:59.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.096+0000 7f3fed117700 1 -- 172.21.15.69:0/1272690567 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe8158c70 con 0x7f3fe815a5d0 2023-10-06T01:38:59.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.097+0000 7f3fed117700 1 -- 172.21.15.69:0/1272690567 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe804c3c0 con 0x7f3fe815a5d0 2023-10-06T01:38:59.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.097+0000 7f3fdf7fe700 1 -- 172.21.15.69:0/1272690567 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3fe0003020 con 0x7f3fe815a5d0 2023-10-06T01:38:59.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.098+0000 7f3fdf7fe700 1 --2- 172.21.15.69:0/1272690567 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3fc8066f30 0x7f3fc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.098+0000 7f3fdf7fe700 1 -- 172.21.15.69:0/1272690567 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3fe0084580 con 0x7f3fe815a5d0 2023-10-06T01:38:59.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.098+0000 7f3fe6d9d700 1 --2- 172.21.15.69:0/1272690567 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3fc8066f30 0x7f3fc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.098+0000 7f3fe6d9d700 1 --2- 172.21.15.69:0/1272690567 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3fc8066f30 0x7f3fc80693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3fd80091e0 tx=0x7f3fd8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.102+0000 7f3fdf7fe700 1 -- 172.21.15.69:0/1272690567 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fe004d5a0 con 0x7f3fe815a5d0 2023-10-06T01:38:59.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.287+0000 7f3fed117700 1 -- 172.21.15.69:0/1272690567 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3fe80cd1e0 con 0x7f3fe815a5d0 2023-10-06T01:38:59.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.288+0000 7f3fdf7fe700 1 -- 172.21.15.69:0/1272690567 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f3fe0055120 con 0x7f3fe815a5d0 2023-10-06T01:38:59.289 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:38:59.289 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":24,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:38:50.506861+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:38:43.046056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:38:47.525023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:38:47.992048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:38:59.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.290+0000 7f3fed117700 1 -- 172.21.15.69:0/1272690567 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3fc8066f30 msgr2=0x7f3fc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.290+0000 7f3fed117700 1 --2- 172.21.15.69:0/1272690567 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3fc8066f30 0x7f3fc80693e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3fd80091e0 tx=0x7f3fd8017000 comp rx=0 tx=0).stop 2023-10-06T01:38:59.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.290+0000 7f3fed117700 1 -- 172.21.15.69:0/1272690567 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3fe815a5d0 msgr2=0x7f3fe8157ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.290+0000 7f3fed117700 1 --2- 172.21.15.69:0/1272690567 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3fe815a5d0 0x7f3fe8157ed0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0009f30 tx=0x7f3fe000b040 comp rx=0 tx=0).stop 2023-10-06T01:38:59.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.290+0000 7f3fed117700 1 -- 172.21.15.69:0/1272690567 shutdown_connections 2023-10-06T01:38:59.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.290+0000 7f3fed117700 1 --2- 172.21.15.69:0/1272690567 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3fc8066f30 0x7f3fc80693e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.290+0000 7f3fed117700 1 --2- 172.21.15.69:0/1272690567 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3fe815a5d0 0x7f3fe8157ed0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.290+0000 7f3fed117700 1 --2- 172.21.15.69:0/1272690567 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3fe80cb5a0 0x7f3fe815c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.290+0000 7f3fed117700 1 --2- 172.21.15.69:0/1272690567 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3fe80cd9e0 0x7f3fe8159730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.290+0000 7f3fed117700 1 -- 172.21.15.69:0/1272690567 >> 172.21.15.69:0/1272690567 conn(0x7f3fe8070e30 msgr2=0x7f3fe80b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:59.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.291+0000 7f3fed117700 1 -- 172.21.15.69:0/1272690567 shutdown_connections 2023-10-06T01:38:59.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.291+0000 7f3fed117700 1 -- 172.21.15.69:0/1272690567 wait complete. 2023-10-06T01:38:59.303 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-06T01:38:59.303 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:38:59.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.417+0000 7fec20fdd700 1 Processor -- start 2023-10-06T01:38:59.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.417+0000 7fec20fdd700 1 -- start start 2023-10-06T01:38:59.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.418+0000 7fec20fdd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fec1c15de50 0x7fec1c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.418+0000 7fec20fdd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fec1c0cef40 0x7fec1c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.418+0000 7fec20fdd700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec1c0cf3c0 con 0x7fec1c153c30 2023-10-06T01:38:59.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.418+0000 7fec20fdd700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1c15afd0 con 0x7fec1c15de50 2023-10-06T01:38:59.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.418+0000 7fec20fdd700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1c15b2b0 con 0x7fec1c0cef40 2023-10-06T01:38:59.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.418+0000 7fec12ffd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fec1c15de50 0x7fec1c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.418+0000 7fec1b7fe700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fec1c153c30 0x7fec1c15a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37360/0 (socket says 172.21.15.69:37360) 2023-10-06T01:38:59.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.418+0000 7fec1b7fe700 1 -- 172.21.15.69:0/3335495236 learned_addr learned my addr 172.21.15.69:0/3335495236 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:38:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.418+0000 7fec1bfff700 1 --2- 172.21.15.69:0/3335495236 >> v2:172.21.15.88:3300/0 conn(0x7fec1c0cef40 0x7fec1c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.418+0000 7fec12ffd700 1 -- 172.21.15.69:0/3335495236 >> v2:172.21.15.88:3300/0 conn(0x7fec1c0cef40 msgr2=0x7fec1c15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.418+0000 7fec12ffd700 1 --2- 172.21.15.69:0/3335495236 >> v2:172.21.15.88:3300/0 conn(0x7fec1c0cef40 0x7fec1c15c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.418+0000 7fec12ffd700 1 -- 172.21.15.69:0/3335495236 >> v1:172.21.15.69:6789/0 conn(0x7fec1c153c30 legacy=0x7fec1c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.418+0000 7fec12ffd700 1 -- 172.21.15.69:0/3335495236 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1c15b590 con 0x7fec1c15de50 2023-10-06T01:38:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.418+0000 7fec1affd700 1 -- 172.21.15.69:0/3335495236 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4017120474 0 0) 0x7fec1c0cf3c0 con 0x7fec1c153c30 2023-10-06T01:38:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.418+0000 7fec1bfff700 1 --2- 172.21.15.69:0/3335495236 >> v2:172.21.15.88:3300/0 conn(0x7fec1c0cef40 0x7fec1c15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:38:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.419+0000 7fec12ffd700 1 --2- 172.21.15.69:0/3335495236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec1c15de50 0x7fec1c0cea00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fec1c0cdab0 tx=0x7fec040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f925f6f9725ee252 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.419+0000 7fec1affd700 1 -- 172.21.15.69:0/3335495236 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0400b6b0 con 0x7fec1c15de50 2023-10-06T01:38:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.419+0000 7fec1affd700 1 -- 172.21.15.69:0/3335495236 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0400b810 con 0x7fec1c15de50 2023-10-06T01:38:59.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.419+0000 7fec1affd700 1 -- 172.21.15.69:0/3335495236 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0400bbb0 con 0x7fec1c15de50 2023-10-06T01:38:59.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.419+0000 7fec20fdd700 1 -- 172.21.15.69:0/3335495236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec1c15de50 msgr2=0x7fec1c0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.419+0000 7fec20fdd700 1 --2- 172.21.15.69:0/3335495236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec1c15de50 0x7fec1c0cea00 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fec1c0cdab0 tx=0x7fec040091a0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.419+0000 7fec20fdd700 1 -- 172.21.15.69:0/3335495236 shutdown_connections 2023-10-06T01:38:59.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.419+0000 7fec20fdd700 1 --2- 172.21.15.69:0/3335495236 >> v2:172.21.15.88:3300/0 conn(0x7fec1c0cef40 0x7fec1c15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.419+0000 7fec20fdd700 1 --2- 172.21.15.69:0/3335495236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec1c15de50 0x7fec1c0cea00 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.419+0000 7fec20fdd700 1 -- 172.21.15.69:0/3335495236 >> 172.21.15.69:0/3335495236 conn(0x7fec1c0703a0 msgr2=0x7fec1c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:59.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.419+0000 7fec20fdd700 1 -- 172.21.15.69:0/3335495236 shutdown_connections 2023-10-06T01:38:59.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.419+0000 7fec20fdd700 1 -- 172.21.15.69:0/3335495236 wait complete. 2023-10-06T01:38:59.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.420+0000 7fec20fdd700 1 Processor -- start 2023-10-06T01:38:59.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.421+0000 7fec20fdd700 1 -- start start 2023-10-06T01:38:59.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.421+0000 7fec20fdd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec1c0cef40 0x7fec1c0c9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.421+0000 7fec20fdd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec1c153c30 0x7fec1c147030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.421+0000 7fec20fdd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec1c15de50 0x7fec1c0b3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.427 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.421+0000 7fec20fdd700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c147570 con 0x7fec1c153c30 2023-10-06T01:38:59.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.421+0000 7fec20fdd700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c0b41c0 con 0x7fec1c0cef40 2023-10-06T01:38:59.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.421+0000 7fec20fdd700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c0b43e0 con 0x7fec1c15de50 2023-10-06T01:38:59.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.421+0000 7fec12ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec1c153c30 0x7fec1c147030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.421+0000 7fec12ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec1c153c30 0x7fec1c147030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56720/0 (socket says 172.21.15.69:56720) 2023-10-06T01:38:59.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.421+0000 7fec12ffd700 1 -- 172.21.15.69:0/404889021 learned_addr learned my addr 172.21.15.69:0/404889021 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:59.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.422+0000 7fec1b7fe700 1 --2- 172.21.15.69:0/404889021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec1c0cef40 0x7fec1c0c9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.422+0000 7fec1bfff700 1 --2- 172.21.15.69:0/404889021 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec1c15de50 0x7fec1c0b3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.422+0000 7fec12ffd700 1 -- 172.21.15.69:0/404889021 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec1c15de50 msgr2=0x7fec1c0b3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.422+0000 7fec12ffd700 1 --2- 172.21.15.69:0/404889021 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec1c15de50 0x7fec1c0b3c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.422+0000 7fec12ffd700 1 -- 172.21.15.69:0/404889021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec1c0cef40 msgr2=0x7fec1c0c9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.422+0000 7fec12ffd700 1 --2- 172.21.15.69:0/404889021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec1c0cef40 0x7fec1c0c9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.422+0000 7fec12ffd700 1 -- 172.21.15.69:0/404889021 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec04009420 con 0x7fec1c153c30 2023-10-06T01:38:59.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.422+0000 7fec1b7fe700 1 --2- 172.21.15.69:0/404889021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec1c0cef40 0x7fec1c0c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:38:59.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.422+0000 7fec1bfff700 1 --2- 172.21.15.69:0/404889021 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec1c15de50 0x7fec1c0b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:38:59.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.422+0000 7fec12ffd700 1 --2- 172.21.15.69:0/404889021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec1c153c30 0x7fec1c147030 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fec0400b0e0 tx=0x7fec04017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.422+0000 7fec13fff700 1 -- 172.21.15.69:0/404889021 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0400bb50 con 0x7fec1c153c30 2023-10-06T01:38:59.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.422+0000 7fec13fff700 1 -- 172.21.15.69:0/404889021 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec04011630 con 0x7fec1c153c30 2023-10-06T01:38:59.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.422+0000 7fec20fdd700 1 -- 172.21.15.69:0/404889021 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec1c0c7680 con 0x7fec1c153c30 2023-10-06T01:38:59.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.422+0000 7fec13fff700 1 -- 172.21.15.69:0/404889021 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec040119f0 con 0x7fec1c153c30 2023-10-06T01:38:59.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.422+0000 7fec20fdd700 1 -- 172.21.15.69:0/404889021 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1c0c7c40 con 0x7fec1c153c30 2023-10-06T01:38:59.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.423+0000 7fec20fdd700 1 -- 172.21.15.69:0/404889021 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec1c0c7e60 con 0x7fec1c153c30 2023-10-06T01:38:59.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.423+0000 7fec13fff700 1 -- 172.21.15.69:0/404889021 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fec040253f0 con 0x7fec1c153c30 2023-10-06T01:38:59.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.424+0000 7fec13fff700 1 --2- 172.21.15.69:0/404889021 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fec00066f30 0x7fec000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.424+0000 7fec1b7fe700 1 --2- 172.21.15.69:0/404889021 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fec00066f30 0x7fec000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.424+0000 7fec13fff700 1 -- 172.21.15.69:0/404889021 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fec04086180 con 0x7fec1c153c30 2023-10-06T01:38:59.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.424+0000 7fec1b7fe700 1 --2- 172.21.15.69:0/404889021 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fec00066f30 0x7fec000693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fec0c001810 tx=0x7fec0c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.428+0000 7fec13fff700 1 -- 172.21.15.69:0/404889021 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fec04053290 con 0x7fec1c153c30 2023-10-06T01:38:59.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.613+0000 7fec20fdd700 1 -- 172.21.15.69:0/404889021 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fec1c04c3c0 con 0x7fec1c153c30 2023-10-06T01:38:59.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.614+0000 7fec13fff700 1 -- 172.21.15.69:0/404889021 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16818 (secure 0 0 0) 0x7fec040568b0 con 0x7fec1c153c30 2023-10-06T01:38:59.614 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:38:59.615 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":24,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:38:50.506861+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:38:43.046056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:38:47.525023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:38:47.992048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:38:59.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.616+0000 7fec20fdd700 1 -- 172.21.15.69:0/404889021 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fec00066f30 msgr2=0x7fec000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.616+0000 7fec20fdd700 1 --2- 172.21.15.69:0/404889021 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fec00066f30 0x7fec000693e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fec0c001810 tx=0x7fec0c009040 comp rx=0 tx=0).stop 2023-10-06T01:38:59.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.616+0000 7fec20fdd700 1 -- 172.21.15.69:0/404889021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec1c153c30 msgr2=0x7fec1c147030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.616+0000 7fec20fdd700 1 --2- 172.21.15.69:0/404889021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec1c153c30 0x7fec1c147030 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fec0400b0e0 tx=0x7fec04017000 comp rx=0 tx=0).stop 2023-10-06T01:38:59.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.616+0000 7fec20fdd700 1 -- 172.21.15.69:0/404889021 shutdown_connections 2023-10-06T01:38:59.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.616+0000 7fec20fdd700 1 --2- 172.21.15.69:0/404889021 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fec00066f30 0x7fec000693e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.616+0000 7fec20fdd700 1 --2- 172.21.15.69:0/404889021 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fec1c15de50 0x7fec1c0b3c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.616+0000 7fec20fdd700 1 --2- 172.21.15.69:0/404889021 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fec1c0cef40 0x7fec1c0c9f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.616+0000 7fec20fdd700 1 --2- 172.21.15.69:0/404889021 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec1c153c30 0x7fec1c147030 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.616+0000 7fec20fdd700 1 -- 172.21.15.69:0/404889021 >> 172.21.15.69:0/404889021 conn(0x7fec1c0703a0 msgr2=0x7fec1c15c490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:59.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.616+0000 7fec20fdd700 1 -- 172.21.15.69:0/404889021 shutdown_connections 2023-10-06T01:38:59.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.616+0000 7fec20fdd700 1 -- 172.21.15.69:0/404889021 wait complete. 2023-10-06T01:38:59.629 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-06T01:38:59.629 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-06T01:38:59.630 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-06T01:38:59.630 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-06T01:38:59.630 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-06T01:38:59.631 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-06T01:38:59.631 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-06T01:38:59.631 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-06T01:38:59.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.821+0000 7f37f1cee700 1 Processor -- start 2023-10-06T01:38:59.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.821+0000 7f37f1cee700 1 -- start start 2023-10-06T01:38:59.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.822+0000 7f37f1cee700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37ec0c29b0 0x7f37ec156af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.822+0000 7f37f1cee700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f37ec070410 0x7f37ec160120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.822+0000 7f37f1cee700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37ec0c3a30 con 0x7f37ec13fcc0 2023-10-06T01:38:59.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.822+0000 7f37f1cee700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37ec0c2e20 con 0x7f37ec070410 2023-10-06T01:38:59.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.822+0000 7f37f1cee700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec0c3100 con 0x7f37ec0c29b0 2023-10-06T01:38:59.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.822+0000 7f37eaffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37ec0c29b0 0x7f37ec156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.822+0000 7f37ebfff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f37ec070410 0x7f37ec160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.822+0000 7f37ebfff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f37ec070410 0x7f37ec160120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56728/0 (socket says 172.21.15.69:56728) 2023-10-06T01:38:59.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.822+0000 7f37ebfff700 1 -- 172.21.15.69:0/1087983035 learned_addr learned my addr 172.21.15.69:0/1087983035 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:59.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.823+0000 7f37ebfff700 1 -- 172.21.15.69:0/1087983035 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37ec0c29b0 msgr2=0x7f37ec156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:59.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.823+0000 7f37ebfff700 1 --2- 172.21.15.69:0/1087983035 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37ec0c29b0 0x7f37ec156af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.823+0000 7f37ebfff700 1 -- 172.21.15.69:0/1087983035 >> v1:172.21.15.69:6789/0 conn(0x7f37ec13fcc0 legacy=0x7f37ec0c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.823+0000 7f37ebfff700 1 -- 172.21.15.69:0/1087983035 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ec0c33e0 con 0x7f37ec070410 2023-10-06T01:38:59.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.823+0000 7f37ebfff700 1 --2- 172.21.15.69:0/1087983035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37ec070410 0x7f37ec160120 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f37e4009f20 tx=0x7f37e4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed42bb87bb574b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.823+0000 7f6a523f2700 1 Processor -- start 2023-10-06T01:38:59.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.823+0000 7f6a523f2700 1 -- start start 2023-10-06T01:38:59.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.825+0000 7f6a523f2700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6a4c15da70 0x7f6a4c15de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.825+0000 7f6a523f2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6a4c0c3300 0x7f6a4c0c3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.825+0000 7f6a523f2700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a4c06e0c0 con 0x7f6a4c0cbf90 2023-10-06T01:38:59.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.825+0000 7f6a523f2700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a4c0c30c0 con 0x7f6a4c15da70 2023-10-06T01:38:59.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.825+0000 7f6a523f2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a4c06c6a0 con 0x7f6a4c0c3300 2023-10-06T01:38:59.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.825+0000 7f37ea7fc700 1 -- 172.21.15.69:0/1087983035 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e400e070 con 0x7f37ec070410 2023-10-06T01:38:59.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.825+0000 7f37ea7fc700 1 -- 172.21.15.69:0/1087983035 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e400ba80 con 0x7f37ec070410 2023-10-06T01:38:59.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.825+0000 7f37ea7fc700 1 -- 172.21.15.69:0/1087983035 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e40092e0 con 0x7f37ec070410 2023-10-06T01:38:59.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.825+0000 7f6a4bfff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6a4c15da70 0x7f6a4c15de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.825+0000 7f6a4bfff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f6a4c15da70 0x7f6a4c15de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56738/0 (socket says 172.21.15.69:56738) 2023-10-06T01:38:59.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.825+0000 7f6a4bfff700 1 -- 172.21.15.69:0/2128252658 learned_addr learned my addr 172.21.15.69:0/2128252658 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:59.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.825+0000 7f6a4bfff700 1 -- 172.21.15.69:0/2128252658 >> v2:172.21.15.88:3300/0 conn(0x7f6a4c0c3300 msgr2=0x7f6a4c0c3740 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T01:38:59.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.825+0000 7f6a4bfff700 1 --2- 172.21.15.69:0/2128252658 >> v2:172.21.15.88:3300/0 conn(0x7f6a4c0c3300 0x7f6a4c0c3740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.825+0000 7f6a4bfff700 1 -- 172.21.15.69:0/2128252658 >> v1:172.21.15.69:6789/0 conn(0x7f6a4c0cbf90 legacy=0x7f6a4c0c29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:59.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.825+0000 7f6a4bfff700 1 -- 172.21.15.69:0/2128252658 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c15e380 con 0x7f6a4c15da70 2023-10-06T01:38:59.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.826+0000 7f6a4bfff700 1 --2- 172.21.15.69:0/2128252658 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a4c15da70 0x7f6a4c15de40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c06b890 tx=0x7f6a40009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff69985e5d823ef1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.826+0000 7f37f1cee700 1 -- 172.21.15.69:0/1087983035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37ec070410 msgr2=0x7f37ec160120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.826+0000 7f37f1cee700 1 --2- 172.21.15.69:0/1087983035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37ec070410 0x7f37ec160120 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f37e4009f20 tx=0x7f37e4009840 comp rx=0 tx=0).stop 2023-10-06T01:38:59.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.826+0000 7f6a4affd700 1 -- 172.21.15.69:0/2128252658 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4000b820 con 0x7f6a4c15da70 2023-10-06T01:38:59.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.826+0000 7f6a4affd700 1 -- 172.21.15.69:0/2128252658 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4000b980 con 0x7f6a4c15da70 2023-10-06T01:38:59.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.826+0000 7f6a4affd700 1 -- 172.21.15.69:0/2128252658 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4000bd20 con 0x7f6a4c15da70 2023-10-06T01:38:59.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.826+0000 7f37f1cee700 1 -- 172.21.15.69:0/1087983035 shutdown_connections 2023-10-06T01:38:59.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.826+0000 7f37f1cee700 1 --2- 172.21.15.69:0/1087983035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37ec070410 0x7f37ec160120 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.826+0000 7f37f1cee700 1 --2- 172.21.15.69:0/1087983035 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37ec0c29b0 0x7f37ec156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.826+0000 7f37f1cee700 1 -- 172.21.15.69:0/1087983035 >> 172.21.15.69:0/1087983035 conn(0x7f37ec0ccb60 msgr2=0x7f37ec0ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:59.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.827+0000 7f6a523f2700 1 -- 172.21.15.69:0/2128252658 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a4c15da70 msgr2=0x7f6a4c15de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.827+0000 7f6a523f2700 1 --2- 172.21.15.69:0/2128252658 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a4c15da70 0x7f6a4c15de40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c06b890 tx=0x7f6a40009250 comp rx=0 tx=0).stop 2023-10-06T01:38:59.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.827+0000 7f6a523f2700 1 -- 172.21.15.69:0/2128252658 shutdown_connections 2023-10-06T01:38:59.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.827+0000 7f6a523f2700 1 --2- 172.21.15.69:0/2128252658 >> v2:172.21.15.88:3300/0 conn(0x7f6a4c0c3300 0x7f6a4c0c3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.827+0000 7f6a523f2700 1 --2- 172.21.15.69:0/2128252658 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a4c15da70 0x7f6a4c15de40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.827+0000 7f6a523f2700 1 -- 172.21.15.69:0/2128252658 >> 172.21.15.69:0/2128252658 conn(0x7f6a4c0ccb60 msgr2=0x7f6a4c0ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:59.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.827+0000 7f6a523f2700 1 -- 172.21.15.69:0/2128252658 shutdown_connections 2023-10-06T01:38:59.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.827+0000 7f6a523f2700 1 -- 172.21.15.69:0/2128252658 wait complete. 2023-10-06T01:38:59.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.827+0000 7f37f1cee700 1 -- 172.21.15.69:0/1087983035 shutdown_connections 2023-10-06T01:38:59.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.827+0000 7f37f1cee700 1 -- 172.21.15.69:0/1087983035 wait complete. 2023-10-06T01:38:59.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.829+0000 7f6a523f2700 1 Processor -- start 2023-10-06T01:38:59.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.829+0000 7f37f1cee700 1 Processor -- start 2023-10-06T01:38:59.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.829+0000 7f37f1cee700 1 -- start start 2023-10-06T01:38:59.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.829+0000 7f6a523f2700 1 -- start start 2023-10-06T01:38:59.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.830+0000 7f6a523f2700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6a4c0c3300 0x7f6a4c137070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.830+0000 7f8f47a55700 1 Processor -- start 2023-10-06T01:38:59.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.830+0000 7f6a523f2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a4c0cbf90 0x7f6a4c13fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.830+0000 7f6a523f2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a4c15da70 0x7f6a4c140970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.830+0000 7f6a523f2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c13e1d0 con 0x7f6a4c0cbf90 2023-10-06T01:38:59.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.830+0000 7f6a523f2700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c13eff0 con 0x7f6a4c15da70 2023-10-06T01:38:59.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.830+0000 7f6a523f2700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c13e3e0 con 0x7f6a4c0c3300 2023-10-06T01:38:59.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.830+0000 7f6a4b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a4c0cbf90 0x7f6a4c13fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.830+0000 7f6a4b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a4c0cbf90 0x7f6a4c13fcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56748/0 (socket says 172.21.15.69:56748) 2023-10-06T01:38:59.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.830+0000 7f6a4b7fe700 1 -- 172.21.15.69:0/1775741188 learned_addr learned my addr 172.21.15.69:0/1775741188 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:59.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.830+0000 7f37f1cee700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37ec070410 0x7f37ec12a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.830+0000 7f37f1cee700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37ec13fcc0 0x7f37ec1360a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.830+0000 7f37f1cee700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37ec1365e0 0x7f37ec0c9750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.830+0000 7f37f1cee700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec1373c0 con 0x7f37ec070410 2023-10-06T01:38:59.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.830+0000 7f37f1cee700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec136e00 con 0x7f37ec13fcc0 2023-10-06T01:38:59.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.830+0000 7f37f1cee700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ec1370e0 con 0x7f37ec1365e0 2023-10-06T01:38:59.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.830+0000 7f37eb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37ec070410 0x7f37ec12a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.830+0000 7f37eb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37ec070410 0x7f37ec12a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56760/0 (socket says 172.21.15.69:56760) 2023-10-06T01:38:59.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.830+0000 7f37eb7fe700 1 -- 172.21.15.69:0/842343093 learned_addr learned my addr 172.21.15.69:0/842343093 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:59.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.830+0000 7f6a5098f700 1 --2- 172.21.15.69:0/1775741188 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a4c15da70 0x7f6a4c140970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.830+0000 7f6a4bfff700 1 --2- 172.21.15.69:0/1775741188 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6a4c0c3300 0x7f6a4c137070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.831+0000 7f6a4b7fe700 1 -- 172.21.15.69:0/1775741188 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6a4c0c3300 msgr2=0x7f6a4c137070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.831+0000 7f6a4b7fe700 1 --2- 172.21.15.69:0/1775741188 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6a4c0c3300 0x7f6a4c137070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.831+0000 7f6a4b7fe700 1 -- 172.21.15.69:0/1775741188 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a4c15da70 msgr2=0x7f6a4c140970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.831+0000 7f6a4b7fe700 1 --2- 172.21.15.69:0/1775741188 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6a4c15da70 0x7f6a4c140970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.831+0000 7f6a4b7fe700 1 -- 172.21.15.69:0/1775741188 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a400094f0 con 0x7f6a4c0cbf90 2023-10-06T01:38:59.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.830+0000 7f8f47a55700 1 -- start start 2023-10-06T01:38:59.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.831+0000 7f37ebfff700 1 --2- 172.21.15.69:0/842343093 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37ec1365e0 0x7f37ec0c9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.831+0000 7f37eb7fe700 1 -- 172.21.15.69:0/842343093 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37ec1365e0 msgr2=0x7f37ec0c9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.831+0000 7f37eb7fe700 1 --2- 172.21.15.69:0/842343093 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f37ec1365e0 0x7f37ec0c9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.831+0000 7f37eb7fe700 1 -- 172.21.15.69:0/842343093 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37ec13fcc0 msgr2=0x7f37ec1360a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.831+0000 7f37eb7fe700 1 --2- 172.21.15.69:0/842343093 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f37ec13fcc0 0x7f37ec1360a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.831+0000 7f6a4b7fe700 1 --2- 172.21.15.69:0/1775741188 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a4c0cbf90 0x7f6a4c13fcb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00c5d0 tx=0x7f6a3c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.831+0000 7f37eb7fe700 1 -- 172.21.15.69:0/842343093 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e4009ae0 con 0x7f37ec070410 2023-10-06T01:38:59.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.831+0000 7f6a33fff700 1 -- 172.21.15.69:0/1775741188 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c011590 con 0x7f6a4c0cbf90 2023-10-06T01:38:59.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.831+0000 7f6a33fff700 1 -- 172.21.15.69:0/1775741188 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a3c011710 con 0x7f6a4c0cbf90 2023-10-06T01:38:59.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.831+0000 7f6a33fff700 1 -- 172.21.15.69:0/1775741188 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a3c011ad0 con 0x7f6a4c0cbf90 2023-10-06T01:38:59.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.831+0000 7f6a523f2700 1 -- 172.21.15.69:0/1775741188 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a4c13e6c0 con 0x7f6a4c0cbf90 2023-10-06T01:38:59.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.831+0000 7f6a523f2700 1 -- 172.21.15.69:0/1775741188 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a4c13ec80 con 0x7f6a4c0cbf90 2023-10-06T01:38:59.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.832+0000 7f8f47a55700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8f40161440 0x7f8f400afa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.832+0000 7f8f47a55700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f40160fb0 con 0x7f8f4015db00 2023-10-06T01:38:59.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.832+0000 7f8f47a55700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f401603a0 con 0x7f8f4015fe40 2023-10-06T01:38:59.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.832+0000 7f8f47a55700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f40160680 con 0x7f8f40161440 2023-10-06T01:38:59.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.832+0000 7f8f44ff0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8f40161440 0x7f8f400afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.832+0000 7f8f44ff0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8f40161440 0x7f8f400afa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.69:42410/0 (socket says 172.21.15.69:42410) 2023-10-06T01:38:59.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.832+0000 7f8f44ff0700 1 -- 172.21.15.69:0/3229254663 learned_addr learned my addr 172.21.15.69:0/3229254663 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:59.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.831+0000 7f37eb7fe700 1 --2- 172.21.15.69:0/842343093 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37ec070410 0x7f37ec12a520 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f37e000c590 tx=0x7f37e0007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.832+0000 7f37d37fe700 1 -- 172.21.15.69:0/842343093 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e0011590 con 0x7f37ec070410 2023-10-06T01:38:59.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.832+0000 7f37d37fe700 1 -- 172.21.15.69:0/842343093 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e0011730 con 0x7f37ec070410 2023-10-06T01:38:59.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.832+0000 7f37d37fe700 1 -- 172.21.15.69:0/842343093 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e0011af0 con 0x7f37ec070410 2023-10-06T01:38:59.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.832+0000 7f37f1cee700 1 -- 172.21.15.69:0/842343093 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37ec12b490 con 0x7f37ec070410 2023-10-06T01:38:59.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.832+0000 7f37f1cee700 1 -- 172.21.15.69:0/842343093 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37ec136a50 con 0x7f37ec070410 2023-10-06T01:38:59.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.832+0000 7f017f953700 1 Processor -- start 2023-10-06T01:38:59.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.833+0000 7f017f953700 1 -- start start 2023-10-06T01:38:59.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.833+0000 7f8f37fff700 1 -- 172.21.15.69:0/3229254663 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416315079 0 0) 0x7f8f40160fb0 con 0x7f8f4015db00 2023-10-06T01:38:59.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.833+0000 7f8f37fff700 1 -- 172.21.15.69:0/3229254663 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f2c003570 con 0x7f8f4015db00 2023-10-06T01:38:59.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.832+0000 7f2c1706f700 1 Processor -- start 2023-10-06T01:38:59.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.832+0000 7f2c1706f700 1 -- start start 2023-10-06T01:38:59.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.833+0000 7f8f37fff700 1 -- 172.21.15.69:0/3229254663 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4098961407 0 0) 0x7f8f2c003570 con 0x7f8f4015db00 2023-10-06T01:38:59.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.833+0000 7f8f37fff700 1 -- 172.21.15.69:0/3229254663 >> v2:172.21.15.88:3300/0 conn(0x7f8f40161440 msgr2=0x7f8f400afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:59.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.833+0000 7f8f37fff700 1 --2- 172.21.15.69:0/3229254663 >> v2:172.21.15.88:3300/0 conn(0x7f8f40161440 0x7f8f400afa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.833+0000 7f8f37fff700 1 -- 172.21.15.69:0/3229254663 >> v1:172.21.15.88:6789/0 conn(0x7f8f4015fe40 legacy=0x7f8f4015ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:59.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.833+0000 7f8f37fff700 1 -- 172.21.15.69:0/3229254663 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f40160960 con 0x7f8f4015db00 2023-10-06T01:38:59.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.833+0000 7f8f37fff700 1 -- 172.21.15.69:0/3229254663 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f8f380017f0 con 0x7f8f4015db00 2023-10-06T01:38:59.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.833+0000 7f8f37fff700 1 -- 172.21.15.69:0/3229254663 >> v1:172.21.15.69:6789/0 conn(0x7f8f4015db00 legacy=0x7f8f400b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.833+0000 7f8f37fff700 1 --2- 172.21.15.69:0/3229254663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f2c003ae0 0x7f8f2c003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.833+0000 7f8f37fff700 1 --2- 172.21.15.69:0/3229254663 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8f2c004810 0x7f8f2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.833+0000 7f8f37fff700 1 --2- 172.21.15.69:0/3229254663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f2c005210 0x7f8f2c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.833+0000 7f8f37fff700 1 -- 172.21.15.69:0/3229254663 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f40160680 con 0x7f8f2c003ae0 2023-10-06T01:38:59.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.833+0000 7f8f37fff700 1 -- 172.21.15.69:0/3229254663 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c00c130 con 0x7f8f2c005210 2023-10-06T01:38:59.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.833+0000 7f8f37fff700 1 -- 172.21.15.69:0/3229254663 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c00c2f0 con 0x7f8f2c004810 2023-10-06T01:38:59.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.834+0000 7f8f457f1700 1 --2- 172.21.15.69:0/3229254663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f2c003ae0 0x7f8f2c003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.834+0000 7f017f953700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f01780ae760 0x7f0178150170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.834+0000 7f017f953700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f01780afcd0 0x7f01780b0120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.834+0000 7f017f953700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f01781574e0 0x7f0178157960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.834+0000 7f017f953700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01780ae2d0 con 0x7f01780ae760 2023-10-06T01:38:59.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.834+0000 7f017f953700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01780b0a90 con 0x7f01781574e0 2023-10-06T01:38:59.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.834+0000 7f8f457f1700 1 -- 172.21.15.69:0/3229254663 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8f2c004810 msgr2=0x7f8f2c004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T01:38:59.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.834+0000 7f8f457f1700 1 --2- 172.21.15.69:0/3229254663 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8f2c004810 0x7f8f2c004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.834+0000 7f8f457f1700 1 -- 172.21.15.69:0/3229254663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f2c005210 msgr2=0x7f8f2c00ba60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T01:38:59.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.834+0000 7f8f457f1700 1 --2- 172.21.15.69:0/3229254663 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f2c005210 0x7f8f2c00ba60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.834+0000 7f8f457f1700 1 -- 172.21.15.69:0/3229254663 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f40160960 con 0x7f8f2c003ae0 2023-10-06T01:38:59.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.834+0000 7f8f45ff2700 1 -- 172.21.15.69:0/3229254663 reap_dead start 2023-10-06T01:38:59.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.834+0000 7f017f953700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01780ad9a0 con 0x7f01780afcd0 2023-10-06T01:38:59.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.834+0000 7f37d37fe700 1 -- 172.21.15.69:0/842343093 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f37e0012420 con 0x7f37ec070410 2023-10-06T01:38:59.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.834+0000 7f6a33fff700 1 -- 172.21.15.69:0/1775741188 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6a3c01c460 con 0x7f6a4c0cbf90 2023-10-06T01:38:59.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.834+0000 7f6a523f2700 1 -- 172.21.15.69:0/1775741188 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6a4c04c3c0 con 0x7f6a4c0cbf90 2023-10-06T01:38:59.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.834+0000 7f017d6ef700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f01780ae760 0x7f0178150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.834+0000 7f017d6ef700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f01780ae760 0x7f0178150170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56784/0 (socket says 172.21.15.69:56784) 2023-10-06T01:38:59.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.834+0000 7f017d6ef700 1 -- 172.21.15.69:0/3691803477 learned_addr learned my addr 172.21.15.69:0/3691803477 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:59.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.834+0000 7f017ceee700 1 --2- 172.21.15.69:0/3691803477 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f01780afcd0 0x7f01780b0120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.834+0000 7f8f457f1700 1 --2- 172.21.15.69:0/3229254663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f2c003ae0 0x7f8f2c003ed0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8f3800c610 tx=0x7f8f38002e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=419acc7b2d635672 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f37d37fe700 1 --2- 172.21.15.69:0/842343093 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f37d8067000 0x7f37d80694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f6a33fff700 1 --2- 172.21.15.69:0/1775741188 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6a38066fb0 0x7f6a38069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f6a4bfff700 1 --2- 172.21.15.69:0/1775741188 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6a38066fb0 0x7f6a38069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f017d6ef700 1 -- 172.21.15.69:0/3691803477 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f01780afcd0 msgr2=0x7f01780b0120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:59.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f017d6ef700 1 --2- 172.21.15.69:0/3691803477 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f01780afcd0 0x7f01780b0120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f37d37fe700 1 -- 172.21.15.69:0/842343093 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f37e0083aa0 con 0x7f37ec070410 2023-10-06T01:38:59.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f017d6ef700 1 -- 172.21.15.69:0/3691803477 >> v2:172.21.15.88:3300/0 conn(0x7f01781574e0 msgr2=0x7f0178157960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:59.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f017d6ef700 1 --2- 172.21.15.69:0/3691803477 >> v2:172.21.15.88:3300/0 conn(0x7f01781574e0 0x7f0178157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f017d6ef700 1 -- 172.21.15.69:0/3691803477 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01780adc80 con 0x7f01780ae760 2023-10-06T01:38:59.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.834+0000 7f2c1706f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2c100ca820 0x7f2c1006e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.834+0000 7f2c1706f700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c1006a140 con 0x7f2c100cabf0 2023-10-06T01:38:59.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.834+0000 7f2c1706f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c1006f080 con 0x7f2c1015de80 2023-10-06T01:38:59.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.834+0000 7f2c1706f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c1006f360 con 0x7f2c100ca820 2023-10-06T01:38:59.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.834+0000 7f2c0ffff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f2c100cabf0 0x7f2c1015d770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37392/0 (socket says 172.21.15.69:37392) 2023-10-06T01:38:59.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.834+0000 7f2c0ffff700 1 -- 172.21.15.69:0/1355347705 learned_addr learned my addr 172.21.15.69:0/1355347705 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:38:59.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f2c0f7fe700 1 -- 172.21.15.69:0/1355347705 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2466672994 0 0) 0x7f2c1006a140 con 0x7f2c100cabf0 2023-10-06T01:38:59.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f2c0f7fe700 1 -- 172.21.15.69:0/1355347705 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2bf8003570 con 0x7f2c100cabf0 2023-10-06T01:38:59.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f8f37fff700 1 -- 172.21.15.69:0/3229254663 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f38016070 con 0x7f8f2c003ae0 2023-10-06T01:38:59.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f6a33fff700 1 -- 172.21.15.69:0/1775741188 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6a3c084490 con 0x7f6a4c0cbf90 2023-10-06T01:38:59.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f8f37fff700 1 -- 172.21.15.69:0/3229254663 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f38006ba0 con 0x7f8f2c003ae0 2023-10-06T01:38:59.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f8f37fff700 1 -- 172.21.15.69:0/3229254663 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f38003130 con 0x7f8f2c003ae0 2023-10-06T01:38:59.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f6a33fff700 1 --2- 172.21.15.69:0/1775741188 >> [v2:172.21.15.69:6800/90673,v1:172.21.15.69:6801/90673] conn(0x7f6a3806f7e0 0x7f6a38071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f6a33fff700 1 -- 172.21.15.69:0/1775741188 --> [v2:172.21.15.69:6800/90673,v1:172.21.15.69:6801/90673] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6a380722a0 con 0x7f6a3806f7e0 2023-10-06T01:38:59.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f2c0f7fe700 1 -- 172.21.15.69:0/1355347705 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 603909531 0 0) 0x7f2bf8003570 con 0x7f2c100cabf0 2023-10-06T01:38:59.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f2c0f7fe700 1 -- 172.21.15.69:0/1355347705 >> v2:172.21.15.88:3300/0 conn(0x7f2c100ca820 msgr2=0x7f2c1006e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:59.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f2c0f7fe700 1 --2- 172.21.15.69:0/1355347705 >> v2:172.21.15.88:3300/0 conn(0x7f2c100ca820 0x7f2c1006e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f2c0f7fe700 1 -- 172.21.15.69:0/1355347705 >> v1:172.21.15.88:6789/0 conn(0x7f2c1015de80 legacy=0x7f2c1006a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:59.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f2c0f7fe700 1 -- 172.21.15.69:0/1355347705 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1006f640 con 0x7f2c100cabf0 2023-10-06T01:38:59.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f2c0f7fe700 1 -- 172.21.15.69:0/1355347705 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f2c00001470 con 0x7f2c100cabf0 2023-10-06T01:38:59.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f2c0f7fe700 1 -- 172.21.15.69:0/1355347705 >> v1:172.21.15.69:6789/0 conn(0x7f2c100cabf0 legacy=0x7f2c1015d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f2c0f7fe700 1 --2- 172.21.15.69:0/1355347705 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2bf8003a60 0x7f2bf8003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f2c0f7fe700 1 --2- 172.21.15.69:0/1355347705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bf8004810 0x7f2bf8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f2c0f7fe700 1 --2- 172.21.15.69:0/1355347705 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bf8005310 0x7f2bf800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f2c0f7fe700 1 -- 172.21.15.69:0/1355347705 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1006f360 con 0x7f2bf8005310 2023-10-06T01:38:59.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f2c0f7fe700 1 -- 172.21.15.69:0/1355347705 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf800c230 con 0x7f2bf8004810 2023-10-06T01:38:59.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f2c0f7fe700 1 -- 172.21.15.69:0/1355347705 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bf800c3f0 con 0x7f2bf8003a60 2023-10-06T01:38:59.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f017d6ef700 1 --2- 172.21.15.69:0/3691803477 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01780ae760 0x7f0178150170 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f017815aa40 tx=0x7f0174009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a14efff80dd49857 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.835+0000 7f6a5098f700 1 --2- 172.21.15.69:0/1775741188 >> [v2:172.21.15.69:6800/90673,v1:172.21.15.69:6801/90673] conn(0x7f6a3806f7e0 0x7f6a38071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.836+0000 7f016ffff700 1 -- 172.21.15.69:0/3691803477 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0174009e70 con 0x7f01780ae760 2023-10-06T01:38:59.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.836+0000 7f016ffff700 1 -- 172.21.15.69:0/3691803477 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f017400b860 con 0x7f01780ae760 2023-10-06T01:38:59.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.836+0000 7f016ffff700 1 -- 172.21.15.69:0/3691803477 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f017400bbe0 con 0x7f01780ae760 2023-10-06T01:38:59.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.836+0000 7f37eaffd700 1 --2- 172.21.15.69:0/842343093 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f37d8067000 0x7f37d80694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.836+0000 7f2c1560c700 1 --2- 172.21.15.69:0/1355347705 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bf8005310 0x7f2bf800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.836+0000 7f2c14e0b700 1 --2- 172.21.15.69:0/1355347705 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2bf8003a60 0x7f2bf8003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.836+0000 7f8f47a55700 1 -- 172.21.15.69:0/3229254663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f2c003ae0 msgr2=0x7f8f2c003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.836+0000 7f8f47a55700 1 --2- 172.21.15.69:0/3229254663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f2c003ae0 0x7f8f2c003ed0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8f3800c610 tx=0x7f8f38002e20 comp rx=0 tx=0).stop 2023-10-06T01:38:59.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.836+0000 7f6a5098f700 1 --2- 172.21.15.69:0/1775741188 >> [v2:172.21.15.69:6800/90673,v1:172.21.15.69:6801/90673] conn(0x7f6a3806f7e0 0x7f6a38071bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.836+0000 7f6a4bfff700 1 --2- 172.21.15.69:0/1775741188 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6a38066fb0 0x7f6a38069460 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c06b890 tx=0x7f6a40016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.836+0000 7f37eaffd700 1 --2- 172.21.15.69:0/842343093 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f37d8067000 0x7f37d80694b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f37dc006fd0 tx=0x7f37dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.836+0000 7f8f47a55700 1 -- 172.21.15.69:0/3229254663 shutdown_connections 2023-10-06T01:38:59.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.836+0000 7f8f47a55700 1 --2- 172.21.15.69:0/3229254663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f2c003ae0 0x7f8f2c003ed0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.836+0000 7f8f47a55700 1 -- 172.21.15.69:0/3229254663 >> 172.21.15.69:0/3229254663 conn(0x7f8f4006d170 msgr2=0x7f8f400cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:59.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.836+0000 7f6a33fff700 1 -- 172.21.15.69:0/1775741188 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6a3c0021c0 con 0x7f6a4c0cbf90 2023-10-06T01:38:59.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.836+0000 7f2c0ffff700 1 --2- 172.21.15.69:0/1355347705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bf8004810 0x7f2bf8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.836+0000 7f37f1cee700 1 --2- 172.21.15.69:0/842343093 >> [v2:172.21.15.88:6817/90900,v1:172.21.15.88:6819/90900] conn(0x7f37ec0c9c90 0x7f37ec0ca060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.836+0000 7f37f1cee700 1 -- 172.21.15.69:0/842343093 --> [v2:172.21.15.88:6817/90900,v1:172.21.15.88:6819/90900] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f37ec0ca5a0 con 0x7f37ec0c9c90 2023-10-06T01:38:59.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.836+0000 7f37ebfff700 1 --2- 172.21.15.69:0/842343093 >> [v2:172.21.15.88:6817/90900,v1:172.21.15.88:6819/90900] conn(0x7f37ec0c9c90 0x7f37ec0ca060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.836+0000 7f2c0ffff700 1 -- 172.21.15.69:0/1355347705 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2bf8003a60 msgr2=0x7f2bf8003e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:59.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.836+0000 7f2c0ffff700 1 --2- 172.21.15.69:0/1355347705 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2bf8003a60 0x7f2bf8003e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.836+0000 7f2c0ffff700 1 -- 172.21.15.69:0/1355347705 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bf8005310 msgr2=0x7f2bf800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:59.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.836+0000 7f2c0ffff700 1 --2- 172.21.15.69:0/1355347705 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bf8005310 0x7f2bf800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.836+0000 7f2c0ffff700 1 -- 172.21.15.69:0/1355347705 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bf8003570 con 0x7f2bf8004810 2023-10-06T01:38:59.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.837+0000 7f017f953700 1 -- 172.21.15.69:0/3691803477 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01780ae760 msgr2=0x7f0178150170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.837+0000 7f017f953700 1 --2- 172.21.15.69:0/3691803477 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01780ae760 0x7f0178150170 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f017815aa40 tx=0x7f0174009250 comp rx=0 tx=0).stop 2023-10-06T01:38:59.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.836+0000 7f2c1560c700 1 -- 172.21.15.69:0/1355347705 reap_dead start 2023-10-06T01:38:59.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.836+0000 7f8f47a55700 1 -- 172.21.15.69:0/3229254663 shutdown_connections 2023-10-06T01:38:59.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.837+0000 7f2c0ffff700 1 --2- 172.21.15.69:0/1355347705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bf8004810 0x7f2bf8004c80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000c3c0 tx=0x7f2c00001e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9cda4615091e267 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.837+0000 7f017f953700 1 -- 172.21.15.69:0/3691803477 shutdown_connections 2023-10-06T01:38:59.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.837+0000 7f017f953700 1 --2- 172.21.15.69:0/3691803477 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01780ae760 0x7f0178150170 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.837+0000 7f017f953700 1 --2- 172.21.15.69:0/3691803477 >> v2:172.21.15.88:3300/0 conn(0x7f01781574e0 0x7f0178157960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.837+0000 7f017f953700 1 --2- 172.21.15.69:0/3691803477 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f01780afcd0 0x7f01780b0120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.837+0000 7f017f953700 1 -- 172.21.15.69:0/3691803477 >> 172.21.15.69:0/3691803477 conn(0x7f01780cc300 msgr2=0x7f01780cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:59.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.837+0000 7faab76ab700 1 Processor -- start 2023-10-06T01:38:59.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.837+0000 7f8f47a55700 1 -- 172.21.15.69:0/3229254663 wait complete. 2023-10-06T01:38:59.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.837+0000 7f2c0f7fe700 1 -- 172.21.15.69:0/1355347705 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0000cc90 con 0x7f2bf8004810 2023-10-06T01:38:59.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.837+0000 7f2c0f7fe700 1 -- 172.21.15.69:0/1355347705 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c0000cdf0 con 0x7f2bf8004810 2023-10-06T01:38:59.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.837+0000 7f2c0f7fe700 1 -- 172.21.15.69:0/1355347705 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c00005b50 con 0x7f2bf8004810 2023-10-06T01:38:59.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.837+0000 7faab76ab700 1 -- start start 2023-10-06T01:38:59.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.837+0000 7f37ebfff700 1 --2- 172.21.15.69:0/842343093 >> [v2:172.21.15.88:6817/90900,v1:172.21.15.88:6819/90900] conn(0x7f37ec0c9c90 0x7f37ec0ca060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.837+0000 7f017f953700 1 -- 172.21.15.69:0/3691803477 shutdown_connections 2023-10-06T01:38:59.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.837+0000 7f017f953700 1 -- 172.21.15.69:0/3691803477 wait complete. 2023-10-06T01:38:59.871 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.837+0000 7f6a33fff700 1 -- 172.21.15.69:0/1775741188 <== osd.1 v2:172.21.15.69:6800/90673 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f6a380722a0 con 0x7f6a3806f7e0 2023-10-06T01:38:59.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.838+0000 7f37d37fe700 1 -- 172.21.15.69:0/842343093 <== osd.6 v2:172.21.15.88:6817/90900 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f37ec0ca5a0 con 0x7f37ec0c9c90 2023-10-06T01:38:59.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.838+0000 7f2c1706f700 1 -- 172.21.15.69:0/1355347705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bf8004810 msgr2=0x7f2bf8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.838+0000 7f2c1706f700 1 --2- 172.21.15.69:0/1355347705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bf8004810 0x7f2bf8004c80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f2c0000c3c0 tx=0x7f2c00001e50 comp rx=0 tx=0).stop 2023-10-06T01:38:59.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.838+0000 7f2c1706f700 1 -- 172.21.15.69:0/1355347705 shutdown_connections 2023-10-06T01:38:59.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.838+0000 7f2c1706f700 1 --2- 172.21.15.69:0/1355347705 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2bf8004810 0x7f2bf8004c80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.838+0000 7f2c1706f700 1 -- 172.21.15.69:0/1355347705 >> 172.21.15.69:0/1355347705 conn(0x7f2c100cc720 msgr2=0x7f2c100ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:59.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.838+0000 7faab76ab700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faab0159b40 0x7faab00ab250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.838+0000 7faab76ab700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faab00ab790 0x7faab00af410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.838+0000 7faab76ab700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faab00ac8e0 con 0x7faab006e3f0 2023-10-06T01:38:59.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.838+0000 7faab76ab700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faab00abcd0 con 0x7faab00ab790 2023-10-06T01:38:59.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.838+0000 7faab76ab700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab00abfb0 con 0x7faab0159b40 2023-10-06T01:38:59.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.838+0000 7f8f47a55700 1 Processor -- start 2023-10-06T01:38:59.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.838+0000 7f2c1706f700 1 -- 172.21.15.69:0/1355347705 shutdown_connections 2023-10-06T01:38:59.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.838+0000 7faab4c46700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faab0159b40 0x7faab00ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.839+0000 7faab4c46700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faab0159b40 0x7faab00ab250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.69:42362/0 (socket says 172.21.15.69:42362) 2023-10-06T01:38:59.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.839+0000 7faab4c46700 1 -- 172.21.15.69:0/24835037 learned_addr learned my addr 172.21.15.69:0/24835037 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:59.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.839+0000 7faab5c48700 1 --2- 172.21.15.69:0/24835037 >> v2:172.21.15.88:3300/0 conn(0x7faab00ab790 0x7faab00af410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.839+0000 7faab4c46700 1 -- 172.21.15.69:0/24835037 >> v2:172.21.15.88:3300/0 conn(0x7faab00ab790 msgr2=0x7faab00af410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:59.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.839+0000 7faab4c46700 1 --2- 172.21.15.69:0/24835037 >> v2:172.21.15.88:3300/0 conn(0x7faab00ab790 0x7faab00af410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.839+0000 7faab4c46700 1 -- 172.21.15.69:0/24835037 >> v1:172.21.15.69:6789/0 conn(0x7faab006e3f0 legacy=0x7faab006e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.839+0000 7faab4c46700 1 -- 172.21.15.69:0/24835037 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faab00ac290 con 0x7faab0159b40 2023-10-06T01:38:59.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.839+0000 7faab4c46700 1 --2- 172.21.15.69:0/24835037 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faab0159b40 0x7faab00ab250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7faaa8009f20 tx=0x7faaa8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e85d3c52e2b9a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.839+0000 7faaa7fff700 1 -- 172.21.15.69:0/24835037 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa800e070 con 0x7faab0159b40 2023-10-06T01:38:59.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.839+0000 7faaa7fff700 1 -- 172.21.15.69:0/24835037 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa800ba60 con 0x7faab0159b40 2023-10-06T01:38:59.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.839+0000 7faaa7fff700 1 -- 172.21.15.69:0/24835037 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa80092e0 con 0x7faab0159b40 2023-10-06T01:38:59.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.838+0000 7f8f47a55700 1 -- start start 2023-10-06T01:38:59.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.840+0000 7f8f47a55700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f2c003ae0 0x7f8f401586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.840+0000 7f8f47a55700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8f4014b6a0 0x7f8f400a7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.840+0000 7f8f47a55700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f400a89f0 0x7f8f4015e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.840+0000 7f8f47a55700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f400a8560 con 0x7f8f2c003ae0 2023-10-06T01:38:59.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.840+0000 7f8f47a55700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f4014bb10 con 0x7f8f400a89f0 2023-10-06T01:38:59.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.840+0000 7f8f47a55700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f400a7950 con 0x7f8f4014b6a0 2023-10-06T01:38:59.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.840+0000 7f8f457f1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f2c003ae0 0x7f8f401586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.840+0000 7f8f457f1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f2c003ae0 0x7f8f401586b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56802/0 (socket says 172.21.15.69:56802) 2023-10-06T01:38:59.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.840+0000 7f8f457f1700 1 -- 172.21.15.69:0/3906514304 learned_addr learned my addr 172.21.15.69:0/3906514304 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:59.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.840+0000 7faab76ab700 1 -- 172.21.15.69:0/24835037 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faab0159b40 msgr2=0x7faab00ab250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.840+0000 7faab76ab700 1 --2- 172.21.15.69:0/24835037 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faab0159b40 0x7faab00ab250 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7faaa8009f20 tx=0x7faaa8009840 comp rx=0 tx=0).stop 2023-10-06T01:38:59.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.840+0000 7faab76ab700 1 -- 172.21.15.69:0/24835037 shutdown_connections 2023-10-06T01:38:59.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.840+0000 7f8f45ff2700 1 --2- 172.21.15.69:0/3906514304 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f400a89f0 0x7f8f4015e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.840+0000 7faab76ab700 1 --2- 172.21.15.69:0/24835037 >> v2:172.21.15.88:3300/0 conn(0x7faab00ab790 0x7faab00af410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.840+0000 7faab76ab700 1 --2- 172.21.15.69:0/24835037 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faab0159b40 0x7faab00ab250 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.840+0000 7faab76ab700 1 -- 172.21.15.69:0/24835037 >> 172.21.15.69:0/24835037 conn(0x7faab00cc300 msgr2=0x7faab00cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:59.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.839+0000 7f2c1706f700 1 -- 172.21.15.69:0/1355347705 wait complete. 2023-10-06T01:38:59.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.840+0000 7f2c1706f700 1 Processor -- start 2023-10-06T01:38:59.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.840+0000 7f8f457f1700 1 -- 172.21.15.69:0/3906514304 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8f4014b6a0 msgr2=0x7f8f400a7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.840+0000 7f8f457f1700 1 --2- 172.21.15.69:0/3906514304 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8f4014b6a0 0x7f8f400a7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.840+0000 7f8f457f1700 1 -- 172.21.15.69:0/3906514304 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f400a89f0 msgr2=0x7f8f4015e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.840+0000 7f8f457f1700 1 --2- 172.21.15.69:0/3906514304 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f400a89f0 0x7f8f4015e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.840+0000 7f8f457f1700 1 -- 172.21.15.69:0/3906514304 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f400a7c30 con 0x7f8f2c003ae0 2023-10-06T01:38:59.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.841+0000 7f8f45ff2700 1 --2- 172.21.15.69:0/3906514304 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f400a89f0 0x7f8f4015e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:38:59.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.841+0000 7f8f457f1700 1 --2- 172.21.15.69:0/3906514304 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f2c003ae0 0x7f8f401586b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0057f0 tx=0x7f8f38016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.841+0000 7f8f357fa700 1 -- 172.21.15.69:0/3906514304 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f38000fb0 con 0x7f8f2c003ae0 2023-10-06T01:38:59.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.841+0000 7f8f357fa700 1 -- 172.21.15.69:0/3906514304 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f38006d10 con 0x7f8f2c003ae0 2023-10-06T01:38:59.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.841+0000 7f8f47a55700 1 -- 172.21.15.69:0/3906514304 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f400a7f10 con 0x7f8f2c003ae0 2023-10-06T01:38:59.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.842+0000 7faab76ab700 1 -- 172.21.15.69:0/24835037 shutdown_connections 2023-10-06T01:38:59.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.841+0000 7f8f357fa700 1 -- 172.21.15.69:0/3906514304 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f3801e690 con 0x7f8f2c003ae0 2023-10-06T01:38:59.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.841+0000 7f8f47a55700 1 -- 172.21.15.69:0/3906514304 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f400a7640 con 0x7f8f2c003ae0 2023-10-06T01:38:59.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.842+0000 7f8f47a55700 1 -- 172.21.15.69:0/3906514304 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8f4004c3c0 con 0x7f8f2c003ae0 2023-10-06T01:38:59.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.842+0000 7faab76ab700 1 -- 172.21.15.69:0/24835037 wait complete. 2023-10-06T01:38:59.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.843+0000 7faab76ab700 1 Processor -- start 2023-10-06T01:38:59.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.843+0000 7f8f357fa700 1 -- 172.21.15.69:0/3906514304 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f3801ec50 con 0x7f8f2c003ae0 2023-10-06T01:38:59.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.844+0000 7f8f357fa700 1 --2- 172.21.15.69:0/3906514304 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8f24066f30 0x7f8f240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.844+0000 7f8f357fa700 1 -- 172.21.15.69:0/3906514304 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8f38086c40 con 0x7f8f2c003ae0 2023-10-06T01:38:59.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.844+0000 7f8f44ff0700 1 --2- 172.21.15.69:0/3906514304 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8f24066f30 0x7f8f240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.844+0000 7f8f357fa700 1 --2- 172.21.15.69:0/3906514304 >> [v2:172.21.15.88:6800/90871,v1:172.21.15.88:6801/90871] conn(0x7f8f2406f7e0 0x7f8f24071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.844+0000 7f8f357fa700 1 -- 172.21.15.69:0/3906514304 --> [v2:172.21.15.88:6800/90871,v1:172.21.15.88:6801/90871] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8f240722a0 con 0x7f8f2406f7e0 2023-10-06T01:38:59.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.844+0000 7f8f357fa700 1 -- 172.21.15.69:0/3906514304 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8f38087010 con 0x7f8f2c003ae0 2023-10-06T01:38:59.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.844+0000 7f8f45ff2700 1 --2- 172.21.15.69:0/3906514304 >> [v2:172.21.15.88:6800/90871,v1:172.21.15.88:6801/90871] conn(0x7f8f2406f7e0 0x7f8f24071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.843+0000 7f2c1706f700 1 -- start start 2023-10-06T01:38:59.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.844+0000 7f2c1706f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bf8004810 0x7f2c10176e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.844+0000 7f2c1706f700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2c100c61f0 0x7f2c101628e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.844+0000 7f2c1706f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c10162e20 0x7f2c10159c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.844+0000 7f2c1706f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1015c230 con 0x7f2bf8004810 2023-10-06T01:38:59.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.844+0000 7f2c1706f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c101773d0 con 0x7f2c10162e20 2023-10-06T01:38:59.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.844+0000 7f2c1706f700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1015b360 con 0x7f2c100c61f0 2023-10-06T01:38:59.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.844+0000 7f2c0ffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2c100c61f0 0x7f2c101628e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.844+0000 7f2c0ffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2c100c61f0 0x7f2c101628e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.69:42402/0 (socket says 172.21.15.69:42402) 2023-10-06T01:38:59.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.844+0000 7f2c1560c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c10162e20 0x7f2c10159c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.844+0000 7f2c0ffff700 1 -- 172.21.15.69:0/3221128103 learned_addr learned my addr 172.21.15.69:0/3221128103 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:59.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.844+0000 7f2c14e0b700 1 --2- 172.21.15.69:0/3221128103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bf8004810 0x7f2c10176e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.845+0000 7f2c1560c700 1 -- 172.21.15.69:0/3221128103 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2c100c61f0 msgr2=0x7f2c101628e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.838+0000 7f017f953700 1 Processor -- start 2023-10-06T01:38:59.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.840+0000 7f017f953700 1 -- start start 2023-10-06T01:38:59.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.842+0000 7f017f953700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f01780ae760 0x7f01780cb280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.842+0000 7f017f953700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01780afcd0 0x7f017814ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.842+0000 7f017f953700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01781574e0 0x7f0178159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.842+0000 7f017f953700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01781774b0 con 0x7f01781574e0 2023-10-06T01:38:59.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.842+0000 7f017f953700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0178176910 con 0x7f01780afcd0 2023-10-06T01:38:59.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.842+0000 7f017f953700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0178176b80 con 0x7f01780ae760 2023-10-06T01:38:59.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.842+0000 7f017ceee700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01780afcd0 0x7f017814ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.842+0000 7f017ceee700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01780afcd0 0x7f017814ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.69:42460/0 (socket says 172.21.15.69:42460) 2023-10-06T01:38:59.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.842+0000 7f017ceee700 1 -- 172.21.15.69:0/3119247865 learned_addr learned my addr 172.21.15.69:0/3119247865 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:59.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.842+0000 7f017def0700 1 --2- 172.21.15.69:0/3119247865 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01781574e0 0x7f0178159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.842+0000 7f017d6ef700 1 --2- 172.21.15.69:0/3119247865 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f01780ae760 0x7f01780cb280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.843+0000 7f017ceee700 1 -- 172.21.15.69:0/3119247865 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f01780ae760 msgr2=0x7f01780cb280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.843+0000 7f017ceee700 1 --2- 172.21.15.69:0/3119247865 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f01780ae760 0x7f01780cb280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.843+0000 7f017ceee700 1 -- 172.21.15.69:0/3119247865 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01781574e0 msgr2=0x7f0178159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.843+0000 7f017ceee700 1 --2- 172.21.15.69:0/3119247865 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01781574e0 0x7f0178159ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.843+0000 7f017ceee700 1 -- 172.21.15.69:0/3119247865 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01740094f0 con 0x7f01780afcd0 2023-10-06T01:38:59.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.843+0000 7f017ceee700 1 --2- 172.21.15.69:0/3119247865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01780afcd0 0x7f017814ce40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f016800ec80 tx=0x7f01680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.843+0000 7f016d7fa700 1 -- 172.21.15.69:0/3119247865 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016800c850 con 0x7f01780afcd0 2023-10-06T01:38:59.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.843+0000 7f016d7fa700 1 -- 172.21.15.69:0/3119247865 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016800c9b0 con 0x7f01780afcd0 2023-10-06T01:38:59.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.843+0000 7f017f953700 1 -- 172.21.15.69:0/3119247865 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0178176e60 con 0x7f01780afcd0 2023-10-06T01:38:59.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.843+0000 7f016d7fa700 1 -- 172.21.15.69:0/3119247865 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016800cd50 con 0x7f01780afcd0 2023-10-06T01:38:59.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.843+0000 7f017f953700 1 -- 172.21.15.69:0/3119247865 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01780cb7c0 con 0x7f01780afcd0 2023-10-06T01:38:59.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.844+0000 7f017f953700 1 -- 172.21.15.69:0/3119247865 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f017804c3c0 con 0x7f01780afcd0 2023-10-06T01:38:59.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.845+0000 7f2c1560c700 1 --2- 172.21.15.69:0/3221128103 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2c100c61f0 0x7f2c101628e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.845+0000 7f2c1560c700 1 -- 172.21.15.69:0/3221128103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bf8004810 msgr2=0x7f2c10176e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.845+0000 7f2c1560c700 1 --2- 172.21.15.69:0/3221128103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bf8004810 0x7f2c10176e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.845+0000 7f2c1560c700 1 -- 172.21.15.69:0/3221128103 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1015b5b0 con 0x7f2c10162e20 2023-10-06T01:38:59.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.845+0000 7f2c14e0b700 1 --2- 172.21.15.69:0/3221128103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2bf8004810 0x7f2c10176e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:38:59.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.845+0000 7f2c0ffff700 1 --2- 172.21.15.69:0/3221128103 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2c100c61f0 0x7f2c101628e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:38:59.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.845+0000 7f8f44ff0700 1 --2- 172.21.15.69:0/3906514304 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8f24066f30 0x7f8f240693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8f400a9930 tx=0x7f8f30009250 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.845+0000 7f2c1560c700 1 --2- 172.21.15.69:0/3221128103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c10162e20 0x7f2c10159c70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2c100cc5f0 tx=0x7f2c04007d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.844+0000 7faab76ab700 1 -- start start 2023-10-06T01:38:59.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.845+0000 7faab76ab700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faab006e3f0 0x7faab0144d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.845+0000 7faab76ab700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faab00ab790 0x7faab014c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.845+0000 7faab76ab700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab01412d0 0x7faab014cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.845+0000 7faab76ab700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab0155ad0 con 0x7faab006e3f0 2023-10-06T01:38:59.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.845+0000 7faab76ab700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faab0155db0 con 0x7faab01412d0 2023-10-06T01:38:59.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.845+0000 7faab76ab700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faab00cb2d0 con 0x7faab00ab790 2023-10-06T01:38:59.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.845+0000 7faab5447700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faab006e3f0 0x7faab0144d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.845+0000 7faab5c48700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab01412d0 0x7faab014cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.845+0000 7faab5447700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faab006e3f0 0x7faab0144d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56820/0 (socket says 172.21.15.69:56820) 2023-10-06T01:38:59.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.845+0000 7faab5447700 1 -- 172.21.15.69:0/1337667418 learned_addr learned my addr 172.21.15.69:0/1337667418 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:59.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.845+0000 7f2c0cff9700 1 -- 172.21.15.69:0/3221128103 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c0400fe80 con 0x7f2c10162e20 2023-10-06T01:38:59.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.845+0000 7f2c0cff9700 1 -- 172.21.15.69:0/3221128103 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c04014680 con 0x7f2c10162e20 2023-10-06T01:38:59.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.845+0000 7f2c0cff9700 1 -- 172.21.15.69:0/3221128103 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c04014a40 con 0x7f2c10162e20 2023-10-06T01:38:59.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.845+0000 7faab4c46700 1 --2- 172.21.15.69:0/1337667418 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faab00ab790 0x7faab014c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.846+0000 7faab5c48700 1 -- 172.21.15.69:0/1337667418 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faab00ab790 msgr2=0x7faab014c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.846+0000 7faab5c48700 1 --2- 172.21.15.69:0/1337667418 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faab00ab790 0x7faab014c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.846+0000 7faab5c48700 1 -- 172.21.15.69:0/1337667418 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faab006e3f0 msgr2=0x7faab0144d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.846+0000 7faab5c48700 1 --2- 172.21.15.69:0/1337667418 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faab006e3f0 0x7faab0144d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.846+0000 7faab5c48700 1 -- 172.21.15.69:0/1337667418 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa8009ae0 con 0x7faab01412d0 2023-10-06T01:38:59.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.846+0000 7faab5c48700 1 --2- 172.21.15.69:0/1337667418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab01412d0 0x7faab014cec0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faaac00e950 tx=0x7faaac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.846+0000 7f2c1706f700 1 -- 172.21.15.69:0/3221128103 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c1015b890 con 0x7f2c10162e20 2023-10-06T01:38:59.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.846+0000 7f2c1706f700 1 -- 172.21.15.69:0/3221128103 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c1015be50 con 0x7f2c10162e20 2023-10-06T01:38:59.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.846+0000 7faaa57fa700 1 -- 172.21.15.69:0/1337667418 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac00c6a0 con 0x7faab01412d0 2023-10-06T01:38:59.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.846+0000 7faaa57fa700 1 -- 172.21.15.69:0/1337667418 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaac00c820 con 0x7faab01412d0 2023-10-06T01:38:59.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.846+0000 7faaa57fa700 1 -- 172.21.15.69:0/1337667418 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaac00cbe0 con 0x7faab01412d0 2023-10-06T01:38:59.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.846+0000 7f8f45ff2700 1 --2- 172.21.15.69:0/3906514304 >> [v2:172.21.15.88:6800/90871,v1:172.21.15.88:6801/90871] conn(0x7f8f2406f7e0 0x7f8f24071bf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.846+0000 7f016d7fa700 1 -- 172.21.15.69:0/3119247865 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0168013680 con 0x7f01780afcd0 2023-10-06T01:38:59.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.847+0000 7f2c1706f700 1 -- 172.21.15.69:0/3221128103 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2c1004c3c0 con 0x7f2c10162e20 2023-10-06T01:38:59.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.847+0000 7f016d7fa700 1 --2- 172.21.15.69:0/3119247865 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f015c066f30 0x7f015c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.847+0000 7f016d7fa700 1 -- 172.21.15.69:0/3119247865 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0168084980 con 0x7f01780afcd0 2023-10-06T01:38:59.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.847+0000 7f016d7fa700 1 --2- 172.21.15.69:0/3119247865 >> [v2:172.21.15.88:6808/90870,v1:172.21.15.88:6809/90870] conn(0x7f015c06f7e0 0x7f015c071bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.847+0000 7f016d7fa700 1 -- 172.21.15.69:0/3119247865 --> [v2:172.21.15.88:6808/90870,v1:172.21.15.88:6809/90870] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f015c0722a0 con 0x7f015c06f7e0 2023-10-06T01:38:59.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.847+0000 7f016d7fa700 1 -- 172.21.15.69:0/3119247865 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0168089220 con 0x7f01780afcd0 2023-10-06T01:38:59.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.847+0000 7f017d6ef700 1 --2- 172.21.15.69:0/3119247865 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f015c066f30 0x7f015c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.847+0000 7f017def0700 1 --2- 172.21.15.69:0/3119247865 >> [v2:172.21.15.88:6808/90870,v1:172.21.15.88:6809/90870] conn(0x7f015c06f7e0 0x7f015c071bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.847+0000 7faab76ab700 1 -- 172.21.15.69:0/1337667418 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faab00cb5b0 con 0x7faab01412d0 2023-10-06T01:38:59.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.847+0000 7faab76ab700 1 -- 172.21.15.69:0/1337667418 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faab00cae10 con 0x7faab01412d0 2023-10-06T01:38:59.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.848+0000 7f017d6ef700 1 --2- 172.21.15.69:0/3119247865 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f015c066f30 0x7f015c0693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f017815aa40 tx=0x7f0174017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.848+0000 7f017def0700 1 --2- 172.21.15.69:0/3119247865 >> [v2:172.21.15.88:6808/90870,v1:172.21.15.88:6809/90870] conn(0x7f015c06f7e0 0x7f015c071bf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.848+0000 7f2c0cff9700 1 -- 172.21.15.69:0/3221128103 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c04026440 con 0x7f2c10162e20 2023-10-06T01:38:59.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.848+0000 7f8f357fa700 1 -- 172.21.15.69:0/3906514304 <== osd.5 v2:172.21.15.88:6800/90871 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f8f240722a0 con 0x7f8f2406f7e0 2023-10-06T01:38:59.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.848+0000 7faab76ab700 1 -- 172.21.15.69:0/1337667418 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7faab00cb090 con 0x7faab01412d0 2023-10-06T01:38:59.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.848+0000 7f2c0cff9700 1 --2- 172.21.15.69:0/3221128103 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2bfc067000 0x7f2bfc0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.849+0000 7f2c0cff9700 1 -- 172.21.15.69:0/3221128103 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2c04084900 con 0x7f2c10162e20 2023-10-06T01:38:59.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.849+0000 7f2c0cff9700 1 --2- 172.21.15.69:0/3221128103 >> [v2:172.21.15.69:6824/90698,v1:172.21.15.69:6825/90698] conn(0x7f2bfc06f8b0 0x7f2bfc071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.849+0000 7f2c0cff9700 1 -- 172.21.15.69:0/3221128103 --> [v2:172.21.15.69:6824/90698,v1:172.21.15.69:6825/90698] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2bfc072370 con 0x7f2bfc06f8b0 2023-10-06T01:38:59.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.849+0000 7f2c0cff9700 1 -- 172.21.15.69:0/3221128103 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2c04084cd0 con 0x7f2c10162e20 2023-10-06T01:38:59.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.849+0000 7faaa57fa700 1 -- 172.21.15.69:0/1337667418 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faaac013470 con 0x7faab01412d0 2023-10-06T01:38:59.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.849+0000 7f016d7fa700 1 -- 172.21.15.69:0/3119247865 <== osd.4 v2:172.21.15.88:6808/90870 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f015c0722a0 con 0x7f015c06f7e0 2023-10-06T01:38:59.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.849+0000 7f2c14e0b700 1 --2- 172.21.15.69:0/3221128103 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2bfc067000 0x7f2bfc0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.849+0000 7faaa57fa700 1 --2- 172.21.15.69:0/1337667418 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7faa94067000 0x7faa940694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.849+0000 7f2c0ffff700 1 --2- 172.21.15.69:0/3221128103 >> [v2:172.21.15.69:6824/90698,v1:172.21.15.69:6825/90698] conn(0x7f2bfc06f8b0 0x7f2bfc071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.850+0000 7faaa57fa700 1 -- 172.21.15.69:0/1337667418 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7faaac084520 con 0x7faab01412d0 2023-10-06T01:38:59.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.850+0000 7f2c14e0b700 1 --2- 172.21.15.69:0/3221128103 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2bfc067000 0x7f2bfc0694b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2c1004cc40 tx=0x7f2c08009640 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.850+0000 7faab5447700 1 --2- 172.21.15.69:0/1337667418 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7faa94067000 0x7faa940694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.850+0000 7f2c0ffff700 1 --2- 172.21.15.69:0/3221128103 >> [v2:172.21.15.69:6824/90698,v1:172.21.15.69:6825/90698] conn(0x7f2bfc06f8b0 0x7f2bfc071cc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.850+0000 7faaa57fa700 1 --2- 172.21.15.69:0/1337667418 >> [v2:172.21.15.69:6816/90682,v1:172.21.15.69:6817/90682] conn(0x7faa9406f830 0x7faa94071c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.850+0000 7faaa57fa700 1 -- 172.21.15.69:0/1337667418 --> [v2:172.21.15.69:6816/90682,v1:172.21.15.69:6817/90682] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7faa940722f0 con 0x7faa9406f830 2023-10-06T01:38:59.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.850+0000 7faaa57fa700 1 -- 172.21.15.69:0/1337667418 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7faaac051a80 con 0x7faab01412d0 2023-10-06T01:38:59.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.850+0000 7faab4c46700 1 --2- 172.21.15.69:0/1337667418 >> [v2:172.21.15.69:6816/90682,v1:172.21.15.69:6817/90682] conn(0x7faa9406f830 0x7faa94071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.850+0000 7faab5447700 1 --2- 172.21.15.69:0/1337667418 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7faa94067000 0x7faa940694b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faab00b0220 tx=0x7faaa0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.851+0000 7faab4c46700 1 --2- 172.21.15.69:0/1337667418 >> [v2:172.21.15.69:6816/90682,v1:172.21.15.69:6817/90682] conn(0x7faa9406f830 0x7faa94071c40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.851+0000 7f2c0cff9700 1 -- 172.21.15.69:0/3221128103 <== osd.3 v2:172.21.15.69:6824/90698 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f2bfc072370 con 0x7f2bfc06f8b0 2023-10-06T01:38:59.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.851+0000 7faaa57fa700 1 -- 172.21.15.69:0/1337667418 <== osd.0 v2:172.21.15.69:6816/90682 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7faa940722f0 con 0x7faa9406f830 2023-10-06T01:38:59.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.858+0000 7fd20d0de700 1 Processor -- start 2023-10-06T01:38:59.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.858+0000 7fd20d0de700 1 -- start start 2023-10-06T01:38:59.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.859+0000 7fd20d0de700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd2080c3250 0x7fd20815a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.859+0000 7fd20d0de700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd20815aa20 0x7fd208163430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.859+0000 7fd20d0de700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd20806c7d0 con 0x7fd208143200 2023-10-06T01:38:59.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.859+0000 7fd20d0de700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2081171e0 con 0x7fd2080c3250 2023-10-06T01:38:59.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.859+0000 7fd20d0de700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2080c37a0 con 0x7fd20815aa20 2023-10-06T01:38:59.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.859+0000 7fd20759e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd20815aa20 0x7fd208163430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.859+0000 7fd20759e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd20815aa20 0x7fd208163430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.69:42492/0 (socket says 172.21.15.69:42492) 2023-10-06T01:38:59.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.859+0000 7fd20759e700 1 -- 172.21.15.69:0/3093590 learned_addr learned my addr 172.21.15.69:0/3093590 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:59.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.860+0000 7fd20759e700 1 -- 172.21.15.69:0/3093590 >> v2:172.21.15.69:3300/0 conn(0x7fd2080c3250 msgr2=0x7fd20815a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:59.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.860+0000 7fd20759e700 1 --2- 172.21.15.69:0/3093590 >> v2:172.21.15.69:3300/0 conn(0x7fd2080c3250 0x7fd20815a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.860+0000 7fd20759e700 1 -- 172.21.15.69:0/3093590 >> v1:172.21.15.69:6789/0 conn(0x7fd208143200 legacy=0x7fd208159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.860+0000 7fd20759e700 1 -- 172.21.15.69:0/3093590 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2080cc090 con 0x7fd20815aa20 2023-10-06T01:38:59.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.860+0000 7fd20759e700 1 --2- 172.21.15.69:0/3093590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd20815aa20 0x7fd208163430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd2080cbf90 tx=0x7fd200009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8eeaf7990ca13b5e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.860+0000 7fd205d9b700 1 -- 172.21.15.69:0/3093590 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20000e070 con 0x7fd20815aa20 2023-10-06T01:38:59.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.860+0000 7fd205d9b700 1 -- 172.21.15.69:0/3093590 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20000ba50 con 0x7fd20815aa20 2023-10-06T01:38:59.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.860+0000 7fd205d9b700 1 -- 172.21.15.69:0/3093590 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2000092e0 con 0x7fd20815aa20 2023-10-06T01:38:59.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.861+0000 7fd20d0de700 1 -- 172.21.15.69:0/3093590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd20815aa20 msgr2=0x7fd208163430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.861+0000 7fd20d0de700 1 --2- 172.21.15.69:0/3093590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd20815aa20 0x7fd208163430 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd2080cbf90 tx=0x7fd200009840 comp rx=0 tx=0).stop 2023-10-06T01:38:59.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.861+0000 7fd20d0de700 1 -- 172.21.15.69:0/3093590 shutdown_connections 2023-10-06T01:38:59.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.861+0000 7fd20d0de700 1 --2- 172.21.15.69:0/3093590 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd20815aa20 0x7fd208163430 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.861+0000 7fd20d0de700 1 --2- 172.21.15.69:0/3093590 >> v2:172.21.15.69:3300/0 conn(0x7fd2080c3250 0x7fd20815a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.861+0000 7fd20d0de700 1 -- 172.21.15.69:0/3093590 >> 172.21.15.69:0/3093590 conn(0x7fd2080ccb60 msgr2=0x7fd2080ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:59.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.863+0000 7f6a523f2700 1 -- 172.21.15.69:0/1775741188 --> [v2:172.21.15.69:6800/90673,v1:172.21.15.69:6801/90673] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6a4c070fc0 con 0x7f6a3806f7e0 2023-10-06T01:38:59.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.863+0000 7fd20d0de700 1 -- 172.21.15.69:0/3093590 shutdown_connections 2023-10-06T01:38:59.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.863+0000 7f51c1907700 1 Processor -- start 2023-10-06T01:38:59.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.863+0000 7f51c1907700 1 -- start start 2023-10-06T01:38:59.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.864+0000 7f51c1907700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f51bc161150 0x7f51bc0b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.864+0000 7f51c1907700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f51bc0b1dc0 0x7f51bc0af970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.864+0000 7f51c1907700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51bc0b0310 con 0x7f51bc0afeb0 2023-10-06T01:38:59.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.864+0000 7f51c1907700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51bc0b2230 con 0x7f51bc0b1dc0 2023-10-06T01:38:59.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.864+0000 7f51c1907700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc0aed90 con 0x7f51bc161150 2023-10-06T01:38:59.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.863+0000 7fd20d0de700 1 -- 172.21.15.69:0/3093590 wait complete. 2023-10-06T01:38:59.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.865+0000 7fd20d0de700 1 Processor -- start 2023-10-06T01:38:59.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.865+0000 7fd20d0de700 1 -- start start 2023-10-06T01:38:59.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.865+0000 7f51baffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f51bc161150 0x7f51bc0b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.865+0000 7f51baffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f51bc161150 0x7f51bc0b1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.69:42412/0 (socket says 172.21.15.69:42412) 2023-10-06T01:38:59.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.865+0000 7f51baffd700 1 -- 172.21.15.69:0/2448681556 learned_addr learned my addr 172.21.15.69:0/2448681556 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:59.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.865+0000 7f51baffd700 1 -- 172.21.15.69:0/2448681556 >> v2:172.21.15.88:3300/0 conn(0x7f51bc0b1dc0 msgr2=0x7f51bc0af970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T01:38:59.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.865+0000 7f51baffd700 1 --2- 172.21.15.69:0/2448681556 >> v2:172.21.15.88:3300/0 conn(0x7f51bc0b1dc0 0x7f51bc0af970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.865+0000 7f51baffd700 1 -- 172.21.15.69:0/2448681556 >> v1:172.21.15.88:6789/0 conn(0x7f51bc0afeb0 legacy=0x7f51bc15e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:38:59.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.865+0000 7f51baffd700 1 -- 172.21.15.69:0/2448681556 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc0ad3d0 con 0x7f51bc161150 2023-10-06T01:38:59.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.865+0000 7f51baffd700 1 --2- 172.21.15.69:0/2448681556 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f51bc161150 0x7f51bc0b1880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f51ac009f20 tx=0x7f51ac009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=afc6d8361020e31a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.865+0000 7f51ba7fc700 1 -- 172.21.15.69:0/2448681556 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac00e070 con 0x7f51bc161150 2023-10-06T01:38:59.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.866+0000 7fd20d0de700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd208143200 0x7fd20815af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.866+0000 7fd20d0de700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd20815aa20 0x7fd20815c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.866+0000 7fd20d0de700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2080c5140 0x7fd2080ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.866+0000 7fd20d0de700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20815bed0 con 0x7fd20815aa20 2023-10-06T01:38:59.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.866+0000 7fd20d0de700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd20815ccb0 con 0x7fd2080c5140 2023-10-06T01:38:59.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.866+0000 7fd20d0de700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd20815d060 con 0x7fd208143200 2023-10-06T01:38:59.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.866+0000 7fd20659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd20815aa20 0x7fd20815c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.866+0000 7fd20759e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2080c5140 0x7fd2080ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.866+0000 7fd20659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd20815aa20 0x7fd20815c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56838/0 (socket says 172.21.15.69:56838) 2023-10-06T01:38:59.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.866+0000 7fd20659c700 1 -- 172.21.15.69:0/2675378397 learned_addr learned my addr 172.21.15.69:0/2675378397 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:59.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.865+0000 7f51ba7fc700 1 -- 172.21.15.69:0/2448681556 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ac00ba40 con 0x7f51bc161150 2023-10-06T01:38:59.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.865+0000 7f51ba7fc700 1 -- 172.21.15.69:0/2448681556 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac0092e0 con 0x7f51bc161150 2023-10-06T01:38:59.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.866+0000 7fd20759e700 1 -- 172.21.15.69:0/2675378397 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd208143200 msgr2=0x7fd20815af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.866+0000 7fd20759e700 1 --2- 172.21.15.69:0/2675378397 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd208143200 0x7fd20815af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.866+0000 7fd20759e700 1 -- 172.21.15.69:0/2675378397 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd20815aa20 msgr2=0x7fd20815c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.866+0000 7fd20759e700 1 --2- 172.21.15.69:0/2675378397 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd20815aa20 0x7fd20815c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.866+0000 7fd20759e700 1 -- 172.21.15.69:0/2675378397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd200009ae0 con 0x7fd2080c5140 2023-10-06T01:38:59.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.866+0000 7f51c1907700 1 -- 172.21.15.69:0/2448681556 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f51bc161150 msgr2=0x7f51bc0b1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.866+0000 7f51c1907700 1 --2- 172.21.15.69:0/2448681556 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f51bc161150 0x7f51bc0b1880 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f51ac009f20 tx=0x7f51ac009840 comp rx=0 tx=0).stop 2023-10-06T01:38:59.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.867+0000 7fd20759e700 1 --2- 172.21.15.69:0/2675378397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2080c5140 0x7fd2080ca130 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd200015000 tx=0x7fd200018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.867+0000 7f51c1907700 1 -- 172.21.15.69:0/2448681556 shutdown_connections 2023-10-06T01:38:59.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.867+0000 7f51c1907700 1 --2- 172.21.15.69:0/2448681556 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f51bc161150 0x7f51bc0b1880 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.867+0000 7f51c1907700 1 --2- 172.21.15.69:0/2448681556 >> v2:172.21.15.88:3300/0 conn(0x7f51bc0b1dc0 0x7f51bc0af970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.867+0000 7f51c1907700 1 -- 172.21.15.69:0/2448681556 >> 172.21.15.69:0/2448681556 conn(0x7f51bc0cc300 msgr2=0x7f51bc0cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:59.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.867+0000 7f51c1907700 1 -- 172.21.15.69:0/2448681556 shutdown_connections 2023-10-06T01:38:59.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.867+0000 7f51c1907700 1 -- 172.21.15.69:0/2448681556 wait complete. 2023-10-06T01:38:59.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.867+0000 7fd1feffd700 1 -- 172.21.15.69:0/2675378397 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd200008dd0 con 0x7fd2080c5140 2023-10-06T01:38:59.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.868+0000 7f37f1cee700 1 -- 172.21.15.69:0/842343093 --> [v2:172.21.15.88:6817/90900,v1:172.21.15.88:6819/90900] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f37ec0c36c0 con 0x7f37ec0c9c90 2023-10-06T01:38:59.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.868+0000 7f6a33fff700 1 -- 172.21.15.69:0/1775741188 <== osd.1 v2:172.21.15.69:6800/90673 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6a4c070fc0 con 0x7f6a3806f7e0 2023-10-06T01:38:59.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.868+0000 7f51c1907700 1 Processor -- start 2023-10-06T01:38:59.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.867+0000 7fd1feffd700 1 -- 172.21.15.69:0/2675378397 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd200025460 con 0x7fd2080c5140 2023-10-06T01:38:59.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.867+0000 7fd20d0de700 1 -- 172.21.15.69:0/2675378397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd20815b630 con 0x7fd2080c5140 2023-10-06T01:38:59.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.867+0000 7fd20d0de700 1 -- 172.21.15.69:0/2675378397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd20815bbf0 con 0x7fd2080c5140 2023-10-06T01:38:59.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.869+0000 7fd1feffd700 1 -- 172.21.15.69:0/2675378397 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2000257e0 con 0x7fd2080c5140 2023-10-06T01:38:59.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.869+0000 7fd20d0de700 1 -- 172.21.15.69:0/2675378397 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd1ec000fd0 con 0x7fd2080c5140 2023-10-06T01:38:59.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.869+0000 7f51c1907700 1 -- start start 2023-10-06T01:38:59.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.869+0000 7faab76ab700 1 -- 172.21.15.69:0/1337667418 --> [v2:172.21.15.69:6816/90682,v1:172.21.15.69:6817/90682] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7faab004c3c0 con 0x7faa9406f830 2023-10-06T01:38:59.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.870+0000 7faaa57fa700 1 -- 172.21.15.69:0/1337667418 <== osd.0 v2:172.21.15.69:6816/90682 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7faab004c3c0 con 0x7faa9406f830 2023-10-06T01:38:59.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.870+0000 7fd1feffd700 1 -- 172.21.15.69:0/2675378397 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd200003040 con 0x7fd2080c5140 2023-10-06T01:38:59.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.870+0000 7faab76ab700 1 -- 172.21.15.69:0/1337667418 >> [v2:172.21.15.69:6816/90682,v1:172.21.15.69:6817/90682] conn(0x7faa9406f830 msgr2=0x7faa94071c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.870+0000 7faab76ab700 1 --2- 172.21.15.69:0/1337667418 >> [v2:172.21.15.69:6816/90682,v1:172.21.15.69:6817/90682] conn(0x7faa9406f830 0x7faa94071c40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.870+0000 7faab76ab700 1 -- 172.21.15.69:0/1337667418 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7faa94067000 msgr2=0x7faa940694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.870+0000 7faab76ab700 1 --2- 172.21.15.69:0/1337667418 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7faa94067000 0x7faa940694b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7faab00b0220 tx=0x7faaa0009040 comp rx=0 tx=0).stop 2023-10-06T01:38:59.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.870+0000 7faab76ab700 1 -- 172.21.15.69:0/1337667418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab01412d0 msgr2=0x7faab014cec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.870+0000 7faab76ab700 1 --2- 172.21.15.69:0/1337667418 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faab01412d0 0x7faab014cec0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7faaac00e950 tx=0x7faaac0091a0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.870+0000 7fd1feffd700 1 --2- 172.21.15.69:0/2675378397 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd1e8066f80 0x7fd1e8069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.870+0000 7f51c1907700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f51bc0afeb0 0x7f51bc159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.870+0000 7f51c1907700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51bc0b1dc0 0x7f51bc0a7b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.870+0000 7f51c1907700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51bc161150 0x7f51bc06af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.870+0000 7f51c1907700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc15b7b0 con 0x7f51bc161150 2023-10-06T01:38:59.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.870+0000 7f51c1907700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc0a9b10 con 0x7f51bc0b1dc0 2023-10-06T01:38:59.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.870+0000 7f51c1907700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc0a9df0 con 0x7f51bc0afeb0 2023-10-06T01:38:59.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.870+0000 7faab5c48700 1 -- 172.21.15.69:0/1337667418 reap_dead start 2023-10-06T01:38:59.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.870+0000 7fd1feffd700 1 -- 172.21.15.69:0/2675378397 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd2000863c0 con 0x7fd2080c5140 2023-10-06T01:38:59.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.870+0000 7f51baffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f51bc0afeb0 0x7f51bc159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.870+0000 7f51b27fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51bc0b1dc0 0x7f51bc0a7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.871+0000 7faab76ab700 1 -- 172.21.15.69:0/1337667418 shutdown_connections 2023-10-06T01:38:59.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.871+0000 7faab76ab700 1 -- 172.21.15.69:0/1337667418 >> 172.21.15.69:0/1337667418 conn(0x7faab00cc300 msgr2=0x7faab00aad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:59.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.871+0000 7f51b27fc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51bc0b1dc0 0x7f51bc0a7b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.69:42520/0 (socket says 172.21.15.69:42520) 2023-10-06T01:38:59.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.871+0000 7f51bb7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51bc161150 0x7f51bc06af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.871+0000 7f51b27fc700 1 -- 172.21.15.69:0/3833640669 learned_addr learned my addr 172.21.15.69:0/3833640669 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:38:59.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.871+0000 7faab76ab700 1 -- 172.21.15.69:0/1337667418 shutdown_connections 2023-10-06T01:38:59.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.871+0000 7fd1feffd700 1 --2- 172.21.15.69:0/2675378397 >> [v2:172.21.15.69:6808/90674,v1:172.21.15.69:6809/90674] conn(0x7fd1e806f830 0x7fd1e8071c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.871+0000 7fd1feffd700 1 -- 172.21.15.69:0/2675378397 --> [v2:172.21.15.69:6808/90674,v1:172.21.15.69:6809/90674] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd1e80722f0 con 0x7fd1e806f830 2023-10-06T01:38:59.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.871+0000 7fd1feffd700 1 -- 172.21.15.69:0/2675378397 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd200088a00 con 0x7fd2080c5140 2023-10-06T01:38:59.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.871+0000 7faab76ab700 1 -- 172.21.15.69:0/1337667418 wait complete. 2023-10-06T01:38:59.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.871+0000 7fd20659c700 1 --2- 172.21.15.69:0/2675378397 >> [v2:172.21.15.69:6808/90674,v1:172.21.15.69:6809/90674] conn(0x7fd1e806f830 0x7fd1e8071c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.871+0000 7f51baffd700 1 -- 172.21.15.69:0/3833640669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51bc0b1dc0 msgr2=0x7f51bc0a7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.871+0000 7f51baffd700 1 --2- 172.21.15.69:0/3833640669 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51bc0b1dc0 0x7f51bc0a7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.871+0000 7f51baffd700 1 -- 172.21.15.69:0/3833640669 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51bc161150 msgr2=0x7f51bc06af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.871+0000 7f51baffd700 1 --2- 172.21.15.69:0/3833640669 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51bc161150 0x7f51bc06af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.871+0000 7f51baffd700 1 -- 172.21.15.69:0/3833640669 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac009ae0 con 0x7f51bc0afeb0 2023-10-06T01:38:59.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.871+0000 7f51baffd700 1 --2- 172.21.15.69:0/3833640669 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f51bc0afeb0 0x7f51bc159e80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f51ac009f20 tx=0x7f51ac017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.871+0000 7fd20659c700 1 --2- 172.21.15.69:0/2675378397 >> [v2:172.21.15.69:6808/90674,v1:172.21.15.69:6809/90674] conn(0x7fd1e806f830 0x7fd1e8071c40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.871+0000 7f51b37fe700 1 -- 172.21.15.69:0/3833640669 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac0129a0 con 0x7f51bc0afeb0 2023-10-06T01:38:59.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.871+0000 7f51b37fe700 1 -- 172.21.15.69:0/3833640669 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ac012b00 con 0x7f51bc0afeb0 2023-10-06T01:38:59.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.871+0000 7f51b37fe700 1 -- 172.21.15.69:0/3833640669 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac01d420 con 0x7f51bc0afeb0 2023-10-06T01:38:59.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.871+0000 7f51c1907700 1 -- 172.21.15.69:0/3833640669 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51bc0aa0d0 con 0x7f51bc0afeb0 2023-10-06T01:38:59.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.872+0000 7f51c1907700 1 -- 172.21.15.69:0/3833640669 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51bc0aa690 con 0x7f51bc0afeb0 2023-10-06T01:38:59.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.872+0000 7fd1feffd700 1 -- 172.21.15.69:0/2675378397 <== osd.2 v2:172.21.15.69:6808/90674 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd1e80722f0 con 0x7fd1e806f830 2023-10-06T01:38:59.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.869+0000 7f37d37fe700 1 -- 172.21.15.69:0/842343093 <== osd.6 v2:172.21.15.88:6817/90900 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f37ec0c36c0 con 0x7f37ec0c9c90 2023-10-06T01:38:59.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.873+0000 7f37f1cee700 1 -- 172.21.15.69:0/842343093 >> [v2:172.21.15.88:6817/90900,v1:172.21.15.88:6819/90900] conn(0x7f37ec0c9c90 msgr2=0x7f37ec0ca060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.873+0000 7f37f1cee700 1 --2- 172.21.15.69:0/842343093 >> [v2:172.21.15.88:6817/90900,v1:172.21.15.88:6819/90900] conn(0x7f37ec0c9c90 0x7f37ec0ca060 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.873+0000 7fd206d9d700 1 --2- 172.21.15.69:0/2675378397 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd1e8066f80 0x7fd1e8069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.873+0000 7f51b37fe700 1 -- 172.21.15.69:0/3833640669 <== mon.2 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f51ac01d850 con 0x7f51bc0afeb0 2023-10-06T01:38:59.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.874+0000 7f51b37fe700 1 --2- 172.21.15.69:0/3833640669 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f519c066f30 0x7f519c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.874+0000 7f51b37fe700 1 -- 172.21.15.69:0/3833640669 <== mon.2 v2:172.21.15.88:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f51ac085af0 con 0x7f51bc0afeb0 2023-10-06T01:38:59.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.874+0000 7f51b27fc700 1 --2- 172.21.15.69:0/3833640669 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f519c066f30 0x7f519c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.874+0000 7f51b27fc700 1 --2- 172.21.15.69:0/3833640669 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f519c066f30 0x7f519c0693e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f51bc171630 tx=0x7f51a4000f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.876+0000 7f8f47a55700 1 -- 172.21.15.69:0/3906514304 --> [v2:172.21.15.88:6800/90871,v1:172.21.15.88:6801/90871] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8f40160c40 con 0x7f8f2406f7e0 2023-10-06T01:38:59.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.876+0000 7f8f357fa700 1 -- 172.21.15.69:0/3906514304 <== osd.5 v2:172.21.15.88:6800/90871 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8f40160c40 con 0x7f8f2406f7e0 2023-10-06T01:38:59.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.877+0000 7f8f47a55700 1 -- 172.21.15.69:0/3906514304 >> [v2:172.21.15.88:6800/90871,v1:172.21.15.88:6801/90871] conn(0x7f8f2406f7e0 msgr2=0x7f8f24071bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.877+0000 7f8f47a55700 1 --2- 172.21.15.69:0/3906514304 >> [v2:172.21.15.88:6800/90871,v1:172.21.15.88:6801/90871] conn(0x7f8f2406f7e0 0x7f8f24071bf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.877+0000 7f37f1cee700 1 -- 172.21.15.69:0/842343093 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f37d8067000 msgr2=0x7f37d80694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.877+0000 7f37f1cee700 1 --2- 172.21.15.69:0/842343093 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f37d8067000 0x7f37d80694b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f37dc006fd0 tx=0x7f37dc008040 comp rx=0 tx=0).stop 2023-10-06T01:38:59.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.877+0000 7f37f1cee700 1 -- 172.21.15.69:0/842343093 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37ec070410 msgr2=0x7f37ec12a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.877+0000 7f37f1cee700 1 --2- 172.21.15.69:0/842343093 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37ec070410 0x7f37ec12a520 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f37e000c590 tx=0x7f37e0007f30 comp rx=0 tx=0).stop 2023-10-06T01:38:59.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.877+0000 7f37ebfff700 1 -- 172.21.15.69:0/842343093 reap_dead start 2023-10-06T01:38:59.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.877+0000 7f37f1cee700 1 -- 172.21.15.69:0/842343093 shutdown_connections 2023-10-06T01:38:59.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.877+0000 7f37f1cee700 1 -- 172.21.15.69:0/842343093 >> 172.21.15.69:0/842343093 conn(0x7f37ec0ccb60 msgr2=0x7f37ec158b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:59.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.877+0000 7f8f47a55700 1 -- 172.21.15.69:0/3906514304 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8f24066f30 msgr2=0x7f8f240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.877+0000 7f8f47a55700 1 --2- 172.21.15.69:0/3906514304 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8f24066f30 0x7f8f240693e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8f400a9930 tx=0x7f8f30009250 comp rx=0 tx=0).stop 2023-10-06T01:38:59.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.877+0000 7f8f47a55700 1 -- 172.21.15.69:0/3906514304 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f2c003ae0 msgr2=0x7f8f401586b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.877+0000 7f8f47a55700 1 --2- 172.21.15.69:0/3906514304 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f2c003ae0 0x7f8f401586b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c0057f0 tx=0x7f8f38016000 comp rx=0 tx=0).stop 2023-10-06T01:38:59.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.877+0000 7f8f45ff2700 1 -- 172.21.15.69:0/3906514304 reap_dead start 2023-10-06T01:38:59.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.877+0000 7f8f47a55700 1 -- 172.21.15.69:0/3906514304 shutdown_connections 2023-10-06T01:38:59.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.877+0000 7f8f47a55700 1 -- 172.21.15.69:0/3906514304 >> 172.21.15.69:0/3906514304 conn(0x7f8f4006d170 msgr2=0x7f8f4015bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:59.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.877+0000 7f37f1cee700 1 -- 172.21.15.69:0/842343093 shutdown_connections 2023-10-06T01:38:59.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.877+0000 7f8f47a55700 1 -- 172.21.15.69:0/3906514304 shutdown_connections 2023-10-06T01:38:59.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.877+0000 7f37f1cee700 1 -- 172.21.15.69:0/842343093 wait complete. 2023-10-06T01:38:59.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.877+0000 7f8f47a55700 1 -- 172.21.15.69:0/3906514304 wait complete. 2023-10-06T01:38:59.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.878+0000 7fd206d9d700 1 --2- 172.21.15.69:0/2675378397 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd1e8066f80 0x7fd1e8069430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0001730 tx=0x7fd1f0007b40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.880+0000 7f6a523f2700 1 -- 172.21.15.69:0/1775741188 >> [v2:172.21.15.69:6800/90673,v1:172.21.15.69:6801/90673] conn(0x7f6a3806f7e0 msgr2=0x7f6a38071bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.880+0000 7f6a523f2700 1 --2- 172.21.15.69:0/1775741188 >> [v2:172.21.15.69:6800/90673,v1:172.21.15.69:6801/90673] conn(0x7f6a3806f7e0 0x7f6a38071bf0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.880+0000 7f6a523f2700 1 -- 172.21.15.69:0/1775741188 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6a38066fb0 msgr2=0x7f6a38069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.880+0000 7f6a523f2700 1 --2- 172.21.15.69:0/1775741188 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6a38066fb0 0x7f6a38069460 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c06b890 tx=0x7f6a40016000 comp rx=0 tx=0).stop 2023-10-06T01:38:59.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.880+0000 7f6a523f2700 1 -- 172.21.15.69:0/1775741188 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a4c0cbf90 msgr2=0x7f6a4c13fcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.880+0000 7f6a523f2700 1 --2- 172.21.15.69:0/1775741188 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a4c0cbf90 0x7f6a4c13fcb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c00c5d0 tx=0x7f6a3c007f60 comp rx=0 tx=0).stop 2023-10-06T01:38:59.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.880+0000 7f6a5098f700 1 -- 172.21.15.69:0/1775741188 reap_dead start 2023-10-06T01:38:59.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.880+0000 7f6a523f2700 1 -- 172.21.15.69:0/1775741188 shutdown_connections 2023-10-06T01:38:59.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.880+0000 7f6a523f2700 1 -- 172.21.15.69:0/1775741188 >> 172.21.15.69:0/1775741188 conn(0x7f6a4c0ccb60 msgr2=0x7f6a4c15b170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:59.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.880+0000 7f51c1907700 1 --2- 172.21.15.69:0/3833640669 >> [v2:172.21.15.88:6816/90901,v1:172.21.15.88:6818/90901] conn(0x7f51a00015f0 0x7f51a0003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:38:59.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.880+0000 7f51c1907700 1 -- 172.21.15.69:0/3833640669 --> [v2:172.21.15.88:6816/90901,v1:172.21.15.88:6818/90901] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f51a0006b90 con 0x7f51a00015f0 2023-10-06T01:38:59.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.881+0000 7f51bb7fe700 1 --2- 172.21.15.69:0/3833640669 >> [v2:172.21.15.88:6816/90901,v1:172.21.15.88:6818/90901] conn(0x7f51a00015f0 0x7f51a0003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:38:59.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.881+0000 7f51bb7fe700 1 --2- 172.21.15.69:0/3833640669 >> [v2:172.21.15.88:6816/90901,v1:172.21.15.88:6818/90901] conn(0x7f51a00015f0 0x7f51a0003aa0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:38:59.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.882+0000 7f51b37fe700 1 -- 172.21.15.69:0/3833640669 <== osd.7 v2:172.21.15.88:6816/90901 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f51a0006b90 con 0x7f51a00015f0 2023-10-06T01:38:59.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.882+0000 7f2c1706f700 1 -- 172.21.15.69:0/3221128103 --> [v2:172.21.15.69:6824/90698,v1:172.21.15.69:6825/90698] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2c1006f920 con 0x7f2bfc06f8b0 2023-10-06T01:38:59.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.883+0000 7f2c0cff9700 1 -- 172.21.15.69:0/3221128103 <== osd.3 v2:172.21.15.69:6824/90698 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2c1006f920 con 0x7f2bfc06f8b0 2023-10-06T01:38:59.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.883+0000 7f2c1706f700 1 -- 172.21.15.69:0/3221128103 >> [v2:172.21.15.69:6824/90698,v1:172.21.15.69:6825/90698] conn(0x7f2bfc06f8b0 msgr2=0x7f2bfc071cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.883+0000 7f2c1706f700 1 --2- 172.21.15.69:0/3221128103 >> [v2:172.21.15.69:6824/90698,v1:172.21.15.69:6825/90698] conn(0x7f2bfc06f8b0 0x7f2bfc071cc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.883+0000 7f2c1706f700 1 -- 172.21.15.69:0/3221128103 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2bfc067000 msgr2=0x7f2bfc0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.883+0000 7f2c1706f700 1 --2- 172.21.15.69:0/3221128103 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2bfc067000 0x7f2bfc0694b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2c1004cc40 tx=0x7f2c08009640 comp rx=0 tx=0).stop 2023-10-06T01:38:59.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.883+0000 7f2c1706f700 1 -- 172.21.15.69:0/3221128103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c10162e20 msgr2=0x7f2c10159c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.883+0000 7f2c1706f700 1 --2- 172.21.15.69:0/3221128103 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c10162e20 0x7f2c10159c70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2c100cc5f0 tx=0x7f2c04007d30 comp rx=0 tx=0).stop 2023-10-06T01:38:59.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.883+0000 7f2c1560c700 1 -- 172.21.15.69:0/3221128103 reap_dead start 2023-10-06T01:38:59.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.883+0000 7f017f953700 1 -- 172.21.15.69:0/3119247865 --> [v2:172.21.15.88:6808/90870,v1:172.21.15.88:6809/90870] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f01780adf60 con 0x7f015c06f7e0 2023-10-06T01:38:59.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.884+0000 7f2c1706f700 1 -- 172.21.15.69:0/3221128103 shutdown_connections 2023-10-06T01:38:59.942 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.884+0000 7f2c1706f700 1 -- 172.21.15.69:0/3221128103 >> 172.21.15.69:0/3221128103 conn(0x7f2c100cc720 msgr2=0x7f2c100b1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:59.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.884+0000 7f6a523f2700 1 -- 172.21.15.69:0/1775741188 shutdown_connections 2023-10-06T01:38:59.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.884+0000 7f2c1706f700 1 -- 172.21.15.69:0/3221128103 shutdown_connections 2023-10-06T01:38:59.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.884+0000 7f2c1706f700 1 -- 172.21.15.69:0/3221128103 wait complete. 2023-10-06T01:38:59.944 INFO:teuthology.orchestra.run.smithi069.stdout:55834574857 2023-10-06T01:38:59.945 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T01:38:59.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.884+0000 7f016d7fa700 1 -- 172.21.15.69:0/3119247865 <== osd.4 v2:172.21.15.88:6808/90870 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f01780adf60 con 0x7f015c06f7e0 2023-10-06T01:38:59.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.885+0000 7f017f953700 1 -- 172.21.15.69:0/3119247865 >> [v2:172.21.15.88:6808/90870,v1:172.21.15.88:6809/90870] conn(0x7f015c06f7e0 msgr2=0x7f015c071bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.945 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.885+0000 7f017f953700 1 --2- 172.21.15.69:0/3119247865 >> [v2:172.21.15.88:6808/90870,v1:172.21.15.88:6809/90870] conn(0x7f015c06f7e0 0x7f015c071bf0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.887+0000 7f6a523f2700 1 -- 172.21.15.69:0/1775741188 wait complete. 2023-10-06T01:38:59.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.891+0000 7f017f953700 1 -- 172.21.15.69:0/3119247865 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f015c066f30 msgr2=0x7f015c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.891+0000 7f017f953700 1 --2- 172.21.15.69:0/3119247865 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f015c066f30 0x7f015c0693e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f017815aa40 tx=0x7f0174017000 comp rx=0 tx=0).stop 2023-10-06T01:38:59.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.891+0000 7f017f953700 1 -- 172.21.15.69:0/3119247865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01780afcd0 msgr2=0x7f017814ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.891+0000 7f017f953700 1 --2- 172.21.15.69:0/3119247865 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01780afcd0 0x7f017814ce40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f016800ec80 tx=0x7f01680091a0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.893+0000 7f017def0700 1 -- 172.21.15.69:0/3119247865 reap_dead start 2023-10-06T01:38:59.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.893+0000 7f017f953700 1 -- 172.21.15.69:0/3119247865 shutdown_connections 2023-10-06T01:38:59.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.893+0000 7f017f953700 1 -- 172.21.15.69:0/3119247865 >> 172.21.15.69:0/3119247865 conn(0x7f01780cc300 msgr2=0x7f01780c8320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:59.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.898+0000 7fd20d0de700 1 -- 172.21.15.69:0/2675378397 --> [v2:172.21.15.69:6808/90674,v1:172.21.15.69:6809/90674] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd1ec002d30 con 0x7fd1e806f830 2023-10-06T01:38:59.948 INFO:teuthology.orchestra.run.smithi069.stdout:55834574855 2023-10-06T01:38:59.948 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T01:38:59.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.898+0000 7fd1feffd700 1 -- 172.21.15.69:0/2675378397 <== osd.2 v2:172.21.15.69:6808/90674 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd1ec002d30 con 0x7fd1e806f830 2023-10-06T01:38:59.949 INFO:teuthology.orchestra.run.smithi069.stdout:55834574857 2023-10-06T01:38:59.949 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T01:38:59.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.899+0000 7fd20d0de700 1 -- 172.21.15.69:0/2675378397 >> [v2:172.21.15.69:6808/90674,v1:172.21.15.69:6809/90674] conn(0x7fd1e806f830 msgr2=0x7fd1e8071c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.899+0000 7fd20d0de700 1 --2- 172.21.15.69:0/2675378397 >> [v2:172.21.15.69:6808/90674,v1:172.21.15.69:6809/90674] conn(0x7fd1e806f830 0x7fd1e8071c40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.899+0000 7fd20d0de700 1 -- 172.21.15.69:0/2675378397 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd1e8066f80 msgr2=0x7fd1e8069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.899+0000 7fd20d0de700 1 --2- 172.21.15.69:0/2675378397 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd1e8066f80 0x7fd1e8069430 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fd1f0001730 tx=0x7fd1f0007b40 comp rx=0 tx=0).stop 2023-10-06T01:38:59.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.899+0000 7fd20d0de700 1 -- 172.21.15.69:0/2675378397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2080c5140 msgr2=0x7fd2080ca130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.899+0000 7fd20d0de700 1 --2- 172.21.15.69:0/2675378397 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd2080c5140 0x7fd2080ca130 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd200015000 tx=0x7fd200018000 comp rx=0 tx=0).stop 2023-10-06T01:38:59.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.899+0000 7fd20759e700 1 -- 172.21.15.69:0/2675378397 reap_dead start 2023-10-06T01:38:59.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.899+0000 7fd20d0de700 1 -- 172.21.15.69:0/2675378397 shutdown_connections 2023-10-06T01:38:59.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.899+0000 7fd20d0de700 1 -- 172.21.15.69:0/2675378397 >> 172.21.15.69:0/2675378397 conn(0x7fd2080ccb60 msgr2=0x7fd2081423a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:59.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.899+0000 7fd20d0de700 1 -- 172.21.15.69:0/2675378397 shutdown_connections 2023-10-06T01:38:59.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.899+0000 7fd20d0de700 1 -- 172.21.15.69:0/2675378397 wait complete. 2023-10-06T01:38:59.952 INFO:teuthology.orchestra.run.smithi069.stdout:55834574856 2023-10-06T01:38:59.953 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T01:38:59.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.904+0000 7f017f953700 1 -- 172.21.15.69:0/3119247865 shutdown_connections 2023-10-06T01:38:59.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.904+0000 7f017f953700 1 -- 172.21.15.69:0/3119247865 wait complete. 2023-10-06T01:38:59.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.906+0000 7f51c1907700 1 -- 172.21.15.69:0/3833640669 --> [v2:172.21.15.88:6816/90901,v1:172.21.15.88:6818/90901] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f51a0005c80 con 0x7f51a00015f0 2023-10-06T01:38:59.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.906+0000 7f51b37fe700 1 -- 172.21.15.69:0/3833640669 <== osd.7 v2:172.21.15.88:6816/90901 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f51a0005c80 con 0x7f51a00015f0 2023-10-06T01:38:59.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.907+0000 7f51c1907700 1 -- 172.21.15.69:0/3833640669 >> [v2:172.21.15.88:6816/90901,v1:172.21.15.88:6818/90901] conn(0x7f51a00015f0 msgr2=0x7f51a0003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.907+0000 7f51c1907700 1 --2- 172.21.15.69:0/3833640669 >> [v2:172.21.15.88:6816/90901,v1:172.21.15.88:6818/90901] conn(0x7f51a00015f0 0x7f51a0003aa0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:38:59.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.907+0000 7f51c1907700 1 -- 172.21.15.69:0/3833640669 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f519c066f30 msgr2=0x7f519c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.907+0000 7f51c1907700 1 --2- 172.21.15.69:0/3833640669 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f519c066f30 0x7f519c0693e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f51bc171630 tx=0x7f51a4000f90 comp rx=0 tx=0).stop 2023-10-06T01:38:59.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.907+0000 7f51c1907700 1 -- 172.21.15.69:0/3833640669 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f51bc0afeb0 msgr2=0x7f51bc159e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:38:59.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.907+0000 7f51c1907700 1 --2- 172.21.15.69:0/3833640669 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f51bc0afeb0 0x7f51bc159e80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f51ac009f20 tx=0x7f51ac017000 comp rx=0 tx=0).stop 2023-10-06T01:38:59.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.907+0000 7f51bb7fe700 1 -- 172.21.15.69:0/3833640669 reap_dead start 2023-10-06T01:38:59.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.907+0000 7f51c1907700 1 -- 172.21.15.69:0/3833640669 shutdown_connections 2023-10-06T01:38:59.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.907+0000 7f51c1907700 1 -- 172.21.15.69:0/3833640669 >> 172.21.15.69:0/3833640669 conn(0x7f51bc0cc300 msgr2=0x7f51bc1641b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:38:59.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.907+0000 7f51c1907700 1 -- 172.21.15.69:0/3833640669 shutdown_connections 2023-10-06T01:38:59.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:38:59.907+0000 7f51c1907700 1 -- 172.21.15.69:0/3833640669 wait complete. 2023-10-06T01:38:59.956 INFO:teuthology.orchestra.run.smithi069.stdout:55834574855 2023-10-06T01:38:59.957 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T01:38:59.957 INFO:teuthology.orchestra.run.smithi069.stdout:55834574857 2023-10-06T01:38:59.958 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T01:38:59.959 INFO:teuthology.orchestra.run.smithi069.stdout:55834574856 2023-10-06T01:38:59.959 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T01:38:59.960 INFO:teuthology.orchestra.run.smithi069.stdout:55834574856 2023-10-06T01:38:59.960 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T01:39:00.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.180+0000 7f974693b700 1 Processor -- start 2023-10-06T01:39:00.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.180+0000 7f974693b700 1 -- start start 2023-10-06T01:39:00.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.181+0000 7f974693b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f974015a7d0 0x7f9740158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.181+0000 7f974693b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9740150c90 0x7f97400af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.181+0000 7f974693b700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9740158c80 con 0x7f97401508c0 2023-10-06T01:39:00.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.181+0000 7f974693b700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f974015afc0 con 0x7f974015a7d0 2023-10-06T01:39:00.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.181+0000 7f974693b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97400af820 con 0x7f9740150c90 2023-10-06T01:39:00.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.182+0000 7f9744ed8700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9740150c90 0x7f97400af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.182+0000 7f9744ed8700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9740150c90 0x7f97400af2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.69:42532/0 (socket says 172.21.15.69:42532) 2023-10-06T01:39:00.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.182+0000 7f9744ed8700 1 -- 172.21.15.69:0/2965547068 learned_addr learned my addr 172.21.15.69:0/2965547068 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:00.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.182+0000 7f9744ed8700 1 -- 172.21.15.69:0/2965547068 >> v2:172.21.15.69:3300/0 conn(0x7f974015a7d0 msgr2=0x7f9740158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:00.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.182+0000 7f9744ed8700 1 --2- 172.21.15.69:0/2965547068 >> v2:172.21.15.69:3300/0 conn(0x7f974015a7d0 0x7f9740158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.182+0000 7f9744ed8700 1 -- 172.21.15.69:0/2965547068 >> v1:172.21.15.88:6789/0 conn(0x7f97401508c0 legacy=0x7f974015a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:00.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.182+0000 7f9744ed8700 1 -- 172.21.15.69:0/2965547068 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9740155710 con 0x7f9740150c90 2023-10-06T01:39:00.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.182+0000 7f9744ed8700 1 --2- 172.21.15.69:0/2965547068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9740150c90 0x7f97400af2e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9740070f60 tx=0x7f9738009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5e7fed8ec7c1138 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:00.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.183+0000 7f973effd700 1 -- 172.21.15.69:0/2965547068 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973800b820 con 0x7f9740150c90 2023-10-06T01:39:00.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.183+0000 7f973effd700 1 -- 172.21.15.69:0/2965547068 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973800b980 con 0x7f9740150c90 2023-10-06T01:39:00.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.183+0000 7f973effd700 1 -- 172.21.15.69:0/2965547068 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973800bd20 con 0x7f9740150c90 2023-10-06T01:39:00.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.181+0000 7f231483c700 1 Processor -- start 2023-10-06T01:39:00.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.181+0000 7f231483c700 1 -- start start 2023-10-06T01:39:00.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.183+0000 7f231483c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f2310161150 0x7f23100b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.183+0000 7f231483c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f23100b1dc0 0x7f23100af970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.183+0000 7f231483c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23100b0310 con 0x7f23100afeb0 2023-10-06T01:39:00.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.183+0000 7f231483c700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23100aed90 con 0x7f2310161150 2023-10-06T01:39:00.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.183+0000 7f231483c700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23100ad3d0 con 0x7f23100b1dc0 2023-10-06T01:39:00.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.183+0000 7f230ed9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f23100afeb0 0x7f231015e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.69:43050/0 (socket says 172.21.15.69:43050) 2023-10-06T01:39:00.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.183+0000 7f230ed9d700 1 -- 172.21.15.69:0/703989587 learned_addr learned my addr 172.21.15.69:0/703989587 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:00.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.183+0000 7f230dd9b700 1 --2- 172.21.15.69:0/703989587 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f23100b1dc0 0x7f23100af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.183+0000 7f230d59a700 1 -- 172.21.15.69:0/703989587 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2119343589 0 0) 0x7f2304001110 con 0x7f23100afeb0 2023-10-06T01:39:00.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.183+0000 7f230d59a700 1 -- 172.21.15.69:0/703989587 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22f8003570 con 0x7f23100afeb0 2023-10-06T01:39:00.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.184+0000 7f230dd9b700 1 -- 172.21.15.69:0/703989587 >> v2:172.21.15.69:3300/0 conn(0x7f2310161150 msgr2=0x7f23100b1880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T01:39:00.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.184+0000 7f974693b700 1 -- 172.21.15.69:0/2965547068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9740150c90 msgr2=0x7f97400af2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.184+0000 7f974693b700 1 --2- 172.21.15.69:0/2965547068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9740150c90 0x7f97400af2e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f9740070f60 tx=0x7f9738009250 comp rx=0 tx=0).stop 2023-10-06T01:39:00.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.184+0000 7f974693b700 1 -- 172.21.15.69:0/2965547068 shutdown_connections 2023-10-06T01:39:00.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.184+0000 7f974693b700 1 --2- 172.21.15.69:0/2965547068 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9740150c90 0x7f97400af2e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.184+0000 7f974693b700 1 --2- 172.21.15.69:0/2965547068 >> v2:172.21.15.69:3300/0 conn(0x7f974015a7d0 0x7f9740158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.184+0000 7f974693b700 1 -- 172.21.15.69:0/2965547068 >> 172.21.15.69:0/2965547068 conn(0x7f97400cded0 msgr2=0x7f974006add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:00.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.184+0000 7f230dd9b700 1 --2- 172.21.15.69:0/703989587 >> v2:172.21.15.69:3300/0 conn(0x7f2310161150 0x7f23100b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.184+0000 7f230dd9b700 1 -- 172.21.15.69:0/703989587 >> v1:172.21.15.88:6789/0 conn(0x7f23100afeb0 legacy=0x7f231015e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.184+0000 7f230dd9b700 1 -- 172.21.15.69:0/703989587 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231015e1c0 con 0x7f23100b1dc0 2023-10-06T01:39:00.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.184+0000 7f230dd9b700 1 --2- 172.21.15.69:0/703989587 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f23100b1dc0 0x7f23100af970 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f23000098e0 tx=0x7f23000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c60044fadf637b7f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:00.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.184+0000 7f230d59a700 1 -- 172.21.15.69:0/703989587 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2304001600 con 0x7f23100b1dc0 2023-10-06T01:39:00.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.184+0000 7f230d59a700 1 -- 172.21.15.69:0/703989587 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2300011420 con 0x7f23100b1dc0 2023-10-06T01:39:00.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.184+0000 7f230d59a700 1 -- 172.21.15.69:0/703989587 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23000117c0 con 0x7f23100b1dc0 2023-10-06T01:39:00.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.185+0000 7f231483c700 1 -- 172.21.15.69:0/703989587 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f23100b1dc0 msgr2=0x7f23100af970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.185+0000 7f231483c700 1 --2- 172.21.15.69:0/703989587 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f23100b1dc0 0x7f23100af970 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f23000098e0 tx=0x7f23000091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.185+0000 7f231483c700 1 -- 172.21.15.69:0/703989587 shutdown_connections 2023-10-06T01:39:00.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.185+0000 7f231483c700 1 --2- 172.21.15.69:0/703989587 >> v2:172.21.15.69:3300/0 conn(0x7f2310161150 0x7f23100b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.185+0000 7f231483c700 1 --2- 172.21.15.69:0/703989587 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f23100b1dc0 0x7f23100af970 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.185+0000 7f231483c700 1 -- 172.21.15.69:0/703989587 >> 172.21.15.69:0/703989587 conn(0x7f23100cc300 msgr2=0x7f23100cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:00.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.186+0000 7f974693b700 1 -- 172.21.15.69:0/2965547068 shutdown_connections 2023-10-06T01:39:00.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.187+0000 7f231483c700 1 -- 172.21.15.69:0/703989587 shutdown_connections 2023-10-06T01:39:00.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.187+0000 7f231483c700 1 -- 172.21.15.69:0/703989587 wait complete. 2023-10-06T01:39:00.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.186+0000 7f974693b700 1 -- 172.21.15.69:0/2965547068 wait complete. 2023-10-06T01:39:00.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.188+0000 7f974693b700 1 Processor -- start 2023-10-06T01:39:00.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.188+0000 7f974693b700 1 -- start start 2023-10-06T01:39:00.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.189+0000 7f711e534700 1 Processor -- start 2023-10-06T01:39:00.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.189+0000 7f711e534700 1 -- start start 2023-10-06T01:39:00.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.189+0000 7f231483c700 1 Processor -- start 2023-10-06T01:39:00.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.189+0000 7f231483c700 1 -- start start 2023-10-06T01:39:00.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.189+0000 7f231483c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f23100afeb0 0x7f231014e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.190+0000 7f231483c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f23100b1dc0 0x7f231014e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.190+0000 7f231483c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2310161150 0x7f231013d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.190+0000 7f231483c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23100a61a0 con 0x7f23100afeb0 2023-10-06T01:39:00.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.190+0000 7f231483c700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23100a6380 con 0x7f2310161150 2023-10-06T01:39:00.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.190+0000 7f231483c700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23100a6660 con 0x7f23100b1dc0 2023-10-06T01:39:00.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.190+0000 7f116216f700 1 Processor -- start 2023-10-06T01:39:00.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.190+0000 7f230dd9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f23100b1dc0 0x7f231014e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.190+0000 7f230dd9b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f23100b1dc0 0x7f231014e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.69:42468/0 (socket says 172.21.15.69:42468) 2023-10-06T01:39:00.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.190+0000 7f230dd9b700 1 -- 172.21.15.69:0/2568117139 learned_addr learned my addr 172.21.15.69:0/2568117139 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:00.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.190+0000 7f116216f700 1 -- start start 2023-10-06T01:39:00.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.190+0000 7f230e59c700 1 --2- 172.21.15.69:0/2568117139 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f23100afeb0 0x7f231014e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.189+0000 7f974693b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9740150c90 0x7f974014d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.189+0000 7f974693b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f974015a7d0 0x7f97400b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.189+0000 7f974693b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97400b0d60 0x7f97401531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.189+0000 7f974693b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974014f400 con 0x7f97400b0d60 2023-10-06T01:39:00.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.189+0000 7f974693b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f974016d020 con 0x7f9740150c90 2023-10-06T01:39:00.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.189+0000 7f974693b700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f974014e7f0 con 0x7f974015a7d0 2023-10-06T01:39:00.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.190+0000 7f973ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9740150c90 0x7f974014d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.190+0000 7f711e534700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f711806e3f0 0x7f711806e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.190+0000 7f711e534700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7118159b40 0x7f71180ab250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.190+0000 7f711e534700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71180ac8e0 con 0x7f71180ab790 2023-10-06T01:39:00.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.190+0000 7f711e534700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f711806ed00 con 0x7f7118159b40 2023-10-06T01:39:00.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.190+0000 7f711e534700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71180abcd0 con 0x7f711806e3f0 2023-10-06T01:39:00.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.190+0000 7f711cad1700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f71180ab790 0x7f71180a98e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37416/0 (socket says 172.21.15.69:37416) 2023-10-06T01:39:00.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.190+0000 7f711cad1700 1 -- 172.21.15.69:0/3549153225 learned_addr learned my addr 172.21.15.69:0/3549153225 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:00.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.190+0000 7f71177fe700 1 --2- 172.21.15.69:0/3549153225 >> v2:172.21.15.69:3300/0 conn(0x7f7118159b40 0x7f71180ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.190+0000 7f7117fff700 1 --2- 172.21.15.69:0/3549153225 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f711806e3f0 0x7f711806e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f9744ed8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97400b0d60 0x7f97401531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f9744ed8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97400b0d60 0x7f97401531e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56874/0 (socket says 172.21.15.69:56874) 2023-10-06T01:39:00.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f9744ed8700 1 -- 172.21.15.69:0/1526841454 learned_addr learned my addr 172.21.15.69:0/1526841454 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:00.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f230e59c700 1 -- 172.21.15.69:0/2568117139 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f23100b1dc0 msgr2=0x7f231014e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f230e59c700 1 --2- 172.21.15.69:0/2568117139 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f23100b1dc0 0x7f231014e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f230e59c700 1 -- 172.21.15.69:0/2568117139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2310161150 msgr2=0x7f231013d610 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T01:39:00.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f230e59c700 1 --2- 172.21.15.69:0/2568117139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2310161150 0x7f231013d610 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f230e59c700 1 -- 172.21.15.69:0/2568117139 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2300009420 con 0x7f23100afeb0 2023-10-06T01:39:00.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f230e59c700 1 --2- 172.21.15.69:0/2568117139 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f23100afeb0 0x7f231014e050 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f230800bad0 tx=0x7f2308009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:00.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f7116ffd700 1 -- 172.21.15.69:0/3549153225 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2268039598 0 0) 0x7f71180ac8e0 con 0x7f71180ab790 2023-10-06T01:39:00.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f71177fe700 1 -- 172.21.15.69:0/3549153225 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f711806e3f0 msgr2=0x7f711806e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:00.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f71177fe700 1 --2- 172.21.15.69:0/3549153225 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f711806e3f0 0x7f711806e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f71177fe700 1 -- 172.21.15.69:0/3549153225 >> v1:172.21.15.69:6789/0 conn(0x7f71180ab790 legacy=0x7f71180a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f71177fe700 1 -- 172.21.15.69:0/3549153225 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71180abfb0 con 0x7f7118159b40 2023-10-06T01:39:00.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7fccd2e11700 1 Processor -- start 2023-10-06T01:39:00.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f116216f700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f115c138bc0 0x7f115c06d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f116216f700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f115c1393f0 0x7f115c0cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f22fe7fc700 1 -- 172.21.15.69:0/2568117139 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230800c8c0 con 0x7f23100afeb0 2023-10-06T01:39:00.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f22fe7fc700 1 -- 172.21.15.69:0/2568117139 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f230800ca40 con 0x7f23100afeb0 2023-10-06T01:39:00.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f22fe7fc700 1 -- 172.21.15.69:0/2568117139 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f230800ce00 con 0x7f23100afeb0 2023-10-06T01:39:00.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7fccd2e11700 1 -- start start 2023-10-06T01:39:00.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f116216f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f115c06dab0 0x7f115c0cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f116216f700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f115c0c3380 con 0x7f115c1393f0 2023-10-06T01:39:00.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f116216f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f115c06e010 con 0x7f115c06dab0 2023-10-06T01:39:00.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f116216f700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f115c0c2a50 con 0x7f115c138bc0 2023-10-06T01:39:00.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f9744ed8700 1 -- 172.21.15.69:0/1526841454 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f974015a7d0 msgr2=0x7f97400b0820 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T01:39:00.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f9744ed8700 1 --2- 172.21.15.69:0/1526841454 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f974015a7d0 0x7f97400b0820 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f9744ed8700 1 -- 172.21.15.69:0/1526841454 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9740150c90 msgr2=0x7f974014d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f9744ed8700 1 --2- 172.21.15.69:0/1526841454 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9740150c90 0x7f974014d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f9744ed8700 1 -- 172.21.15.69:0/1526841454 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97380094f0 con 0x7f97400b0d60 2023-10-06T01:39:00.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f115affd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f115c1393f0 0x7f115c0cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.192+0000 7f115affd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f115c1393f0 0x7f115c0cb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56900/0 (socket says 172.21.15.69:56900) 2023-10-06T01:39:00.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.192+0000 7f115affd700 1 -- 172.21.15.69:0/1617700401 learned_addr learned my addr 172.21.15.69:0/1617700401 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:00.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.192+0000 7f71177fe700 1 --2- 172.21.15.69:0/3549153225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7118159b40 0x7f71180ab250 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7110009e60 tx=0x7f7110009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc88f617358849f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:00.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.192+0000 7f115affd700 1 -- 172.21.15.69:0/1617700401 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f115c138bc0 msgr2=0x7f115c06d570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T01:39:00.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.192+0000 7f115affd700 1 --2- 172.21.15.69:0/1617700401 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f115c138bc0 0x7f115c06d570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.192+0000 7f115affd700 1 -- 172.21.15.69:0/1617700401 >> v2:172.21.15.88:3300/0 conn(0x7f115c06dab0 msgr2=0x7f115c0cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:00.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.192+0000 7f115affd700 1 --2- 172.21.15.69:0/1617700401 >> v2:172.21.15.88:3300/0 conn(0x7f115c06dab0 0x7f115c0cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.192+0000 7f115affd700 1 -- 172.21.15.69:0/1617700401 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115c0c2d30 con 0x7f115c1393f0 2023-10-06T01:39:00.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.192+0000 7f9744ed8700 1 --2- 172.21.15.69:0/1526841454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97400b0d60 0x7f97401531e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f97400c9ec0 tx=0x7f9738016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:00.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f231483c700 1 -- 172.21.15.69:0/2568117139 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23100a6940 con 0x7f23100afeb0 2023-10-06T01:39:00.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.191+0000 7f231483c700 1 -- 172.21.15.69:0/2568117139 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231014b780 con 0x7f23100afeb0 2023-10-06T01:39:00.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.192+0000 7f115affd700 1 --2- 172.21.15.69:0/1617700401 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f115c1393f0 0x7f115c0cb5e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f115c069a10 tx=0x7f115000b4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3cfb89485b9615 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:00.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.192+0000 7f7116ffd700 1 -- 172.21.15.69:0/3549153225 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711000e070 con 0x7f7118159b40 2023-10-06T01:39:00.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.192+0000 7f7116ffd700 1 -- 172.21.15.69:0/3549153225 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711000bbf0 con 0x7f7118159b40 2023-10-06T01:39:00.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.192+0000 7f7116ffd700 1 -- 172.21.15.69:0/3549153225 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7110012430 con 0x7f7118159b40 2023-10-06T01:39:00.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.192+0000 7f9727fff700 1 -- 172.21.15.69:0/1526841454 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973801a650 con 0x7f97400b0d60 2023-10-06T01:39:00.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.192+0000 7fa9751c6700 1 Processor -- start 2023-10-06T01:39:00.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.192+0000 7f9727fff700 1 -- 172.21.15.69:0/1526841454 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973801f070 con 0x7f97400b0d60 2023-10-06T01:39:00.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.192+0000 7f9727fff700 1 -- 172.21.15.69:0/1526841454 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973801aa00 con 0x7f97400b0d60 2023-10-06T01:39:00.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.193+0000 7f974693b700 1 -- 172.21.15.69:0/1526841454 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f974014ead0 con 0x7f97400b0d60 2023-10-06T01:39:00.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.193+0000 7f974693b700 1 -- 172.21.15.69:0/1526841454 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f974014f090 con 0x7f97400b0d60 2023-10-06T01:39:00.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.193+0000 7fccd2e11700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fcccc0add80 0x7fcccc0cca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.193+0000 7fccd2e11700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcccc0b0910 0x7fcccc155b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.193+0000 7fccd2e11700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcccc157510 con 0x7fcccc159940 2023-10-06T01:39:00.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.193+0000 7fccd2e11700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcccc0ae2f0 con 0x7fcccc0add80 2023-10-06T01:39:00.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.193+0000 7fccd2e11700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcccc0ae5d0 con 0x7fcccc0b0910 2023-10-06T01:39:00.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.193+0000 7f711e534700 1 -- 172.21.15.69:0/3549153225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7118159b40 msgr2=0x7f71180ab250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.193+0000 7f711e534700 1 --2- 172.21.15.69:0/3549153225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7118159b40 0x7f71180ab250 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7110009e60 tx=0x7f7110009780 comp rx=0 tx=0).stop 2023-10-06T01:39:00.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.193+0000 7fccd13ae700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcccc0b0910 0x7fcccc155b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.193+0000 7fccd13ae700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcccc0b0910 0x7fcccc155b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.69:42486/0 (socket says 172.21.15.69:42486) 2023-10-06T01:39:00.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.193+0000 7fccd13ae700 1 -- 172.21.15.69:0/2049225326 learned_addr learned my addr 172.21.15.69:0/2049225326 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:00.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.193+0000 7fccd0bad700 1 --2- 172.21.15.69:0/2049225326 >> v2:172.21.15.69:3300/0 conn(0x7fcccc0add80 0x7fcccc0cca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.193+0000 7f115a7fc700 1 -- 172.21.15.69:0/1617700401 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115000db10 con 0x7f115c1393f0 2023-10-06T01:39:00.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.193+0000 7f711e534700 1 -- 172.21.15.69:0/3549153225 shutdown_connections 2023-10-06T01:39:00.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7f711e534700 1 --2- 172.21.15.69:0/3549153225 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f711806e3f0 0x7f711806e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7f711e534700 1 --2- 172.21.15.69:0/3549153225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7118159b40 0x7f71180ab250 secure :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7110009e60 tx=0x7f7110009780 comp rx=0 tx=0).stop 2023-10-06T01:39:00.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7f711e534700 1 -- 172.21.15.69:0/3549153225 >> 172.21.15.69:0/3549153225 conn(0x7f71180cc300 msgr2=0x7f71180cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:00.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.193+0000 7f115a7fc700 1 -- 172.21.15.69:0/1617700401 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115000dc70 con 0x7f115c1393f0 2023-10-06T01:39:00.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7f115a7fc700 1 -- 172.21.15.69:0/1617700401 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1150017420 con 0x7f115c1393f0 2023-10-06T01:39:00.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7f231483c700 1 -- 172.21.15.69:0/2568117139 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22f40052b0 con 0x7f23100afeb0 2023-10-06T01:39:00.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7fccd13ae700 1 -- 172.21.15.69:0/2049225326 >> v2:172.21.15.69:3300/0 conn(0x7fcccc0add80 msgr2=0x7fcccc0cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:00.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7fccd13ae700 1 --2- 172.21.15.69:0/2049225326 >> v2:172.21.15.69:3300/0 conn(0x7fcccc0add80 0x7fcccc0cca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7fccd13ae700 1 -- 172.21.15.69:0/2049225326 >> v1:172.21.15.88:6789/0 conn(0x7fcccc159940 legacy=0x7fcccc0b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7fccd13ae700 1 -- 172.21.15.69:0/2049225326 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcccc0ae8b0 con 0x7fcccc0b0910 2023-10-06T01:39:00.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7ff9b415c700 1 Processor -- start 2023-10-06T01:39:00.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7fccd13ae700 1 --2- 172.21.15.69:0/2049225326 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcccc0b0910 0x7fcccc155b70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fccc40099b0 tx=0x7fccc4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16ef05a2f0fa634b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:00.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7fcccbfff700 1 -- 172.21.15.69:0/2049225326 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc4009ea0 con 0x7fcccc0b0910 2023-10-06T01:39:00.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7fcccbfff700 1 -- 172.21.15.69:0/2049225326 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccc400b860 con 0x7fcccc0b0910 2023-10-06T01:39:00.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7fcccbfff700 1 -- 172.21.15.69:0/2049225326 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccc400bc00 con 0x7fcccc0b0910 2023-10-06T01:39:00.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7f22fe7fc700 1 -- 172.21.15.69:0/2568117139 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2308014620 con 0x7f23100afeb0 2023-10-06T01:39:00.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7f116216f700 1 -- 172.21.15.69:0/1617700401 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f115c1393f0 msgr2=0x7f115c0cb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7f116216f700 1 --2- 172.21.15.69:0/1617700401 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f115c1393f0 0x7f115c0cb5e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f115c069a10 tx=0x7f115000b4e0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.195+0000 7f22fe7fc700 1 --2- 172.21.15.69:0/2568117139 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f22f0066fb0 0x7f22f0069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.195+0000 7f116216f700 1 -- 172.21.15.69:0/1617700401 shutdown_connections 2023-10-06T01:39:00.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.195+0000 7f116216f700 1 --2- 172.21.15.69:0/1617700401 >> v2:172.21.15.88:3300/0 conn(0x7f115c06dab0 0x7f115c0cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.195+0000 7f116216f700 1 --2- 172.21.15.69:0/1617700401 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f115c138bc0 0x7f115c06d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.195+0000 7f116216f700 1 --2- 172.21.15.69:0/1617700401 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f115c1393f0 0x7f115c0cb5e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.195+0000 7f116216f700 1 -- 172.21.15.69:0/1617700401 >> 172.21.15.69:0/1617700401 conn(0x7f115c0ccb60 msgr2=0x7f115c0ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:00.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.195+0000 7f22fe7fc700 1 -- 172.21.15.69:0/2568117139 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f23080846e0 con 0x7f23100afeb0 2023-10-06T01:39:00.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.195+0000 7f116216f700 1 -- 172.21.15.69:0/1617700401 shutdown_connections 2023-10-06T01:39:00.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.195+0000 7f116216f700 1 -- 172.21.15.69:0/1617700401 wait complete. 2023-10-06T01:39:00.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.193+0000 7fa9751c6700 1 -- start start 2023-10-06T01:39:00.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7fa9751c6700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa9700cb970 0x7fa970159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7fa9751c6700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa97015a400 0x7fa970156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7fa9751c6700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa97015ae40 con 0x7fa9700cb5a0 2023-10-06T01:39:00.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.195+0000 7f974693b700 1 -- 172.21.15.69:0/1526841454 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f974014f5b0 con 0x7f97400b0d60 2023-10-06T01:39:00.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7fa9751c6700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9700ce0f0 con 0x7fa9700cb970 2023-10-06T01:39:00.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7fa9751c6700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9700d13f0 con 0x7fa97015a400 2023-10-06T01:39:00.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7fa96e59c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa9700cb970 0x7fa970159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7fa96e59c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fa9700cb970 0x7fa970159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56930/0 (socket says 172.21.15.69:56930) 2023-10-06T01:39:00.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7fa96e59c700 1 -- 172.21.15.69:0/3796792332 learned_addr learned my addr 172.21.15.69:0/3796792332 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:00.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7fa96e59c700 1 -- 172.21.15.69:0/3796792332 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa97015a400 msgr2=0x7fa970156e90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-06T01:39:00.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7fa96e59c700 1 --2- 172.21.15.69:0/3796792332 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa97015a400 0x7fa970156e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7fa96e59c700 1 -- 172.21.15.69:0/3796792332 >> v1:172.21.15.88:6789/0 conn(0x7fa9700cb5a0 legacy=0x7fa9700cd9e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T01:39:00.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7fa96e59c700 1 -- 172.21.15.69:0/3796792332 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa97015ab60 con 0x7fa9700cb970 2023-10-06T01:39:00.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.195+0000 7fa96e59c700 1 --2- 172.21.15.69:0/3796792332 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9700cb970 0x7fa970159ec0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa9600099b0 tx=0x7fa960009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34350cb43cd6c287 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:00.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.195+0000 7fccd2e11700 1 -- 172.21.15.69:0/2049225326 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcccc0b0910 msgr2=0x7fcccc155b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.195+0000 7fccd2e11700 1 --2- 172.21.15.69:0/2049225326 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcccc0b0910 0x7fcccc155b70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fccc40099b0 tx=0x7fccc4009250 comp rx=0 tx=0).stop 2023-10-06T01:39:00.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.195+0000 7f711e534700 1 -- 172.21.15.69:0/3549153225 shutdown_connections 2023-10-06T01:39:00.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.195+0000 7f711e534700 1 -- 172.21.15.69:0/3549153225 wait complete. 2023-10-06T01:39:00.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.194+0000 7ff9b415c700 1 -- start start 2023-10-06T01:39:00.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.195+0000 7ff9b415c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff9ac0cb8e0 0x7ff9ac0cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.195+0000 7ff9b415c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff9ac0ac830 0x7ff9ac06e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.195+0000 7ff9b415c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff9ac0accd0 0x7ff9ac06e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.195+0000 7ff9b415c700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ac0b20a0 con 0x7ff9ac0cb8e0 2023-10-06T01:39:00.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.195+0000 7ff9b415c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ac156ee0 con 0x7ff9ac0ac830 2023-10-06T01:39:00.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.195+0000 7ff9b415c700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac156c00 con 0x7ff9ac0accd0 2023-10-06T01:39:00.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.196+0000 7f230dd9b700 1 --2- 172.21.15.69:0/2568117139 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f22f0066fb0 0x7f22f0069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.196+0000 7fccd2e11700 1 -- 172.21.15.69:0/2049225326 shutdown_connections 2023-10-06T01:39:00.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.196+0000 7fccd2e11700 1 --2- 172.21.15.69:0/2049225326 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcccc0b0910 0x7fcccc155b70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.196+0000 7fccd2e11700 1 --2- 172.21.15.69:0/2049225326 >> v2:172.21.15.69:3300/0 conn(0x7fcccc0add80 0x7fcccc0cca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.196+0000 7fccd2e11700 1 -- 172.21.15.69:0/2049225326 >> 172.21.15.69:0/2049225326 conn(0x7fcccc06d170 msgr2=0x7fcccc0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:00.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.196+0000 7ff9b16f7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff9ac0ac830 0x7ff9ac06e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.196+0000 7ff9b26f9700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff9ac0accd0 0x7ff9ac06e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.196+0000 7ff9b16f7700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff9ac0ac830 0x7ff9ac06e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.69:42560/0 (socket says 172.21.15.69:42560) 2023-10-06T01:39:00.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.196+0000 7ff9b16f7700 1 -- 172.21.15.69:0/953555114 learned_addr learned my addr 172.21.15.69:0/953555114 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:00.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.196+0000 7fccd2e11700 1 -- 172.21.15.69:0/2049225326 shutdown_connections 2023-10-06T01:39:00.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.196+0000 7ff9b26f9700 1 -- 172.21.15.69:0/953555114 >> v2:172.21.15.88:3300/0 conn(0x7ff9ac0ac830 msgr2=0x7ff9ac06e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:00.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.196+0000 7ff9b26f9700 1 --2- 172.21.15.69:0/953555114 >> v2:172.21.15.88:3300/0 conn(0x7ff9ac0ac830 0x7ff9ac06e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.196+0000 7ff9b26f9700 1 -- 172.21.15.69:0/953555114 >> v2:172.21.15.69:3300/0 conn(0x7ff9ac0cb8e0 msgr2=0x7ff9ac0cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:00.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.196+0000 7ff9b26f9700 1 --2- 172.21.15.69:0/953555114 >> v2:172.21.15.69:3300/0 conn(0x7ff9ac0cb8e0 0x7ff9ac0cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.196+0000 7ff9b26f9700 1 -- 172.21.15.69:0/953555114 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ac0abd50 con 0x7ff9ac0accd0 2023-10-06T01:39:00.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.196+0000 7fccd2e11700 1 -- 172.21.15.69:0/2049225326 wait complete. 2023-10-06T01:39:00.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.196+0000 7f230dd9b700 1 --2- 172.21.15.69:0/2568117139 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f22f0066fb0 0x7f22f0069460 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f231014edf0 tx=0x7f2300017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:00.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.196+0000 7f116216f700 1 Processor -- start 2023-10-06T01:39:00.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.197+0000 7f116216f700 1 -- start start 2023-10-06T01:39:00.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.197+0000 7ff9b26f9700 1 --2- 172.21.15.69:0/953555114 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff9ac0accd0 0x7ff9ac06e930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac0ad440 tx=0x7ff9a400a0f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=849dcc9a15524617 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:00.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.197+0000 7f711e534700 1 Processor -- start 2023-10-06T01:39:00.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.197+0000 7ff9b0ef6700 1 -- 172.21.15.69:0/953555114 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4007330 con 0x7ff9ac0accd0 2023-10-06T01:39:00.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.197+0000 7ff9b0ef6700 1 -- 172.21.15.69:0/953555114 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a4007490 con 0x7ff9ac0accd0 2023-10-06T01:39:00.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.197+0000 7ff9b0ef6700 1 -- 172.21.15.69:0/953555114 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a400daa0 con 0x7ff9ac0accd0 2023-10-06T01:39:00.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.197+0000 7f711e534700 1 -- start start 2023-10-06T01:39:00.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7f116216f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f115c06dab0 0x7f115c15b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7f116216f700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f115c138bc0 0x7f115c136c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7f116216f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f115c1393f0 0x7f115c15fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7f116216f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115c15b920 con 0x7f115c06dab0 2023-10-06T01:39:00.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7f116216f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f115c15bc00 con 0x7f115c1393f0 2023-10-06T01:39:00.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7f116216f700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f115c15bee0 con 0x7f115c138bc0 2023-10-06T01:39:00.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7f115bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f115c1393f0 0x7f115c15fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7f115bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f115c1393f0 0x7f115c15fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.69:42574/0 (socket says 172.21.15.69:42574) 2023-10-06T01:39:00.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7f115affd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f115c138bc0 0x7f115c136c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7f115bfff700 1 -- 172.21.15.69:0/2531899370 learned_addr learned my addr 172.21.15.69:0/2531899370 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:00.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7ff9b415c700 1 -- 172.21.15.69:0/953555114 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff9ac0accd0 msgr2=0x7ff9ac06e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7ff9b415c700 1 --2- 172.21.15.69:0/953555114 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff9ac0accd0 0x7ff9ac06e930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac0ad440 tx=0x7ff9a400a0f0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7f115bfff700 1 -- 172.21.15.69:0/2531899370 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f115c138bc0 msgr2=0x7f115c136c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7f115bfff700 1 --2- 172.21.15.69:0/2531899370 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f115c138bc0 0x7f115c136c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7f115bfff700 1 -- 172.21.15.69:0/2531899370 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f115c06dab0 msgr2=0x7f115c15b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7f115bfff700 1 --2- 172.21.15.69:0/2531899370 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f115c06dab0 0x7f115c15b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7f115bfff700 1 -- 172.21.15.69:0/2531899370 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115000b780 con 0x7f115c1393f0 2023-10-06T01:39:00.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7ff9b415c700 1 -- 172.21.15.69:0/953555114 shutdown_connections 2023-10-06T01:39:00.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7ff9b415c700 1 --2- 172.21.15.69:0/953555114 >> v2:172.21.15.69:3300/0 conn(0x7ff9ac0cb8e0 0x7ff9ac0cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7ff9b415c700 1 --2- 172.21.15.69:0/953555114 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff9ac0accd0 0x7ff9ac06e930 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7ff9b415c700 1 --2- 172.21.15.69:0/953555114 >> v2:172.21.15.88:3300/0 conn(0x7ff9ac0ac830 0x7ff9ac06e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7ff9b415c700 1 -- 172.21.15.69:0/953555114 >> 172.21.15.69:0/953555114 conn(0x7ff9ac0cc300 msgr2=0x7ff9ac0cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:00.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7f711e534700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f711806e3f0 0x7f71180ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7f711e534700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71180ab790 0x7f7118151100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7f711e534700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7118151640 0x7f711814ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7f711e534700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7118152bf0 con 0x7f711806e3f0 2023-10-06T01:39:00.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7f711e534700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71180cae50 con 0x7f71180ab790 2023-10-06T01:39:00.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7f711e534700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7118152760 con 0x7f7118151640 2023-10-06T01:39:00.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7f7117fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f711806e3f0 0x7f71180ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7f711cad1700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7118151640 0x7f711814ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7f7117fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f711806e3f0 0x7f71180ca910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56968/0 (socket says 172.21.15.69:56968) 2023-10-06T01:39:00.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7f7117fff700 1 -- 172.21.15.69:0/2256626675 learned_addr learned my addr 172.21.15.69:0/2256626675 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:00.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7f115bfff700 1 --2- 172.21.15.69:0/2531899370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f115c1393f0 0x7f115c15fa30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f115400bc30 tx=0x7f1154009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:00.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7fccd2e11700 1 Processor -- start 2023-10-06T01:39:00.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.198+0000 7fccd2e11700 1 -- start start 2023-10-06T01:39:00.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.199+0000 7f11437fe700 1 -- 172.21.15.69:0/2531899370 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11540092e0 con 0x7f115c1393f0 2023-10-06T01:39:00.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.199+0000 7f116216f700 1 -- 172.21.15.69:0/2531899370 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f115c15c1c0 con 0x7f115c1393f0 2023-10-06T01:39:00.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.199+0000 7f116216f700 1 -- 172.21.15.69:0/2531899370 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f115c137150 con 0x7f115c1393f0 2023-10-06T01:39:00.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.199+0000 7f11437fe700 1 -- 172.21.15.69:0/2531899370 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115400c6f0 con 0x7f115c1393f0 2023-10-06T01:39:00.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.199+0000 7f11437fe700 1 -- 172.21.15.69:0/2531899370 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115400cad0 con 0x7f115c1393f0 2023-10-06T01:39:00.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.199+0000 7f7117fff700 1 -- 172.21.15.69:0/2256626675 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7118151640 msgr2=0x7f711814ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.199+0000 7f7117fff700 1 --2- 172.21.15.69:0/2256626675 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7118151640 0x7f711814ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.199+0000 7f7117fff700 1 -- 172.21.15.69:0/2256626675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71180ab790 msgr2=0x7f7118151100 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T01:39:00.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.199+0000 7f7117fff700 1 --2- 172.21.15.69:0/2256626675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71180ab790 0x7f7118151100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.199+0000 7f7117fff700 1 -- 172.21.15.69:0/2256626675 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7110009a20 con 0x7f711806e3f0 2023-10-06T01:39:00.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.199+0000 7fccd2e11700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcccc0add80 0x7fcccc146fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.199+0000 7fccd2e11700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcccc0b0910 0x7fcccc147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.199+0000 7fccd2e11700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcccc159940 0x7fcccc148d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.199+0000 7fccd2e11700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcccc148870 con 0x7fcccc0add80 2023-10-06T01:39:00.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.199+0000 7fccd2e11700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcccc146680 con 0x7fcccc159940 2023-10-06T01:39:00.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.199+0000 7fccd2e11700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcccc147f80 con 0x7fcccc0b0910 2023-10-06T01:39:00.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.199+0000 7fccd0bad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcccc0add80 0x7fcccc146fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.199+0000 7fccd13ae700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcccc159940 0x7fcccc148d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.199+0000 7fccd0bad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcccc0add80 0x7fcccc146fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56978/0 (socket says 172.21.15.69:56978) 2023-10-06T01:39:00.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.199+0000 7fccd0bad700 1 -- 172.21.15.69:0/935521269 learned_addr learned my addr 172.21.15.69:0/935521269 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:00.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.199+0000 7f7117fff700 1 --2- 172.21.15.69:0/2256626675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f711806e3f0 0x7f71180ca910 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f710c00ecb0 tx=0x7f710c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:00.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.199+0000 7fccc3fff700 1 --2- 172.21.15.69:0/935521269 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcccc0b0910 0x7fcccc147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.199+0000 7fccd0bad700 1 -- 172.21.15.69:0/935521269 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcccc0b0910 msgr2=0x7fcccc147520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.199+0000 7fccd0bad700 1 --2- 172.21.15.69:0/935521269 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcccc0b0910 0x7fcccc147520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.199+0000 7fccd0bad700 1 -- 172.21.15.69:0/935521269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcccc159940 msgr2=0x7fcccc148d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.199+0000 7fccd0bad700 1 --2- 172.21.15.69:0/935521269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcccc159940 0x7fcccc148d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.199+0000 7fccd0bad700 1 -- 172.21.15.69:0/935521269 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc40094f0 con 0x7fcccc0add80 2023-10-06T01:39:00.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.200+0000 7ff9b415c700 1 -- 172.21.15.69:0/953555114 shutdown_connections 2023-10-06T01:39:00.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.200+0000 7fccd0bad700 1 --2- 172.21.15.69:0/935521269 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcccc0add80 0x7fcccc146fe0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fccbc009e50 tx=0x7fccbc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:00.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.200+0000 7f116216f700 1 -- 172.21.15.69:0/2531899370 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f113c0052b0 con 0x7f115c1393f0 2023-10-06T01:39:00.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.200+0000 7ff9b415c700 1 -- 172.21.15.69:0/953555114 wait complete. 2023-10-06T01:39:00.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.201+0000 7f11437fe700 1 -- 172.21.15.69:0/2531899370 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1154012070 con 0x7f115c1393f0 2023-10-06T01:39:00.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.201+0000 7ff9b415c700 1 Processor -- start 2023-10-06T01:39:00.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.201+0000 7ff9b415c700 1 -- start start 2023-10-06T01:39:00.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.201+0000 7f22fe7fc700 1 -- 172.21.15.69:0/2568117139 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2308051750 con 0x7f23100afeb0 2023-10-06T01:39:00.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.201+0000 7f11437fe700 1 --2- 172.21.15.69:0/2531899370 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1148066f60 0x7f1148069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.201+0000 7f11437fe700 1 -- 172.21.15.69:0/2531899370 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1154084200 con 0x7f115c1393f0 2023-10-06T01:39:00.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.201+0000 7f115b7fe700 1 --2- 172.21.15.69:0/2531899370 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1148066f60 0x7f1148069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.202+0000 7f115b7fe700 1 --2- 172.21.15.69:0/2531899370 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1148066f60 0x7f1148069410 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f114c0097c0 tx=0x7f114c006ce0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:00.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.202+0000 7ff9b415c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9ac0ac830 0x7ff9ac0ab0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.202+0000 7ff9b415c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9ac0accd0 0x7ff9ac153e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.202+0000 7ff9b415c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff9ac0cb8e0 0x7ff9ac0a6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.202+0000 7ff9b415c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac151590 con 0x7ff9ac0ac830 2023-10-06T01:39:00.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.202+0000 7ff9b415c700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac0ab630 con 0x7ff9ac0accd0 2023-10-06T01:39:00.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.202+0000 7ff9b415c700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ac154970 con 0x7ff9ac0cb8e0 2023-10-06T01:39:00.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.202+0000 7ff9b16f7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9ac0accd0 0x7ff9ac153e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.202+0000 7ff9b16f7700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9ac0accd0 0x7ff9ac153e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.69:42600/0 (socket says 172.21.15.69:42600) 2023-10-06T01:39:00.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.202+0000 7ff9b16f7700 1 -- 172.21.15.69:0/305350498 learned_addr learned my addr 172.21.15.69:0/305350498 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:00.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.203+0000 7ff9b16f7700 1 -- 172.21.15.69:0/305350498 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff9ac0cb8e0 msgr2=0x7ff9ac0a6780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T01:39:00.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.203+0000 7ff9b16f7700 1 --2- 172.21.15.69:0/305350498 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff9ac0cb8e0 0x7ff9ac0a6780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.203+0000 7ff9b16f7700 1 -- 172.21.15.69:0/305350498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9ac0ac830 msgr2=0x7ff9ac0ab0f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T01:39:00.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.203+0000 7ff9b16f7700 1 --2- 172.21.15.69:0/305350498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9ac0ac830 0x7ff9ac0ab0f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.203+0000 7ff9b16f7700 1 -- 172.21.15.69:0/305350498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9a4007740 con 0x7ff9ac0accd0 2023-10-06T01:39:00.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.203+0000 7f9727fff700 1 -- 172.21.15.69:0/1526841454 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9738026480 con 0x7f97400b0d60 2023-10-06T01:39:00.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.203+0000 7ff9b16f7700 1 --2- 172.21.15.69:0/305350498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9ac0accd0 0x7ff9ac153e70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800bcb0 tx=0x7ff9a800f040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:00.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.202+0000 7f70fffff700 1 -- 172.21.15.69:0/2256626675 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c00c920 con 0x7f711806e3f0 2023-10-06T01:39:00.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.202+0000 7f70fffff700 1 -- 172.21.15.69:0/2256626675 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f710c00ca80 con 0x7f711806e3f0 2023-10-06T01:39:00.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.202+0000 7f70fffff700 1 -- 172.21.15.69:0/2256626675 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f710c00ce00 con 0x7f711806e3f0 2023-10-06T01:39:00.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.202+0000 7f711e534700 1 -- 172.21.15.69:0/2256626675 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7118151b50 con 0x7f711806e3f0 2023-10-06T01:39:00.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.202+0000 7f711e534700 1 -- 172.21.15.69:0/2256626675 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7118152110 con 0x7f711806e3f0 2023-10-06T01:39:00.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.203+0000 7f9727fff700 1 --2- 172.21.15.69:0/1526841454 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f972c067000 0x7f972c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.203+0000 7f973ffff700 1 --2- 172.21.15.69:0/1526841454 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f972c067000 0x7f972c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.203+0000 7f9727fff700 1 -- 172.21.15.69:0/1526841454 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9738021070 con 0x7f97400b0d60 2023-10-06T01:39:00.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.204+0000 7fccc97fa700 1 -- 172.21.15.69:0/935521269 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc00caa0 con 0x7fcccc0add80 2023-10-06T01:39:00.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.204+0000 7fccc97fa700 1 -- 172.21.15.69:0/935521269 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccbc00f040 con 0x7fcccc0add80 2023-10-06T01:39:00.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.204+0000 7fccc97fa700 1 -- 172.21.15.69:0/935521269 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccbc00ce30 con 0x7fcccc0add80 2023-10-06T01:39:00.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.204+0000 7f973ffff700 1 --2- 172.21.15.69:0/1526841454 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f972c067000 0x7f972c0694b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9740063530 tx=0x7f9734009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:00.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.204+0000 7fccd2e11700 1 -- 172.21.15.69:0/935521269 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcccc148220 con 0x7fcccc0add80 2023-10-06T01:39:00.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.204+0000 7fccd2e11700 1 -- 172.21.15.69:0/935521269 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcccc149240 con 0x7fcccc0add80 2023-10-06T01:39:00.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.204+0000 7fa96dd9b700 1 -- 172.21.15.69:0/3796792332 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96000b820 con 0x7fa9700cb970 2023-10-06T01:39:00.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.204+0000 7fa96dd9b700 1 -- 172.21.15.69:0/3796792332 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96000b980 con 0x7fa9700cb970 2023-10-06T01:39:00.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.204+0000 7fa96dd9b700 1 -- 172.21.15.69:0/3796792332 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96000bd20 con 0x7fa9700cb970 2023-10-06T01:39:00.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.205+0000 7fa9751c6700 1 -- 172.21.15.69:0/3796792332 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9700cb970 msgr2=0x7fa970159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.205+0000 7fa9751c6700 1 --2- 172.21.15.69:0/3796792332 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9700cb970 0x7fa970159ec0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa9600099b0 tx=0x7fa960009250 comp rx=0 tx=0).stop 2023-10-06T01:39:00.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.205+0000 7fb3f0722700 1 Processor -- start 2023-10-06T01:39:00.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.205+0000 7fa9751c6700 1 -- 172.21.15.69:0/3796792332 shutdown_connections 2023-10-06T01:39:00.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.205+0000 7fa9751c6700 1 --2- 172.21.15.69:0/3796792332 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa97015a400 0x7fa970156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.205+0000 7fa9751c6700 1 --2- 172.21.15.69:0/3796792332 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9700cb970 0x7fa970159ec0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.205+0000 7fa9751c6700 1 -- 172.21.15.69:0/3796792332 >> 172.21.15.69:0/3796792332 conn(0x7fa970070e30 msgr2=0x7fa9700d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:00.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.205+0000 7fb3f0722700 1 -- start start 2023-10-06T01:39:00.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.205+0000 7fccd2e11700 1 -- 172.21.15.69:0/935521269 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccb00052b0 con 0x7fcccc0add80 2023-10-06T01:39:00.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.206+0000 7fa9751c6700 1 -- 172.21.15.69:0/3796792332 shutdown_connections 2023-10-06T01:39:00.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.206+0000 7fa9751c6700 1 -- 172.21.15.69:0/3796792332 wait complete. 2023-10-06T01:39:00.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.206+0000 7f711e534700 1 -- 172.21.15.69:0/2256626675 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f711804c3c0 con 0x7f711806e3f0 2023-10-06T01:39:00.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.206+0000 7ff9a1ffb700 1 -- 172.21.15.69:0/305350498 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a800bec0 con 0x7ff9ac0accd0 2023-10-06T01:39:00.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.206+0000 7ff9a1ffb700 1 -- 172.21.15.69:0/305350498 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a800d1c0 con 0x7ff9ac0accd0 2023-10-06T01:39:00.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.206+0000 7ff9a1ffb700 1 -- 172.21.15.69:0/305350498 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a800fb40 con 0x7ff9ac0accd0 2023-10-06T01:39:00.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.206+0000 7ff9b415c700 1 -- 172.21.15.69:0/305350498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ac154c50 con 0x7ff9ac0accd0 2023-10-06T01:39:00.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.206+0000 7fb3f0722700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb3e8159c80 0x7fb3e80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.206+0000 7fb3f0722700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e80ce9d0 con 0x7fb3e80cfe70 2023-10-06T01:39:00.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.206+0000 7fb3f0722700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e80af960 con 0x7fb3e81598b0 2023-10-06T01:39:00.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.206+0000 7fb3f0722700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e80afc30 con 0x7fb3e8159c80 2023-10-06T01:39:00.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.206+0000 7ff9b415c700 1 -- 172.21.15.69:0/305350498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ac155210 con 0x7ff9ac0accd0 2023-10-06T01:39:00.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.206+0000 7fb3ee4be700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fb3e81598b0 0x7fb3e80af250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.69:43076/0 (socket says 172.21.15.69:43076) 2023-10-06T01:39:00.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.206+0000 7fb3ee4be700 1 -- 172.21.15.69:0/2231035700 learned_addr learned my addr 172.21.15.69:0/2231035700 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:00.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.206+0000 7fb3edcbd700 1 --2- 172.21.15.69:0/2231035700 >> v2:172.21.15.69:3300/0 conn(0x7fb3e8159c80 0x7fb3e80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.206+0000 7f11437fe700 1 -- 172.21.15.69:0/2531899370 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1154051310 con 0x7f115c1393f0 2023-10-06T01:39:00.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.207+0000 7fb3edcbd700 1 -- 172.21.15.69:0/2231035700 >> v1:172.21.15.88:6789/0 conn(0x7fb3e81598b0 legacy=0x7fb3e80af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:00.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.207+0000 7fb3edcbd700 1 -- 172.21.15.69:0/2231035700 >> v1:172.21.15.69:6789/0 conn(0x7fb3e80cfe70 legacy=0x7fb3e8163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.207+0000 7fb3edcbd700 1 -- 172.21.15.69:0/2231035700 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e80aff10 con 0x7fb3e8159c80 2023-10-06T01:39:00.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.207+0000 7fb3edcbd700 1 --2- 172.21.15.69:0/2231035700 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3e8159c80 0x7fb3e80cb6f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80098e0 tx=0x7fb3d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eebe16ed48b1f02e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:00.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.207+0000 7ff9b415c700 1 -- 172.21.15.69:0/305350498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ac04c3c0 con 0x7ff9ac0accd0 2023-10-06T01:39:00.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.208+0000 7ff9a1ffb700 1 -- 172.21.15.69:0/305350498 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff9a8014070 con 0x7ff9ac0accd0 2023-10-06T01:39:00.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.208+0000 7fa9751c6700 1 Processor -- start 2023-10-06T01:39:00.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.208+0000 7fa9751c6700 1 -- start start 2023-10-06T01:39:00.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.208+0000 7ff9a1ffb700 1 --2- 172.21.15.69:0/305350498 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff990066f30 0x7ff9900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.208+0000 7ff9a1ffb700 1 -- 172.21.15.69:0/305350498 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff9a8083b70 con 0x7ff9ac0accd0 2023-10-06T01:39:00.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.208+0000 7ff9b1ef8700 1 --2- 172.21.15.69:0/305350498 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff990066f30 0x7ff9900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.209+0000 7ff9b1ef8700 1 --2- 172.21.15.69:0/305350498 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff990066f30 0x7ff9900693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009760 tx=0x7ff99c006c90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:00.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.209+0000 7fa9751c6700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa9700cb5a0 0x7fa9700c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.209+0000 7fa9751c6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9700cb970 0x7fa970152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.209+0000 7fa9751c6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa97015a400 0x7fa9701586c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.209+0000 7fa9751c6700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa970158230 con 0x7fa9700cb970 2023-10-06T01:39:00.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.209+0000 7fa9751c6700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9700c7d00 con 0x7fa97015a400 2023-10-06T01:39:00.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.209+0000 7fa9751c6700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa970153460 con 0x7fa9700cb5a0 2023-10-06T01:39:00.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.209+0000 7fa96ed9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa9700cb5a0 0x7fa9700c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.209+0000 7fa96ed9d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa9700cb5a0 0x7fa9700c77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.69:42510/0 (socket says 172.21.15.69:42510) 2023-10-06T01:39:00.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.209+0000 7fa96f59e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa97015a400 0x7fa9701586c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.209+0000 7fa96ed9d700 1 -- 172.21.15.69:0/657280925 learned_addr learned my addr 172.21.15.69:0/657280925 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:00.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.210+0000 7f70fffff700 1 -- 172.21.15.69:0/2256626675 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f710c013680 con 0x7f711806e3f0 2023-10-06T01:39:00.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.210+0000 7fa96ed9d700 1 -- 172.21.15.69:0/657280925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa97015a400 msgr2=0x7fa9701586c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.210+0000 7fa96ed9d700 1 --2- 172.21.15.69:0/657280925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa97015a400 0x7fa9701586c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.210+0000 7fa96ed9d700 1 -- 172.21.15.69:0/657280925 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9700cb970 msgr2=0x7fa970152f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.210+0000 7fa96ed9d700 1 --2- 172.21.15.69:0/657280925 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9700cb970 0x7fa970152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.210+0000 7fa96ed9d700 1 -- 172.21.15.69:0/657280925 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9600094f0 con 0x7fa9700cb5a0 2023-10-06T01:39:00.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.210+0000 7fa96f59e700 1 --2- 172.21.15.69:0/657280925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa97015a400 0x7fa9701586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:00.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.210+0000 7fccc97fa700 1 -- 172.21.15.69:0/935521269 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fccbc014690 con 0x7fcccc0add80 2023-10-06T01:39:00.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.210+0000 7fa96ed9d700 1 --2- 172.21.15.69:0/657280925 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa9700cb5a0 0x7fa9700c77c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa96400b610 tx=0x7fa9640090f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:00.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.210+0000 7f70fffff700 1 --2- 172.21.15.69:0/2256626675 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7104066f30 0x7f71040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.210+0000 7fa956ffd700 1 -- 172.21.15.69:0/657280925 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96400f510 con 0x7fa9700cb5a0 2023-10-06T01:39:00.255 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.210+0000 7f71177fe700 1 --2- 172.21.15.69:0/2256626675 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7104066f30 0x7f71040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.210+0000 7fa956ffd700 1 -- 172.21.15.69:0/657280925 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa96400f690 con 0x7fa9700cb5a0 2023-10-06T01:39:00.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.210+0000 7fa956ffd700 1 -- 172.21.15.69:0/657280925 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa96400fa50 con 0x7fa9700cb5a0 2023-10-06T01:39:00.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.210+0000 7fccc97fa700 1 --2- 172.21.15.69:0/935521269 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fccac066fb0 0x7fccac069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.210+0000 7fccc3fff700 1 --2- 172.21.15.69:0/935521269 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fccac066fb0 0x7fccac069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.210+0000 7fccc97fa700 1 -- 172.21.15.69:0/935521269 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fccbc0856d0 con 0x7fcccc0add80 2023-10-06T01:39:00.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.211+0000 7f71177fe700 1 --2- 172.21.15.69:0/2256626675 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7104066f30 0x7f71040693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f71180cbd70 tx=0x7f7110019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:00.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.211+0000 7fccc3fff700 1 --2- 172.21.15.69:0/935521269 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fccac066fb0 0x7fccac069460 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcccc14af90 tx=0x7fccb4007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:00.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.208+0000 7f9727fff700 1 -- 172.21.15.69:0/1526841454 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9738054120 con 0x7f97400b0d60 2023-10-06T01:39:00.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.212+0000 7fb3ed4bc700 1 -- 172.21.15.69:0/2231035700 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d8009e80 con 0x7fb3e8159c80 2023-10-06T01:39:00.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.212+0000 7fb3ed4bc700 1 -- 172.21.15.69:0/2231035700 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d800b860 con 0x7fb3e8159c80 2023-10-06T01:39:00.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.212+0000 7fb3ed4bc700 1 -- 172.21.15.69:0/2231035700 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d800bbe0 con 0x7fb3e8159c80 2023-10-06T01:39:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.212+0000 7fb3f0722700 1 -- 172.21.15.69:0/2231035700 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3e8159c80 msgr2=0x7fb3e80cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.212+0000 7fb3f0722700 1 --2- 172.21.15.69:0/2231035700 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3e8159c80 0x7fb3e80cb6f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fb3d80098e0 tx=0x7fb3d80091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.213+0000 7fb3f0722700 1 -- 172.21.15.69:0/2231035700 shutdown_connections 2023-10-06T01:39:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.213+0000 7fb3f0722700 1 --2- 172.21.15.69:0/2231035700 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3e8159c80 0x7fb3e80cb6f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.213+0000 7fb3f0722700 1 -- 172.21.15.69:0/2231035700 >> 172.21.15.69:0/2231035700 conn(0x7fb3e8070e30 msgr2=0x7fb3e80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.213+0000 7fb3f0722700 1 -- 172.21.15.69:0/2231035700 shutdown_connections 2023-10-06T01:39:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.213+0000 7fb3f0722700 1 -- 172.21.15.69:0/2231035700 wait complete. 2023-10-06T01:39:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.213+0000 7ff9a1ffb700 1 -- 172.21.15.69:0/305350498 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff9a8050c80 con 0x7ff9ac0accd0 2023-10-06T01:39:00.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.214+0000 7fb3f0722700 1 Processor -- start 2023-10-06T01:39:00.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.214+0000 7fb3f0722700 1 -- start start 2023-10-06T01:39:00.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.215+0000 7fb3f0722700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3e80cfe70 0x7fb3e816a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.215+0000 7fb3f0722700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb3e81598b0 0x7fb3e8155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.215+0000 7fb3f0722700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3e8159c80 0x7fb3e8169780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.215+0000 7fb3f0722700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e80c7cb0 con 0x7fb3e8159c80 2023-10-06T01:39:00.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.215+0000 7fb3f0722700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e816a210 con 0x7fb3e80cfe70 2023-10-06T01:39:00.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.215+0000 7fb3f0722700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e816a4f0 con 0x7fb3e81598b0 2023-10-06T01:39:00.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.215+0000 7fb3eecbf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3e8159c80 0x7fb3e8169780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.215+0000 7fb3eecbf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3e8159c80 0x7fb3e8169780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57012/0 (socket says 172.21.15.69:57012) 2023-10-06T01:39:00.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.215+0000 7fb3eecbf700 1 -- 172.21.15.69:0/2992496052 learned_addr learned my addr 172.21.15.69:0/2992496052 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:00.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.215+0000 7fb3eecbf700 1 -- 172.21.15.69:0/2992496052 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb3e81598b0 msgr2=0x7fb3e8155280 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T01:39:00.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.215+0000 7fb3eecbf700 1 --2- 172.21.15.69:0/2992496052 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb3e81598b0 0x7fb3e8155280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.261 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.215+0000 7fb3eecbf700 1 -- 172.21.15.69:0/2992496052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3e80cfe70 msgr2=0x7fb3e816a950 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T01:39:00.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.215+0000 7fb3eecbf700 1 --2- 172.21.15.69:0/2992496052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3e80cfe70 0x7fb3e816a950 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.215+0000 7fb3eecbf700 1 -- 172.21.15.69:0/2992496052 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d8009420 con 0x7fb3e8159c80 2023-10-06T01:39:00.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.216+0000 7fb3eecbf700 1 --2- 172.21.15.69:0/2992496052 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3e8159c80 0x7fb3e8169780 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000c8e0 tx=0x7fb3e0001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:00.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.216+0000 7f70fffff700 1 -- 172.21.15.69:0/2256626675 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f710c056610 con 0x7f711806e3f0 2023-10-06T01:39:00.262 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.216+0000 7f70fffff700 1 -- 172.21.15.69:0/2256626675 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f710c052250 con 0x7f711806e3f0 2023-10-06T01:39:00.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.222+0000 7fa9751c6700 1 -- 172.21.15.69:0/657280925 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa970157900 con 0x7fa9700cb5a0 2023-10-06T01:39:00.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.222+0000 7fa9751c6700 1 -- 172.21.15.69:0/657280925 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa970157ec0 con 0x7fa9700cb5a0 2023-10-06T01:39:00.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.222+0000 7fa9751c6700 1 -- 172.21.15.69:0/657280925 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa97004c3c0 con 0x7fa9700cb5a0 2023-10-06T01:39:00.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.224+0000 7fb3de7fc700 1 -- 172.21.15.69:0/2992496052 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e000ce80 con 0x7fb3e8159c80 2023-10-06T01:39:00.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.224+0000 7fb3de7fc700 1 -- 172.21.15.69:0/2992496052 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3e000a7e0 con 0x7fb3e8159c80 2023-10-06T01:39:00.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.224+0000 7fb3de7fc700 1 -- 172.21.15.69:0/2992496052 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3e000ab60 con 0x7fb3e8159c80 2023-10-06T01:39:00.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.224+0000 7fa956ffd700 1 -- 172.21.15.69:0/657280925 <== mon.2 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa964024430 con 0x7fa9700cb5a0 2023-10-06T01:39:00.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.224+0000 7fa956ffd700 1 --2- 172.21.15.69:0/657280925 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa95c066f30 0x7fa95c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.224+0000 7fa956ffd700 1 -- 172.21.15.69:0/657280925 <== mon.2 v2:172.21.15.88:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fa964084b60 con 0x7fa9700cb5a0 2023-10-06T01:39:00.264 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.224+0000 7fccc97fa700 1 -- 172.21.15.69:0/935521269 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fccbc0527c0 con 0x7fcccc0add80 2023-10-06T01:39:00.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.224+0000 7fb3f0722700 1 -- 172.21.15.69:0/2992496052 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e80c7940 con 0x7fb3e8159c80 2023-10-06T01:39:00.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.224+0000 7fb3f0722700 1 -- 172.21.15.69:0/2992496052 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e8158f90 con 0x7fb3e8159c80 2023-10-06T01:39:00.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.226+0000 7fb3f0722700 1 -- 172.21.15.69:0/2992496052 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3d00052b0 con 0x7fb3e8159c80 2023-10-06T01:39:00.265 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.226+0000 7fa96e59c700 1 --2- 172.21.15.69:0/657280925 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa95c066f30 0x7fa95c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.226+0000 7fb3de7fc700 1 -- 172.21.15.69:0/2992496052 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb3e0012420 con 0x7fb3e8159c80 2023-10-06T01:39:00.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.227+0000 7fb3de7fc700 1 --2- 172.21.15.69:0/2992496052 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb3cc067000 0x7fb3cc0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:00.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.227+0000 7fb3ee4be700 1 --2- 172.21.15.69:0/2992496052 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb3cc067000 0x7fb3cc0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:00.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.227+0000 7fb3de7fc700 1 -- 172.21.15.69:0/2992496052 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb3e00848d0 con 0x7fb3e8159c80 2023-10-06T01:39:00.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.227+0000 7fb3ee4be700 1 --2- 172.21.15.69:0/2992496052 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb3cc067000 0x7fb3cc0694b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4005030 tx=0x7fb3e4007bf0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:00.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.228+0000 7fa956ffd700 1 -- 172.21.15.69:0/657280925 <== mon.2 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa964051dd0 con 0x7fa9700cb5a0 2023-10-06T01:39:00.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.233+0000 7fa96e59c700 1 --2- 172.21.15.69:0/657280925 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa95c066f30 0x7fa95c0693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa9600099b0 tx=0x7fa960016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:00.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.236+0000 7fb3de7fc700 1 -- 172.21.15.69:0/2992496052 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb3e0051a60 con 0x7fb3e8159c80 2023-10-06T01:39:00.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.600+0000 7f974693b700 1 -- 172.21.15.69:0/1526841454 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f974004c3c0 con 0x7f97400b0d60 2023-10-06T01:39:00.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.602+0000 7f231483c700 1 -- 172.21.15.69:0/2568117139 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f22f4005560 con 0x7f23100afeb0 2023-10-06T01:39:00.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.602+0000 7f711e534700 1 -- 172.21.15.69:0/2256626675 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f71180ac290 con 0x7f711806e3f0 2023-10-06T01:39:00.603 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.603+0000 7f9727fff700 1 -- 172.21.15.69:0/1526841454 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f973801adb0 con 0x7f97400b0d60 2023-10-06T01:39:00.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.604+0000 7f22fe7fc700 1 -- 172.21.15.69:0/2568117139 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2308054d70 con 0x7f23100afeb0 2023-10-06T01:39:00.604 INFO:teuthology.orchestra.run.smithi069.stdout:55834574854 2023-10-06T01:39:00.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.604+0000 7f70fffff700 1 -- 172.21.15.69:0/2256626675 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f710c017090 con 0x7f711806e3f0 2023-10-06T01:39:00.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.604+0000 7f116216f700 1 -- 172.21.15.69:0/2531899370 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f113c005830 con 0x7f115c1393f0 2023-10-06T01:39:00.608 INFO:teuthology.orchestra.run.smithi069.stdout:55834574856 2023-10-06T01:39:00.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.607+0000 7f974693b700 1 -- 172.21.15.69:0/1526841454 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f972c067000 msgr2=0x7f972c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.607+0000 7f974693b700 1 --2- 172.21.15.69:0/1526841454 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f972c067000 0x7f972c0694b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f9740063530 tx=0x7f9734009040 comp rx=0 tx=0).stop 2023-10-06T01:39:00.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.607+0000 7f974693b700 1 -- 172.21.15.69:0/1526841454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97400b0d60 msgr2=0x7f97401531e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.607+0000 7f974693b700 1 --2- 172.21.15.69:0/1526841454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97400b0d60 0x7f97401531e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f97400c9ec0 tx=0x7f9738016000 comp rx=0 tx=0).stop 2023-10-06T01:39:00.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.607+0000 7f974693b700 1 -- 172.21.15.69:0/1526841454 shutdown_connections 2023-10-06T01:39:00.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.607+0000 7f974693b700 1 --2- 172.21.15.69:0/1526841454 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f972c067000 0x7f972c0694b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.607+0000 7f974693b700 1 --2- 172.21.15.69:0/1526841454 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97400b0d60 0x7f97401531e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.607+0000 7f974693b700 1 --2- 172.21.15.69:0/1526841454 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9740150c90 0x7f974014d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.607+0000 7f974693b700 1 --2- 172.21.15.69:0/1526841454 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f974015a7d0 0x7f97400b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.607+0000 7f974693b700 1 -- 172.21.15.69:0/1526841454 >> 172.21.15.69:0/1526841454 conn(0x7f97400cded0 msgr2=0x7f97401562f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:00.609 INFO:teuthology.orchestra.run.smithi069.stdout:55834574855 2023-10-06T01:39:00.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.606+0000 7f11437fe700 1 -- 172.21.15.69:0/2531899370 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1154054930 con 0x7f115c1393f0 2023-10-06T01:39:00.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.605+0000 7ff9b415c700 1 -- 172.21.15.69:0/305350498 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff9ac0ac030 con 0x7ff9ac0accd0 2023-10-06T01:39:00.610 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.607+0000 7ff9a1ffb700 1 -- 172.21.15.69:0/305350498 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff9a801b020 con 0x7ff9ac0accd0 2023-10-06T01:39:00.610 INFO:teuthology.orchestra.run.smithi069.stdout:55834574854 2023-10-06T01:39:00.611 INFO:teuthology.orchestra.run.smithi069.stdout:55834574856 2023-10-06T01:39:00.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.608+0000 7f974693b700 1 -- 172.21.15.69:0/1526841454 shutdown_connections 2023-10-06T01:39:00.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.608+0000 7f974693b700 1 -- 172.21.15.69:0/1526841454 wait complete. 2023-10-06T01:39:00.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.608+0000 7fccd2e11700 1 -- 172.21.15.69:0/935521269 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fccb0005830 con 0x7fcccc0add80 2023-10-06T01:39:00.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.609+0000 7f711e534700 1 -- 172.21.15.69:0/2256626675 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7104066f30 msgr2=0x7f71040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.609+0000 7f711e534700 1 --2- 172.21.15.69:0/2256626675 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7104066f30 0x7f71040693e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f71180cbd70 tx=0x7f7110019000 comp rx=0 tx=0).stop 2023-10-06T01:39:00.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.609+0000 7f711e534700 1 -- 172.21.15.69:0/2256626675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f711806e3f0 msgr2=0x7f71180ca910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.609+0000 7f711e534700 1 --2- 172.21.15.69:0/2256626675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f711806e3f0 0x7f71180ca910 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f710c00ecb0 tx=0x7f710c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.609+0000 7fccc97fa700 1 -- 172.21.15.69:0/935521269 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fccbc055de0 con 0x7fcccc0add80 2023-10-06T01:39:00.613 INFO:teuthology.orchestra.run.smithi069.stdout:55834574855 2023-10-06T01:39:00.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.609+0000 7f711e534700 1 -- 172.21.15.69:0/2256626675 shutdown_connections 2023-10-06T01:39:00.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.609+0000 7f711e534700 1 --2- 172.21.15.69:0/2256626675 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7104066f30 0x7f71040693e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.609+0000 7f711e534700 1 --2- 172.21.15.69:0/2256626675 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7118151640 0x7f711814ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.609+0000 7f711e534700 1 --2- 172.21.15.69:0/2256626675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f711806e3f0 0x7f71180ca910 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.609+0000 7f711e534700 1 --2- 172.21.15.69:0/2256626675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71180ab790 0x7f7118151100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.609+0000 7f711e534700 1 -- 172.21.15.69:0/2256626675 >> 172.21.15.69:0/2256626675 conn(0x7f71180cc300 msgr2=0x7f71180b1490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:00.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.612+0000 7f116216f700 1 -- 172.21.15.69:0/2531899370 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1148066f60 msgr2=0x7f1148069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.612+0000 7f116216f700 1 --2- 172.21.15.69:0/2531899370 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1148066f60 0x7f1148069410 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f114c0097c0 tx=0x7f114c006ce0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.612+0000 7f116216f700 1 -- 172.21.15.69:0/2531899370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f115c1393f0 msgr2=0x7f115c15fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.612+0000 7f116216f700 1 --2- 172.21.15.69:0/2531899370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f115c1393f0 0x7f115c15fa30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f115400bc30 tx=0x7f1154009840 comp rx=0 tx=0).stop 2023-10-06T01:39:00.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.612+0000 7ff9b415c700 1 -- 172.21.15.69:0/305350498 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff990066f30 msgr2=0x7ff9900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.612+0000 7ff9b415c700 1 --2- 172.21.15.69:0/305350498 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff990066f30 0x7ff9900693e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff99c009760 tx=0x7ff99c006c90 comp rx=0 tx=0).stop 2023-10-06T01:39:00.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.612+0000 7ff9b415c700 1 -- 172.21.15.69:0/305350498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9ac0accd0 msgr2=0x7ff9ac153e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.612+0000 7ff9b415c700 1 --2- 172.21.15.69:0/305350498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9ac0accd0 0x7ff9ac153e70 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff9a800bcb0 tx=0x7ff9a800f040 comp rx=0 tx=0).stop 2023-10-06T01:39:00.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.612+0000 7fa9751c6700 1 -- 172.21.15.69:0/657280925 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fa9700c5770 con 0x7fa9700cb5a0 2023-10-06T01:39:00.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.612+0000 7fccd2e11700 1 -- 172.21.15.69:0/935521269 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fccac066fb0 msgr2=0x7fccac069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.612+0000 7fccd2e11700 1 --2- 172.21.15.69:0/935521269 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fccac066fb0 0x7fccac069460 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcccc14af90 tx=0x7fccb4007ec0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.612+0000 7fccd2e11700 1 -- 172.21.15.69:0/935521269 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcccc0add80 msgr2=0x7fcccc146fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.612+0000 7fccd2e11700 1 --2- 172.21.15.69:0/935521269 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcccc0add80 0x7fcccc146fe0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fccbc009e50 tx=0x7fccbc00b040 comp rx=0 tx=0).stop 2023-10-06T01:39:00.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.613+0000 7fa956ffd700 1 -- 172.21.15.69:0/657280925 <== mon.2 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa9640553f0 con 0x7fa9700cb5a0 2023-10-06T01:39:00.617 INFO:teuthology.orchestra.run.smithi069.stdout:55834574855 2023-10-06T01:39:00.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.614+0000 7f711e534700 1 -- 172.21.15.69:0/2256626675 shutdown_connections 2023-10-06T01:39:00.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.614+0000 7ff9b415c700 1 -- 172.21.15.69:0/305350498 shutdown_connections 2023-10-06T01:39:00.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.614+0000 7f116216f700 1 -- 172.21.15.69:0/2531899370 shutdown_connections 2023-10-06T01:39:00.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.614+0000 7ff9b415c700 1 --2- 172.21.15.69:0/305350498 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff990066f30 0x7ff9900693e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.614+0000 7ff9b415c700 1 --2- 172.21.15.69:0/305350498 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff9ac0cb8e0 0x7ff9ac0a6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.614+0000 7ff9b415c700 1 --2- 172.21.15.69:0/305350498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9ac0ac830 0x7ff9ac0ab0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.614+0000 7ff9b415c700 1 --2- 172.21.15.69:0/305350498 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9ac0accd0 0x7ff9ac153e70 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.614+0000 7f116216f700 1 --2- 172.21.15.69:0/2531899370 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1148066f60 0x7f1148069410 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.614+0000 7f116216f700 1 --2- 172.21.15.69:0/2531899370 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f115c1393f0 0x7f115c15fa30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.614+0000 7f116216f700 1 --2- 172.21.15.69:0/2531899370 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f115c06dab0 0x7f115c15b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.614+0000 7f116216f700 1 --2- 172.21.15.69:0/2531899370 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f115c138bc0 0x7f115c136c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.614+0000 7f116216f700 1 -- 172.21.15.69:0/2531899370 >> 172.21.15.69:0/2531899370 conn(0x7f115c0ccb60 msgr2=0x7f115c159800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:00.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.614+0000 7ff9b415c700 1 -- 172.21.15.69:0/305350498 >> 172.21.15.69:0/305350498 conn(0x7ff9ac0cc300 msgr2=0x7ff9ac06a9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:00.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.614+0000 7f116216f700 1 -- 172.21.15.69:0/2531899370 shutdown_connections 2023-10-06T01:39:00.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.614+0000 7ff9b415c700 1 -- 172.21.15.69:0/305350498 shutdown_connections 2023-10-06T01:39:00.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.614+0000 7ff9b415c700 1 -- 172.21.15.69:0/305350498 wait complete. 2023-10-06T01:39:00.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.614+0000 7f116216f700 1 -- 172.21.15.69:0/2531899370 wait complete. 2023-10-06T01:39:00.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.615+0000 7f231483c700 1 -- 172.21.15.69:0/2568117139 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f22f0066fb0 msgr2=0x7f22f0069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.615+0000 7f231483c700 1 --2- 172.21.15.69:0/2568117139 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f22f0066fb0 0x7f22f0069460 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f231014edf0 tx=0x7f2300017000 comp rx=0 tx=0).stop 2023-10-06T01:39:00.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.615+0000 7f231483c700 1 -- 172.21.15.69:0/2568117139 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f23100afeb0 msgr2=0x7f231014e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.615+0000 7f231483c700 1 --2- 172.21.15.69:0/2568117139 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f23100afeb0 0x7f231014e050 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f230800bad0 tx=0x7f2308009780 comp rx=0 tx=0).stop 2023-10-06T01:39:00.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.615+0000 7fa9751c6700 1 -- 172.21.15.69:0/657280925 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa95c066f30 msgr2=0x7fa95c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.615+0000 7fa9751c6700 1 --2- 172.21.15.69:0/657280925 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa95c066f30 0x7fa95c0693e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa9600099b0 tx=0x7fa960016000 comp rx=0 tx=0).stop 2023-10-06T01:39:00.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.615+0000 7fa9751c6700 1 -- 172.21.15.69:0/657280925 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa9700cb5a0 msgr2=0x7fa9700c77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.615+0000 7fa9751c6700 1 --2- 172.21.15.69:0/657280925 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa9700cb5a0 0x7fa9700c77c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa96400b610 tx=0x7fa9640090f0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.615+0000 7fa9751c6700 1 -- 172.21.15.69:0/657280925 shutdown_connections 2023-10-06T01:39:00.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.615+0000 7fa9751c6700 1 --2- 172.21.15.69:0/657280925 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa95c066f30 0x7fa95c0693e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.615+0000 7fa9751c6700 1 --2- 172.21.15.69:0/657280925 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa97015a400 0x7fa9701586c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.615+0000 7fa9751c6700 1 --2- 172.21.15.69:0/657280925 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa9700cb5a0 0x7fa9700c77c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.615+0000 7fa9751c6700 1 --2- 172.21.15.69:0/657280925 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa9700cb970 0x7fa970152f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.615+0000 7fa9751c6700 1 -- 172.21.15.69:0/657280925 >> 172.21.15.69:0/657280925 conn(0x7fa970070e30 msgr2=0x7fa9700b2450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:00.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.615+0000 7fa9751c6700 1 -- 172.21.15.69:0/657280925 shutdown_connections 2023-10-06T01:39:00.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.615+0000 7fa9751c6700 1 -- 172.21.15.69:0/657280925 wait complete. 2023-10-06T01:39:00.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.618+0000 7fccd2e11700 1 -- 172.21.15.69:0/935521269 shutdown_connections 2023-10-06T01:39:00.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.618+0000 7fccd2e11700 1 --2- 172.21.15.69:0/935521269 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fccac066fb0 0x7fccac069460 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.618+0000 7fccd2e11700 1 --2- 172.21.15.69:0/935521269 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcccc159940 0x7fcccc148d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.618+0000 7fccd2e11700 1 --2- 172.21.15.69:0/935521269 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcccc0add80 0x7fcccc146fe0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.618+0000 7fccd2e11700 1 --2- 172.21.15.69:0/935521269 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcccc0b0910 0x7fcccc147520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.618+0000 7fccd2e11700 1 -- 172.21.15.69:0/935521269 >> 172.21.15.69:0/935521269 conn(0x7fcccc06d170 msgr2=0x7fcccc1578a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:00.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.618+0000 7fccd2e11700 1 -- 172.21.15.69:0/935521269 shutdown_connections 2023-10-06T01:39:00.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.618+0000 7fccd2e11700 1 -- 172.21.15.69:0/935521269 wait complete. 2023-10-06T01:39:00.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.619+0000 7f231483c700 1 -- 172.21.15.69:0/2568117139 shutdown_connections 2023-10-06T01:39:00.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.619+0000 7f231483c700 1 --2- 172.21.15.69:0/2568117139 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f22f0066fb0 0x7f22f0069460 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.619+0000 7f231483c700 1 --2- 172.21.15.69:0/2568117139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2310161150 0x7f231013d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.619+0000 7f231483c700 1 --2- 172.21.15.69:0/2568117139 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f23100afeb0 0x7f231014e050 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.619+0000 7f231483c700 1 --2- 172.21.15.69:0/2568117139 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f23100b1dc0 0x7f231014e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.619+0000 7f231483c700 1 -- 172.21.15.69:0/2568117139 >> 172.21.15.69:0/2568117139 conn(0x7f23100cc300 msgr2=0x7f231006eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:00.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.621+0000 7f711e534700 1 -- 172.21.15.69:0/2256626675 wait complete. 2023-10-06T01:39:00.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.622+0000 7fb3f0722700 1 -- 172.21.15.69:0/2992496052 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb3d0005830 con 0x7fb3e8159c80 2023-10-06T01:39:00.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.623+0000 7f231483c700 1 -- 172.21.15.69:0/2568117139 shutdown_connections 2023-10-06T01:39:00.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.627+0000 7f231483c700 1 -- 172.21.15.69:0/2568117139 wait complete. 2023-10-06T01:39:00.631 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2023-10-06T01:39:00.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.632+0000 7fb3de7fc700 1 -- 172.21.15.69:0/2992496052 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb3e0055080 con 0x7fb3e8159c80 2023-10-06T01:39:00.633 INFO:teuthology.orchestra.run.smithi069.stdout:55834574856 2023-10-06T01:39:00.639 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.1 2023-10-06T01:39:00.640 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.7 2023-10-06T01:39:00.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.639+0000 7fb3f0722700 1 -- 172.21.15.69:0/2992496052 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb3cc067000 msgr2=0x7fb3cc0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.639+0000 7fb3f0722700 1 --2- 172.21.15.69:0/2992496052 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb3cc067000 0x7fb3cc0694b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb3e4005030 tx=0x7fb3e4007bf0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.639+0000 7fb3f0722700 1 -- 172.21.15.69:0/2992496052 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3e8159c80 msgr2=0x7fb3e8169780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:00.640 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.639+0000 7fb3f0722700 1 --2- 172.21.15.69:0/2992496052 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3e8159c80 0x7fb3e8169780 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb3e000c8e0 tx=0x7fb3e0001710 comp rx=0 tx=0).stop 2023-10-06T01:39:00.641 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.2 2023-10-06T01:39:00.642 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.3 2023-10-06T01:39:00.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.641+0000 7fb3f0722700 1 -- 172.21.15.69:0/2992496052 shutdown_connections 2023-10-06T01:39:00.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.641+0000 7fb3f0722700 1 --2- 172.21.15.69:0/2992496052 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb3cc067000 0x7fb3cc0694b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.641+0000 7fb3f0722700 1 --2- 172.21.15.69:0/2992496052 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3e8159c80 0x7fb3e8169780 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.641+0000 7fb3f0722700 1 --2- 172.21.15.69:0/2992496052 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3e80cfe70 0x7fb3e816a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.641+0000 7fb3f0722700 1 --2- 172.21.15.69:0/2992496052 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb3e81598b0 0x7fb3e8155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:00.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.641+0000 7fb3f0722700 1 -- 172.21.15.69:0/2992496052 >> 172.21.15.69:0/2992496052 conn(0x7fb3e8070e30 msgr2=0x7fb3e80b1700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:00.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.641+0000 7fb3f0722700 1 -- 172.21.15.69:0/2992496052 shutdown_connections 2023-10-06T01:39:00.643 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:00.641+0000 7fb3f0722700 1 -- 172.21.15.69:0/2992496052 wait complete. 2023-10-06T01:39:00.644 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.4 2023-10-06T01:39:00.648 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2023-10-06T01:39:00.654 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2023-10-06T01:39:01.633 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-06T01:39:01.640 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-06T01:39:01.641 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-06T01:39:01.642 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-06T01:39:01.643 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-06T01:39:01.645 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-06T01:39:01.648 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-06T01:39:01.655 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-06T01:39:01.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.819+0000 7fe253b0c700 1 Processor -- start 2023-10-06T01:39:01.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.819+0000 7fe253b0c700 1 -- start start 2023-10-06T01:39:01.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.821+0000 7fe253b0c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe24c0b1f90 0x7fe24c0aff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.821+0000 7fe253b0c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe24c0cb2d0 0x7fe24c0cb750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.821+0000 7fe253b0c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe24c167a60 con 0x7fe24c0afb30 2023-10-06T01:39:01.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.821+0000 7fe253b0c700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe24c166e50 con 0x7fe24c0b1f90 2023-10-06T01:39:01.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.821+0000 7fe253b0c700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c167130 con 0x7fe24c0cb2d0 2023-10-06T01:39:01.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.821+0000 7fe2510a7700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe24c0b1f90 0x7fe24c0aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.821+0000 7fe2510a7700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe24c0b1f90 0x7fe24c0aff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57020/0 (socket says 172.21.15.69:57020) 2023-10-06T01:39:01.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.821+0000 7fe2510a7700 1 -- 172.21.15.69:0/3878809589 learned_addr learned my addr 172.21.15.69:0/3878809589 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:01.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.821+0000 7fe2520a9700 1 --2- 172.21.15.69:0/3878809589 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe24c0cb2d0 0x7fe24c0cb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.822+0000 7fe2508a6700 1 -- 172.21.15.69:0/3878809589 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1533399269 0 0) 0x7fe24c167a60 con 0x7fe24c0afb30 2023-10-06T01:39:01.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.822+0000 7fe2508a6700 1 -- 172.21.15.69:0/3878809589 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe238003550 con 0x7fe24c0afb30 2023-10-06T01:39:01.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.822+0000 7fe2510a7700 1 -- 172.21.15.69:0/3878809589 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe24c0cb2d0 msgr2=0x7fe24c0cb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:01.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.822+0000 7fe2510a7700 1 --2- 172.21.15.69:0/3878809589 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe24c0cb2d0 0x7fe24c0cb750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.822+0000 7fe2510a7700 1 -- 172.21.15.69:0/3878809589 >> v1:172.21.15.88:6789/0 conn(0x7fe24c0afb30 legacy=0x7fe24c0b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:01.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.822+0000 7fe2510a7700 1 -- 172.21.15.69:0/3878809589 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24c167410 con 0x7fe24c0b1f90 2023-10-06T01:39:01.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.822+0000 7fe2510a7700 1 --2- 172.21.15.69:0/3878809589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe24c0b1f90 0x7fe24c0aff00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe244009f20 tx=0x7fe244007510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b676dc959153d1a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:01.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.823+0000 7fe2508a6700 1 -- 172.21.15.69:0/3878809589 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe244014ce0 con 0x7fe24c0b1f90 2023-10-06T01:39:01.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.823+0000 7fe2508a6700 1 -- 172.21.15.69:0/3878809589 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe244014e40 con 0x7fe24c0b1f90 2023-10-06T01:39:01.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.823+0000 7fe2508a6700 1 -- 172.21.15.69:0/3878809589 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24400baf0 con 0x7fe24c0b1f90 2023-10-06T01:39:01.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.824+0000 7fe253b0c700 1 -- 172.21.15.69:0/3878809589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe24c0b1f90 msgr2=0x7fe24c0aff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:01.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.824+0000 7fe253b0c700 1 --2- 172.21.15.69:0/3878809589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe24c0b1f90 0x7fe24c0aff00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe244009f20 tx=0x7fe244007510 comp rx=0 tx=0).stop 2023-10-06T01:39:01.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.824+0000 7fe253b0c700 1 -- 172.21.15.69:0/3878809589 shutdown_connections 2023-10-06T01:39:01.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.824+0000 7fe253b0c700 1 --2- 172.21.15.69:0/3878809589 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe24c0cb2d0 0x7fe24c0cb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.824+0000 7fe253b0c700 1 --2- 172.21.15.69:0/3878809589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe24c0b1f90 0x7fe24c0aff00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.824+0000 7fe253b0c700 1 -- 172.21.15.69:0/3878809589 >> 172.21.15.69:0/3878809589 conn(0x7fe24c0cc300 msgr2=0x7fe24c0cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:01.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.824+0000 7fe253b0c700 1 -- 172.21.15.69:0/3878809589 shutdown_connections 2023-10-06T01:39:01.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.824+0000 7fe253b0c700 1 -- 172.21.15.69:0/3878809589 wait complete. 2023-10-06T01:39:01.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.826+0000 7fe253b0c700 1 Processor -- start 2023-10-06T01:39:01.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.826+0000 7fe253b0c700 1 -- start start 2023-10-06T01:39:01.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.827+0000 7fe253b0c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe24c0afb30 0x7fe24c0a6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.827+0000 7fe253b0c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe24c0b1f90 0x7fe24c15f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.827+0000 7fe253b0c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe24c0cb2d0 0x7fe24c158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.827+0000 7fe253b0c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c0a6710 con 0x7fe24c0cb2d0 2023-10-06T01:39:01.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.827+0000 7fe253b0c700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c15ff30 con 0x7fe24c0afb30 2023-10-06T01:39:01.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.827+0000 7fe253b0c700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c0a5b00 con 0x7fe24c0b1f90 2023-10-06T01:39:01.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.828+0000 7fe2520a9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe24c0cb2d0 0x7fe24c158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.828+0000 7fe2520a9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe24c0cb2d0 0x7fe24c158d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57032/0 (socket says 172.21.15.69:57032) 2023-10-06T01:39:01.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.828+0000 7fe2520a9700 1 -- 172.21.15.69:0/1828988516 learned_addr learned my addr 172.21.15.69:0/1828988516 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:01.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.828+0000 7fe2510a7700 1 --2- 172.21.15.69:0/1828988516 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe24c0b1f90 0x7fe24c15f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.829+0000 7fe2520a9700 1 -- 172.21.15.69:0/1828988516 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe24c0b1f90 msgr2=0x7fe24c15f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:01.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.829+0000 7fe2520a9700 1 --2- 172.21.15.69:0/1828988516 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe24c0b1f90 0x7fe24c15f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.829+0000 7fe2520a9700 1 -- 172.21.15.69:0/1828988516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe24c0afb30 msgr2=0x7fe24c0a6ba0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T01:39:01.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.829+0000 7fe2520a9700 1 --2- 172.21.15.69:0/1828988516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe24c0afb30 0x7fe24c0a6ba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.829+0000 7fe2520a9700 1 -- 172.21.15.69:0/1828988516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe244009ae0 con 0x7fe24c0cb2d0 2023-10-06T01:39:01.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.829+0000 7fe2520a9700 1 --2- 172.21.15.69:0/1828988516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe24c0cb2d0 0x7fe24c158d20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe23c00b7a0 tx=0x7fe23c007160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:01.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.830+0000 7fe241ffb700 1 -- 172.21.15.69:0/1828988516 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c011070 con 0x7fe24c0cb2d0 2023-10-06T01:39:01.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.830+0000 7fe241ffb700 1 -- 172.21.15.69:0/1828988516 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23c0084c0 con 0x7fe24c0cb2d0 2023-10-06T01:39:01.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.830+0000 7fe241ffb700 1 -- 172.21.15.69:0/1828988516 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c008880 con 0x7fe24c0cb2d0 2023-10-06T01:39:01.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.830+0000 7fe253b0c700 1 -- 172.21.15.69:0/1828988516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe24c0a5de0 con 0x7fe24c0cb2d0 2023-10-06T01:39:01.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.830+0000 7fe253b0c700 1 -- 172.21.15.69:0/1828988516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe24c0a63a0 con 0x7fe24c0cb2d0 2023-10-06T01:39:01.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.835+0000 7fe241ffb700 1 -- 172.21.15.69:0/1828988516 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe23c008c30 con 0x7fe24c0cb2d0 2023-10-06T01:39:01.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.835+0000 7fe241ffb700 1 --2- 172.21.15.69:0/1828988516 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe230067080 0x7fe230069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.835+0000 7fe241ffb700 1 -- 172.21.15.69:0/1828988516 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe23c083e20 con 0x7fe24c0cb2d0 2023-10-06T01:39:01.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.836+0000 7fe253b0c700 1 -- 172.21.15.69:0/1828988516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe22c0052b0 con 0x7fe24c0cb2d0 2023-10-06T01:39:01.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.837+0000 7fe2518a8700 1 --2- 172.21.15.69:0/1828988516 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe230067080 0x7fe230069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.837+0000 7fe2518a8700 1 --2- 172.21.15.69:0/1828988516 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe230067080 0x7fe230069530 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe248007fd0 tx=0x7fe248007990 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:01.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.845+0000 7fe241ffb700 1 -- 172.21.15.69:0/1828988516 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe23c050f10 con 0x7fe24c0cb2d0 2023-10-06T01:39:01.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.875+0000 7f23f055f700 1 Processor -- start 2023-10-06T01:39:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.876+0000 7f23f055f700 1 -- start start 2023-10-06T01:39:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.877+0000 7f2225f24700 1 Processor -- start 2023-10-06T01:39:01.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.877+0000 7f2225f24700 1 -- start start 2023-10-06T01:39:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.877+0000 7f23f055f700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f23e8064550 0x7f23e806ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.877+0000 7f23f055f700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e806a290 con 0x7f23e8155dd0 2023-10-06T01:39:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.877+0000 7f23f055f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e8068580 con 0x7f23e8067ec0 2023-10-06T01:39:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.877+0000 7f23f055f700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e80c8c20 con 0x7f23e8064550 2023-10-06T01:39:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.878+0000 7f23ee2fb700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f23e8064550 0x7f23e806ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.878+0000 7f23ee2fb700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f23e8064550 0x7f23e806ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57042/0 (socket says 172.21.15.69:57042) 2023-10-06T01:39:01.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.878+0000 7f23ee2fb700 1 -- 172.21.15.69:0/2209396903 learned_addr learned my addr 172.21.15.69:0/2209396903 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:01.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.878+0000 7f23ee2fb700 1 -- 172.21.15.69:0/2209396903 >> v1:172.21.15.88:6789/0 conn(0x7f23e8067ec0 legacy=0x7f23e80c71b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T01:39:01.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.878+0000 7f23ee2fb700 1 -- 172.21.15.69:0/2209396903 >> v1:172.21.15.69:6789/0 conn(0x7f23e8155dd0 legacy=0x7f23e80677b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:01.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.878+0000 7f23ee2fb700 1 -- 172.21.15.69:0/2209396903 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e8156900 con 0x7f23e8064550 2023-10-06T01:39:01.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.878+0000 7f23ee2fb700 1 --2- 172.21.15.69:0/2209396903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f23e8064550 0x7f23e806ace0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f23e40099b0 tx=0x7f23e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0650f2e141743e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:01.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.878+0000 7f2225f24700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f22200b2390 0x7f22200caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.878+0000 7f2225f24700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f222006ce20 con 0x7f2220157550 2023-10-06T01:39:01.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.878+0000 7f2225f24700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22200c9020 con 0x7f22200c8bd0 2023-10-06T01:39:01.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.878+0000 7f2225f24700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22200c9290 con 0x7f22200b2390 2023-10-06T01:39:01.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.879+0000 7f2216ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f22200b2390 0x7f22200caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.879+0000 7f221ffff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f22200c8bd0 0x7f222006d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.69:43090/0 (socket says 172.21.15.69:43090) 2023-10-06T01:39:01.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.879+0000 7f221ffff700 1 -- 172.21.15.69:0/3151098525 learned_addr learned my addr 172.21.15.69:0/3151098525 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:01.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.879+0000 7f2216ffd700 1 -- 172.21.15.69:0/3151098525 >> v1:172.21.15.88:6789/0 conn(0x7f22200c8bd0 legacy=0x7f222006d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:01.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.879+0000 7f2216ffd700 1 -- 172.21.15.69:0/3151098525 >> v1:172.21.15.69:6789/0 conn(0x7f2220157550 legacy=0x7f22200b1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:01.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.879+0000 7f2216ffd700 1 -- 172.21.15.69:0/3151098525 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f222006c7d0 con 0x7f22200b2390 2023-10-06T01:39:01.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.879+0000 7f2216ffd700 1 --2- 172.21.15.69:0/3151098525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22200b2390 0x7f22200caa40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f22080098e0 tx=0x7f22080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9d23285ee9d4b530 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:01.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.879+0000 7f975c25b700 1 Processor -- start 2023-10-06T01:39:01.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.879+0000 7f221effd700 1 -- 172.21.15.69:0/3151098525 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2208009e80 con 0x7f22200b2390 2023-10-06T01:39:01.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.879+0000 7f221effd700 1 -- 172.21.15.69:0/3151098525 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f220800b860 con 0x7f22200b2390 2023-10-06T01:39:01.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.879+0000 7f221effd700 1 -- 172.21.15.69:0/3151098525 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f220800bc00 con 0x7f22200b2390 2023-10-06T01:39:01.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.880+0000 7f975c25b700 1 -- start start 2023-10-06T01:39:01.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.880+0000 7f9208fcb700 1 Processor -- start 2023-10-06T01:39:01.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.881+0000 7f2225f24700 1 -- 172.21.15.69:0/3151098525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22200b2390 msgr2=0x7f22200caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:01.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.881+0000 7f2225f24700 1 --2- 172.21.15.69:0/3151098525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22200b2390 0x7f22200caa40 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f22080098e0 tx=0x7f22080091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.881+0000 7f2225f24700 1 -- 172.21.15.69:0/3151098525 shutdown_connections 2023-10-06T01:39:01.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.881+0000 7f2225f24700 1 --2- 172.21.15.69:0/3151098525 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f22200b2390 0x7f22200caa40 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f22080098e0 tx=0x7f22080091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.881+0000 7f2225f24700 1 -- 172.21.15.69:0/3151098525 >> 172.21.15.69:0/3151098525 conn(0x7f222006f190 msgr2=0x7f22200ae580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:01.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.881+0000 7f2225f24700 1 -- 172.21.15.69:0/3151098525 shutdown_connections 2023-10-06T01:39:01.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.881+0000 7f2225f24700 1 -- 172.21.15.69:0/3151098525 wait complete. 2023-10-06T01:39:01.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.881+0000 7f975c25b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f97540cb8e0 0x7f97540cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.881+0000 7f975c25b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f97540ac830 0x7f975406e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.881+0000 7f975c25b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f97540acca0 0x7f975406e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.881+0000 7f975c25b700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97540b20a0 con 0x7f97540ac830 2023-10-06T01:39:01.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.881+0000 7f975c25b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9754156ee0 con 0x7f97540acca0 2023-10-06T01:39:01.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.881+0000 7f975c25b700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9754156c00 con 0x7f97540cb8e0 2023-10-06T01:39:01.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.881+0000 7f9208fcb700 1 -- start start 2023-10-06T01:39:01.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.881+0000 7f975a7f8700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f97540acca0 0x7f975406e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.881+0000 7f975a7f8700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f97540acca0 0x7f975406e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.69:42650/0 (socket says 172.21.15.69:42650) 2023-10-06T01:39:01.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.881+0000 7f975a7f8700 1 -- 172.21.15.69:0/2034155387 learned_addr learned my addr 172.21.15.69:0/2034155387 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:01.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.882+0000 7f975a7f8700 1 -- 172.21.15.69:0/2034155387 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f97540cb8e0 msgr2=0x7f97540cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:01.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.882+0000 7f975a7f8700 1 --2- 172.21.15.69:0/2034155387 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f97540cb8e0 0x7f97540cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.882+0000 7f975a7f8700 1 -- 172.21.15.69:0/2034155387 >> v2:172.21.15.69:3300/0 conn(0x7f97540ac830 msgr2=0x7f975406e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:01.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.882+0000 7f975a7f8700 1 --2- 172.21.15.69:0/2034155387 >> v2:172.21.15.69:3300/0 conn(0x7f97540ac830 0x7f975406e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.882+0000 7f975a7f8700 1 -- 172.21.15.69:0/2034155387 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97540abd50 con 0x7f97540acca0 2023-10-06T01:39:01.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.882+0000 7f975a7f8700 1 --2- 172.21.15.69:0/2034155387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97540acca0 0x7f975406e930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f97540cc1f0 tx=0x7f974c009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51db5550e61076fa server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:01.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.882+0000 7f9758ff5700 1 -- 172.21.15.69:0/2034155387 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c0092e0 con 0x7f97540acca0 2023-10-06T01:39:01.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.882+0000 7f9758ff5700 1 -- 172.21.15.69:0/2034155387 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f974c010450 con 0x7f97540acca0 2023-10-06T01:39:01.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.882+0000 7f9758ff5700 1 -- 172.21.15.69:0/2034155387 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f974c010810 con 0x7f97540acca0 2023-10-06T01:39:01.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.883+0000 7f2225f24700 1 Processor -- start 2023-10-06T01:39:01.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.883+0000 7f975c25b700 1 -- 172.21.15.69:0/2034155387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97540acca0 msgr2=0x7f975406e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:01.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.883+0000 7f975c25b700 1 --2- 172.21.15.69:0/2034155387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97540acca0 0x7f975406e930 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f97540cc1f0 tx=0x7f974c009f90 comp rx=0 tx=0).stop 2023-10-06T01:39:01.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.883+0000 7f975c25b700 1 -- 172.21.15.69:0/2034155387 shutdown_connections 2023-10-06T01:39:01.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.883+0000 7f975c25b700 1 --2- 172.21.15.69:0/2034155387 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97540acca0 0x7f975406e930 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.883+0000 7f975c25b700 1 --2- 172.21.15.69:0/2034155387 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f97540cb8e0 0x7f97540cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.883+0000 7f975c25b700 1 --2- 172.21.15.69:0/2034155387 >> v2:172.21.15.69:3300/0 conn(0x7f97540ac830 0x7f975406e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.883+0000 7f975c25b700 1 -- 172.21.15.69:0/2034155387 >> 172.21.15.69:0/2034155387 conn(0x7f97540cc300 msgr2=0x7f97540cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:01.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.884+0000 7f975c25b700 1 -- 172.21.15.69:0/2034155387 shutdown_connections 2023-10-06T01:39:01.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.884+0000 7f975c25b700 1 -- 172.21.15.69:0/2034155387 wait complete. 2023-10-06T01:39:01.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.883+0000 7f2225f24700 1 -- start start 2023-10-06T01:39:01.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.884+0000 7f2225f24700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f22200c8bd0 0x7f222014ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.884+0000 7f2225f24700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2220157550 0x7f22201596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.884+0000 7f2225f24700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2220159c20 0x7f22200a72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.884+0000 7f2225f24700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222015a0c0 con 0x7f22200c8bd0 2023-10-06T01:39:01.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.884+0000 7f2225f24700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22200a9430 con 0x7f2220157550 2023-10-06T01:39:01.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.884+0000 7f2225f24700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f222015aeb0 con 0x7f2220159c20 2023-10-06T01:39:01.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.884+0000 7f221f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f22200c8bd0 0x7f222014ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.884+0000 7f221f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f22200c8bd0 0x7f222014ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57074/0 (socket says 172.21.15.69:57074) 2023-10-06T01:39:01.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.884+0000 7f221f7fe700 1 -- 172.21.15.69:0/2638178680 learned_addr learned my addr 172.21.15.69:0/2638178680 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:01.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.882+0000 7f9208fcb700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f920415da70 0x7f920415de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.882+0000 7f9208fcb700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92040c3300 0x7f92040c3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.882+0000 7f9208fcb700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f920406e0c0 con 0x7f92040cbf90 2023-10-06T01:39:01.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.882+0000 7f9208fcb700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92040c30c0 con 0x7f920415da70 2023-10-06T01:39:01.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.882+0000 7f9208fcb700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f920406c6a0 con 0x7f92040c3300 2023-10-06T01:39:01.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.882+0000 7f920259c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f920415da70 0x7f920415de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.882+0000 7f920259c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f920415da70 0x7f920415de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57060/0 (socket says 172.21.15.69:57060) 2023-10-06T01:39:01.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.882+0000 7f920259c700 1 -- 172.21.15.69:0/2883780245 learned_addr learned my addr 172.21.15.69:0/2883780245 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:01.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.882+0000 7f920259c700 1 -- 172.21.15.69:0/2883780245 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92040c3300 msgr2=0x7f92040c3740 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-06T01:39:01.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.882+0000 7f920259c700 1 --2- 172.21.15.69:0/2883780245 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92040c3300 0x7f92040c3740 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.883+0000 7f920259c700 1 -- 172.21.15.69:0/2883780245 >> v1:172.21.15.69:6789/0 conn(0x7f92040cbf90 legacy=0x7f92040c29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:01.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.883+0000 7f920259c700 1 -- 172.21.15.69:0/2883780245 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920415e380 con 0x7f920415da70 2023-10-06T01:39:01.890 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.883+0000 7f920259c700 1 --2- 172.21.15.69:0/2883780245 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f920415da70 0x7f920415de40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f91f80099b0 tx=0x7f91f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1db5354bd0a7ac18 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:01.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.883+0000 7f920159a700 1 -- 172.21.15.69:0/2883780245 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f800b820 con 0x7f920415da70 2023-10-06T01:39:01.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.883+0000 7f920159a700 1 -- 172.21.15.69:0/2883780245 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f800b980 con 0x7f920415da70 2023-10-06T01:39:01.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.883+0000 7f920159a700 1 -- 172.21.15.69:0/2883780245 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f800bd20 con 0x7f920415da70 2023-10-06T01:39:01.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.884+0000 7f9208fcb700 1 -- 172.21.15.69:0/2883780245 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f920415da70 msgr2=0x7f920415de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:01.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.884+0000 7f9208fcb700 1 --2- 172.21.15.69:0/2883780245 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f920415da70 0x7f920415de40 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f91f80099b0 tx=0x7f91f8009250 comp rx=0 tx=0).stop 2023-10-06T01:39:01.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.885+0000 7f2216ffd700 1 --2- 172.21.15.69:0/2638178680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2220157550 0x7f22201596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.891 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.885+0000 7f221ffff700 1 --2- 172.21.15.69:0/2638178680 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2220159c20 0x7f22200a72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.885+0000 7f221f7fe700 1 -- 172.21.15.69:0/2638178680 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2220159c20 msgr2=0x7f22200a72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:01.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.885+0000 7f221f7fe700 1 --2- 172.21.15.69:0/2638178680 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2220159c20 0x7f22200a72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.885+0000 7f221f7fe700 1 -- 172.21.15.69:0/2638178680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2220157550 msgr2=0x7f22201596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:01.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.885+0000 7f221f7fe700 1 --2- 172.21.15.69:0/2638178680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2220157550 0x7f22201596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.885+0000 7f221f7fe700 1 -- 172.21.15.69:0/2638178680 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2208009420 con 0x7f22200c8bd0 2023-10-06T01:39:01.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.885+0000 7f975c25b700 1 Processor -- start 2023-10-06T01:39:01.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.885+0000 7f975c25b700 1 -- start start 2023-10-06T01:39:01.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.885+0000 7f23ed2f9700 1 -- 172.21.15.69:0/2209396903 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e400b7e0 con 0x7f23e8064550 2023-10-06T01:39:01.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.885+0000 7f23ed2f9700 1 -- 172.21.15.69:0/2209396903 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e400b940 con 0x7f23e8064550 2023-10-06T01:39:01.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.885+0000 7f221f7fe700 1 --2- 172.21.15.69:0/2638178680 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f22200c8bd0 0x7f222014ffb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f221000c510 tx=0x7f221000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:01.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.886+0000 7f2217fff700 1 -- 172.21.15.69:0/2638178680 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2210011590 con 0x7f22200c8bd0 2023-10-06T01:39:01.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.886+0000 7fbee5d7e700 1 Processor -- start 2023-10-06T01:39:01.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.886+0000 7f975c25b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97540ac830 0x7f97541456b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.886+0000 7f975c25b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97540acca0 0x7f9754152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.886+0000 7f975c25b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f97540cb8e0 0x7f975414fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.886+0000 7f975c25b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9754153bf0 con 0x7f97540ac830 2023-10-06T01:39:01.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.886+0000 7f975c25b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9754152d40 con 0x7f97540acca0 2023-10-06T01:39:01.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.886+0000 7f975c25b700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9754152fe0 con 0x7f97540cb8e0 2023-10-06T01:39:01.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.887+0000 7f9759ff7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97540ac830 0x7f97541456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.887+0000 7f9759ff7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97540ac830 0x7f97541456b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57076/0 (socket says 172.21.15.69:57076) 2023-10-06T01:39:01.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.887+0000 7f975a7f8700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f97540cb8e0 0x7f975414fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.887+0000 7f9759ff7700 1 -- 172.21.15.69:0/2742849793 learned_addr learned my addr 172.21.15.69:0/2742849793 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:01.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.887+0000 7f9759ff7700 1 -- 172.21.15.69:0/2742849793 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f97540cb8e0 msgr2=0x7f975414fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:01.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.887+0000 7f9759ff7700 1 --2- 172.21.15.69:0/2742849793 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f97540cb8e0 0x7f975414fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.887+0000 7f9759ff7700 1 -- 172.21.15.69:0/2742849793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97540acca0 msgr2=0x7f9754152800 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-06T01:39:01.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.887+0000 7f9759ff7700 1 --2- 172.21.15.69:0/2742849793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97540acca0 0x7f9754152800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.887+0000 7f9759ff7700 1 -- 172.21.15.69:0/2742849793 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974c00c370 con 0x7f97540ac830 2023-10-06T01:39:01.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.886+0000 7f2217fff700 1 -- 172.21.15.69:0/2638178680 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2210011710 con 0x7f22200c8bd0 2023-10-06T01:39:01.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.886+0000 7f2217fff700 1 -- 172.21.15.69:0/2638178680 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2210011ad0 con 0x7f22200c8bd0 2023-10-06T01:39:01.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.886+0000 7f2225f24700 1 -- 172.21.15.69:0/2638178680 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22200a6780 con 0x7f22200c8bd0 2023-10-06T01:39:01.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.886+0000 7f2225f24700 1 -- 172.21.15.69:0/2638178680 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f222015a580 con 0x7f22200c8bd0 2023-10-06T01:39:01.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.885+0000 7f23ed2f9700 1 -- 172.21.15.69:0/2209396903 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e400bce0 con 0x7f23e8064550 2023-10-06T01:39:01.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.886+0000 7f23f055f700 1 -- 172.21.15.69:0/2209396903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f23e8064550 msgr2=0x7f23e806ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:01.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.886+0000 7f23f055f700 1 --2- 172.21.15.69:0/2209396903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f23e8064550 0x7f23e806ace0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f23e40099b0 tx=0x7f23e4009250 comp rx=0 tx=0).stop 2023-10-06T01:39:01.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.886+0000 7f23f055f700 1 -- 172.21.15.69:0/2209396903 shutdown_connections 2023-10-06T01:39:01.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.886+0000 7f23f055f700 1 --2- 172.21.15.69:0/2209396903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f23e8064550 0x7f23e806ace0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.886+0000 7f23f055f700 1 -- 172.21.15.69:0/2209396903 >> 172.21.15.69:0/2209396903 conn(0x7f23e80cc720 msgr2=0x7f23e80ccb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:01.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.886+0000 7f23f055f700 1 -- 172.21.15.69:0/2209396903 shutdown_connections 2023-10-06T01:39:01.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.887+0000 7f23f055f700 1 -- 172.21.15.69:0/2209396903 wait complete. 2023-10-06T01:39:01.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.886+0000 7fd907651700 1 Processor -- start 2023-10-06T01:39:01.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.886+0000 7f9208fcb700 1 -- 172.21.15.69:0/2883780245 shutdown_connections 2023-10-06T01:39:01.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.886+0000 7f9208fcb700 1 --2- 172.21.15.69:0/2883780245 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92040c3300 0x7f92040c3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.886+0000 7f9208fcb700 1 --2- 172.21.15.69:0/2883780245 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f920415da70 0x7f920415de40 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.886+0000 7f9208fcb700 1 -- 172.21.15.69:0/2883780245 >> 172.21.15.69:0/2883780245 conn(0x7f92040ccb60 msgr2=0x7f92040ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:01.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.887+0000 7fbee5d7e700 1 -- start start 2023-10-06T01:39:01.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.888+0000 7f9759ff7700 1 --2- 172.21.15.69:0/2742849793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97540ac830 0x7f97541456b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f975000b590 tx=0x7f9750006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:01.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.887+0000 7fd907651700 1 -- start start 2023-10-06T01:39:01.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.888+0000 7fbee5d7e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbee00cb8e0 0x7fbee00cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.888+0000 7fbee5d7e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbee00accd0 0x7fbee00ad6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.888+0000 7fbee5d7e700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbee0156c00 con 0x7fbee00ac830 2023-10-06T01:39:01.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.888+0000 7fbee5d7e700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbee00b20a0 con 0x7fbee00cb8e0 2023-10-06T01:39:01.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.888+0000 7fbee5d7e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee0156ee0 con 0x7fbee00accd0 2023-10-06T01:39:01.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.888+0000 7fbedf7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbee00cb8e0 0x7fbee00cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.888+0000 7fd907651700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd900161150 0x7fd9000b1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.888+0000 7fd907651700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd9000b0080 0x7fd900167920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.888+0000 7fd907651700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9000ad3d0 con 0x7fd9000b1dc0 2023-10-06T01:39:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.888+0000 7fd907651700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9000b2230 con 0x7fd9000b0080 2023-10-06T01:39:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.888+0000 7fd907651700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9000aed90 con 0x7fd900161150 2023-10-06T01:39:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.888+0000 7fbedffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbee00accd0 0x7fbee00ad6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.888+0000 7fbedeffd700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fbee00ac830 0x7fbee006e3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37456/0 (socket says 172.21.15.69:37456) 2023-10-06T01:39:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.888+0000 7fbedf7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fbee00cb8e0 0x7fbee00cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57086/0 (socket says 172.21.15.69:57086) 2023-10-06T01:39:01.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.888+0000 7fbedf7fe700 1 -- 172.21.15.69:0/2508830949 learned_addr learned my addr 172.21.15.69:0/2508830949 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:01.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.888+0000 7f2225f24700 1 -- 172.21.15.69:0/2638178680 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f222004c3c0 con 0x7f22200c8bd0 2023-10-06T01:39:01.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.888+0000 7f23f055f700 1 Processor -- start 2023-10-06T01:39:01.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.888+0000 7f23f055f700 1 -- start start 2023-10-06T01:39:01.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.888+0000 7fd9053ed700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd900161150 0x7fd9000b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.888+0000 7fd9053ed700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd900161150 0x7fd9000b1880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.69:42604/0 (socket says 172.21.15.69:42604) 2023-10-06T01:39:01.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.888+0000 7fd9053ed700 1 -- 172.21.15.69:0/1428212163 learned_addr learned my addr 172.21.15.69:0/1428212163 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:01.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.888+0000 7fd905bee700 1 --2- 172.21.15.69:0/1428212163 >> v2:172.21.15.88:3300/0 conn(0x7fd9000b0080 0x7fd900167920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.888+0000 7f9745ffb700 1 -- 172.21.15.69:0/2742849793 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975000f510 con 0x7f97540ac830 2023-10-06T01:39:01.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.888+0000 7f9745ffb700 1 -- 172.21.15.69:0/2742849793 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f975000f670 con 0x7f97540ac830 2023-10-06T01:39:01.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.888+0000 7f9745ffb700 1 -- 172.21.15.69:0/2742849793 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f975000fa30 con 0x7f97540ac830 2023-10-06T01:39:01.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.888+0000 7f975c25b700 1 -- 172.21.15.69:0/2742849793 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97541532c0 con 0x7f97540ac830 2023-10-06T01:39:01.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.889+0000 7fbedffff700 1 -- 172.21.15.69:0/2508830949 >> v2:172.21.15.69:3300/0 conn(0x7fbee00cb8e0 msgr2=0x7fbee00cbcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:01.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.889+0000 7fbedffff700 1 --2- 172.21.15.69:0/2508830949 >> v2:172.21.15.69:3300/0 conn(0x7fbee00cb8e0 0x7fbee00cbcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.889+0000 7fbedffff700 1 -- 172.21.15.69:0/2508830949 >> v1:172.21.15.69:6789/0 conn(0x7fbee00ac830 legacy=0x7fbee006e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:01.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.889+0000 7f975c25b700 1 -- 172.21.15.69:0/2742849793 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9754153880 con 0x7f97540ac830 2023-10-06T01:39:01.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.889+0000 7fd9053ed700 1 -- 172.21.15.69:0/1428212163 >> v2:172.21.15.88:3300/0 conn(0x7fd9000b0080 msgr2=0x7fd900167920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:01.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.889+0000 7fd9053ed700 1 --2- 172.21.15.69:0/1428212163 >> v2:172.21.15.88:3300/0 conn(0x7fd9000b0080 0x7fd900167920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.889+0000 7fd9053ed700 1 -- 172.21.15.69:0/1428212163 >> v1:172.21.15.69:6789/0 conn(0x7fd9000b1dc0 legacy=0x7fd9000af970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:01.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.889+0000 7fd9053ed700 1 -- 172.21.15.69:0/1428212163 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd90015e1c0 con 0x7fd900161150 2023-10-06T01:39:01.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.889+0000 7fbedffff700 1 -- 172.21.15.69:0/2508830949 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee00abd50 con 0x7fbee00accd0 2023-10-06T01:39:01.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.889+0000 7f9208fcb700 1 -- 172.21.15.69:0/2883780245 shutdown_connections 2023-10-06T01:39:01.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.889+0000 7f9208fcb700 1 -- 172.21.15.69:0/2883780245 wait complete. 2023-10-06T01:39:01.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.889+0000 7fbedffff700 1 --2- 172.21.15.69:0/2508830949 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbee00accd0 0x7fbee00ad6b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbed40098e0 tx=0x7fbed40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ca83c221f68d196 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:01.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.889+0000 7fbede7fc700 1 -- 172.21.15.69:0/2508830949 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed4011630 con 0x7fbee00accd0 2023-10-06T01:39:01.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.889+0000 7fbede7fc700 1 -- 172.21.15.69:0/2508830949 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed40117b0 con 0x7fbee00accd0 2023-10-06T01:39:01.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.889+0000 7fbede7fc700 1 -- 172.21.15.69:0/2508830949 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed4011b70 con 0x7fbee00accd0 2023-10-06T01:39:01.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.889+0000 7f23f055f700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f23e8064550 0x7f23e80b1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.889+0000 7f23f055f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f23e8067ec0 0x7f23e814d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.889+0000 7f23f055f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23e8155dd0 0x7f23e80b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.889+0000 7f23f055f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e80b1860 con 0x7f23e8067ec0 2023-10-06T01:39:01.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.889+0000 7f23f055f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e814d820 con 0x7f23e8155dd0 2023-10-06T01:39:01.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.889+0000 7f23f055f700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e80b0c50 con 0x7f23e8064550 2023-10-06T01:39:01.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.890+0000 7f23eeafc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23e8155dd0 0x7f23e80b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.890+0000 7f23eeafc700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23e8155dd0 0x7f23e80b02e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.69:42680/0 (socket says 172.21.15.69:42680) 2023-10-06T01:39:01.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.890+0000 7f23eeafc700 1 -- 172.21.15.69:0/985236128 learned_addr learned my addr 172.21.15.69:0/985236128 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:01.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.890+0000 7fd9053ed700 1 --2- 172.21.15.69:0/1428212163 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd900161150 0x7fd9000b1880 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd8f00099b0 tx=0x7fd8f0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35ee73861c0bb15a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:01.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.889+0000 7f2217fff700 1 -- 172.21.15.69:0/2638178680 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f221001b3b0 con 0x7f22200c8bd0 2023-10-06T01:39:01.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.889+0000 7f2217fff700 1 --2- 172.21.15.69:0/2638178680 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2200067080 0x7f2200069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.890+0000 7f2217fff700 1 -- 172.21.15.69:0/2638178680 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2210083aa0 con 0x7f22200c8bd0 2023-10-06T01:39:01.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.890+0000 7fd8f7fff700 1 -- 172.21.15.69:0/1428212163 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0009ea0 con 0x7fd900161150 2023-10-06T01:39:01.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.890+0000 7f23edafa700 1 --2- 172.21.15.69:0/985236128 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f23e8067ec0 0x7f23e814d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.890+0000 7fd8f7fff700 1 -- 172.21.15.69:0/1428212163 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f000b820 con 0x7fd900161150 2023-10-06T01:39:01.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.890+0000 7fd8f7fff700 1 -- 172.21.15.69:0/1428212163 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f000bbc0 con 0x7fd900161150 2023-10-06T01:39:01.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.890+0000 7fbedeffd700 1 --1- 172.21.15.69:0/2508830949 >> v1:172.21.15.69:6789/0 conn(0x7fbee00ac830 0x7fbee006e3f0 :-1 s=CLOSED pgs=0 cs=0 l=0).handle_server_banner_and_identify state changed while learned_addr, mark_down or replacing must be happened just now 2023-10-06T01:39:01.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.890+0000 7f23eeafc700 1 -- 172.21.15.69:0/985236128 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f23e8064550 msgr2=0x7f23e80b1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:01.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.890+0000 7f23eeafc700 1 --2- 172.21.15.69:0/985236128 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f23e8064550 0x7f23e80b1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.890+0000 7f23eeafc700 1 -- 172.21.15.69:0/985236128 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f23e8067ec0 msgr2=0x7f23e814d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:01.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.890+0000 7f23eeafc700 1 --2- 172.21.15.69:0/985236128 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f23e8067ec0 0x7f23e814d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.890+0000 7f23eeafc700 1 -- 172.21.15.69:0/985236128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e40094f0 con 0x7f23e8155dd0 2023-10-06T01:39:01.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.890+0000 7f9208fcb700 1 Processor -- start 2023-10-06T01:39:01.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.891+0000 7fbee5d7e700 1 -- 172.21.15.69:0/2508830949 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbee00accd0 msgr2=0x7fbee00ad6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:01.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.891+0000 7fbee5d7e700 1 --2- 172.21.15.69:0/2508830949 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbee00accd0 0x7fbee00ad6b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbed40098e0 tx=0x7fbed40091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.891+0000 7fbee5d7e700 1 -- 172.21.15.69:0/2508830949 shutdown_connections 2023-10-06T01:39:01.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.891+0000 7fbee5d7e700 1 --2- 172.21.15.69:0/2508830949 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbee00accd0 0x7fbee00ad6b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.891+0000 7fbee5d7e700 1 --2- 172.21.15.69:0/2508830949 >> v2:172.21.15.69:3300/0 conn(0x7fbee00cb8e0 0x7fbee00cbcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.891+0000 7fbee5d7e700 1 -- 172.21.15.69:0/2508830949 >> 172.21.15.69:0/2508830949 conn(0x7fbee00cc300 msgr2=0x7fbee00cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:01.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.891+0000 7fd907651700 1 -- 172.21.15.69:0/1428212163 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd900161150 msgr2=0x7fd9000b1880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:01.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.891+0000 7fd907651700 1 --2- 172.21.15.69:0/1428212163 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd900161150 0x7fd9000b1880 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fd8f00099b0 tx=0x7fd8f0009250 comp rx=0 tx=0).stop 2023-10-06T01:39:01.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.891+0000 7fd907651700 1 -- 172.21.15.69:0/1428212163 shutdown_connections 2023-10-06T01:39:01.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.891+0000 7fd907651700 1 --2- 172.21.15.69:0/1428212163 >> v2:172.21.15.88:3300/0 conn(0x7fd9000b0080 0x7fd900167920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.891+0000 7fd907651700 1 --2- 172.21.15.69:0/1428212163 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd900161150 0x7fd9000b1880 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.891+0000 7fd907651700 1 -- 172.21.15.69:0/1428212163 >> 172.21.15.69:0/1428212163 conn(0x7fd9000cc300 msgr2=0x7fd9000cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:01.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.890+0000 7f9208fcb700 1 -- start start 2023-10-06T01:39:01.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.891+0000 7fbee5d7e700 1 -- 172.21.15.69:0/2508830949 shutdown_connections 2023-10-06T01:39:01.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.891+0000 7fd907651700 1 -- 172.21.15.69:0/1428212163 shutdown_connections 2023-10-06T01:39:01.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.891+0000 7f23eeafc700 1 --2- 172.21.15.69:0/985236128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23e8155dd0 0x7f23e80b02e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f23e000bb80 tx=0x7f23e0009810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:01.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.891+0000 7f9745ffb700 1 -- 172.21.15.69:0/2742849793 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f975001a400 con 0x7f97540ac830 2023-10-06T01:39:01.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.891+0000 7f9745ffb700 1 --2- 172.21.15.69:0/2742849793 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9738066f30 0x7f97380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.892+0000 7f9745ffb700 1 -- 172.21.15.69:0/2742849793 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f97500841f0 con 0x7f97540ac830 2023-10-06T01:39:01.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.891+0000 7fd907651700 1 -- 172.21.15.69:0/1428212163 wait complete. 2023-10-06T01:39:01.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.892+0000 7f9208fcb700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92040c3300 0x7f920413dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.892+0000 7f9208fcb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f920415da70 0x7f9204152620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.892+0000 7f9208fcb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9204152b60 0x7f92040c5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.892+0000 7f9208fcb700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9204153000 con 0x7f920415da70 2023-10-06T01:39:01.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.892+0000 7f9208fcb700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9204158a20 con 0x7f9204152b60 2023-10-06T01:39:01.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.892+0000 7f9208fcb700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92041580f0 con 0x7f92040c3300 2023-10-06T01:39:01.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.892+0000 7f920259c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92040c3300 0x7f920413dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.892+0000 7f2216ffd700 1 --2- 172.21.15.69:0/2638178680 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2200067080 0x7f2200069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.892+0000 7f920259c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92040c3300 0x7f920413dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.69:42622/0 (socket says 172.21.15.69:42622) 2023-10-06T01:39:01.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.892+0000 7f920259c700 1 -- 172.21.15.69:0/1255037442 learned_addr learned my addr 172.21.15.69:0/1255037442 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:01.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.892+0000 7f9202d9d700 1 --2- 172.21.15.69:0/1255037442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9204152b60 0x7f92040c5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.892+0000 7f9201d9b700 1 --2- 172.21.15.69:0/1255037442 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f920415da70 0x7f9204152620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.892+0000 7f975c25b700 1 -- 172.21.15.69:0/2742849793 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f975404c3c0 con 0x7f97540ac830 2023-10-06T01:39:01.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.892+0000 7f920259c700 1 -- 172.21.15.69:0/1255037442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9204152b60 msgr2=0x7f92040c5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:01.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.892+0000 7f920259c700 1 --2- 172.21.15.69:0/1255037442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9204152b60 0x7f92040c5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.892+0000 7f920259c700 1 -- 172.21.15.69:0/1255037442 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f920415da70 msgr2=0x7f9204152620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:01.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.892+0000 7f920259c700 1 --2- 172.21.15.69:0/1255037442 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f920415da70 0x7f9204152620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.892+0000 7f920259c700 1 -- 172.21.15.69:0/1255037442 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f80094f0 con 0x7f92040c3300 2023-10-06T01:39:01.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.892+0000 7f920259c700 1 --2- 172.21.15.69:0/1255037442 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92040c3300 0x7f920413dd40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f91f8009290 tx=0x7f91f8027000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:01.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.893+0000 7f2216ffd700 1 --2- 172.21.15.69:0/2638178680 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2200067080 0x7f2200069530 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f22200b2790 tx=0x7f2208017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:01.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.893+0000 7f91f27fc700 1 -- 172.21.15.69:0/1255037442 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f8022910 con 0x7f92040c3300 2023-10-06T01:39:01.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.893+0000 7f9208fcb700 1 -- 172.21.15.69:0/1255037442 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92041583d0 con 0x7f92040c3300 2023-10-06T01:39:01.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.893+0000 7f9208fcb700 1 -- 172.21.15.69:0/1255037442 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f920413e8f0 con 0x7f92040c3300 2023-10-06T01:39:01.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.893+0000 7fd907651700 1 Processor -- start 2023-10-06T01:39:01.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.893+0000 7fd907651700 1 -- start start 2023-10-06T01:39:01.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.891+0000 7fbee5d7e700 1 -- 172.21.15.69:0/2508830949 wait complete. 2023-10-06T01:39:01.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.893+0000 7fbee5d7e700 1 Processor -- start 2023-10-06T01:39:01.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.893+0000 7fbee5d7e700 1 -- start start 2023-10-06T01:39:01.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.894+0000 7f23de7fc700 1 -- 172.21.15.69:0/985236128 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e000c970 con 0x7f23e8155dd0 2023-10-06T01:39:01.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.894+0000 7f23de7fc700 1 -- 172.21.15.69:0/985236128 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23e000caf0 con 0x7f23e8155dd0 2023-10-06T01:39:01.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.894+0000 7f23de7fc700 1 -- 172.21.15.69:0/985236128 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23e0014410 con 0x7f23e8155dd0 2023-10-06T01:39:01.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.894+0000 7f23f055f700 1 -- 172.21.15.69:0/985236128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e80b0f30 con 0x7f23e8155dd0 2023-10-06T01:39:01.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.894+0000 7f23f055f700 1 -- 172.21.15.69:0/985236128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e80b14f0 con 0x7f23e8155dd0 2023-10-06T01:39:01.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.893+0000 7f97597f6700 1 --2- 172.21.15.69:0/2742849793 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9738066f30 0x7f97380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.894+0000 7f91f27fc700 1 -- 172.21.15.69:0/1255037442 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91f8031070 con 0x7f92040c3300 2023-10-06T01:39:01.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.894+0000 7f91f27fc700 1 -- 172.21.15.69:0/1255037442 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91f8022c80 con 0x7f92040c3300 2023-10-06T01:39:01.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.894+0000 7fbee5d7e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbee00ac830 0x7fbee0150fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.894+0000 7fbee5d7e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbee00accd0 0x7fbee0152b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.894+0000 7f9208fcb700 1 -- 172.21.15.69:0/1255037442 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f920404c3c0 con 0x7f92040c3300 2023-10-06T01:39:01.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.894+0000 7fbee5d7e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbee00cb8e0 0x7fbee0153070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.894+0000 7fbee5d7e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee0151a90 con 0x7fbee00ac830 2023-10-06T01:39:01.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.894+0000 7fbee5d7e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbee0151d70 con 0x7fbee00accd0 2023-10-06T01:39:01.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.894+0000 7fbee5d7e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbee0152050 con 0x7fbee00cb8e0 2023-10-06T01:39:01.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.894+0000 7fbedeffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbee00accd0 0x7fbee0152b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.895+0000 7fbedeffd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbee00accd0 0x7fbee0152b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.69:42694/0 (socket says 172.21.15.69:42694) 2023-10-06T01:39:01.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.895+0000 7fbedeffd700 1 -- 172.21.15.69:0/612462363 learned_addr learned my addr 172.21.15.69:0/612462363 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:01.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.895+0000 7fbedf7fe700 1 --2- 172.21.15.69:0/612462363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbee00ac830 0x7fbee0150fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.895+0000 7f97597f6700 1 --2- 172.21.15.69:0/2742849793 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9738066f30 0x7f97380693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9748006fd0 tx=0x7f9748006d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:01.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.894+0000 7fd907651700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9000b0080 0x7fd900149a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.894+0000 7fd907651700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9000b1dc0 0x7fd90015ae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.894+0000 7fd907651700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd900161150 0x7fd900163910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.894+0000 7fd907651700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd900147bc0 con 0x7fd900161150 2023-10-06T01:39:01.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.894+0000 7fd907651700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd900149f80 con 0x7fd9000b0080 2023-10-06T01:39:01.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.894+0000 7fd907651700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd900146fb0 con 0x7fd9000b1dc0 2023-10-06T01:39:01.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.895+0000 7f23f055f700 1 -- 172.21.15.69:0/985236128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d00052b0 con 0x7f23e8155dd0 2023-10-06T01:39:01.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.895+0000 7fd905bee700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd900161150 0x7fd900163910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.895+0000 7fd905bee700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd900161150 0x7fd900163910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57100/0 (socket says 172.21.15.69:57100) 2023-10-06T01:39:01.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.895+0000 7fd905bee700 1 -- 172.21.15.69:0/590175268 learned_addr learned my addr 172.21.15.69:0/590175268 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:01.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.896+0000 7fd905bee700 1 -- 172.21.15.69:0/590175268 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9000b1dc0 msgr2=0x7fd90015ae50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T01:39:01.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.896+0000 7fd905bee700 1 --2- 172.21.15.69:0/590175268 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9000b1dc0 0x7fd90015ae50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.896+0000 7fd905bee700 1 -- 172.21.15.69:0/590175268 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9000b0080 msgr2=0x7fd900149a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:01.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.896+0000 7fd905bee700 1 --2- 172.21.15.69:0/590175268 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9000b0080 0x7fd900149a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.896+0000 7fd905bee700 1 -- 172.21.15.69:0/590175268 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f00094f0 con 0x7fd900161150 2023-10-06T01:39:01.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.896+0000 7fd905bee700 1 --2- 172.21.15.69:0/590175268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd900161150 0x7fd900163910 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc00ea20 tx=0x7fd8fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:01.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.896+0000 7fbedf7fe700 1 -- 172.21.15.69:0/612462363 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbee00cb8e0 msgr2=0x7fbee0153070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:01.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.896+0000 7fbedf7fe700 1 --2- 172.21.15.69:0/612462363 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbee00cb8e0 0x7fbee0153070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.896+0000 7fbedf7fe700 1 -- 172.21.15.69:0/612462363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbee00accd0 msgr2=0x7fbee0152b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:01.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.896+0000 7fbedf7fe700 1 --2- 172.21.15.69:0/612462363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbee00accd0 0x7fbee0152b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.896+0000 7fbedf7fe700 1 -- 172.21.15.69:0/612462363 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbed4009420 con 0x7fbee00ac830 2023-10-06T01:39:01.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.896+0000 7fbedf7fe700 1 --2- 172.21.15.69:0/612462363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbee00ac830 0x7fbee0150fd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbed800ed60 tx=0x7fbed800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:01.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.896+0000 7f91f27fc700 1 -- 172.21.15.69:0/1255037442 <== mon.2 v2:172.21.15.88:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f91f8033030 con 0x7f92040c3300 2023-10-06T01:39:01.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.896+0000 7f91f27fc700 1 --2- 172.21.15.69:0/1255037442 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f91e4066f80 0x7f91e4069430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.896+0000 7f9201d9b700 1 --2- 172.21.15.69:0/1255037442 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f91e4066f80 0x7f91e4069430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.896+0000 7f91f27fc700 1 -- 172.21.15.69:0/1255037442 <== mon.2 v2:172.21.15.88:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f91f80971c0 con 0x7f92040c3300 2023-10-06T01:39:01.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.897+0000 7f9201d9b700 1 --2- 172.21.15.69:0/1255037442 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f91e4066f80 0x7f91e4069430 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9204168a00 tx=0x7f91f4007ea0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:01.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.897+0000 7f2217fff700 1 -- 172.21.15.69:0/2638178680 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2210050b90 con 0x7f22200c8bd0 2023-10-06T01:39:01.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.897+0000 7f23de7fc700 1 -- 172.21.15.69:0/985236128 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f23e00147c0 con 0x7f23e8155dd0 2023-10-06T01:39:01.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.898+0000 7f23de7fc700 1 --2- 172.21.15.69:0/985236128 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f23cc067000 0x7f23cc0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.898+0000 7f23ee2fb700 1 --2- 172.21.15.69:0/985236128 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f23cc067000 0x7f23cc0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.898+0000 7f23de7fc700 1 -- 172.21.15.69:0/985236128 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f23e0084ff0 con 0x7f23e8155dd0 2023-10-06T01:39:01.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.898+0000 7f8f3ac46700 1 Processor -- start 2023-10-06T01:39:01.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.898+0000 7f8f3ac46700 1 -- start start 2023-10-06T01:39:01.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.899+0000 7f23ee2fb700 1 --2- 172.21.15.69:0/985236128 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f23cc067000 0x7f23cc0694b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f23e40099b0 tx=0x7f23e4016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:01.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.899+0000 7f8f3ac46700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8f341393f0 0x7f8f340cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.899+0000 7f8f3ac46700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f8f340cbb20 0x7f8f340c3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.899+0000 7f8f3ac46700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f340c3380 con 0x7f8f34138bc0 2023-10-06T01:39:01.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.899+0000 7f8f3ac46700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f340cbf60 con 0x7f8f340cbb20 2023-10-06T01:39:01.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.899+0000 7f8f3ac46700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f3406e010 con 0x7f8f341393f0 2023-10-06T01:39:01.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.899+0000 7f8f389e2700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f8f34138bc0 0x7f8f3406d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37474/0 (socket says 172.21.15.69:37474) 2023-10-06T01:39:01.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.899+0000 7f8f389e2700 1 -- 172.21.15.69:0/529530539 learned_addr learned my addr 172.21.15.69:0/529530539 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:01.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.899+0000 7f8f391e3700 1 --2- 172.21.15.69:0/529530539 >> v2:172.21.15.69:3300/0 conn(0x7f8f340cbb20 0x7f8f340c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.900+0000 7f8f33fff700 1 --2- 172.21.15.69:0/529530539 >> v2:172.21.15.88:3300/0 conn(0x7f8f341393f0 0x7f8f340cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.900+0000 7f8f391e3700 1 -- 172.21.15.69:0/529530539 >> v2:172.21.15.88:3300/0 conn(0x7f8f341393f0 msgr2=0x7f8f340cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:01.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.900+0000 7f8f391e3700 1 --2- 172.21.15.69:0/529530539 >> v2:172.21.15.88:3300/0 conn(0x7f8f341393f0 0x7f8f340cb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.900+0000 7f8f391e3700 1 -- 172.21.15.69:0/529530539 >> v1:172.21.15.69:6789/0 conn(0x7f8f34138bc0 legacy=0x7f8f3406d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:01.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.900+0000 7f8f391e3700 1 -- 172.21.15.69:0/529530539 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f340c2a50 con 0x7f8f340cbb20 2023-10-06T01:39:01.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.900+0000 7f8f391e3700 1 --2- 172.21.15.69:0/529530539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f340cbb20 0x7f8f340c3810 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8f341597d0 tx=0x7f8f2c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aabe9918e384bc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:01.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.901+0000 7f23de7fc700 1 -- 172.21.15.69:0/985236128 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f23e00521a0 con 0x7f23e8155dd0 2023-10-06T01:39:01.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.901+0000 7f91f27fc700 1 -- 172.21.15.69:0/1255037442 <== mon.2 v2:172.21.15.88:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f91f8064230 con 0x7f92040c3300 2023-10-06T01:39:01.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.902+0000 7fd8f57fa700 1 -- 172.21.15.69:0/590175268 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc00c7f0 con 0x7fd900161150 2023-10-06T01:39:01.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.902+0000 7f8f337fe700 1 -- 172.21.15.69:0/529530539 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c00e070 con 0x7f8f340cbb20 2023-10-06T01:39:01.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.903+0000 7f8f337fe700 1 -- 172.21.15.69:0/529530539 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2c00bb60 con 0x7f8f340cbb20 2023-10-06T01:39:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.902+0000 7f9745ffb700 1 -- 172.21.15.69:0/2742849793 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9750051380 con 0x7f97540ac830 2023-10-06T01:39:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.903+0000 7f8f337fe700 1 -- 172.21.15.69:0/529530539 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2c012430 con 0x7f8f340cbb20 2023-10-06T01:39:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.903+0000 7fd8f57fa700 1 -- 172.21.15.69:0/590175268 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8fc00c950 con 0x7fd900161150 2023-10-06T01:39:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.903+0000 7fd8f57fa700 1 -- 172.21.15.69:0/590175268 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc00cd10 con 0x7fd900161150 2023-10-06T01:39:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.903+0000 7fd907651700 1 -- 172.21.15.69:0/590175268 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd900147290 con 0x7fd900161150 2023-10-06T01:39:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.903+0000 7fd907651700 1 -- 172.21.15.69:0/590175268 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd900147850 con 0x7fd900161150 2023-10-06T01:39:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.903+0000 7f8f3ac46700 1 -- 172.21.15.69:0/529530539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f340cbb20 msgr2=0x7f8f340c3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.903+0000 7f8f3ac46700 1 --2- 172.21.15.69:0/529530539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f340cbb20 0x7f8f340c3810 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8f341597d0 tx=0x7f8f2c009780 comp rx=0 tx=0).stop 2023-10-06T01:39:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.904+0000 7fd907651700 1 -- 172.21.15.69:0/590175268 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd90004c3c0 con 0x7fd900161150 2023-10-06T01:39:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.905+0000 7f8f3ac46700 1 -- 172.21.15.69:0/529530539 shutdown_connections 2023-10-06T01:39:01.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.905+0000 7f8f3ac46700 1 --2- 172.21.15.69:0/529530539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f340cbb20 0x7f8f340c3810 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.905+0000 7f8f3ac46700 1 --2- 172.21.15.69:0/529530539 >> v2:172.21.15.88:3300/0 conn(0x7f8f341393f0 0x7f8f340cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.905+0000 7f8f3ac46700 1 -- 172.21.15.69:0/529530539 >> 172.21.15.69:0/529530539 conn(0x7f8f340ccb60 msgr2=0x7f8f340ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:01.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.906+0000 7fbec77fe700 1 -- 172.21.15.69:0/612462363 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed80092e0 con 0x7fbee00ac830 2023-10-06T01:39:01.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.906+0000 7fbec77fe700 1 -- 172.21.15.69:0/612462363 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbed800f040 con 0x7fbee00ac830 2023-10-06T01:39:01.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.906+0000 7fbec77fe700 1 -- 172.21.15.69:0/612462363 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbed800cb50 con 0x7fbee00ac830 2023-10-06T01:39:01.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.908+0000 7fbee5d7e700 1 -- 172.21.15.69:0/612462363 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbee0152330 con 0x7fbee00ac830 2023-10-06T01:39:01.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.908+0000 7fbee5d7e700 1 -- 172.21.15.69:0/612462363 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbee015ac60 con 0x7fbee00ac830 2023-10-06T01:39:01.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.905+0000 7fd8f57fa700 1 -- 172.21.15.69:0/590175268 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd8fc013680 con 0x7fd900161150 2023-10-06T01:39:01.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.906+0000 7fd8f57fa700 1 --2- 172.21.15.69:0/590175268 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd8e4067000 0x7fd8e40694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.906+0000 7fd8f57fa700 1 -- 172.21.15.69:0/590175268 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd8fc085070 con 0x7fd900161150 2023-10-06T01:39:01.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.909+0000 7fd9053ed700 1 --2- 172.21.15.69:0/590175268 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd8e4067000 0x7fd8e40694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.909+0000 7fbee5d7e700 1 -- 172.21.15.69:0/612462363 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbee004c3c0 con 0x7fbee00ac830 2023-10-06T01:39:01.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.909+0000 7fd8f57fa700 1 -- 172.21.15.69:0/590175268 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8fc0522e0 con 0x7fd900161150 2023-10-06T01:39:01.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.910+0000 7fd9053ed700 1 --2- 172.21.15.69:0/590175268 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd8e4067000 0x7fd8e40694b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd8f00099b0 tx=0x7fd8f0016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:01.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.911+0000 7fbec77fe700 1 -- 172.21.15.69:0/612462363 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbed8014480 con 0x7fbee00ac830 2023-10-06T01:39:01.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.912+0000 7fbec77fe700 1 --2- 172.21.15.69:0/612462363 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fbecc067080 0x7fbecc069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.912+0000 7fbec77fe700 1 -- 172.21.15.69:0/612462363 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbed80855f0 con 0x7fbee00ac830 2023-10-06T01:39:01.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.915+0000 7f8f3ac46700 1 -- 172.21.15.69:0/529530539 shutdown_connections 2023-10-06T01:39:01.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.915+0000 7fbec77fe700 1 -- 172.21.15.69:0/612462363 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbed8052760 con 0x7fbee00ac830 2023-10-06T01:39:01.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.921+0000 7f8f3ac46700 1 -- 172.21.15.69:0/529530539 wait complete. 2023-10-06T01:39:01.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.922+0000 7f8f3ac46700 1 Processor -- start 2023-10-06T01:39:01.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.923+0000 7f8f3ac46700 1 -- start start 2023-10-06T01:39:01.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.924+0000 7f8f3ac46700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f340cbb20 0x7f8f34154a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.924+0000 7f8f3ac46700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8f34138bc0 0x7f8f34159f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.924+0000 7f8f3ac46700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f341393f0 0x7f8f34155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.924+0000 7f8f3ac46700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f34154f40 con 0x7f8f341393f0 2023-10-06T01:39:01.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.924+0000 7f8f3ac46700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3412ea80 con 0x7f8f340cbb20 2023-10-06T01:39:01.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.924+0000 7f8f3ac46700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3412e770 con 0x7f8f34138bc0 2023-10-06T01:39:01.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.924+0000 7f8f389e2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f340cbb20 0x7f8f34154a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.924+0000 7f8f389e2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f340cbb20 0x7f8f34154a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.69:42706/0 (socket says 172.21.15.69:42706) 2023-10-06T01:39:01.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.924+0000 7f8f389e2700 1 -- 172.21.15.69:0/692521294 learned_addr learned my addr 172.21.15.69:0/692521294 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:01.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.924+0000 7f8f391e3700 1 --2- 172.21.15.69:0/692521294 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f341393f0 0x7f8f34155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.924+0000 7f8f389e2700 1 -- 172.21.15.69:0/692521294 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8f34138bc0 msgr2=0x7f8f34159f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-06T01:39:01.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.924+0000 7f8f389e2700 1 --2- 172.21.15.69:0/692521294 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8f34138bc0 0x7f8f34159f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.924+0000 7f8f389e2700 1 -- 172.21.15.69:0/692521294 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f341393f0 msgr2=0x7f8f34155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:01.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.924+0000 7f8f389e2700 1 --2- 172.21.15.69:0/692521294 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f341393f0 0x7f8f34155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:01.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.924+0000 7f8f389e2700 1 -- 172.21.15.69:0/692521294 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c009a20 con 0x7f8f340cbb20 2023-10-06T01:39:01.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.925+0000 7f8f389e2700 1 --2- 172.21.15.69:0/692521294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f340cbb20 0x7f8f34154a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8f2800c7f0 tx=0x7f8f28007f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:01.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.926+0000 7fbedeffd700 1 --2- 172.21.15.69:0/612462363 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fbecc067080 0x7fbecc069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.934+0000 7fbedeffd700 1 --2- 172.21.15.69:0/612462363 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fbecc067080 0x7fbecc069530 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbee014d980 tx=0x7fbed0007eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:01.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.934+0000 7f8f30ff9700 1 -- 172.21.15.69:0/692521294 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f28005b30 con 0x7f8f340cbb20 2023-10-06T01:39:01.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.934+0000 7f8f30ff9700 1 -- 172.21.15.69:0/692521294 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f28005cb0 con 0x7f8f340cbb20 2023-10-06T01:39:01.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.934+0000 7f8f30ff9700 1 -- 172.21.15.69:0/692521294 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f28007320 con 0x7f8f340cbb20 2023-10-06T01:39:01.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.934+0000 7f8f3ac46700 1 -- 172.21.15.69:0/692521294 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f34155170 con 0x7f8f340cbb20 2023-10-06T01:39:01.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.935+0000 7f8f3ac46700 1 -- 172.21.15.69:0/692521294 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f34155730 con 0x7f8f340cbb20 2023-10-06T01:39:01.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.936+0000 7f8f3ac46700 1 -- 172.21.15.69:0/692521294 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f3404c3c0 con 0x7f8f340cbb20 2023-10-06T01:39:01.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.938+0000 7f8f30ff9700 1 -- 172.21.15.69:0/692521294 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8f28007690 con 0x7f8f340cbb20 2023-10-06T01:39:01.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.938+0000 7f8f30ff9700 1 --2- 172.21.15.69:0/692521294 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8f18067080 0x7f8f18069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:01.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.939+0000 7f8f30ff9700 1 -- 172.21.15.69:0/692521294 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8f28083af0 con 0x7f8f340cbb20 2023-10-06T01:39:01.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.939+0000 7f8f33fff700 1 --2- 172.21.15.69:0/692521294 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8f18067080 0x7f8f18069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:01.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.939+0000 7f8f33fff700 1 --2- 172.21.15.69:0/692521294 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8f18067080 0x7f8f18069530 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8f341379a0 tx=0x7f8f20008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:01.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:01.943+0000 7f8f30ff9700 1 -- 172.21.15.69:0/692521294 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f28050be0 con 0x7f8f340cbb20 2023-10-06T01:39:02.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.238+0000 7fe253b0c700 1 -- 172.21.15.69:0/1828988516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe22c005560 con 0x7fe24c0cb2d0 2023-10-06T01:39:02.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.239+0000 7fe241ffb700 1 -- 172.21.15.69:0/1828988516 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe23c01a030 con 0x7fe24c0cb2d0 2023-10-06T01:39:02.242 INFO:teuthology.orchestra.run.smithi069.stdout:55834574857 2023-10-06T01:39:02.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.242+0000 7fe253b0c700 1 -- 172.21.15.69:0/1828988516 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe230067080 msgr2=0x7fe230069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:02.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.242+0000 7fe253b0c700 1 --2- 172.21.15.69:0/1828988516 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe230067080 0x7fe230069530 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe248007fd0 tx=0x7fe248007990 comp rx=0 tx=0).stop 2023-10-06T01:39:02.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.242+0000 7fe253b0c700 1 -- 172.21.15.69:0/1828988516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe24c0cb2d0 msgr2=0x7fe24c158d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:02.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.242+0000 7fe253b0c700 1 --2- 172.21.15.69:0/1828988516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe24c0cb2d0 0x7fe24c158d20 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe23c00b7a0 tx=0x7fe23c007160 comp rx=0 tx=0).stop 2023-10-06T01:39:02.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.243+0000 7fe253b0c700 1 -- 172.21.15.69:0/1828988516 shutdown_connections 2023-10-06T01:39:02.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.243+0000 7fe253b0c700 1 --2- 172.21.15.69:0/1828988516 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe230067080 0x7fe230069530 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.243+0000 7fe253b0c700 1 --2- 172.21.15.69:0/1828988516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe24c0cb2d0 0x7fe24c158d20 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.243+0000 7fe253b0c700 1 --2- 172.21.15.69:0/1828988516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe24c0afb30 0x7fe24c0a6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.243+0000 7fe253b0c700 1 --2- 172.21.15.69:0/1828988516 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe24c0b1f90 0x7fe24c15f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.243+0000 7fe253b0c700 1 -- 172.21.15.69:0/1828988516 >> 172.21.15.69:0/1828988516 conn(0x7fe24c0cc300 msgr2=0x7fe24c069c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:02.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.251+0000 7fe253b0c700 1 -- 172.21.15.69:0/1828988516 shutdown_connections 2023-10-06T01:39:02.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.251+0000 7fe253b0c700 1 -- 172.21.15.69:0/1828988516 wait complete. 2023-10-06T01:39:02.272 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2023-10-06T01:39:02.272 DEBUG:teuthology.parallel:result is None 2023-10-06T01:39:02.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.282+0000 7fbee5d7e700 1 -- 172.21.15.69:0/612462363 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fbee00ac030 con 0x7fbee00ac830 2023-10-06T01:39:02.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.282+0000 7f2225f24700 1 -- 172.21.15.69:0/2638178680 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f222006cab0 con 0x7f22200c8bd0 2023-10-06T01:39:02.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.283+0000 7fbec77fe700 1 -- 172.21.15.69:0/612462363 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbed8055d80 con 0x7fbee00ac830 2023-10-06T01:39:02.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.283+0000 7f2217fff700 1 -- 172.21.15.69:0/2638178680 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2210017070 con 0x7f22200c8bd0 2023-10-06T01:39:02.284 INFO:teuthology.orchestra.run.smithi069.stdout:55834574856 2023-10-06T01:39:02.284 INFO:teuthology.orchestra.run.smithi069.stdout:55834574855 2023-10-06T01:39:02.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.285+0000 7f9208fcb700 1 -- 172.21.15.69:0/1255037442 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f920404c3c0 con 0x7f92040c3300 2023-10-06T01:39:02.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.285+0000 7f91f27fc700 1 -- 172.21.15.69:0/1255037442 <== mon.2 v2:172.21.15.88:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f91f8067850 con 0x7f92040c3300 2023-10-06T01:39:02.286 INFO:teuthology.orchestra.run.smithi069.stdout:55834574856 2023-10-06T01:39:02.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.286+0000 7f2225f24700 1 -- 172.21.15.69:0/2638178680 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2200067080 msgr2=0x7f2200069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:02.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.286+0000 7f2225f24700 1 --2- 172.21.15.69:0/2638178680 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2200067080 0x7f2200069530 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f22200b2790 tx=0x7f2208017000 comp rx=0 tx=0).stop 2023-10-06T01:39:02.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.286+0000 7f2225f24700 1 -- 172.21.15.69:0/2638178680 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f22200c8bd0 msgr2=0x7f222014ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:02.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.286+0000 7f2225f24700 1 --2- 172.21.15.69:0/2638178680 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f22200c8bd0 0x7f222014ffb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f221000c510 tx=0x7f221000c820 comp rx=0 tx=0).stop 2023-10-06T01:39:02.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.286+0000 7f2225f24700 1 -- 172.21.15.69:0/2638178680 shutdown_connections 2023-10-06T01:39:02.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.286+0000 7f2225f24700 1 --2- 172.21.15.69:0/2638178680 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2200067080 0x7f2200069530 secure :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f22200b2790 tx=0x7f2208017000 comp rx=0 tx=0).stop 2023-10-06T01:39:02.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.286+0000 7f2225f24700 1 --2- 172.21.15.69:0/2638178680 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2220159c20 0x7f22200a72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.286+0000 7f2225f24700 1 --2- 172.21.15.69:0/2638178680 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f22200c8bd0 0x7f222014ffb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.286+0000 7f2225f24700 1 --2- 172.21.15.69:0/2638178680 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2220157550 0x7f22201596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.286+0000 7f2225f24700 1 -- 172.21.15.69:0/2638178680 >> 172.21.15.69:0/2638178680 conn(0x7f222006f190 msgr2=0x7f22200b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:02.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.287+0000 7f2225f24700 1 -- 172.21.15.69:0/2638178680 shutdown_connections 2023-10-06T01:39:02.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.286+0000 7fbee5d7e700 1 -- 172.21.15.69:0/612462363 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fbecc067080 msgr2=0x7fbecc069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:02.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.286+0000 7fbee5d7e700 1 --2- 172.21.15.69:0/612462363 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fbecc067080 0x7fbecc069530 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fbee014d980 tx=0x7fbed0007eb0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.286+0000 7fbee5d7e700 1 -- 172.21.15.69:0/612462363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbee00ac830 msgr2=0x7fbee0150fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:02.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.286+0000 7fbee5d7e700 1 --2- 172.21.15.69:0/612462363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbee00ac830 0x7fbee0150fd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbed800ed60 tx=0x7fbed800b040 comp rx=0 tx=0).stop 2023-10-06T01:39:02.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.286+0000 7fbee5d7e700 1 -- 172.21.15.69:0/612462363 shutdown_connections 2023-10-06T01:39:02.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.286+0000 7fbee5d7e700 1 --2- 172.21.15.69:0/612462363 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fbecc067080 0x7fbecc069530 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.286+0000 7fbee5d7e700 1 --2- 172.21.15.69:0/612462363 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbee00cb8e0 0x7fbee0153070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.286+0000 7fbee5d7e700 1 --2- 172.21.15.69:0/612462363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbee00ac830 0x7fbee0150fd0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.286+0000 7fbee5d7e700 1 --2- 172.21.15.69:0/612462363 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbee00accd0 0x7fbee0152b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.287+0000 7fbee5d7e700 1 -- 172.21.15.69:0/612462363 >> 172.21.15.69:0/612462363 conn(0x7fbee00cc300 msgr2=0x7fbee00ad6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:02.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.287+0000 7fbee5d7e700 1 -- 172.21.15.69:0/612462363 shutdown_connections 2023-10-06T01:39:02.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.287+0000 7fbee5d7e700 1 -- 172.21.15.69:0/612462363 wait complete. 2023-10-06T01:39:02.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.288+0000 7f2225f24700 1 -- 172.21.15.69:0/2638178680 wait complete. 2023-10-06T01:39:02.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.288+0000 7f975c25b700 1 -- 172.21.15.69:0/2742849793 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f97540ac030 con 0x7f97540ac830 2023-10-06T01:39:02.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.288+0000 7f9208fcb700 1 -- 172.21.15.69:0/1255037442 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f91e4066f80 msgr2=0x7f91e4069430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:02.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.288+0000 7f9208fcb700 1 --2- 172.21.15.69:0/1255037442 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f91e4066f80 0x7f91e4069430 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9204168a00 tx=0x7f91f4007ea0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.288+0000 7f9208fcb700 1 -- 172.21.15.69:0/1255037442 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92040c3300 msgr2=0x7f920413dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:02.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.288+0000 7f9208fcb700 1 --2- 172.21.15.69:0/1255037442 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92040c3300 0x7f920413dd40 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f91f8009290 tx=0x7f91f8027000 comp rx=0 tx=0).stop 2023-10-06T01:39:02.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.289+0000 7f9745ffb700 1 -- 172.21.15.69:0/2742849793 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f97500549a0 con 0x7f97540ac830 2023-10-06T01:39:02.291 INFO:teuthology.orchestra.run.smithi069.stdout:55834574855 2023-10-06T01:39:02.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.289+0000 7f9208fcb700 1 -- 172.21.15.69:0/1255037442 shutdown_connections 2023-10-06T01:39:02.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.289+0000 7f9208fcb700 1 --2- 172.21.15.69:0/1255037442 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f91e4066f80 0x7f91e4069430 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.289+0000 7f9208fcb700 1 --2- 172.21.15.69:0/1255037442 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9204152b60 0x7f92040c5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.289+0000 7f9208fcb700 1 --2- 172.21.15.69:0/1255037442 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92040c3300 0x7f920413dd40 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.289+0000 7f9208fcb700 1 --2- 172.21.15.69:0/1255037442 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f920415da70 0x7f9204152620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.289+0000 7f9208fcb700 1 -- 172.21.15.69:0/1255037442 >> 172.21.15.69:0/1255037442 conn(0x7f92040ccb60 msgr2=0x7f9204153500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:02.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.289+0000 7f9208fcb700 1 -- 172.21.15.69:0/1255037442 shutdown_connections 2023-10-06T01:39:02.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.289+0000 7f9208fcb700 1 -- 172.21.15.69:0/1255037442 wait complete. 2023-10-06T01:39:02.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.291+0000 7f23f055f700 1 -- 172.21.15.69:0/985236128 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f23d0005830 con 0x7f23e8155dd0 2023-10-06T01:39:02.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.292+0000 7f975c25b700 1 -- 172.21.15.69:0/2742849793 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9738066f30 msgr2=0x7f97380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:02.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.292+0000 7f975c25b700 1 --2- 172.21.15.69:0/2742849793 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9738066f30 0x7f97380693e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9748006fd0 tx=0x7f9748006d30 comp rx=0 tx=0).stop 2023-10-06T01:39:02.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.292+0000 7f975c25b700 1 -- 172.21.15.69:0/2742849793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97540ac830 msgr2=0x7f97541456b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:02.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.292+0000 7f975c25b700 1 --2- 172.21.15.69:0/2742849793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97540ac830 0x7f97541456b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f975000b590 tx=0x7f9750006f90 comp rx=0 tx=0).stop 2023-10-06T01:39:02.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.298+0000 7f975c25b700 1 -- 172.21.15.69:0/2742849793 shutdown_connections 2023-10-06T01:39:02.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.298+0000 7f975c25b700 1 --2- 172.21.15.69:0/2742849793 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9738066f30 0x7f97380693e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.298+0000 7f975c25b700 1 --2- 172.21.15.69:0/2742849793 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f97540cb8e0 0x7f975414fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.298+0000 7f975c25b700 1 --2- 172.21.15.69:0/2742849793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97540ac830 0x7f97541456b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.298+0000 7f975c25b700 1 --2- 172.21.15.69:0/2742849793 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f97540acca0 0x7f9754152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.298+0000 7f975c25b700 1 -- 172.21.15.69:0/2742849793 >> 172.21.15.69:0/2742849793 conn(0x7f97540cc300 msgr2=0x7f975414a490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:02.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.298+0000 7f975c25b700 1 -- 172.21.15.69:0/2742849793 shutdown_connections 2023-10-06T01:39:02.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.298+0000 7f975c25b700 1 -- 172.21.15.69:0/2742849793 wait complete. 2023-10-06T01:39:02.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.298+0000 7f23de7fc700 1 -- 172.21.15.69:0/985236128 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f23e00557c0 con 0x7f23e8155dd0 2023-10-06T01:39:02.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.299+0000 7fd907651700 1 -- 172.21.15.69:0/590175268 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fd900147d00 con 0x7fd900161150 2023-10-06T01:39:02.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.300+0000 7fd8f57fa700 1 -- 172.21.15.69:0/590175268 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd8fc055900 con 0x7fd900161150 2023-10-06T01:39:02.303 INFO:teuthology.orchestra.run.smithi069.stdout:55834574856 2023-10-06T01:39:02.303 INFO:teuthology.orchestra.run.smithi069.stdout:55834574857 2023-10-06T01:39:02.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.304+0000 7fd907651700 1 -- 172.21.15.69:0/590175268 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd8e4067000 msgr2=0x7fd8e40694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:02.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.304+0000 7fd907651700 1 --2- 172.21.15.69:0/590175268 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd8e4067000 0x7fd8e40694b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd8f00099b0 tx=0x7fd8f0016000 comp rx=0 tx=0).stop 2023-10-06T01:39:02.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.304+0000 7fd907651700 1 -- 172.21.15.69:0/590175268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd900161150 msgr2=0x7fd900163910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:02.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.304+0000 7fd907651700 1 --2- 172.21.15.69:0/590175268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd900161150 0x7fd900163910 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc00ea20 tx=0x7fd8fc0091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.304+0000 7f23f055f700 1 -- 172.21.15.69:0/985236128 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f23cc067000 msgr2=0x7f23cc0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:02.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.304+0000 7f23f055f700 1 --2- 172.21.15.69:0/985236128 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f23cc067000 0x7f23cc0694b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f23e40099b0 tx=0x7f23e4016000 comp rx=0 tx=0).stop 2023-10-06T01:39:02.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.304+0000 7f23f055f700 1 -- 172.21.15.69:0/985236128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23e8155dd0 msgr2=0x7f23e80b02e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:02.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.304+0000 7f23f055f700 1 --2- 172.21.15.69:0/985236128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23e8155dd0 0x7f23e80b02e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f23e000bb80 tx=0x7f23e0009810 comp rx=0 tx=0).stop 2023-10-06T01:39:02.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.304+0000 7fd907651700 1 -- 172.21.15.69:0/590175268 shutdown_connections 2023-10-06T01:39:02.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.304+0000 7fd907651700 1 --2- 172.21.15.69:0/590175268 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd8e4067000 0x7fd8e40694b0 secure :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fd8f00099b0 tx=0x7fd8f0016000 comp rx=0 tx=0).stop 2023-10-06T01:39:02.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.304+0000 7fd907651700 1 --2- 172.21.15.69:0/590175268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd900161150 0x7fd900163910 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.304+0000 7fd907651700 1 --2- 172.21.15.69:0/590175268 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9000b0080 0x7fd900149a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.304+0000 7fd907651700 1 --2- 172.21.15.69:0/590175268 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9000b1dc0 0x7fd90015ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.304+0000 7fd907651700 1 -- 172.21.15.69:0/590175268 >> 172.21.15.69:0/590175268 conn(0x7fd9000cc300 msgr2=0x7fd900159c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:02.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.305+0000 7f23f055f700 1 -- 172.21.15.69:0/985236128 shutdown_connections 2023-10-06T01:39:02.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.305+0000 7f23f055f700 1 --2- 172.21.15.69:0/985236128 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f23cc067000 0x7f23cc0694b0 secure :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f23e40099b0 tx=0x7f23e4016000 comp rx=0 tx=0).stop 2023-10-06T01:39:02.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.305+0000 7f23f055f700 1 --2- 172.21.15.69:0/985236128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f23e8155dd0 0x7f23e80b02e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.305+0000 7f23f055f700 1 --2- 172.21.15.69:0/985236128 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f23e8064550 0x7f23e80b1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.305+0000 7f23f055f700 1 --2- 172.21.15.69:0/985236128 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f23e8067ec0 0x7f23e814d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.310 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.305+0000 7f23f055f700 1 -- 172.21.15.69:0/985236128 >> 172.21.15.69:0/985236128 conn(0x7f23e80cc720 msgr2=0x7f23e80638f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:02.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.306+0000 7fd907651700 1 -- 172.21.15.69:0/590175268 shutdown_connections 2023-10-06T01:39:02.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.309+0000 7f23f055f700 1 -- 172.21.15.69:0/985236128 shutdown_connections 2023-10-06T01:39:02.311 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.309+0000 7f23f055f700 1 -- 172.21.15.69:0/985236128 wait complete. 2023-10-06T01:39:02.312 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.309+0000 7fd907651700 1 -- 172.21.15.69:0/590175268 wait complete. 2023-10-06T01:39:02.313 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2023-10-06T01:39:02.313 DEBUG:teuthology.parallel:result is None 2023-10-06T01:39:02.314 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-10-06T01:39:02.314 DEBUG:teuthology.parallel:result is None 2023-10-06T01:39:02.315 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.7 2023-10-06T01:39:02.315 DEBUG:teuthology.parallel:result is None 2023-10-06T01:39:02.316 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2023-10-06T01:39:02.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.316+0000 7f8f3ac46700 1 -- 172.21.15.69:0/692521294 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8f340c2d30 con 0x7f8f340cbb20 2023-10-06T01:39:02.316 DEBUG:teuthology.parallel:result is None 2023-10-06T01:39:02.317 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.316+0000 7f8f30ff9700 1 -- 172.21.15.69:0/692521294 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8f28017090 con 0x7f8f340cbb20 2023-10-06T01:39:02.317 INFO:teuthology.orchestra.run.smithi069.stdout:55834574857 2023-10-06T01:39:02.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.320+0000 7f8f3ac46700 1 -- 172.21.15.69:0/692521294 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8f18067080 msgr2=0x7f8f18069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:02.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.320+0000 7f8f3ac46700 1 --2- 172.21.15.69:0/692521294 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8f18067080 0x7f8f18069530 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8f341379a0 tx=0x7f8f20008040 comp rx=0 tx=0).stop 2023-10-06T01:39:02.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.320+0000 7f8f3ac46700 1 -- 172.21.15.69:0/692521294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f340cbb20 msgr2=0x7f8f34154a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:02.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.320+0000 7f8f3ac46700 1 --2- 172.21.15.69:0/692521294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f340cbb20 0x7f8f34154a00 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8f2800c7f0 tx=0x7f8f28007f30 comp rx=0 tx=0).stop 2023-10-06T01:39:02.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.320+0000 7f8f3ac46700 1 -- 172.21.15.69:0/692521294 shutdown_connections 2023-10-06T01:39:02.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.320+0000 7f8f3ac46700 1 --2- 172.21.15.69:0/692521294 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8f18067080 0x7f8f18069530 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.320+0000 7f8f3ac46700 1 --2- 172.21.15.69:0/692521294 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f341393f0 0x7f8f34155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.320+0000 7f8f3ac46700 1 --2- 172.21.15.69:0/692521294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f340cbb20 0x7f8f34154a00 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.320+0000 7f8f3ac46700 1 --2- 172.21.15.69:0/692521294 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8f34138bc0 0x7f8f34159f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.320+0000 7f8f3ac46700 1 -- 172.21.15.69:0/692521294 >> 172.21.15.69:0/692521294 conn(0x7f8f340ccb60 msgr2=0x7f8f34135cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:02.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.320+0000 7f8f3ac46700 1 -- 172.21.15.69:0/692521294 shutdown_connections 2023-10-06T01:39:02.323 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.320+0000 7f8f3ac46700 1 -- 172.21.15.69:0/692521294 wait complete. 2023-10-06T01:39:02.325 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2023-10-06T01:39:02.325 DEBUG:teuthology.parallel:result is None 2023-10-06T01:39:02.330 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.3 2023-10-06T01:39:02.330 DEBUG:teuthology.parallel:result is None 2023-10-06T01:39:02.336 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2023-10-06T01:39:02.336 DEBUG:teuthology.parallel:result is None 2023-10-06T01:39:02.336 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T01:39:02.337 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:39:02.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.491+0000 7f8caa579700 1 Processor -- start 2023-10-06T01:39:02.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.491+0000 7f8caa579700 1 -- start start 2023-10-06T01:39:02.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.492+0000 7f8caa579700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f8ca40cb970 0x7f8ca4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:02.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.492+0000 7f8caa579700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ca415a400 0x7f8ca4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:02.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.492+0000 7f8caa579700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ca415ae40 con 0x7f8ca40cb5a0 2023-10-06T01:39:02.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.492+0000 7f8caa579700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ca40ce0f0 con 0x7f8ca40cb970 2023-10-06T01:39:02.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.492+0000 7f8caa579700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca40d13f0 con 0x7f8ca415a400 2023-10-06T01:39:02.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.492+0000 7f8ca37fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f8ca40cb970 0x7f8ca4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:02.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.492+0000 7f8ca3fff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f8ca40cb5a0 0x7f8ca40cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37490/0 (socket says 172.21.15.69:37490) 2023-10-06T01:39:02.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.492+0000 7f8ca3fff700 1 -- 172.21.15.69:0/3051754510 learned_addr learned my addr 172.21.15.69:0/3051754510 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:02.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.492+0000 7f8ca37fe700 1 -- 172.21.15.69:0/3051754510 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ca415a400 msgr2=0x7f8ca4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:02.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.492+0000 7f8ca37fe700 1 --2- 172.21.15.69:0/3051754510 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ca415a400 0x7f8ca4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.492+0000 7f8ca37fe700 1 -- 172.21.15.69:0/3051754510 >> v1:172.21.15.69:6789/0 conn(0x7f8ca40cb5a0 legacy=0x7f8ca40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:02.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.493+0000 7f8ca37fe700 1 -- 172.21.15.69:0/3051754510 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca415ab60 con 0x7f8ca40cb970 2023-10-06T01:39:02.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.492+0000 7f8ca2ffd700 1 -- 172.21.15.69:0/3051754510 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3332405588 0 0) 0x7f8ca415ae40 con 0x7f8ca40cb5a0 2023-10-06T01:39:02.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.493+0000 7f8ca37fe700 1 --2- 172.21.15.69:0/3051754510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ca40cb970 0x7f8ca4159ec0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8c980098e0 tx=0x7f8c980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c2654aae068ab04 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:02.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.493+0000 7f8ca2ffd700 1 -- 172.21.15.69:0/3051754510 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c98009e80 con 0x7f8ca40cb970 2023-10-06T01:39:02.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.493+0000 7f8ca2ffd700 1 -- 172.21.15.69:0/3051754510 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9800b860 con 0x7f8ca40cb970 2023-10-06T01:39:02.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.493+0000 7f8ca2ffd700 1 -- 172.21.15.69:0/3051754510 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9800bbe0 con 0x7f8ca40cb970 2023-10-06T01:39:02.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.493+0000 7f8caa579700 1 -- 172.21.15.69:0/3051754510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ca40cb970 msgr2=0x7f8ca4159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:02.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.493+0000 7f8caa579700 1 --2- 172.21.15.69:0/3051754510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ca40cb970 0x7f8ca4159ec0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8c980098e0 tx=0x7f8c980091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.493+0000 7f8caa579700 1 -- 172.21.15.69:0/3051754510 shutdown_connections 2023-10-06T01:39:02.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.493+0000 7f8caa579700 1 --2- 172.21.15.69:0/3051754510 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ca415a400 0x7f8ca4156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.493+0000 7f8caa579700 1 --2- 172.21.15.69:0/3051754510 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ca40cb970 0x7f8ca4159ec0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.493+0000 7f8caa579700 1 -- 172.21.15.69:0/3051754510 >> 172.21.15.69:0/3051754510 conn(0x7f8ca4070e30 msgr2=0x7f8ca40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:02.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.493+0000 7f8caa579700 1 -- 172.21.15.69:0/3051754510 shutdown_connections 2023-10-06T01:39:02.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.493+0000 7f8caa579700 1 -- 172.21.15.69:0/3051754510 wait complete. 2023-10-06T01:39:02.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.494+0000 7f8caa579700 1 Processor -- start 2023-10-06T01:39:02.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.495+0000 7f8caa579700 1 -- start start 2023-10-06T01:39:02.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.495+0000 7f8caa579700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ca40cb5a0 0x7f8ca40c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:02.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.495+0000 7f8caa579700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ca40cb970 0x7f8ca40b3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:02.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.495+0000 7f8caa579700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ca415a400 0x7f8ca40c93b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:02.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.495+0000 7f8caa579700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca40b34b0 con 0x7f8ca40cb5a0 2023-10-06T01:39:02.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.495+0000 7f8caa579700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca40b3a70 con 0x7f8ca415a400 2023-10-06T01:39:02.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.495+0000 7f8caa579700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ca41516c0 con 0x7f8ca40cb970 2023-10-06T01:39:02.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.495+0000 7f8ca3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ca40cb5a0 0x7f8ca40c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:02.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.495+0000 7f8ca3fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ca40cb5a0 0x7f8ca40c69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57134/0 (socket says 172.21.15.69:57134) 2023-10-06T01:39:02.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.495+0000 7f8ca3fff700 1 -- 172.21.15.69:0/1120728313 learned_addr learned my addr 172.21.15.69:0/1120728313 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:02.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.496+0000 7f8ca37fe700 1 --2- 172.21.15.69:0/1120728313 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ca40cb970 0x7f8ca40b3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:02.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.496+0000 7f8ca3fff700 1 -- 172.21.15.69:0/1120728313 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ca40cb970 msgr2=0x7f8ca40b3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:02.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.496+0000 7f8ca3fff700 1 --2- 172.21.15.69:0/1120728313 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ca40cb970 0x7f8ca40b3f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.496+0000 7f8ca3fff700 1 -- 172.21.15.69:0/1120728313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ca415a400 msgr2=0x7f8ca40c93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:02.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.496+0000 7f8ca3fff700 1 --2- 172.21.15.69:0/1120728313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ca415a400 0x7f8ca40c93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.496+0000 7f8ca3fff700 1 -- 172.21.15.69:0/1120728313 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c98009420 con 0x7f8ca40cb5a0 2023-10-06T01:39:02.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.496+0000 7f8ca3fff700 1 --2- 172.21.15.69:0/1120728313 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ca40cb5a0 0x7f8ca40c69f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400c7e0 tx=0x7f8c94007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:02.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.496+0000 7f8c8bfff700 1 -- 172.21.15.69:0/1120728313 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c94005b30 con 0x7f8ca40cb5a0 2023-10-06T01:39:02.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.496+0000 7f8c8bfff700 1 -- 172.21.15.69:0/1120728313 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c94005c90 con 0x7f8ca40cb5a0 2023-10-06T01:39:02.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.496+0000 7f8caa579700 1 -- 172.21.15.69:0/1120728313 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca40c83d0 con 0x7f8ca40cb5a0 2023-10-06T01:39:02.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.496+0000 7f8c8bfff700 1 -- 172.21.15.69:0/1120728313 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c94007300 con 0x7f8ca40cb5a0 2023-10-06T01:39:02.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.496+0000 7f8caa579700 1 -- 172.21.15.69:0/1120728313 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ca40b3700 con 0x7f8ca40cb5a0 2023-10-06T01:39:02.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.497+0000 7f8caa579700 1 -- 172.21.15.69:0/1120728313 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ca40b3d50 con 0x7f8ca40cb5a0 2023-10-06T01:39:02.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.497+0000 7f8c8bfff700 1 -- 172.21.15.69:0/1120728313 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8c9401b400 con 0x7f8ca40cb5a0 2023-10-06T01:39:02.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.498+0000 7f8c8bfff700 1 --2- 172.21.15.69:0/1120728313 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8c90066f30 0x7f8c900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:02.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.498+0000 7f8ca37fe700 1 --2- 172.21.15.69:0/1120728313 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8c90066f30 0x7f8c900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:02.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.498+0000 7f8c8bfff700 1 -- 172.21.15.69:0/1120728313 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8c940841a0 con 0x7f8ca40cb5a0 2023-10-06T01:39:02.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.498+0000 7f8ca37fe700 1 --2- 172.21.15.69:0/1120728313 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8c90066f30 0x7f8c900693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40c91d0 tx=0x7f8c98017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:02.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.502+0000 7f8c8bfff700 1 -- 172.21.15.69:0/1120728313 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c94051330 con 0x7f8ca40cb5a0 2023-10-06T01:39:02.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.679+0000 7f8caa579700 1 -- 172.21.15.69:0/1120728313 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8ca404c3c0 con 0x7f8c90066f30 2023-10-06T01:39:02.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.687+0000 7f8c8bfff700 1 -- 172.21.15.69:0/1120728313 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286641 (secure 0 0 0) 0x7f8ca404c3c0 con 0x7f8c90066f30 2023-10-06T01:39:02.692 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:02.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.690+0000 7f8caa579700 1 -- 172.21.15.69:0/1120728313 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8c90066f30 msgr2=0x7f8c900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:02.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.690+0000 7f8caa579700 1 --2- 172.21.15.69:0/1120728313 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8c90066f30 0x7f8c900693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40c91d0 tx=0x7f8c98017000 comp rx=0 tx=0).stop 2023-10-06T01:39:02.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.690+0000 7f8caa579700 1 -- 172.21.15.69:0/1120728313 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ca40cb5a0 msgr2=0x7f8ca40c69f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:02.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.690+0000 7f8caa579700 1 --2- 172.21.15.69:0/1120728313 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ca40cb5a0 0x7f8ca40c69f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400c7e0 tx=0x7f8c94007df0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.690+0000 7f8caa579700 1 -- 172.21.15.69:0/1120728313 shutdown_connections 2023-10-06T01:39:02.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.690+0000 7f8caa579700 1 --2- 172.21.15.69:0/1120728313 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8c90066f30 0x7f8c900693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.690+0000 7f8caa579700 1 --2- 172.21.15.69:0/1120728313 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8ca415a400 0x7f8ca40c93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.690+0000 7f8caa579700 1 --2- 172.21.15.69:0/1120728313 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8ca40cb5a0 0x7f8ca40c69f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.690+0000 7f8caa579700 1 --2- 172.21.15.69:0/1120728313 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8ca40cb970 0x7f8ca40b3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.690+0000 7f8caa579700 1 -- 172.21.15.69:0/1120728313 >> 172.21.15.69:0/1120728313 conn(0x7f8ca4070e30 msgr2=0x7f8ca4154910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:02.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.691+0000 7f8caa579700 1 -- 172.21.15.69:0/1120728313 shutdown_connections 2023-10-06T01:39:02.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.691+0000 7f8caa579700 1 -- 172.21.15.69:0/1120728313 wait complete. 2023-10-06T01:39:02.696 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-10-06T01:39:02.703 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2023-10-06T01:39:02.263462+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381512,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593208,"statfs":{"total":773094113280,"available":770655444992,"internally_reserved":0,"allocated":3284992,"data_stored":1937172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.754862"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524056+0000","last_change":"2023-10-06T01:38:49.517903+0000","last_active":"2023-10-06T01:38:49.524056+0000","last_peered":"2023-10-06T01:38:49.524056+0000","last_clean":"2023-10-06T01:38:49.524056+0000","last_became_active":"2023-10-06T01:38:49.517634+0000","last_became_peered":"2023-10-06T01:38:49.517634+0000","last_unstale":"2023-10-06T01:38:49.524056+0000","last_undegraded":"2023-10-06T01:38:49.524056+0000","last_fullsized":"2023-10-06T01:38:49.524056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:04.939212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527124+0000","last_change":"2023-10-06T01:38:49.523256+0000","last_active":"2023-10-06T01:38:49.527124+0000","last_peered":"2023-10-06T01:38:49.527124+0000","last_clean":"2023-10-06T01:38:49.527124+0000","last_became_active":"2023-10-06T01:38:49.522954+0000","last_became_peered":"2023-10-06T01:38:49.522954+0000","last_unstale":"2023-10-06T01:38:49.527124+0000","last_undegraded":"2023-10-06T01:38:49.527124+0000","last_fullsized":"2023-10-06T01:38:49.527124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532807+0000","last_change":"2023-10-06T01:38:49.528144+0000","last_active":"2023-10-06T01:38:49.532807+0000","last_peered":"2023-10-06T01:38:49.532807+0000","last_clean":"2023-10-06T01:38:49.532807+0000","last_became_active":"2023-10-06T01:38:49.527476+0000","last_became_peered":"2023-10-06T01:38:49.527476+0000","last_unstale":"2023-10-06T01:38:49.532807+0000","last_undegraded":"2023-10-06T01:38:49.532807+0000","last_fullsized":"2023-10-06T01:38:49.532807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:49.294618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.528235+0000","last_change":"2023-10-06T01:38:49.526214+0000","last_active":"2023-10-06T01:38:49.528235+0000","last_peered":"2023-10-06T01:38:49.528235+0000","last_clean":"2023-10-06T01:38:49.528235+0000","last_became_active":"2023-10-06T01:38:49.525926+0000","last_became_peered":"2023-10-06T01:38:49.525926+0000","last_unstale":"2023-10-06T01:38:49.528235+0000","last_undegraded":"2023-10-06T01:38:49.528235+0000","last_fullsized":"2023-10-06T01:38:49.528235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:57:08.899972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524841+0000","last_change":"2023-10-06T01:38:49.522000+0000","last_active":"2023-10-06T01:38:49.524841+0000","last_peered":"2023-10-06T01:38:49.524841+0000","last_clean":"2023-10-06T01:38:49.524841+0000","last_became_active":"2023-10-06T01:38:49.521580+0000","last_became_peered":"2023-10-06T01:38:49.521580+0000","last_unstale":"2023-10-06T01:38:49.524841+0000","last_undegraded":"2023-10-06T01:38:49.524841+0000","last_fullsized":"2023-10-06T01:38:49.524841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:21.430025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532735+0000","last_change":"2023-10-06T01:38:49.527658+0000","last_active":"2023-10-06T01:38:49.532735+0000","last_peered":"2023-10-06T01:38:49.532735+0000","last_clean":"2023-10-06T01:38:49.532735+0000","last_became_active":"2023-10-06T01:38:49.527109+0000","last_became_peered":"2023-10-06T01:38:49.527109+0000","last_unstale":"2023-10-06T01:38:49.532735+0000","last_undegraded":"2023-10-06T01:38:49.532735+0000","last_fullsized":"2023-10-06T01:38:49.532735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:41.094305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.529246+0000","last_change":"2023-10-06T01:38:49.526274+0000","last_active":"2023-10-06T01:38:49.529246+0000","last_peered":"2023-10-06T01:38:49.529246+0000","last_clean":"2023-10-06T01:38:49.529246+0000","last_became_active":"2023-10-06T01:38:49.526058+0000","last_became_peered":"2023-10-06T01:38:49.526058+0000","last_unstale":"2023-10-06T01:38:49.529246+0000","last_undegraded":"2023-10-06T01:38:49.529246+0000","last_fullsized":"2023-10-06T01:38:49.529246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.529633+0000","last_change":"2023-10-06T01:38:49.527609+0000","last_active":"2023-10-06T01:38:49.529633+0000","last_peered":"2023-10-06T01:38:49.529633+0000","last_clean":"2023-10-06T01:38:49.529633+0000","last_became_active":"2023-10-06T01:38:49.527309+0000","last_became_peered":"2023-10-06T01:38:49.527309+0000","last_unstale":"2023-10-06T01:38:49.529633+0000","last_undegraded":"2023-10-06T01:38:49.529633+0000","last_fullsized":"2023-10-06T01:38:49.529633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:04.188051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524708+0000","last_change":"2023-10-06T01:38:49.519471+0000","last_active":"2023-10-06T01:38:49.524708+0000","last_peered":"2023-10-06T01:38:49.524708+0000","last_clean":"2023-10-06T01:38:49.524708+0000","last_became_active":"2023-10-06T01:38:49.519232+0000","last_became_peered":"2023-10-06T01:38:49.519232+0000","last_unstale":"2023-10-06T01:38:49.524708+0000","last_undegraded":"2023-10-06T01:38:49.524708+0000","last_fullsized":"2023-10-06T01:38:49.524708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:11.839303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527105+0000","last_change":"2023-10-06T01:38:49.519625+0000","last_active":"2023-10-06T01:38:49.527105+0000","last_peered":"2023-10-06T01:38:49.527105+0000","last_clean":"2023-10-06T01:38:49.527105+0000","last_became_active":"2023-10-06T01:38:49.519350+0000","last_became_peered":"2023-10-06T01:38:49.519350+0000","last_unstale":"2023-10-06T01:38:49.527105+0000","last_undegraded":"2023-10-06T01:38:49.527105+0000","last_fullsized":"2023-10-06T01:38:49.527105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:21.430025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532757+0000","last_change":"2023-10-06T01:38:49.527759+0000","last_active":"2023-10-06T01:38:49.532757+0000","last_peered":"2023-10-06T01:38:49.532757+0000","last_clean":"2023-10-06T01:38:49.532757+0000","last_became_active":"2023-10-06T01:38:49.527046+0000","last_became_peered":"2023-10-06T01:38:49.527046+0000","last_unstale":"2023-10-06T01:38:49.532757+0000","last_undegraded":"2023-10-06T01:38:49.532757+0000","last_fullsized":"2023-10-06T01:38:49.532757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:04.140534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531758+0000","last_change":"2023-10-06T01:38:49.527553+0000","last_active":"2023-10-06T01:38:49.531758+0000","last_peered":"2023-10-06T01:38:49.531758+0000","last_clean":"2023-10-06T01:38:49.531758+0000","last_became_active":"2023-10-06T01:38:49.527370+0000","last_became_peered":"2023-10-06T01:38:49.527370+0000","last_unstale":"2023-10-06T01:38:49.531758+0000","last_undegraded":"2023-10-06T01:38:49.531758+0000","last_fullsized":"2023-10-06T01:38:49.531758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:55.861597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.523956+0000","last_change":"2023-10-06T01:38:49.517619+0000","last_active":"2023-10-06T01:38:49.523956+0000","last_peered":"2023-10-06T01:38:49.523956+0000","last_clean":"2023-10-06T01:38:49.523956+0000","last_became_active":"2023-10-06T01:38:49.517323+0000","last_became_peered":"2023-10-06T01:38:49.517323+0000","last_unstale":"2023-10-06T01:38:49.523956+0000","last_undegraded":"2023-10-06T01:38:49.523956+0000","last_fullsized":"2023-10-06T01:38:49.523956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:35.290053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.523783+0000","last_change":"2023-10-06T01:38:49.518132+0000","last_active":"2023-10-06T01:38:49.523783+0000","last_peered":"2023-10-06T01:38:49.523783+0000","last_clean":"2023-10-06T01:38:49.523783+0000","last_became_active":"2023-10-06T01:38:49.517901+0000","last_became_peered":"2023-10-06T01:38:49.517901+0000","last_unstale":"2023-10-06T01:38:49.523783+0000","last_undegraded":"2023-10-06T01:38:49.523783+0000","last_fullsized":"2023-10-06T01:38:49.523783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:57.306692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.529431+0000","last_change":"2023-10-06T01:38:49.526480+0000","last_active":"2023-10-06T01:38:49.529431+0000","last_peered":"2023-10-06T01:38:49.529431+0000","last_clean":"2023-10-06T01:38:49.529431+0000","last_became_active":"2023-10-06T01:38:49.526183+0000","last_became_peered":"2023-10-06T01:38:49.526183+0000","last_unstale":"2023-10-06T01:38:49.529431+0000","last_undegraded":"2023-10-06T01:38:49.529431+0000","last_fullsized":"2023-10-06T01:38:49.529431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:57.306692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.528330+0000","last_change":"2023-10-06T01:38:49.525375+0000","last_active":"2023-10-06T01:38:49.528330+0000","last_peered":"2023-10-06T01:38:49.528330+0000","last_clean":"2023-10-06T01:38:49.528330+0000","last_became_active":"2023-10-06T01:38:49.525091+0000","last_became_peered":"2023-10-06T01:38:49.525091+0000","last_unstale":"2023-10-06T01:38:49.528330+0000","last_undegraded":"2023-10-06T01:38:49.528330+0000","last_fullsized":"2023-10-06T01:38:49.528330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:44.668443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524727+0000","last_change":"2023-10-06T01:38:49.520872+0000","last_active":"2023-10-06T01:38:49.524727+0000","last_peered":"2023-10-06T01:38:49.524727+0000","last_clean":"2023-10-06T01:38:49.524727+0000","last_became_active":"2023-10-06T01:38:49.520588+0000","last_became_peered":"2023-10-06T01:38:49.520588+0000","last_unstale":"2023-10-06T01:38:49.524727+0000","last_undegraded":"2023-10-06T01:38:49.524727+0000","last_fullsized":"2023-10-06T01:38:49.524727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:57.494182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532943+0000","last_change":"2023-10-06T01:38:49.528700+0000","last_active":"2023-10-06T01:38:49.532943+0000","last_peered":"2023-10-06T01:38:49.532943+0000","last_clean":"2023-10-06T01:38:49.532943+0000","last_became_active":"2023-10-06T01:38:49.527947+0000","last_became_peered":"2023-10-06T01:38:49.527947+0000","last_unstale":"2023-10-06T01:38:49.532943+0000","last_undegraded":"2023-10-06T01:38:49.532943+0000","last_fullsized":"2023-10-06T01:38:49.532943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:22.289895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.528863+0000","last_change":"2023-10-06T01:38:49.524738+0000","last_active":"2023-10-06T01:38:49.528863+0000","last_peered":"2023-10-06T01:38:49.528863+0000","last_clean":"2023-10-06T01:38:49.528863+0000","last_became_active":"2023-10-06T01:38:49.524478+0000","last_became_peered":"2023-10-06T01:38:49.524478+0000","last_unstale":"2023-10-06T01:38:49.528863+0000","last_undegraded":"2023-10-06T01:38:49.528863+0000","last_fullsized":"2023-10-06T01:38:49.528863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:05.235173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533032+0000","last_change":"2023-10-06T01:38:49.528930+0000","last_active":"2023-10-06T01:38:49.533032+0000","last_peered":"2023-10-06T01:38:49.533032+0000","last_clean":"2023-10-06T01:38:49.533032+0000","last_became_active":"2023-10-06T01:38:49.528446+0000","last_became_peered":"2023-10-06T01:38:49.528446+0000","last_unstale":"2023-10-06T01:38:49.533032+0000","last_undegraded":"2023-10-06T01:38:49.533032+0000","last_fullsized":"2023-10-06T01:38:49.533032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:58.019042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532838+0000","last_change":"2023-10-06T01:38:49.530433+0000","last_active":"2023-10-06T01:38:49.532838+0000","last_peered":"2023-10-06T01:38:49.532838+0000","last_clean":"2023-10-06T01:38:49.532838+0000","last_became_active":"2023-10-06T01:38:49.530161+0000","last_became_peered":"2023-10-06T01:38:49.530161+0000","last_unstale":"2023-10-06T01:38:49.532838+0000","last_undegraded":"2023-10-06T01:38:49.532838+0000","last_fullsized":"2023-10-06T01:38:49.532838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:38:23.293524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526894+0000","last_change":"2023-10-06T01:38:49.523986+0000","last_active":"2023-10-06T01:38:49.526894+0000","last_peered":"2023-10-06T01:38:49.526894+0000","last_clean":"2023-10-06T01:38:49.526894+0000","last_became_active":"2023-10-06T01:38:49.523736+0000","last_became_peered":"2023-10-06T01:38:49.523736+0000","last_unstale":"2023-10-06T01:38:49.526894+0000","last_undegraded":"2023-10-06T01:38:49.526894+0000","last_fullsized":"2023-10-06T01:38:49.526894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:57.306692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526902+0000","last_change":"2023-10-06T01:38:49.517570+0000","last_active":"2023-10-06T01:38:49.526902+0000","last_peered":"2023-10-06T01:38:49.526902+0000","last_clean":"2023-10-06T01:38:49.526902+0000","last_became_active":"2023-10-06T01:38:49.517319+0000","last_became_peered":"2023-10-06T01:38:49.517319+0000","last_unstale":"2023-10-06T01:38:49.526902+0000","last_undegraded":"2023-10-06T01:38:49.526902+0000","last_fullsized":"2023-10-06T01:38:49.526902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:22.060988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.529224+0000","last_change":"2023-10-06T01:38:49.524486+0000","last_active":"2023-10-06T01:38:49.529224+0000","last_peered":"2023-10-06T01:38:49.529224+0000","last_clean":"2023-10-06T01:38:49.529224+0000","last_became_active":"2023-10-06T01:38:49.524244+0000","last_became_peered":"2023-10-06T01:38:49.524244+0000","last_unstale":"2023-10-06T01:38:49.529224+0000","last_undegraded":"2023-10-06T01:38:49.529224+0000","last_fullsized":"2023-10-06T01:38:49.529224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:22.814342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.525649+0000","last_change":"2023-10-06T01:38:49.521288+0000","last_active":"2023-10-06T01:38:49.525649+0000","last_peered":"2023-10-06T01:38:49.525649+0000","last_clean":"2023-10-06T01:38:49.525649+0000","last_became_active":"2023-10-06T01:38:49.520995+0000","last_became_peered":"2023-10-06T01:38:49.520995+0000","last_unstale":"2023-10-06T01:38:49.525649+0000","last_undegraded":"2023-10-06T01:38:49.525649+0000","last_fullsized":"2023-10-06T01:38:49.525649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:06.793193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.525993+0000","last_change":"2023-10-06T01:38:49.521528+0000","last_active":"2023-10-06T01:38:49.525993+0000","last_peered":"2023-10-06T01:38:49.525993+0000","last_clean":"2023-10-06T01:38:49.525993+0000","last_became_active":"2023-10-06T01:38:49.520274+0000","last_became_peered":"2023-10-06T01:38:49.520274+0000","last_unstale":"2023-10-06T01:38:49.525993+0000","last_undegraded":"2023-10-06T01:38:49.525993+0000","last_fullsized":"2023-10-06T01:38:49.525993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:31:19.856103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527242+0000","last_change":"2023-10-06T01:38:49.519548+0000","last_active":"2023-10-06T01:38:49.527242+0000","last_peered":"2023-10-06T01:38:49.527242+0000","last_clean":"2023-10-06T01:38:49.527242+0000","last_became_active":"2023-10-06T01:38:49.519249+0000","last_became_peered":"2023-10-06T01:38:49.519249+0000","last_unstale":"2023-10-06T01:38:49.527242+0000","last_undegraded":"2023-10-06T01:38:49.527242+0000","last_fullsized":"2023-10-06T01:38:49.527242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:57.494182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.656554+0000","last_change":"2023-10-06T01:38:48.666150+0000","last_active":"2023-10-06T01:38:49.656554+0000","last_peered":"2023-10-06T01:38:49.656554+0000","last_clean":"2023-10-06T01:38:49.656554+0000","last_became_active":"2023-10-06T01:38:48.663061+0000","last_became_peered":"2023-10-06T01:38:48.663061+0000","last_unstale":"2023-10-06T01:38:49.656554+0000","last_undegraded":"2023-10-06T01:38:49.656554+0000","last_fullsized":"2023-10-06T01:38:49.656554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:07:41.517375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531425+0000","last_change":"2023-10-06T01:38:49.520719+0000","last_active":"2023-10-06T01:38:49.531425+0000","last_peered":"2023-10-06T01:38:49.531425+0000","last_clean":"2023-10-06T01:38:49.531425+0000","last_became_active":"2023-10-06T01:38:49.520470+0000","last_became_peered":"2023-10-06T01:38:49.520470+0000","last_unstale":"2023-10-06T01:38:49.531425+0000","last_undegraded":"2023-10-06T01:38:49.531425+0000","last_fullsized":"2023-10-06T01:38:49.531425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:11.839303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515999+0000","last_change":"2023-10-06T01:38:48.666186+0000","last_active":"2023-10-06T01:38:49.515999+0000","last_peered":"2023-10-06T01:38:49.515999+0000","last_clean":"2023-10-06T01:38:49.515999+0000","last_became_active":"2023-10-06T01:38:48.665875+0000","last_became_peered":"2023-10-06T01:38:48.665875+0000","last_unstale":"2023-10-06T01:38:49.515999+0000","last_undegraded":"2023-10-06T01:38:49.515999+0000","last_fullsized":"2023-10-06T01:38:49.515999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:09.299545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524755+0000","last_change":"2023-10-06T01:38:49.518381+0000","last_active":"2023-10-06T01:38:49.524755+0000","last_peered":"2023-10-06T01:38:49.524755+0000","last_clean":"2023-10-06T01:38:49.524755+0000","last_became_active":"2023-10-06T01:38:49.518041+0000","last_became_peered":"2023-10-06T01:38:49.518041+0000","last_unstale":"2023-10-06T01:38:49.524755+0000","last_undegraded":"2023-10-06T01:38:49.524755+0000","last_fullsized":"2023-10-06T01:38:49.524755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.508966+0000","last_change":"2023-10-06T01:38:48.665041+0000","last_active":"2023-10-06T01:38:49.508966+0000","last_peered":"2023-10-06T01:38:49.508966+0000","last_clean":"2023-10-06T01:38:49.508966+0000","last_became_active":"2023-10-06T01:38:48.664783+0000","last_became_peered":"2023-10-06T01:38:48.664783+0000","last_unstale":"2023-10-06T01:38:49.508966+0000","last_undegraded":"2023-10-06T01:38:49.508966+0000","last_fullsized":"2023-10-06T01:38:49.508966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:52.982952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.528203+0000","last_change":"2023-10-06T01:38:49.524574+0000","last_active":"2023-10-06T01:38:49.528203+0000","last_peered":"2023-10-06T01:38:49.528203+0000","last_clean":"2023-10-06T01:38:49.528203+0000","last_became_active":"2023-10-06T01:38:49.524266+0000","last_became_peered":"2023-10-06T01:38:49.524266+0000","last_unstale":"2023-10-06T01:38:49.528203+0000","last_undegraded":"2023-10-06T01:38:49.528203+0000","last_fullsized":"2023-10-06T01:38:49.528203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:27.853451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.512647+0000","last_change":"2023-10-06T01:38:48.662259+0000","last_active":"2023-10-06T01:38:49.512647+0000","last_peered":"2023-10-06T01:38:49.512647+0000","last_clean":"2023-10-06T01:38:49.512647+0000","last_became_active":"2023-10-06T01:38:48.661993+0000","last_became_peered":"2023-10-06T01:38:48.661993+0000","last_unstale":"2023-10-06T01:38:49.512647+0000","last_undegraded":"2023-10-06T01:38:49.512647+0000","last_fullsized":"2023-10-06T01:38:49.512647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:04.233408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526872+0000","last_change":"2023-10-06T01:38:49.518829+0000","last_active":"2023-10-06T01:38:49.526872+0000","last_peered":"2023-10-06T01:38:49.526872+0000","last_clean":"2023-10-06T01:38:49.526872+0000","last_became_active":"2023-10-06T01:38:49.517297+0000","last_became_peered":"2023-10-06T01:38:49.517297+0000","last_unstale":"2023-10-06T01:38:49.526872+0000","last_undegraded":"2023-10-06T01:38:49.526872+0000","last_fullsized":"2023-10-06T01:38:49.526872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.513481+0000","last_change":"2023-10-06T01:38:48.662679+0000","last_active":"2023-10-06T01:38:49.513481+0000","last_peered":"2023-10-06T01:38:49.513481+0000","last_clean":"2023-10-06T01:38:49.513481+0000","last_became_active":"2023-10-06T01:38:48.662335+0000","last_became_peered":"2023-10-06T01:38:48.662335+0000","last_unstale":"2023-10-06T01:38:49.513481+0000","last_undegraded":"2023-10-06T01:38:49.513481+0000","last_fullsized":"2023-10-06T01:38:49.513481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:52.982952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526925+0000","last_change":"2023-10-06T01:38:49.518684+0000","last_active":"2023-10-06T01:38:49.526925+0000","last_peered":"2023-10-06T01:38:49.526925+0000","last_clean":"2023-10-06T01:38:49.526925+0000","last_became_active":"2023-10-06T01:38:49.518436+0000","last_became_peered":"2023-10-06T01:38:49.518436+0000","last_unstale":"2023-10-06T01:38:49.526925+0000","last_undegraded":"2023-10-06T01:38:49.526925+0000","last_fullsized":"2023-10-06T01:38:49.526925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:42.707474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.659791+0000","last_change":"2023-10-06T01:38:48.667307+0000","last_active":"2023-10-06T01:38:49.659791+0000","last_peered":"2023-10-06T01:38:49.659791+0000","last_clean":"2023-10-06T01:38:49.659791+0000","last_became_active":"2023-10-06T01:38:48.667032+0000","last_became_peered":"2023-10-06T01:38:48.667032+0000","last_unstale":"2023-10-06T01:38:49.659791+0000","last_undegraded":"2023-10-06T01:38:49.659791+0000","last_fullsized":"2023-10-06T01:38:49.659791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:26.851686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527967+0000","last_change":"2023-10-06T01:38:49.525949+0000","last_active":"2023-10-06T01:38:49.527967+0000","last_peered":"2023-10-06T01:38:49.527967+0000","last_clean":"2023-10-06T01:38:49.527967+0000","last_became_active":"2023-10-06T01:38:49.525063+0000","last_became_peered":"2023-10-06T01:38:49.525063+0000","last_unstale":"2023-10-06T01:38:49.527967+0000","last_undegraded":"2023-10-06T01:38:49.527967+0000","last_fullsized":"2023-10-06T01:38:49.527967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:31.040385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.659104+0000","last_change":"2023-10-06T01:38:48.666319+0000","last_active":"2023-10-06T01:38:49.659104+0000","last_peered":"2023-10-06T01:38:49.659104+0000","last_clean":"2023-10-06T01:38:49.659104+0000","last_became_active":"2023-10-06T01:38:48.666058+0000","last_became_peered":"2023-10-06T01:38:48.666058+0000","last_unstale":"2023-10-06T01:38:49.659104+0000","last_undegraded":"2023-10-06T01:38:49.659104+0000","last_fullsized":"2023-10-06T01:38:49.659104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:09.299545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532960+0000","last_change":"2023-10-06T01:38:49.528713+0000","last_active":"2023-10-06T01:38:49.532960+0000","last_peered":"2023-10-06T01:38:49.532960+0000","last_clean":"2023-10-06T01:38:49.532960+0000","last_became_active":"2023-10-06T01:38:49.528396+0000","last_became_peered":"2023-10-06T01:38:49.528396+0000","last_unstale":"2023-10-06T01:38:49.532960+0000","last_undegraded":"2023-10-06T01:38:49.532960+0000","last_fullsized":"2023-10-06T01:38:49.532960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:22.060988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.657311+0000","last_change":"2023-10-06T01:38:48.669666+0000","last_active":"2023-10-06T01:38:49.657311+0000","last_peered":"2023-10-06T01:38:49.657311+0000","last_clean":"2023-10-06T01:38:49.657311+0000","last_became_active":"2023-10-06T01:38:48.669403+0000","last_became_peered":"2023-10-06T01:38:48.669403+0000","last_unstale":"2023-10-06T01:38:49.657311+0000","last_undegraded":"2023-10-06T01:38:49.657311+0000","last_fullsized":"2023-10-06T01:38:49.657311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:11.825838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531689+0000","last_change":"2023-10-06T01:38:49.522550+0000","last_active":"2023-10-06T01:38:49.531689+0000","last_peered":"2023-10-06T01:38:49.531689+0000","last_clean":"2023-10-06T01:38:49.531689+0000","last_became_active":"2023-10-06T01:38:49.521718+0000","last_became_peered":"2023-10-06T01:38:49.521718+0000","last_unstale":"2023-10-06T01:38:49.531689+0000","last_undegraded":"2023-10-06T01:38:49.531689+0000","last_fullsized":"2023-10-06T01:38:49.531689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:38:23.293524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.512791+0000","last_change":"2023-10-06T01:38:48.657883+0000","last_active":"2023-10-06T01:38:49.512791+0000","last_peered":"2023-10-06T01:38:49.512791+0000","last_clean":"2023-10-06T01:38:49.512791+0000","last_became_active":"2023-10-06T01:38:48.656431+0000","last_became_peered":"2023-10-06T01:38:48.656431+0000","last_unstale":"2023-10-06T01:38:49.512791+0000","last_undegraded":"2023-10-06T01:38:49.512791+0000","last_fullsized":"2023-10-06T01:38:49.512791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:52.982952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.523875+0000","last_change":"2023-10-06T01:38:49.516970+0000","last_active":"2023-10-06T01:38:49.523875+0000","last_peered":"2023-10-06T01:38:49.523875+0000","last_clean":"2023-10-06T01:38:49.523875+0000","last_became_active":"2023-10-06T01:38:49.516721+0000","last_became_peered":"2023-10-06T01:38:49.516721+0000","last_unstale":"2023-10-06T01:38:49.523875+0000","last_undegraded":"2023-10-06T01:38:49.523875+0000","last_fullsized":"2023-10-06T01:38:49.523875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:38:23.293524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.514766+0000","last_change":"2023-10-06T01:38:48.667484+0000","last_active":"2023-10-06T01:38:49.514766+0000","last_peered":"2023-10-06T01:38:49.514766+0000","last_clean":"2023-10-06T01:38:49.514766+0000","last_became_active":"2023-10-06T01:38:48.667215+0000","last_became_peered":"2023-10-06T01:38:48.667215+0000","last_unstale":"2023-10-06T01:38:49.514766+0000","last_undegraded":"2023-10-06T01:38:49.514766+0000","last_fullsized":"2023-10-06T01:38:49.514766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:57:07.898207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526925+0000","last_change":"2023-10-06T01:38:49.523815+0000","last_active":"2023-10-06T01:38:49.526925+0000","last_peered":"2023-10-06T01:38:49.526925+0000","last_clean":"2023-10-06T01:38:49.526925+0000","last_became_active":"2023-10-06T01:38:49.520967+0000","last_became_peered":"2023-10-06T01:38:49.520967+0000","last_unstale":"2023-10-06T01:38:49.526925+0000","last_undegraded":"2023-10-06T01:38:49.526925+0000","last_fullsized":"2023-10-06T01:38:49.526925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:04.188051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.659578+0000","last_change":"2023-10-06T01:38:48.665231+0000","last_active":"2023-10-06T01:38:49.659578+0000","last_peered":"2023-10-06T01:38:49.659578+0000","last_clean":"2023-10-06T01:38:49.659578+0000","last_became_active":"2023-10-06T01:38:48.664910+0000","last_became_peered":"2023-10-06T01:38:48.664910+0000","last_unstale":"2023-10-06T01:38:49.659578+0000","last_undegraded":"2023-10-06T01:38:49.659578+0000","last_fullsized":"2023-10-06T01:38:49.659578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:50.373603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526858+0000","last_change":"2023-10-06T01:38:49.519035+0000","last_active":"2023-10-06T01:38:49.526858+0000","last_peered":"2023-10-06T01:38:49.526858+0000","last_clean":"2023-10-06T01:38:49.526858+0000","last_became_active":"2023-10-06T01:38:49.518788+0000","last_became_peered":"2023-10-06T01:38:49.518788+0000","last_unstale":"2023-10-06T01:38:49.526858+0000","last_undegraded":"2023-10-06T01:38:49.526858+0000","last_fullsized":"2023-10-06T01:38:49.526858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:21.430025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.656778+0000","last_change":"2023-10-06T01:38:48.669414+0000","last_active":"2023-10-06T01:38:49.656778+0000","last_peered":"2023-10-06T01:38:49.656778+0000","last_clean":"2023-10-06T01:38:49.656778+0000","last_became_active":"2023-10-06T01:38:48.669152+0000","last_became_peered":"2023-10-06T01:38:48.669152+0000","last_unstale":"2023-10-06T01:38:49.656778+0000","last_undegraded":"2023-10-06T01:38:49.656778+0000","last_fullsized":"2023-10-06T01:38:49.656778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:31.036573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.523629+0000","last_change":"2023-10-06T01:38:49.515615+0000","last_active":"2023-10-06T01:38:49.523629+0000","last_peered":"2023-10-06T01:38:49.523629+0000","last_clean":"2023-10-06T01:38:49.523629+0000","last_became_active":"2023-10-06T01:38:49.515307+0000","last_became_peered":"2023-10-06T01:38:49.515307+0000","last_unstale":"2023-10-06T01:38:49.523629+0000","last_undegraded":"2023-10-06T01:38:49.523629+0000","last_fullsized":"2023-10-06T01:38:49.523629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:31.040385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.657257+0000","last_change":"2023-10-06T01:38:48.669339+0000","last_active":"2023-10-06T01:38:49.657257+0000","last_peered":"2023-10-06T01:38:49.657257+0000","last_clean":"2023-10-06T01:38:49.657257+0000","last_became_active":"2023-10-06T01:38:48.668855+0000","last_became_peered":"2023-10-06T01:38:48.668855+0000","last_unstale":"2023-10-06T01:38:49.657257+0000","last_undegraded":"2023-10-06T01:38:49.657257+0000","last_fullsized":"2023-10-06T01:38:49.657257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:33.441697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533008+0000","last_change":"2023-10-06T01:38:49.528804+0000","last_active":"2023-10-06T01:38:49.533008+0000","last_peered":"2023-10-06T01:38:49.533008+0000","last_clean":"2023-10-06T01:38:49.533008+0000","last_became_active":"2023-10-06T01:38:49.528188+0000","last_became_peered":"2023-10-06T01:38:49.528188+0000","last_unstale":"2023-10-06T01:38:49.533008+0000","last_undegraded":"2023-10-06T01:38:49.533008+0000","last_fullsized":"2023-10-06T01:38:49.533008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:42.707474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.656825+0000","last_change":"2023-10-06T01:38:48.662704+0000","last_active":"2023-10-06T01:38:49.656825+0000","last_peered":"2023-10-06T01:38:49.656825+0000","last_clean":"2023-10-06T01:38:49.656825+0000","last_became_active":"2023-10-06T01:38:48.662445+0000","last_became_peered":"2023-10-06T01:38:48.662445+0000","last_unstale":"2023-10-06T01:38:49.656825+0000","last_undegraded":"2023-10-06T01:38:49.656825+0000","last_fullsized":"2023-10-06T01:38:49.656825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:21:02.893859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.529784+0000","last_change":"2023-10-06T01:38:49.524878+0000","last_active":"2023-10-06T01:38:49.529784+0000","last_peered":"2023-10-06T01:38:49.529784+0000","last_clean":"2023-10-06T01:38:49.529784+0000","last_became_active":"2023-10-06T01:38:49.524606+0000","last_became_peered":"2023-10-06T01:38:49.524606+0000","last_unstale":"2023-10-06T01:38:49.529784+0000","last_undegraded":"2023-10-06T01:38:49.529784+0000","last_fullsized":"2023-10-06T01:38:49.529784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:32.038338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.513006+0000","last_change":"2023-10-06T01:38:48.669114+0000","last_active":"2023-10-06T01:38:49.513006+0000","last_peered":"2023-10-06T01:38:49.513006+0000","last_clean":"2023-10-06T01:38:49.513006+0000","last_became_active":"2023-10-06T01:38:48.668855+0000","last_became_peered":"2023-10-06T01:38:48.668855+0000","last_unstale":"2023-10-06T01:38:49.513006+0000","last_undegraded":"2023-10-06T01:38:49.513006+0000","last_fullsized":"2023-10-06T01:38:49.513006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:04.233408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524798+0000","last_change":"2023-10-06T01:38:49.521828+0000","last_active":"2023-10-06T01:38:49.524798+0000","last_peered":"2023-10-06T01:38:49.524798+0000","last_clean":"2023-10-06T01:38:49.524798+0000","last_became_active":"2023-10-06T01:38:49.521245+0000","last_became_peered":"2023-10-06T01:38:49.521245+0000","last_unstale":"2023-10-06T01:38:49.524798+0000","last_undegraded":"2023-10-06T01:38:49.524798+0000","last_fullsized":"2023-10-06T01:38:49.524798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:22.814342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.654286+0000","last_change":"2023-10-06T01:38:48.665908+0000","last_active":"2023-10-06T01:38:49.654286+0000","last_peered":"2023-10-06T01:38:49.654286+0000","last_clean":"2023-10-06T01:38:49.654286+0000","last_became_active":"2023-10-06T01:38:48.665663+0000","last_became_peered":"2023-10-06T01:38:48.665663+0000","last_unstale":"2023-10-06T01:38:49.654286+0000","last_undegraded":"2023-10-06T01:38:49.654286+0000","last_fullsized":"2023-10-06T01:38:49.654286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:04.233408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533179+0000","last_change":"2023-10-06T01:38:49.532282+0000","last_active":"2023-10-06T01:38:49.533179+0000","last_peered":"2023-10-06T01:38:49.533179+0000","last_clean":"2023-10-06T01:38:49.533179+0000","last_became_active":"2023-10-06T01:38:49.532000+0000","last_became_peered":"2023-10-06T01:38:49.532000+0000","last_unstale":"2023-10-06T01:38:49.533179+0000","last_undegraded":"2023-10-06T01:38:49.533179+0000","last_fullsized":"2023-10-06T01:38:49.533179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:43.950553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.517541+0000","last_change":"2023-10-06T01:38:48.668151+0000","last_active":"2023-10-06T01:38:49.517541+0000","last_peered":"2023-10-06T01:38:49.517541+0000","last_clean":"2023-10-06T01:38:49.517541+0000","last_became_active":"2023-10-06T01:38:48.667870+0000","last_became_peered":"2023-10-06T01:38:48.667870+0000","last_unstale":"2023-10-06T01:38:49.517541+0000","last_undegraded":"2023-10-06T01:38:49.517541+0000","last_fullsized":"2023-10-06T01:38:49.517541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:07:41.517375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532859+0000","last_change":"2023-10-06T01:38:49.528292+0000","last_active":"2023-10-06T01:38:49.532859+0000","last_peered":"2023-10-06T01:38:49.532859+0000","last_clean":"2023-10-06T01:38:49.532859+0000","last_became_active":"2023-10-06T01:38:49.527980+0000","last_became_peered":"2023-10-06T01:38:49.527980+0000","last_unstale":"2023-10-06T01:38:49.532859+0000","last_undegraded":"2023-10-06T01:38:49.532859+0000","last_fullsized":"2023-10-06T01:38:49.532859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:24.795745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.521291+0000","last_change":"2023-10-06T01:38:48.659921+0000","last_active":"2023-10-06T01:38:49.521291+0000","last_peered":"2023-10-06T01:38:49.521291+0000","last_clean":"2023-10-06T01:38:49.521291+0000","last_became_active":"2023-10-06T01:38:48.659640+0000","last_became_peered":"2023-10-06T01:38:48.659640+0000","last_unstale":"2023-10-06T01:38:49.521291+0000","last_undegraded":"2023-10-06T01:38:49.521291+0000","last_fullsized":"2023-10-06T01:38:49.521291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:03.937447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533026+0000","last_change":"2023-10-06T01:38:49.528830+0000","last_active":"2023-10-06T01:38:49.533026+0000","last_peered":"2023-10-06T01:38:49.533026+0000","last_clean":"2023-10-06T01:38:49.533026+0000","last_became_active":"2023-10-06T01:38:49.528523+0000","last_became_peered":"2023-10-06T01:38:49.528523+0000","last_unstale":"2023-10-06T01:38:49.533026+0000","last_undegraded":"2023-10-06T01:38:49.533026+0000","last_fullsized":"2023-10-06T01:38:49.533026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:04.188051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.508523+0000","last_change":"2023-10-06T01:38:48.661605+0000","last_active":"2023-10-06T01:38:49.508523+0000","last_peered":"2023-10-06T01:38:49.508523+0000","last_clean":"2023-10-06T01:38:49.508523+0000","last_became_active":"2023-10-06T01:38:48.661424+0000","last_became_peered":"2023-10-06T01:38:48.661424+0000","last_unstale":"2023-10-06T01:38:49.508523+0000","last_undegraded":"2023-10-06T01:38:49.508523+0000","last_fullsized":"2023-10-06T01:38:49.508523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:34.288288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526228+0000","last_change":"2023-10-06T01:38:49.524678+0000","last_active":"2023-10-06T01:38:49.526228+0000","last_peered":"2023-10-06T01:38:49.526228+0000","last_clean":"2023-10-06T01:38:49.526228+0000","last_became_active":"2023-10-06T01:38:49.522598+0000","last_became_peered":"2023-10-06T01:38:49.522598+0000","last_unstale":"2023-10-06T01:38:49.526228+0000","last_undegraded":"2023-10-06T01:38:49.526228+0000","last_fullsized":"2023-10-06T01:38:49.526228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515842+0000","last_change":"2023-10-06T01:38:44.533111+0000","last_active":"2023-10-06T01:38:49.515842+0000","last_peered":"2023-10-06T01:38:49.515842+0000","last_clean":"2023-10-06T01:38:49.515842+0000","last_became_active":"2023-10-06T01:38:44.532838+0000","last_became_peered":"2023-10-06T01:38:44.532838+0000","last_unstale":"2023-10-06T01:38:49.515842+0000","last_undegraded":"2023-10-06T01:38:49.515842+0000","last_fullsized":"2023-10-06T01:38:49.515842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.513492+0000","last_change":"2023-10-06T01:38:48.666716+0000","last_active":"2023-10-06T01:38:49.513492+0000","last_peered":"2023-10-06T01:38:49.513492+0000","last_clean":"2023-10-06T01:38:49.513492+0000","last_became_active":"2023-10-06T01:38:48.666431+0000","last_became_peered":"2023-10-06T01:38:48.666431+0000","last_unstale":"2023-10-06T01:38:49.513492+0000","last_undegraded":"2023-10-06T01:38:49.513492+0000","last_fullsized":"2023-10-06T01:38:49.513492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:33.441697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526310+0000","last_change":"2023-10-06T01:38:49.524629+0000","last_active":"2023-10-06T01:38:49.526310+0000","last_peered":"2023-10-06T01:38:49.526310+0000","last_clean":"2023-10-06T01:38:49.526310+0000","last_became_active":"2023-10-06T01:38:49.524372+0000","last_became_peered":"2023-10-06T01:38:49.524372+0000","last_unstale":"2023-10-06T01:38:49.526310+0000","last_undegraded":"2023-10-06T01:38:49.526310+0000","last_fullsized":"2023-10-06T01:38:49.526310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:22.814342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.512226+0000","last_change":"2023-10-06T01:38:44.533897+0000","last_active":"2023-10-06T01:38:49.512226+0000","last_peered":"2023-10-06T01:38:49.512226+0000","last_clean":"2023-10-06T01:38:49.512226+0000","last_became_active":"2023-10-06T01:38:44.533611+0000","last_became_peered":"2023-10-06T01:38:44.533611+0000","last_unstale":"2023-10-06T01:38:49.512226+0000","last_undegraded":"2023-10-06T01:38:49.512226+0000","last_fullsized":"2023-10-06T01:38:49.512226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:24.411408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.520109+0000","last_change":"2023-10-06T01:38:48.666784+0000","last_active":"2023-10-06T01:38:49.520109+0000","last_peered":"2023-10-06T01:38:49.520109+0000","last_clean":"2023-10-06T01:38:49.520109+0000","last_became_active":"2023-10-06T01:38:48.666228+0000","last_became_peered":"2023-10-06T01:38:48.666228+0000","last_unstale":"2023-10-06T01:38:49.520109+0000","last_undegraded":"2023-10-06T01:38:49.520109+0000","last_fullsized":"2023-10-06T01:38:49.520109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:34.288288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526238+0000","last_change":"2023-10-06T01:38:49.520640+0000","last_active":"2023-10-06T01:38:49.526238+0000","last_peered":"2023-10-06T01:38:49.526238+0000","last_clean":"2023-10-06T01:38:49.526238+0000","last_became_active":"2023-10-06T01:38:49.520050+0000","last_became_peered":"2023-10-06T01:38:49.520050+0000","last_unstale":"2023-10-06T01:38:49.526238+0000","last_undegraded":"2023-10-06T01:38:49.526238+0000","last_fullsized":"2023-10-06T01:38:49.526238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:27.494951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.513741+0000","last_change":"2023-10-06T01:38:45.307814+0000","last_active":"2023-10-06T01:38:49.513741+0000","last_peered":"2023-10-06T01:38:49.513741+0000","last_clean":"2023-10-06T01:38:49.513741+0000","last_became_active":"2023-10-06T01:38:45.307536+0000","last_became_peered":"2023-10-06T01:38:45.307536+0000","last_unstale":"2023-10-06T01:38:49.513741+0000","last_undegraded":"2023-10-06T01:38:49.513741+0000","last_fullsized":"2023-10-06T01:38:49.513741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:09.503713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515587+0000","last_change":"2023-10-06T01:38:48.656055+0000","last_active":"2023-10-06T01:38:49.515587+0000","last_peered":"2023-10-06T01:38:49.515587+0000","last_clean":"2023-10-06T01:38:49.515587+0000","last_became_active":"2023-10-06T01:38:48.655769+0000","last_became_peered":"2023-10-06T01:38:48.655769+0000","last_unstale":"2023-10-06T01:38:49.515587+0000","last_undegraded":"2023-10-06T01:38:49.515587+0000","last_fullsized":"2023-10-06T01:38:49.515587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:34.288288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527622+0000","last_change":"2023-10-06T01:38:49.524773+0000","last_active":"2023-10-06T01:38:49.527622+0000","last_peered":"2023-10-06T01:38:49.527622+0000","last_clean":"2023-10-06T01:38:49.527622+0000","last_became_active":"2023-10-06T01:38:49.524515+0000","last_became_peered":"2023-10-06T01:38:49.524515+0000","last_unstale":"2023-10-06T01:38:49.527622+0000","last_undegraded":"2023-10-06T01:38:49.527622+0000","last_fullsized":"2023-10-06T01:38:49.527622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:57.306692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.512742+0000","last_change":"2023-10-06T01:38:44.534507+0000","last_active":"2023-10-06T01:38:49.512742+0000","last_peered":"2023-10-06T01:38:49.512742+0000","last_clean":"2023-10-06T01:38:49.512742+0000","last_became_active":"2023-10-06T01:38:44.534191+0000","last_became_peered":"2023-10-06T01:38:44.534191+0000","last_unstale":"2023-10-06T01:38:49.512742+0000","last_undegraded":"2023-10-06T01:38:49.512742+0000","last_fullsized":"2023-10-06T01:38:49.512742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.514777+0000","last_change":"2023-10-06T01:38:40.115117+0000","last_active":"2023-10-06T01:38:49.514777+0000","last_peered":"2023-10-06T01:38:49.514777+0000","last_clean":"2023-10-06T01:38:49.514777+0000","last_became_active":"2023-10-06T01:38:40.114142+0000","last_became_peered":"2023-10-06T01:38:40.114142+0000","last_unstale":"2023-10-06T01:38:49.514777+0000","last_undegraded":"2023-10-06T01:38:49.514777+0000","last_fullsized":"2023-10-06T01:38:49.514777+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_clean_scrub_stamp":"2023-10-06T01:38:38.338797+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:52.870262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.508643+0000","last_change":"2023-10-06T01:38:48.663223+0000","last_active":"2023-10-06T01:38:49.508643+0000","last_peered":"2023-10-06T01:38:49.508643+0000","last_clean":"2023-10-06T01:38:49.508643+0000","last_became_active":"2023-10-06T01:38:48.662956+0000","last_became_peered":"2023-10-06T01:38:48.662956+0000","last_unstale":"2023-10-06T01:38:49.508643+0000","last_undegraded":"2023-10-06T01:38:49.508643+0000","last_fullsized":"2023-10-06T01:38:49.508643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:54.859831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531599+0000","last_change":"2023-10-06T01:38:49.530401+0000","last_active":"2023-10-06T01:38:49.531599+0000","last_peered":"2023-10-06T01:38:49.531599+0000","last_clean":"2023-10-06T01:38:49.531599+0000","last_became_active":"2023-10-06T01:38:49.530107+0000","last_became_peered":"2023-10-06T01:38:49.530107+0000","last_unstale":"2023-10-06T01:38:49.531599+0000","last_undegraded":"2023-10-06T01:38:49.531599+0000","last_fullsized":"2023-10-06T01:38:49.531599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:12.827603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515221+0000","last_change":"2023-10-06T01:38:44.531831+0000","last_active":"2023-10-06T01:38:49.515221+0000","last_peered":"2023-10-06T01:38:49.515221+0000","last_clean":"2023-10-06T01:38:49.515221+0000","last_became_active":"2023-10-06T01:38:44.531496+0000","last_became_peered":"2023-10-06T01:38:44.531496+0000","last_unstale":"2023-10-06T01:38:49.515221+0000","last_undegraded":"2023-10-06T01:38:49.515221+0000","last_fullsized":"2023-10-06T01:38:49.515221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:28.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.512340+0000","last_change":"2023-10-06T01:38:48.667413+0000","last_active":"2023-10-06T01:38:49.512340+0000","last_peered":"2023-10-06T01:38:49.512340+0000","last_clean":"2023-10-06T01:38:49.512340+0000","last_became_active":"2023-10-06T01:38:48.667114+0000","last_became_peered":"2023-10-06T01:38:48.667114+0000","last_unstale":"2023-10-06T01:38:49.512340+0000","last_undegraded":"2023-10-06T01:38:49.512340+0000","last_fullsized":"2023-10-06T01:38:49.512340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:03.937447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531783+0000","last_change":"2023-10-06T01:38:49.524239+0000","last_active":"2023-10-06T01:38:49.531783+0000","last_peered":"2023-10-06T01:38:49.531783+0000","last_clean":"2023-10-06T01:38:49.531783+0000","last_became_active":"2023-10-06T01:38:49.523994+0000","last_became_peered":"2023-10-06T01:38:49.523994+0000","last_unstale":"2023-10-06T01:38:49.531783+0000","last_undegraded":"2023-10-06T01:38:49.531783+0000","last_fullsized":"2023-10-06T01:38:49.531783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:31:19.856103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515175+0000","last_change":"2023-10-06T01:38:44.531335+0000","last_active":"2023-10-06T01:38:49.515175+0000","last_peered":"2023-10-06T01:38:49.515175+0000","last_clean":"2023-10-06T01:38:49.515175+0000","last_became_active":"2023-10-06T01:38:44.530966+0000","last_became_peered":"2023-10-06T01:38:44.530966+0000","last_unstale":"2023-10-06T01:38:49.515175+0000","last_undegraded":"2023-10-06T01:38:49.515175+0000","last_fullsized":"2023-10-06T01:38:49.515175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:33.926180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515942+0000","last_change":"2023-10-06T01:38:48.660438+0000","last_active":"2023-10-06T01:38:49.515942+0000","last_peered":"2023-10-06T01:38:49.515942+0000","last_clean":"2023-10-06T01:38:49.515942+0000","last_became_active":"2023-10-06T01:38:48.660222+0000","last_became_peered":"2023-10-06T01:38:48.660222+0000","last_unstale":"2023-10-06T01:38:49.515942+0000","last_undegraded":"2023-10-06T01:38:49.515942+0000","last_fullsized":"2023-10-06T01:38:49.515942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:03.937447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524781+0000","last_change":"2023-10-06T01:38:49.517014+0000","last_active":"2023-10-06T01:38:49.524781+0000","last_peered":"2023-10-06T01:38:49.524781+0000","last_clean":"2023-10-06T01:38:49.524781+0000","last_became_active":"2023-10-06T01:38:49.516679+0000","last_became_peered":"2023-10-06T01:38:49.516679+0000","last_unstale":"2023-10-06T01:38:49.524781+0000","last_undegraded":"2023-10-06T01:38:49.524781+0000","last_fullsized":"2023-10-06T01:38:49.524781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:38:23.293524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.658035+0000","last_change":"2023-10-06T01:38:48.663372+0000","last_active":"2023-10-06T01:38:49.658035+0000","last_peered":"2023-10-06T01:38:49.658035+0000","last_clean":"2023-10-06T01:38:49.658035+0000","last_became_active":"2023-10-06T01:38:48.663074+0000","last_became_peered":"2023-10-06T01:38:48.663074+0000","last_unstale":"2023-10-06T01:38:49.658035+0000","last_undegraded":"2023-10-06T01:38:49.658035+0000","last_fullsized":"2023-10-06T01:38:49.658035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:09.299545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.516315+0000","last_change":"2023-10-06T01:38:44.533582+0000","last_active":"2023-10-06T01:38:49.516315+0000","last_peered":"2023-10-06T01:38:49.516315+0000","last_clean":"2023-10-06T01:38:49.516315+0000","last_became_active":"2023-10-06T01:38:44.533324+0000","last_became_peered":"2023-10-06T01:38:44.533324+0000","last_unstale":"2023-10-06T01:38:49.516315+0000","last_undegraded":"2023-10-06T01:38:49.516315+0000","last_fullsized":"2023-10-06T01:38:49.516315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.519956+0000","last_change":"2023-10-06T01:38:49.516429+0000","last_active":"2023-10-06T01:38:49.519956+0000","last_peered":"2023-10-06T01:38:49.519956+0000","last_clean":"2023-10-06T01:38:49.519956+0000","last_became_active":"2023-10-06T01:38:49.515639+0000","last_became_peered":"2023-10-06T01:38:49.515639+0000","last_unstale":"2023-10-06T01:38:49.519956+0000","last_undegraded":"2023-10-06T01:38:49.519956+0000","last_fullsized":"2023-10-06T01:38:49.519956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:22.814342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.516330+0000","last_change":"2023-10-06T01:38:44.533765+0000","last_active":"2023-10-06T01:38:49.516330+0000","last_peered":"2023-10-06T01:38:49.516330+0000","last_clean":"2023-10-06T01:38:49.516330+0000","last_became_active":"2023-10-06T01:38:44.533406+0000","last_became_peered":"2023-10-06T01:38:44.533406+0000","last_unstale":"2023-10-06T01:38:49.516330+0000","last_undegraded":"2023-10-06T01:38:49.516330+0000","last_fullsized":"2023-10-06T01:38:49.516330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:38:50.515561+0000","last_change":"2023-10-06T01:38:48.659164+0000","last_active":"2023-10-06T01:38:50.515561+0000","last_peered":"2023-10-06T01:38:50.515561+0000","last_clean":"2023-10-06T01:38:50.515561+0000","last_became_active":"2023-10-06T01:38:48.658890+0000","last_became_peered":"2023-10-06T01:38:48.658890+0000","last_unstale":"2023-10-06T01:38:50.515561+0000","last_undegraded":"2023-10-06T01:38:50.515561+0000","last_fullsized":"2023-10-06T01:38:50.515561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:34.288288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533074+0000","last_change":"2023-10-06T01:38:49.529282+0000","last_active":"2023-10-06T01:38:49.533074+0000","last_peered":"2023-10-06T01:38:49.533074+0000","last_clean":"2023-10-06T01:38:49.533074+0000","last_became_active":"2023-10-06T01:38:49.528544+0000","last_became_peered":"2023-10-06T01:38:49.528544+0000","last_unstale":"2023-10-06T01:38:49.533074+0000","last_undegraded":"2023-10-06T01:38:49.533074+0000","last_fullsized":"2023-10-06T01:38:49.533074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:21.430025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.656041+0000","last_change":"2023-10-06T01:38:48.668953+0000","last_active":"2023-10-06T01:38:49.656041+0000","last_peered":"2023-10-06T01:38:49.656041+0000","last_clean":"2023-10-06T01:38:49.656041+0000","last_became_active":"2023-10-06T01:38:48.668711+0000","last_became_peered":"2023-10-06T01:38:48.668711+0000","last_unstale":"2023-10-06T01:38:49.656041+0000","last_undegraded":"2023-10-06T01:38:49.656041+0000","last_fullsized":"2023-10-06T01:38:49.656041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:07:41.517375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527535+0000","last_change":"2023-10-06T01:38:49.523156+0000","last_active":"2023-10-06T01:38:49.527535+0000","last_peered":"2023-10-06T01:38:49.527535+0000","last_clean":"2023-10-06T01:38:49.527535+0000","last_became_active":"2023-10-06T01:38:49.522238+0000","last_became_peered":"2023-10-06T01:38:49.522238+0000","last_unstale":"2023-10-06T01:38:49.527535+0000","last_undegraded":"2023-10-06T01:38:49.527535+0000","last_fullsized":"2023-10-06T01:38:49.527535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:53.984718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.657984+0000","last_change":"2023-10-06T01:38:48.669432+0000","last_active":"2023-10-06T01:38:49.657984+0000","last_peered":"2023-10-06T01:38:49.657984+0000","last_clean":"2023-10-06T01:38:49.657984+0000","last_became_active":"2023-10-06T01:38:48.669170+0000","last_became_peered":"2023-10-06T01:38:48.669170+0000","last_unstale":"2023-10-06T01:38:49.657984+0000","last_undegraded":"2023-10-06T01:38:49.657984+0000","last_fullsized":"2023-10-06T01:38:49.657984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:31.036573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533202+0000","last_change":"2023-10-06T01:38:49.532440+0000","last_active":"2023-10-06T01:38:49.533202+0000","last_peered":"2023-10-06T01:38:49.533202+0000","last_clean":"2023-10-06T01:38:49.533202+0000","last_became_active":"2023-10-06T01:38:49.532184+0000","last_became_peered":"2023-10-06T01:38:49.532184+0000","last_unstale":"2023-10-06T01:38:49.533202+0000","last_undegraded":"2023-10-06T01:38:49.533202+0000","last_fullsized":"2023-10-06T01:38:49.533202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:57.688866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.657725+0000","last_change":"2023-10-06T01:38:48.668877+0000","last_active":"2023-10-06T01:38:49.657725+0000","last_peered":"2023-10-06T01:38:49.657725+0000","last_clean":"2023-10-06T01:38:49.657725+0000","last_became_active":"2023-10-06T01:38:48.668564+0000","last_became_peered":"2023-10-06T01:38:48.668564+0000","last_unstale":"2023-10-06T01:38:49.657725+0000","last_undegraded":"2023-10-06T01:38:49.657725+0000","last_fullsized":"2023-10-06T01:38:49.657725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:54.859831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533193+0000","last_change":"2023-10-06T01:38:49.532416+0000","last_active":"2023-10-06T01:38:49.533193+0000","last_peered":"2023-10-06T01:38:49.533193+0000","last_clean":"2023-10-06T01:38:49.533193+0000","last_became_active":"2023-10-06T01:38:49.532101+0000","last_became_peered":"2023-10-06T01:38:49.532101+0000","last_unstale":"2023-10-06T01:38:49.533193+0000","last_undegraded":"2023-10-06T01:38:49.533193+0000","last_fullsized":"2023-10-06T01:38:49.533193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.654641+0000","last_change":"2023-10-06T01:38:48.665065+0000","last_active":"2023-10-06T01:38:49.654641+0000","last_peered":"2023-10-06T01:38:49.654641+0000","last_clean":"2023-10-06T01:38:49.654641+0000","last_became_active":"2023-10-06T01:38:48.664769+0000","last_became_peered":"2023-10-06T01:38:48.664769+0000","last_unstale":"2023-10-06T01:38:49.654641+0000","last_undegraded":"2023-10-06T01:38:49.654641+0000","last_fullsized":"2023-10-06T01:38:49.654641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:33.441697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526916+0000","last_change":"2023-10-06T01:38:49.518384+0000","last_active":"2023-10-06T01:38:49.526916+0000","last_peered":"2023-10-06T01:38:49.526916+0000","last_clean":"2023-10-06T01:38:49.526916+0000","last_became_active":"2023-10-06T01:38:49.518100+0000","last_became_peered":"2023-10-06T01:38:49.518100+0000","last_unstale":"2023-10-06T01:38:49.526916+0000","last_undegraded":"2023-10-06T01:38:49.526916+0000","last_fullsized":"2023-10-06T01:38:49.526916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:57.494182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.655794+0000","last_change":"2023-10-06T01:38:48.662504+0000","last_active":"2023-10-06T01:38:49.655794+0000","last_peered":"2023-10-06T01:38:49.655794+0000","last_clean":"2023-10-06T01:38:49.655794+0000","last_became_active":"2023-10-06T01:38:48.662220+0000","last_became_peered":"2023-10-06T01:38:48.662220+0000","last_unstale":"2023-10-06T01:38:49.655794+0000","last_undegraded":"2023-10-06T01:38:49.655794+0000","last_fullsized":"2023-10-06T01:38:49.655794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:54.859831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533135+0000","last_change":"2023-10-06T01:38:49.531208+0000","last_active":"2023-10-06T01:38:49.533135+0000","last_peered":"2023-10-06T01:38:49.533135+0000","last_clean":"2023-10-06T01:38:49.533135+0000","last_became_active":"2023-10-06T01:38:49.530797+0000","last_became_peered":"2023-10-06T01:38:49.530797+0000","last_unstale":"2023-10-06T01:38:49.533135+0000","last_undegraded":"2023-10-06T01:38:49.533135+0000","last_fullsized":"2023-10-06T01:38:49.533135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:57.494182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527811+0000","last_change":"2023-10-06T01:38:49.521503+0000","last_active":"2023-10-06T01:38:49.527811+0000","last_peered":"2023-10-06T01:38:49.527811+0000","last_clean":"2023-10-06T01:38:49.527811+0000","last_became_active":"2023-10-06T01:38:49.521219+0000","last_became_peered":"2023-10-06T01:38:49.521219+0000","last_unstale":"2023-10-06T01:38:49.527811+0000","last_undegraded":"2023-10-06T01:38:49.527811+0000","last_fullsized":"2023-10-06T01:38:49.527811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:34.443462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531744+0000","last_change":"2023-10-06T01:38:49.522310+0000","last_active":"2023-10-06T01:38:49.531744+0000","last_peered":"2023-10-06T01:38:49.531744+0000","last_clean":"2023-10-06T01:38:49.531744+0000","last_became_active":"2023-10-06T01:38:49.522062+0000","last_became_peered":"2023-10-06T01:38:49.522062+0000","last_unstale":"2023-10-06T01:38:49.531744+0000","last_undegraded":"2023-10-06T01:38:49.531744+0000","last_fullsized":"2023-10-06T01:38:49.531744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:04.188051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532797+0000","last_change":"2023-10-06T01:38:49.527987+0000","last_active":"2023-10-06T01:38:49.532797+0000","last_peered":"2023-10-06T01:38:49.532797+0000","last_clean":"2023-10-06T01:38:49.532797+0000","last_became_active":"2023-10-06T01:38:49.527716+0000","last_became_peered":"2023-10-06T01:38:49.527716+0000","last_unstale":"2023-10-06T01:38:49.532797+0000","last_undegraded":"2023-10-06T01:38:49.532797+0000","last_fullsized":"2023-10-06T01:38:49.532797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:11.839303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526877+0000","last_change":"2023-10-06T01:38:49.519300+0000","last_active":"2023-10-06T01:38:49.526877+0000","last_peered":"2023-10-06T01:38:49.526877+0000","last_clean":"2023-10-06T01:38:49.526877+0000","last_became_active":"2023-10-06T01:38:49.519069+0000","last_became_peered":"2023-10-06T01:38:49.519069+0000","last_unstale":"2023-10-06T01:38:49.526877+0000","last_undegraded":"2023-10-06T01:38:49.526877+0000","last_fullsized":"2023-10-06T01:38:49.526877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:04.140534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527983+0000","last_change":"2023-10-06T01:38:49.526134+0000","last_active":"2023-10-06T01:38:49.527983+0000","last_peered":"2023-10-06T01:38:49.527983+0000","last_clean":"2023-10-06T01:38:49.527983+0000","last_became_active":"2023-10-06T01:38:49.524965+0000","last_became_peered":"2023-10-06T01:38:49.524965+0000","last_unstale":"2023-10-06T01:38:49.527983+0000","last_undegraded":"2023-10-06T01:38:49.527983+0000","last_fullsized":"2023-10-06T01:38:49.527983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:27.359068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":876544,"data_stored":686098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298120,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073720,"statfs":{"total":96636764160,"available":96331489280,"internally_reserved":0,"allocated":851968,"data_stored":684900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297540,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074300,"statfs":{"total":96636764160,"available":96332083200,"internally_reserved":0,"allocated":258048,"data_stored":94068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":95570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":94602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:39:02.710 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:39:02.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.857+0000 7f5c2898b700 1 Processor -- start 2023-10-06T01:39:02.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.857+0000 7f5c2898b700 1 -- start start 2023-10-06T01:39:02.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.858+0000 7f5c2898b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5c240b2980 0x7f5c240cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:02.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.858+0000 7f5c2898b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5c2415a8c0 0x7f5c2406d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:02.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.858+0000 7f5c2898b700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c2406e240 con 0x7f5c2406ddd0 2023-10-06T01:39:02.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.858+0000 7f5c2898b700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c240cec30 con 0x7f5c240b2980 2023-10-06T01:39:02.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.858+0000 7f5c2898b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c240ce930 con 0x7f5c2415a8c0 2023-10-06T01:39:02.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.858+0000 7f5c22d9d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5c240b2980 0x7f5c240cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:02.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.858+0000 7f5c22d9d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5c240b2980 0x7f5c240cce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57142/0 (socket says 172.21.15.69:57142) 2023-10-06T01:39:02.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.858+0000 7f5c22d9d700 1 -- 172.21.15.69:0/931751750 learned_addr learned my addr 172.21.15.69:0/931751750 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:02.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.858+0000 7f5c2259c700 1 --2- 172.21.15.69:0/931751750 >> v2:172.21.15.88:3300/0 conn(0x7f5c2415a8c0 0x7f5c2406d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:02.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.858+0000 7f5c22d9d700 1 -- 172.21.15.69:0/931751750 >> v2:172.21.15.88:3300/0 conn(0x7f5c2415a8c0 msgr2=0x7f5c2406d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:02.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.858+0000 7f5c22d9d700 1 --2- 172.21.15.69:0/931751750 >> v2:172.21.15.88:3300/0 conn(0x7f5c2415a8c0 0x7f5c2406d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.858+0000 7f5c22d9d700 1 -- 172.21.15.69:0/931751750 >> v1:172.21.15.88:6789/0 conn(0x7f5c2406ddd0 legacy=0x7f5c2415d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:02.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.858+0000 7f5c22d9d700 1 -- 172.21.15.69:0/931751750 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c240d00d0 con 0x7f5c240b2980 2023-10-06T01:39:02.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.858+0000 7f5c2259c700 1 --2- 172.21.15.69:0/931751750 >> v2:172.21.15.88:3300/0 conn(0x7f5c2415a8c0 0x7f5c2406d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:02.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.858+0000 7f5c22d9d700 1 --2- 172.21.15.69:0/931751750 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c240b2980 0x7f5c240cce00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5c240b6590 tx=0x7f5c14009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e82bbda6feb5078f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:02.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.858+0000 7f5c21d9b700 1 -- 172.21.15.69:0/931751750 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c1400e070 con 0x7f5c240b2980 2023-10-06T01:39:02.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.859+0000 7f5c21d9b700 1 -- 172.21.15.69:0/931751750 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c1400ba10 con 0x7f5c240b2980 2023-10-06T01:39:02.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.859+0000 7f5c21d9b700 1 -- 172.21.15.69:0/931751750 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c140092e0 con 0x7f5c240b2980 2023-10-06T01:39:02.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.859+0000 7f5c2898b700 1 -- 172.21.15.69:0/931751750 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c240b2980 msgr2=0x7f5c240cce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:02.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.859+0000 7f5c2898b700 1 --2- 172.21.15.69:0/931751750 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c240b2980 0x7f5c240cce00 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f5c240b6590 tx=0x7f5c14009840 comp rx=0 tx=0).stop 2023-10-06T01:39:02.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.859+0000 7f5c2898b700 1 -- 172.21.15.69:0/931751750 shutdown_connections 2023-10-06T01:39:02.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.859+0000 7f5c2898b700 1 --2- 172.21.15.69:0/931751750 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c240b2980 0x7f5c240cce00 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.859+0000 7f5c2898b700 1 --2- 172.21.15.69:0/931751750 >> v2:172.21.15.88:3300/0 conn(0x7f5c2415a8c0 0x7f5c2406d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.859+0000 7f5c2898b700 1 -- 172.21.15.69:0/931751750 >> 172.21.15.69:0/931751750 conn(0x7f5c240703a0 msgr2=0x7f5c240707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:02.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.859+0000 7f5c2898b700 1 -- 172.21.15.69:0/931751750 shutdown_connections 2023-10-06T01:39:02.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.859+0000 7f5c2898b700 1 -- 172.21.15.69:0/931751750 wait complete. 2023-10-06T01:39:02.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.860+0000 7f5c2898b700 1 Processor -- start 2023-10-06T01:39:02.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.860+0000 7f5c2898b700 1 -- start start 2023-10-06T01:39:02.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.861+0000 7f5c2898b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5c2406ddd0 0x7f5c240c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:02.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.861+0000 7f5c2898b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c240b2980 0x7f5c2414e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:02.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.861+0000 7f5c2898b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c2415a8c0 0x7f5c240c7640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:02.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.861+0000 7f5c2898b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c241522e0 con 0x7f5c240b2980 2023-10-06T01:39:02.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.861+0000 7f5c2898b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c240c8410 con 0x7f5c2415a8c0 2023-10-06T01:39:02.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.861+0000 7f5c2898b700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c240b5dc0 con 0x7f5c2406ddd0 2023-10-06T01:39:02.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.861+0000 7f5c2259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c240b2980 0x7f5c2414e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:02.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.861+0000 7f5c2259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c240b2980 0x7f5c2414e6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57154/0 (socket says 172.21.15.69:57154) 2023-10-06T01:39:02.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.861+0000 7f5c2259c700 1 -- 172.21.15.69:0/2142587579 learned_addr learned my addr 172.21.15.69:0/2142587579 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:02.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.861+0000 7f5c22d9d700 1 --2- 172.21.15.69:0/2142587579 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5c2406ddd0 0x7f5c240c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:02.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.861+0000 7f5c2359e700 1 --2- 172.21.15.69:0/2142587579 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c2415a8c0 0x7f5c240c7640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:02.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.861+0000 7f5c2259c700 1 -- 172.21.15.69:0/2142587579 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5c2406ddd0 msgr2=0x7f5c240c96f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:02.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.861+0000 7f5c2259c700 1 --2- 172.21.15.69:0/2142587579 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5c2406ddd0 0x7f5c240c96f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.861+0000 7f5c2259c700 1 -- 172.21.15.69:0/2142587579 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c2415a8c0 msgr2=0x7f5c240c7640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:02.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.861+0000 7f5c2259c700 1 --2- 172.21.15.69:0/2142587579 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c2415a8c0 0x7f5c240c7640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:02.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.861+0000 7f5c2259c700 1 -- 172.21.15.69:0/2142587579 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c14009ae0 con 0x7f5c240b2980 2023-10-06T01:39:02.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.862+0000 7f5c2259c700 1 --2- 172.21.15.69:0/2142587579 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c240b2980 0x7f5c2414e6f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5c1800c850 tx=0x7f5c18008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:02.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.862+0000 7f5c0affd700 1 -- 172.21.15.69:0/2142587579 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c18011600 con 0x7f5c240b2980 2023-10-06T01:39:02.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.862+0000 7f5c0affd700 1 -- 172.21.15.69:0/2142587579 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c18011760 con 0x7f5c240b2980 2023-10-06T01:39:02.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.862+0000 7f5c0affd700 1 -- 172.21.15.69:0/2142587579 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c18011b00 con 0x7f5c240b2980 2023-10-06T01:39:02.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.862+0000 7f5c2898b700 1 -- 172.21.15.69:0/2142587579 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c240b60a0 con 0x7f5c240b2980 2023-10-06T01:39:02.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.862+0000 7f5c2898b700 1 -- 172.21.15.69:0/2142587579 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c24151f70 con 0x7f5c240b2980 2023-10-06T01:39:02.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.863+0000 7f5c2898b700 1 -- 172.21.15.69:0/2142587579 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c24152490 con 0x7f5c240b2980 2023-10-06T01:39:02.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.863+0000 7f5c0affd700 1 -- 172.21.15.69:0/2142587579 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c18018350 con 0x7f5c240b2980 2023-10-06T01:39:02.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.863+0000 7f5c0affd700 1 --2- 172.21.15.69:0/2142587579 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5c10066f30 0x7f5c100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:02.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.863+0000 7f5c0affd700 1 -- 172.21.15.69:0/2142587579 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5c18084530 con 0x7f5c240b2980 2023-10-06T01:39:02.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.864+0000 7f5c22d9d700 1 --2- 172.21.15.69:0/2142587579 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5c10066f30 0x7f5c100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:02.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.864+0000 7f5c22d9d700 1 --2- 172.21.15.69:0/2142587579 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5c10066f30 0x7f5c100693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5c14009880 tx=0x7f5c14017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:02.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:02.868+0000 7f5c0affd700 1 -- 172.21.15.69:0/2142587579 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c24152490 con 0x7f5c240b2980 2023-10-06T01:39:03.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.048+0000 7f5c2898b700 1 -- 172.21.15.69:0/2142587579 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c2404c3c0 con 0x7f5c10066f30 2023-10-06T01:39:03.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.056+0000 7f5c0affd700 1 -- 172.21.15.69:0/2142587579 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286641 (secure 0 0 0) 0x7f5c2404c3c0 con 0x7f5c10066f30 2023-10-06T01:39:03.059 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:03.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.059+0000 7f5c2898b700 1 -- 172.21.15.69:0/2142587579 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5c10066f30 msgr2=0x7f5c100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:03.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.059+0000 7f5c2898b700 1 --2- 172.21.15.69:0/2142587579 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5c10066f30 0x7f5c100693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f5c14009880 tx=0x7f5c14017000 comp rx=0 tx=0).stop 2023-10-06T01:39:03.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.059+0000 7f5c2898b700 1 -- 172.21.15.69:0/2142587579 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c240b2980 msgr2=0x7f5c2414e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:03.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.059+0000 7f5c2898b700 1 --2- 172.21.15.69:0/2142587579 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c240b2980 0x7f5c2414e6f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f5c1800c850 tx=0x7f5c18008040 comp rx=0 tx=0).stop 2023-10-06T01:39:03.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.059+0000 7f5c2898b700 1 -- 172.21.15.69:0/2142587579 shutdown_connections 2023-10-06T01:39:03.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.059+0000 7f5c2898b700 1 --2- 172.21.15.69:0/2142587579 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5c10066f30 0x7f5c100693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.059+0000 7f5c2898b700 1 --2- 172.21.15.69:0/2142587579 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c2415a8c0 0x7f5c240c7640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.059+0000 7f5c2898b700 1 --2- 172.21.15.69:0/2142587579 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5c2406ddd0 0x7f5c240c96f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.059+0000 7f5c2898b700 1 --2- 172.21.15.69:0/2142587579 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c240b2980 0x7f5c2414e6f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.059+0000 7f5c2898b700 1 -- 172.21.15.69:0/2142587579 >> 172.21.15.69:0/2142587579 conn(0x7f5c240703a0 msgr2=0x7f5c240cad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:03.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.059+0000 7f5c2898b700 1 -- 172.21.15.69:0/2142587579 shutdown_connections 2023-10-06T01:39:03.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.059+0000 7f5c2898b700 1 -- 172.21.15.69:0/2142587579 wait complete. 2023-10-06T01:39:03.062 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-10-06T01:39:03.071 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":30,"stamp":"2023-10-06T01:39:02.263462+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381512,"kb_used_data":3208,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593208,"statfs":{"total":773094113280,"available":770655444992,"internally_reserved":0,"allocated":3284992,"data_stored":1937172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.754862"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524056+0000","last_change":"2023-10-06T01:38:49.517903+0000","last_active":"2023-10-06T01:38:49.524056+0000","last_peered":"2023-10-06T01:38:49.524056+0000","last_clean":"2023-10-06T01:38:49.524056+0000","last_became_active":"2023-10-06T01:38:49.517634+0000","last_became_peered":"2023-10-06T01:38:49.517634+0000","last_unstale":"2023-10-06T01:38:49.524056+0000","last_undegraded":"2023-10-06T01:38:49.524056+0000","last_fullsized":"2023-10-06T01:38:49.524056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:04.939212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527124+0000","last_change":"2023-10-06T01:38:49.523256+0000","last_active":"2023-10-06T01:38:49.527124+0000","last_peered":"2023-10-06T01:38:49.527124+0000","last_clean":"2023-10-06T01:38:49.527124+0000","last_became_active":"2023-10-06T01:38:49.522954+0000","last_became_peered":"2023-10-06T01:38:49.522954+0000","last_unstale":"2023-10-06T01:38:49.527124+0000","last_undegraded":"2023-10-06T01:38:49.527124+0000","last_fullsized":"2023-10-06T01:38:49.527124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532807+0000","last_change":"2023-10-06T01:38:49.528144+0000","last_active":"2023-10-06T01:38:49.532807+0000","last_peered":"2023-10-06T01:38:49.532807+0000","last_clean":"2023-10-06T01:38:49.532807+0000","last_became_active":"2023-10-06T01:38:49.527476+0000","last_became_peered":"2023-10-06T01:38:49.527476+0000","last_unstale":"2023-10-06T01:38:49.532807+0000","last_undegraded":"2023-10-06T01:38:49.532807+0000","last_fullsized":"2023-10-06T01:38:49.532807+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:49.294618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.528235+0000","last_change":"2023-10-06T01:38:49.526214+0000","last_active":"2023-10-06T01:38:49.528235+0000","last_peered":"2023-10-06T01:38:49.528235+0000","last_clean":"2023-10-06T01:38:49.528235+0000","last_became_active":"2023-10-06T01:38:49.525926+0000","last_became_peered":"2023-10-06T01:38:49.525926+0000","last_unstale":"2023-10-06T01:38:49.528235+0000","last_undegraded":"2023-10-06T01:38:49.528235+0000","last_fullsized":"2023-10-06T01:38:49.528235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:57:08.899972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524841+0000","last_change":"2023-10-06T01:38:49.522000+0000","last_active":"2023-10-06T01:38:49.524841+0000","last_peered":"2023-10-06T01:38:49.524841+0000","last_clean":"2023-10-06T01:38:49.524841+0000","last_became_active":"2023-10-06T01:38:49.521580+0000","last_became_peered":"2023-10-06T01:38:49.521580+0000","last_unstale":"2023-10-06T01:38:49.524841+0000","last_undegraded":"2023-10-06T01:38:49.524841+0000","last_fullsized":"2023-10-06T01:38:49.524841+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:21.430025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532735+0000","last_change":"2023-10-06T01:38:49.527658+0000","last_active":"2023-10-06T01:38:49.532735+0000","last_peered":"2023-10-06T01:38:49.532735+0000","last_clean":"2023-10-06T01:38:49.532735+0000","last_became_active":"2023-10-06T01:38:49.527109+0000","last_became_peered":"2023-10-06T01:38:49.527109+0000","last_unstale":"2023-10-06T01:38:49.532735+0000","last_undegraded":"2023-10-06T01:38:49.532735+0000","last_fullsized":"2023-10-06T01:38:49.532735+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:09:41.094305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.529246+0000","last_change":"2023-10-06T01:38:49.526274+0000","last_active":"2023-10-06T01:38:49.529246+0000","last_peered":"2023-10-06T01:38:49.529246+0000","last_clean":"2023-10-06T01:38:49.529246+0000","last_became_active":"2023-10-06T01:38:49.526058+0000","last_became_peered":"2023-10-06T01:38:49.526058+0000","last_unstale":"2023-10-06T01:38:49.529246+0000","last_undegraded":"2023-10-06T01:38:49.529246+0000","last_fullsized":"2023-10-06T01:38:49.529246+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.529633+0000","last_change":"2023-10-06T01:38:49.527609+0000","last_active":"2023-10-06T01:38:49.529633+0000","last_peered":"2023-10-06T01:38:49.529633+0000","last_clean":"2023-10-06T01:38:49.529633+0000","last_became_active":"2023-10-06T01:38:49.527309+0000","last_became_peered":"2023-10-06T01:38:49.527309+0000","last_unstale":"2023-10-06T01:38:49.529633+0000","last_undegraded":"2023-10-06T01:38:49.529633+0000","last_fullsized":"2023-10-06T01:38:49.529633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:04.188051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524708+0000","last_change":"2023-10-06T01:38:49.519471+0000","last_active":"2023-10-06T01:38:49.524708+0000","last_peered":"2023-10-06T01:38:49.524708+0000","last_clean":"2023-10-06T01:38:49.524708+0000","last_became_active":"2023-10-06T01:38:49.519232+0000","last_became_peered":"2023-10-06T01:38:49.519232+0000","last_unstale":"2023-10-06T01:38:49.524708+0000","last_undegraded":"2023-10-06T01:38:49.524708+0000","last_fullsized":"2023-10-06T01:38:49.524708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:11.839303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527105+0000","last_change":"2023-10-06T01:38:49.519625+0000","last_active":"2023-10-06T01:38:49.527105+0000","last_peered":"2023-10-06T01:38:49.527105+0000","last_clean":"2023-10-06T01:38:49.527105+0000","last_became_active":"2023-10-06T01:38:49.519350+0000","last_became_peered":"2023-10-06T01:38:49.519350+0000","last_unstale":"2023-10-06T01:38:49.527105+0000","last_undegraded":"2023-10-06T01:38:49.527105+0000","last_fullsized":"2023-10-06T01:38:49.527105+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:21.430025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532757+0000","last_change":"2023-10-06T01:38:49.527759+0000","last_active":"2023-10-06T01:38:49.532757+0000","last_peered":"2023-10-06T01:38:49.532757+0000","last_clean":"2023-10-06T01:38:49.532757+0000","last_became_active":"2023-10-06T01:38:49.527046+0000","last_became_peered":"2023-10-06T01:38:49.527046+0000","last_unstale":"2023-10-06T01:38:49.532757+0000","last_undegraded":"2023-10-06T01:38:49.532757+0000","last_fullsized":"2023-10-06T01:38:49.532757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:04.140534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531758+0000","last_change":"2023-10-06T01:38:49.527553+0000","last_active":"2023-10-06T01:38:49.531758+0000","last_peered":"2023-10-06T01:38:49.531758+0000","last_clean":"2023-10-06T01:38:49.531758+0000","last_became_active":"2023-10-06T01:38:49.527370+0000","last_became_peered":"2023-10-06T01:38:49.527370+0000","last_unstale":"2023-10-06T01:38:49.531758+0000","last_undegraded":"2023-10-06T01:38:49.531758+0000","last_fullsized":"2023-10-06T01:38:49.531758+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:55.861597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.523956+0000","last_change":"2023-10-06T01:38:49.517619+0000","last_active":"2023-10-06T01:38:49.523956+0000","last_peered":"2023-10-06T01:38:49.523956+0000","last_clean":"2023-10-06T01:38:49.523956+0000","last_became_active":"2023-10-06T01:38:49.517323+0000","last_became_peered":"2023-10-06T01:38:49.517323+0000","last_unstale":"2023-10-06T01:38:49.523956+0000","last_undegraded":"2023-10-06T01:38:49.523956+0000","last_fullsized":"2023-10-06T01:38:49.523956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:35.290053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.523783+0000","last_change":"2023-10-06T01:38:49.518132+0000","last_active":"2023-10-06T01:38:49.523783+0000","last_peered":"2023-10-06T01:38:49.523783+0000","last_clean":"2023-10-06T01:38:49.523783+0000","last_became_active":"2023-10-06T01:38:49.517901+0000","last_became_peered":"2023-10-06T01:38:49.517901+0000","last_unstale":"2023-10-06T01:38:49.523783+0000","last_undegraded":"2023-10-06T01:38:49.523783+0000","last_fullsized":"2023-10-06T01:38:49.523783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:57.306692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.529431+0000","last_change":"2023-10-06T01:38:49.526480+0000","last_active":"2023-10-06T01:38:49.529431+0000","last_peered":"2023-10-06T01:38:49.529431+0000","last_clean":"2023-10-06T01:38:49.529431+0000","last_became_active":"2023-10-06T01:38:49.526183+0000","last_became_peered":"2023-10-06T01:38:49.526183+0000","last_unstale":"2023-10-06T01:38:49.529431+0000","last_undegraded":"2023-10-06T01:38:49.529431+0000","last_fullsized":"2023-10-06T01:38:49.529431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:57.306692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.528330+0000","last_change":"2023-10-06T01:38:49.525375+0000","last_active":"2023-10-06T01:38:49.528330+0000","last_peered":"2023-10-06T01:38:49.528330+0000","last_clean":"2023-10-06T01:38:49.528330+0000","last_became_active":"2023-10-06T01:38:49.525091+0000","last_became_peered":"2023-10-06T01:38:49.525091+0000","last_unstale":"2023-10-06T01:38:49.528330+0000","last_undegraded":"2023-10-06T01:38:49.528330+0000","last_fullsized":"2023-10-06T01:38:49.528330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:44.668443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524727+0000","last_change":"2023-10-06T01:38:49.520872+0000","last_active":"2023-10-06T01:38:49.524727+0000","last_peered":"2023-10-06T01:38:49.524727+0000","last_clean":"2023-10-06T01:38:49.524727+0000","last_became_active":"2023-10-06T01:38:49.520588+0000","last_became_peered":"2023-10-06T01:38:49.520588+0000","last_unstale":"2023-10-06T01:38:49.524727+0000","last_undegraded":"2023-10-06T01:38:49.524727+0000","last_fullsized":"2023-10-06T01:38:49.524727+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:57.494182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532943+0000","last_change":"2023-10-06T01:38:49.528700+0000","last_active":"2023-10-06T01:38:49.532943+0000","last_peered":"2023-10-06T01:38:49.532943+0000","last_clean":"2023-10-06T01:38:49.532943+0000","last_became_active":"2023-10-06T01:38:49.527947+0000","last_became_peered":"2023-10-06T01:38:49.527947+0000","last_unstale":"2023-10-06T01:38:49.532943+0000","last_undegraded":"2023-10-06T01:38:49.532943+0000","last_fullsized":"2023-10-06T01:38:49.532943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:48:22.289895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.528863+0000","last_change":"2023-10-06T01:38:49.524738+0000","last_active":"2023-10-06T01:38:49.528863+0000","last_peered":"2023-10-06T01:38:49.528863+0000","last_clean":"2023-10-06T01:38:49.528863+0000","last_became_active":"2023-10-06T01:38:49.524478+0000","last_became_peered":"2023-10-06T01:38:49.524478+0000","last_unstale":"2023-10-06T01:38:49.528863+0000","last_undegraded":"2023-10-06T01:38:49.528863+0000","last_fullsized":"2023-10-06T01:38:49.528863+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:05.235173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533032+0000","last_change":"2023-10-06T01:38:49.528930+0000","last_active":"2023-10-06T01:38:49.533032+0000","last_peered":"2023-10-06T01:38:49.533032+0000","last_clean":"2023-10-06T01:38:49.533032+0000","last_became_active":"2023-10-06T01:38:49.528446+0000","last_became_peered":"2023-10-06T01:38:49.528446+0000","last_unstale":"2023-10-06T01:38:49.533032+0000","last_undegraded":"2023-10-06T01:38:49.533032+0000","last_fullsized":"2023-10-06T01:38:49.533032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:58.019042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532838+0000","last_change":"2023-10-06T01:38:49.530433+0000","last_active":"2023-10-06T01:38:49.532838+0000","last_peered":"2023-10-06T01:38:49.532838+0000","last_clean":"2023-10-06T01:38:49.532838+0000","last_became_active":"2023-10-06T01:38:49.530161+0000","last_became_peered":"2023-10-06T01:38:49.530161+0000","last_unstale":"2023-10-06T01:38:49.532838+0000","last_undegraded":"2023-10-06T01:38:49.532838+0000","last_fullsized":"2023-10-06T01:38:49.532838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:38:23.293524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526894+0000","last_change":"2023-10-06T01:38:49.523986+0000","last_active":"2023-10-06T01:38:49.526894+0000","last_peered":"2023-10-06T01:38:49.526894+0000","last_clean":"2023-10-06T01:38:49.526894+0000","last_became_active":"2023-10-06T01:38:49.523736+0000","last_became_peered":"2023-10-06T01:38:49.523736+0000","last_unstale":"2023-10-06T01:38:49.526894+0000","last_undegraded":"2023-10-06T01:38:49.526894+0000","last_fullsized":"2023-10-06T01:38:49.526894+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:57.306692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526902+0000","last_change":"2023-10-06T01:38:49.517570+0000","last_active":"2023-10-06T01:38:49.526902+0000","last_peered":"2023-10-06T01:38:49.526902+0000","last_clean":"2023-10-06T01:38:49.526902+0000","last_became_active":"2023-10-06T01:38:49.517319+0000","last_became_peered":"2023-10-06T01:38:49.517319+0000","last_unstale":"2023-10-06T01:38:49.526902+0000","last_undegraded":"2023-10-06T01:38:49.526902+0000","last_fullsized":"2023-10-06T01:38:49.526902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:22.060988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.529224+0000","last_change":"2023-10-06T01:38:49.524486+0000","last_active":"2023-10-06T01:38:49.529224+0000","last_peered":"2023-10-06T01:38:49.529224+0000","last_clean":"2023-10-06T01:38:49.529224+0000","last_became_active":"2023-10-06T01:38:49.524244+0000","last_became_peered":"2023-10-06T01:38:49.524244+0000","last_unstale":"2023-10-06T01:38:49.529224+0000","last_undegraded":"2023-10-06T01:38:49.529224+0000","last_fullsized":"2023-10-06T01:38:49.529224+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:22.814342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.525649+0000","last_change":"2023-10-06T01:38:49.521288+0000","last_active":"2023-10-06T01:38:49.525649+0000","last_peered":"2023-10-06T01:38:49.525649+0000","last_clean":"2023-10-06T01:38:49.525649+0000","last_became_active":"2023-10-06T01:38:49.520995+0000","last_became_peered":"2023-10-06T01:38:49.520995+0000","last_unstale":"2023-10-06T01:38:49.525649+0000","last_undegraded":"2023-10-06T01:38:49.525649+0000","last_fullsized":"2023-10-06T01:38:49.525649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:37:06.793193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.525993+0000","last_change":"2023-10-06T01:38:49.521528+0000","last_active":"2023-10-06T01:38:49.525993+0000","last_peered":"2023-10-06T01:38:49.525993+0000","last_clean":"2023-10-06T01:38:49.525993+0000","last_became_active":"2023-10-06T01:38:49.520274+0000","last_became_peered":"2023-10-06T01:38:49.520274+0000","last_unstale":"2023-10-06T01:38:49.525993+0000","last_undegraded":"2023-10-06T01:38:49.525993+0000","last_fullsized":"2023-10-06T01:38:49.525993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:31:19.856103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527242+0000","last_change":"2023-10-06T01:38:49.519548+0000","last_active":"2023-10-06T01:38:49.527242+0000","last_peered":"2023-10-06T01:38:49.527242+0000","last_clean":"2023-10-06T01:38:49.527242+0000","last_became_active":"2023-10-06T01:38:49.519249+0000","last_became_peered":"2023-10-06T01:38:49.519249+0000","last_unstale":"2023-10-06T01:38:49.527242+0000","last_undegraded":"2023-10-06T01:38:49.527242+0000","last_fullsized":"2023-10-06T01:38:49.527242+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:57.494182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.656554+0000","last_change":"2023-10-06T01:38:48.666150+0000","last_active":"2023-10-06T01:38:49.656554+0000","last_peered":"2023-10-06T01:38:49.656554+0000","last_clean":"2023-10-06T01:38:49.656554+0000","last_became_active":"2023-10-06T01:38:48.663061+0000","last_became_peered":"2023-10-06T01:38:48.663061+0000","last_unstale":"2023-10-06T01:38:49.656554+0000","last_undegraded":"2023-10-06T01:38:49.656554+0000","last_fullsized":"2023-10-06T01:38:49.656554+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:07:41.517375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531425+0000","last_change":"2023-10-06T01:38:49.520719+0000","last_active":"2023-10-06T01:38:49.531425+0000","last_peered":"2023-10-06T01:38:49.531425+0000","last_clean":"2023-10-06T01:38:49.531425+0000","last_became_active":"2023-10-06T01:38:49.520470+0000","last_became_peered":"2023-10-06T01:38:49.520470+0000","last_unstale":"2023-10-06T01:38:49.531425+0000","last_undegraded":"2023-10-06T01:38:49.531425+0000","last_fullsized":"2023-10-06T01:38:49.531425+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:11.839303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515999+0000","last_change":"2023-10-06T01:38:48.666186+0000","last_active":"2023-10-06T01:38:49.515999+0000","last_peered":"2023-10-06T01:38:49.515999+0000","last_clean":"2023-10-06T01:38:49.515999+0000","last_became_active":"2023-10-06T01:38:48.665875+0000","last_became_peered":"2023-10-06T01:38:48.665875+0000","last_unstale":"2023-10-06T01:38:49.515999+0000","last_undegraded":"2023-10-06T01:38:49.515999+0000","last_fullsized":"2023-10-06T01:38:49.515999+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:09.299545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524755+0000","last_change":"2023-10-06T01:38:49.518381+0000","last_active":"2023-10-06T01:38:49.524755+0000","last_peered":"2023-10-06T01:38:49.524755+0000","last_clean":"2023-10-06T01:38:49.524755+0000","last_became_active":"2023-10-06T01:38:49.518041+0000","last_became_peered":"2023-10-06T01:38:49.518041+0000","last_unstale":"2023-10-06T01:38:49.524755+0000","last_undegraded":"2023-10-06T01:38:49.524755+0000","last_fullsized":"2023-10-06T01:38:49.524755+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.508966+0000","last_change":"2023-10-06T01:38:48.665041+0000","last_active":"2023-10-06T01:38:49.508966+0000","last_peered":"2023-10-06T01:38:49.508966+0000","last_clean":"2023-10-06T01:38:49.508966+0000","last_became_active":"2023-10-06T01:38:48.664783+0000","last_became_peered":"2023-10-06T01:38:48.664783+0000","last_unstale":"2023-10-06T01:38:49.508966+0000","last_undegraded":"2023-10-06T01:38:49.508966+0000","last_fullsized":"2023-10-06T01:38:49.508966+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:52.982952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.528203+0000","last_change":"2023-10-06T01:38:49.524574+0000","last_active":"2023-10-06T01:38:49.528203+0000","last_peered":"2023-10-06T01:38:49.528203+0000","last_clean":"2023-10-06T01:38:49.528203+0000","last_became_active":"2023-10-06T01:38:49.524266+0000","last_became_peered":"2023-10-06T01:38:49.524266+0000","last_unstale":"2023-10-06T01:38:49.528203+0000","last_undegraded":"2023-10-06T01:38:49.528203+0000","last_fullsized":"2023-10-06T01:38:49.528203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:27.853451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.512647+0000","last_change":"2023-10-06T01:38:48.662259+0000","last_active":"2023-10-06T01:38:49.512647+0000","last_peered":"2023-10-06T01:38:49.512647+0000","last_clean":"2023-10-06T01:38:49.512647+0000","last_became_active":"2023-10-06T01:38:48.661993+0000","last_became_peered":"2023-10-06T01:38:48.661993+0000","last_unstale":"2023-10-06T01:38:49.512647+0000","last_undegraded":"2023-10-06T01:38:49.512647+0000","last_fullsized":"2023-10-06T01:38:49.512647+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:04.233408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526872+0000","last_change":"2023-10-06T01:38:49.518829+0000","last_active":"2023-10-06T01:38:49.526872+0000","last_peered":"2023-10-06T01:38:49.526872+0000","last_clean":"2023-10-06T01:38:49.526872+0000","last_became_active":"2023-10-06T01:38:49.517297+0000","last_became_peered":"2023-10-06T01:38:49.517297+0000","last_unstale":"2023-10-06T01:38:49.526872+0000","last_undegraded":"2023-10-06T01:38:49.526872+0000","last_fullsized":"2023-10-06T01:38:49.526872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.513481+0000","last_change":"2023-10-06T01:38:48.662679+0000","last_active":"2023-10-06T01:38:49.513481+0000","last_peered":"2023-10-06T01:38:49.513481+0000","last_clean":"2023-10-06T01:38:49.513481+0000","last_became_active":"2023-10-06T01:38:48.662335+0000","last_became_peered":"2023-10-06T01:38:48.662335+0000","last_unstale":"2023-10-06T01:38:49.513481+0000","last_undegraded":"2023-10-06T01:38:49.513481+0000","last_fullsized":"2023-10-06T01:38:49.513481+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:52.982952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526925+0000","last_change":"2023-10-06T01:38:49.518684+0000","last_active":"2023-10-06T01:38:49.526925+0000","last_peered":"2023-10-06T01:38:49.526925+0000","last_clean":"2023-10-06T01:38:49.526925+0000","last_became_active":"2023-10-06T01:38:49.518436+0000","last_became_peered":"2023-10-06T01:38:49.518436+0000","last_unstale":"2023-10-06T01:38:49.526925+0000","last_undegraded":"2023-10-06T01:38:49.526925+0000","last_fullsized":"2023-10-06T01:38:49.526925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:42.707474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"23'3","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.659791+0000","last_change":"2023-10-06T01:38:48.667307+0000","last_active":"2023-10-06T01:38:49.659791+0000","last_peered":"2023-10-06T01:38:49.659791+0000","last_clean":"2023-10-06T01:38:49.659791+0000","last_became_active":"2023-10-06T01:38:48.667032+0000","last_became_peered":"2023-10-06T01:38:48.667032+0000","last_unstale":"2023-10-06T01:38:49.659791+0000","last_undegraded":"2023-10-06T01:38:49.659791+0000","last_fullsized":"2023-10-06T01:38:49.659791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:34:26.851686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527967+0000","last_change":"2023-10-06T01:38:49.525949+0000","last_active":"2023-10-06T01:38:49.527967+0000","last_peered":"2023-10-06T01:38:49.527967+0000","last_clean":"2023-10-06T01:38:49.527967+0000","last_became_active":"2023-10-06T01:38:49.525063+0000","last_became_peered":"2023-10-06T01:38:49.525063+0000","last_unstale":"2023-10-06T01:38:49.527967+0000","last_undegraded":"2023-10-06T01:38:49.527967+0000","last_fullsized":"2023-10-06T01:38:49.527967+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:31.040385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"23'6","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.659104+0000","last_change":"2023-10-06T01:38:48.666319+0000","last_active":"2023-10-06T01:38:49.659104+0000","last_peered":"2023-10-06T01:38:49.659104+0000","last_clean":"2023-10-06T01:38:49.659104+0000","last_became_active":"2023-10-06T01:38:48.666058+0000","last_became_peered":"2023-10-06T01:38:48.666058+0000","last_unstale":"2023-10-06T01:38:49.659104+0000","last_undegraded":"2023-10-06T01:38:49.659104+0000","last_fullsized":"2023-10-06T01:38:49.659104+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:09.299545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532960+0000","last_change":"2023-10-06T01:38:49.528713+0000","last_active":"2023-10-06T01:38:49.532960+0000","last_peered":"2023-10-06T01:38:49.532960+0000","last_clean":"2023-10-06T01:38:49.532960+0000","last_became_active":"2023-10-06T01:38:49.528396+0000","last_became_peered":"2023-10-06T01:38:49.528396+0000","last_unstale":"2023-10-06T01:38:49.532960+0000","last_undegraded":"2023-10-06T01:38:49.532960+0000","last_fullsized":"2023-10-06T01:38:49.532960+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:22.060988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.13","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.657311+0000","last_change":"2023-10-06T01:38:48.669666+0000","last_active":"2023-10-06T01:38:49.657311+0000","last_peered":"2023-10-06T01:38:49.657311+0000","last_clean":"2023-10-06T01:38:49.657311+0000","last_became_active":"2023-10-06T01:38:48.669403+0000","last_became_peered":"2023-10-06T01:38:48.669403+0000","last_unstale":"2023-10-06T01:38:49.657311+0000","last_undegraded":"2023-10-06T01:38:49.657311+0000","last_fullsized":"2023-10-06T01:38:49.657311+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:11.825838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531689+0000","last_change":"2023-10-06T01:38:49.522550+0000","last_active":"2023-10-06T01:38:49.531689+0000","last_peered":"2023-10-06T01:38:49.531689+0000","last_clean":"2023-10-06T01:38:49.531689+0000","last_became_active":"2023-10-06T01:38:49.521718+0000","last_became_peered":"2023-10-06T01:38:49.521718+0000","last_unstale":"2023-10-06T01:38:49.531689+0000","last_undegraded":"2023-10-06T01:38:49.531689+0000","last_fullsized":"2023-10-06T01:38:49.531689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:38:23.293524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.512791+0000","last_change":"2023-10-06T01:38:48.657883+0000","last_active":"2023-10-06T01:38:49.512791+0000","last_peered":"2023-10-06T01:38:49.512791+0000","last_clean":"2023-10-06T01:38:49.512791+0000","last_became_active":"2023-10-06T01:38:48.656431+0000","last_became_peered":"2023-10-06T01:38:48.656431+0000","last_unstale":"2023-10-06T01:38:49.512791+0000","last_undegraded":"2023-10-06T01:38:49.512791+0000","last_fullsized":"2023-10-06T01:38:49.512791+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:52.982952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.523875+0000","last_change":"2023-10-06T01:38:49.516970+0000","last_active":"2023-10-06T01:38:49.523875+0000","last_peered":"2023-10-06T01:38:49.523875+0000","last_clean":"2023-10-06T01:38:49.523875+0000","last_became_active":"2023-10-06T01:38:49.516721+0000","last_became_peered":"2023-10-06T01:38:49.516721+0000","last_unstale":"2023-10-06T01:38:49.523875+0000","last_undegraded":"2023-10-06T01:38:49.523875+0000","last_fullsized":"2023-10-06T01:38:49.523875+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:38:23.293524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.514766+0000","last_change":"2023-10-06T01:38:48.667484+0000","last_active":"2023-10-06T01:38:49.514766+0000","last_peered":"2023-10-06T01:38:49.514766+0000","last_clean":"2023-10-06T01:38:49.514766+0000","last_became_active":"2023-10-06T01:38:48.667215+0000","last_became_peered":"2023-10-06T01:38:48.667215+0000","last_unstale":"2023-10-06T01:38:49.514766+0000","last_undegraded":"2023-10-06T01:38:49.514766+0000","last_fullsized":"2023-10-06T01:38:49.514766+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:57:07.898207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526925+0000","last_change":"2023-10-06T01:38:49.523815+0000","last_active":"2023-10-06T01:38:49.526925+0000","last_peered":"2023-10-06T01:38:49.526925+0000","last_clean":"2023-10-06T01:38:49.526925+0000","last_became_active":"2023-10-06T01:38:49.520967+0000","last_became_peered":"2023-10-06T01:38:49.520967+0000","last_unstale":"2023-10-06T01:38:49.526925+0000","last_undegraded":"2023-10-06T01:38:49.526925+0000","last_fullsized":"2023-10-06T01:38:49.526925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:04.188051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"23'8","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.659578+0000","last_change":"2023-10-06T01:38:48.665231+0000","last_active":"2023-10-06T01:38:49.659578+0000","last_peered":"2023-10-06T01:38:49.659578+0000","last_clean":"2023-10-06T01:38:49.659578+0000","last_became_active":"2023-10-06T01:38:48.664910+0000","last_became_peered":"2023-10-06T01:38:48.664910+0000","last_unstale":"2023-10-06T01:38:49.659578+0000","last_undegraded":"2023-10-06T01:38:49.659578+0000","last_fullsized":"2023-10-06T01:38:49.659578+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:06:50.373603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526858+0000","last_change":"2023-10-06T01:38:49.519035+0000","last_active":"2023-10-06T01:38:49.526858+0000","last_peered":"2023-10-06T01:38:49.526858+0000","last_clean":"2023-10-06T01:38:49.526858+0000","last_became_active":"2023-10-06T01:38:49.518788+0000","last_became_peered":"2023-10-06T01:38:49.518788+0000","last_unstale":"2023-10-06T01:38:49.526858+0000","last_undegraded":"2023-10-06T01:38:49.526858+0000","last_fullsized":"2023-10-06T01:38:49.526858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:21.430025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.656778+0000","last_change":"2023-10-06T01:38:48.669414+0000","last_active":"2023-10-06T01:38:49.656778+0000","last_peered":"2023-10-06T01:38:49.656778+0000","last_clean":"2023-10-06T01:38:49.656778+0000","last_became_active":"2023-10-06T01:38:48.669152+0000","last_became_peered":"2023-10-06T01:38:48.669152+0000","last_unstale":"2023-10-06T01:38:49.656778+0000","last_undegraded":"2023-10-06T01:38:49.656778+0000","last_fullsized":"2023-10-06T01:38:49.656778+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:31.036573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.523629+0000","last_change":"2023-10-06T01:38:49.515615+0000","last_active":"2023-10-06T01:38:49.523629+0000","last_peered":"2023-10-06T01:38:49.523629+0000","last_clean":"2023-10-06T01:38:49.523629+0000","last_became_active":"2023-10-06T01:38:49.515307+0000","last_became_peered":"2023-10-06T01:38:49.515307+0000","last_unstale":"2023-10-06T01:38:49.523629+0000","last_undegraded":"2023-10-06T01:38:49.523629+0000","last_fullsized":"2023-10-06T01:38:49.523629+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:58:31.040385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.657257+0000","last_change":"2023-10-06T01:38:48.669339+0000","last_active":"2023-10-06T01:38:49.657257+0000","last_peered":"2023-10-06T01:38:49.657257+0000","last_clean":"2023-10-06T01:38:49.657257+0000","last_became_active":"2023-10-06T01:38:48.668855+0000","last_became_peered":"2023-10-06T01:38:48.668855+0000","last_unstale":"2023-10-06T01:38:49.657257+0000","last_undegraded":"2023-10-06T01:38:49.657257+0000","last_fullsized":"2023-10-06T01:38:49.657257+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:33.441697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533008+0000","last_change":"2023-10-06T01:38:49.528804+0000","last_active":"2023-10-06T01:38:49.533008+0000","last_peered":"2023-10-06T01:38:49.533008+0000","last_clean":"2023-10-06T01:38:49.533008+0000","last_became_active":"2023-10-06T01:38:49.528188+0000","last_became_peered":"2023-10-06T01:38:49.528188+0000","last_unstale":"2023-10-06T01:38:49.533008+0000","last_undegraded":"2023-10-06T01:38:49.533008+0000","last_fullsized":"2023-10-06T01:38:49.533008+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:37:42.707474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.656825+0000","last_change":"2023-10-06T01:38:48.662704+0000","last_active":"2023-10-06T01:38:49.656825+0000","last_peered":"2023-10-06T01:38:49.656825+0000","last_clean":"2023-10-06T01:38:49.656825+0000","last_became_active":"2023-10-06T01:38:48.662445+0000","last_became_peered":"2023-10-06T01:38:48.662445+0000","last_unstale":"2023-10-06T01:38:49.656825+0000","last_undegraded":"2023-10-06T01:38:49.656825+0000","last_fullsized":"2023-10-06T01:38:49.656825+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:21:02.893859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.529784+0000","last_change":"2023-10-06T01:38:49.524878+0000","last_active":"2023-10-06T01:38:49.529784+0000","last_peered":"2023-10-06T01:38:49.529784+0000","last_clean":"2023-10-06T01:38:49.529784+0000","last_became_active":"2023-10-06T01:38:49.524606+0000","last_became_peered":"2023-10-06T01:38:49.524606+0000","last_unstale":"2023-10-06T01:38:49.529784+0000","last_undegraded":"2023-10-06T01:38:49.529784+0000","last_fullsized":"2023-10-06T01:38:49.529784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:32.038338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.513006+0000","last_change":"2023-10-06T01:38:48.669114+0000","last_active":"2023-10-06T01:38:49.513006+0000","last_peered":"2023-10-06T01:38:49.513006+0000","last_clean":"2023-10-06T01:38:49.513006+0000","last_became_active":"2023-10-06T01:38:48.668855+0000","last_became_peered":"2023-10-06T01:38:48.668855+0000","last_unstale":"2023-10-06T01:38:49.513006+0000","last_undegraded":"2023-10-06T01:38:49.513006+0000","last_fullsized":"2023-10-06T01:38:49.513006+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:04.233408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524798+0000","last_change":"2023-10-06T01:38:49.521828+0000","last_active":"2023-10-06T01:38:49.524798+0000","last_peered":"2023-10-06T01:38:49.524798+0000","last_clean":"2023-10-06T01:38:49.524798+0000","last_became_active":"2023-10-06T01:38:49.521245+0000","last_became_peered":"2023-10-06T01:38:49.521245+0000","last_unstale":"2023-10-06T01:38:49.524798+0000","last_undegraded":"2023-10-06T01:38:49.524798+0000","last_fullsized":"2023-10-06T01:38:49.524798+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:22.814342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.654286+0000","last_change":"2023-10-06T01:38:48.665908+0000","last_active":"2023-10-06T01:38:49.654286+0000","last_peered":"2023-10-06T01:38:49.654286+0000","last_clean":"2023-10-06T01:38:49.654286+0000","last_became_active":"2023-10-06T01:38:48.665663+0000","last_became_peered":"2023-10-06T01:38:48.665663+0000","last_unstale":"2023-10-06T01:38:49.654286+0000","last_undegraded":"2023-10-06T01:38:49.654286+0000","last_fullsized":"2023-10-06T01:38:49.654286+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:17:04.233408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533179+0000","last_change":"2023-10-06T01:38:49.532282+0000","last_active":"2023-10-06T01:38:49.533179+0000","last_peered":"2023-10-06T01:38:49.533179+0000","last_clean":"2023-10-06T01:38:49.533179+0000","last_became_active":"2023-10-06T01:38:49.532000+0000","last_became_peered":"2023-10-06T01:38:49.532000+0000","last_unstale":"2023-10-06T01:38:49.533179+0000","last_undegraded":"2023-10-06T01:38:49.533179+0000","last_fullsized":"2023-10-06T01:38:49.533179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:43.950553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.517541+0000","last_change":"2023-10-06T01:38:48.668151+0000","last_active":"2023-10-06T01:38:49.517541+0000","last_peered":"2023-10-06T01:38:49.517541+0000","last_clean":"2023-10-06T01:38:49.517541+0000","last_became_active":"2023-10-06T01:38:48.667870+0000","last_became_peered":"2023-10-06T01:38:48.667870+0000","last_unstale":"2023-10-06T01:38:49.517541+0000","last_undegraded":"2023-10-06T01:38:49.517541+0000","last_fullsized":"2023-10-06T01:38:49.517541+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:07:41.517375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532859+0000","last_change":"2023-10-06T01:38:49.528292+0000","last_active":"2023-10-06T01:38:49.532859+0000","last_peered":"2023-10-06T01:38:49.532859+0000","last_clean":"2023-10-06T01:38:49.532859+0000","last_became_active":"2023-10-06T01:38:49.527980+0000","last_became_peered":"2023-10-06T01:38:49.527980+0000","last_unstale":"2023-10-06T01:38:49.532859+0000","last_undegraded":"2023-10-06T01:38:49.532859+0000","last_fullsized":"2023-10-06T01:38:49.532859+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:33:24.795745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.521291+0000","last_change":"2023-10-06T01:38:48.659921+0000","last_active":"2023-10-06T01:38:49.521291+0000","last_peered":"2023-10-06T01:38:49.521291+0000","last_clean":"2023-10-06T01:38:49.521291+0000","last_became_active":"2023-10-06T01:38:48.659640+0000","last_became_peered":"2023-10-06T01:38:48.659640+0000","last_unstale":"2023-10-06T01:38:49.521291+0000","last_undegraded":"2023-10-06T01:38:49.521291+0000","last_fullsized":"2023-10-06T01:38:49.521291+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:03.937447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533026+0000","last_change":"2023-10-06T01:38:49.528830+0000","last_active":"2023-10-06T01:38:49.533026+0000","last_peered":"2023-10-06T01:38:49.533026+0000","last_clean":"2023-10-06T01:38:49.533026+0000","last_became_active":"2023-10-06T01:38:49.528523+0000","last_became_peered":"2023-10-06T01:38:49.528523+0000","last_unstale":"2023-10-06T01:38:49.533026+0000","last_undegraded":"2023-10-06T01:38:49.533026+0000","last_fullsized":"2023-10-06T01:38:49.533026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:04.188051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.508523+0000","last_change":"2023-10-06T01:38:48.661605+0000","last_active":"2023-10-06T01:38:49.508523+0000","last_peered":"2023-10-06T01:38:49.508523+0000","last_clean":"2023-10-06T01:38:49.508523+0000","last_became_active":"2023-10-06T01:38:48.661424+0000","last_became_peered":"2023-10-06T01:38:48.661424+0000","last_unstale":"2023-10-06T01:38:49.508523+0000","last_undegraded":"2023-10-06T01:38:49.508523+0000","last_fullsized":"2023-10-06T01:38:49.508523+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:34.288288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526228+0000","last_change":"2023-10-06T01:38:49.524678+0000","last_active":"2023-10-06T01:38:49.526228+0000","last_peered":"2023-10-06T01:38:49.526228+0000","last_clean":"2023-10-06T01:38:49.526228+0000","last_became_active":"2023-10-06T01:38:49.522598+0000","last_became_peered":"2023-10-06T01:38:49.522598+0000","last_unstale":"2023-10-06T01:38:49.526228+0000","last_undegraded":"2023-10-06T01:38:49.526228+0000","last_fullsized":"2023-10-06T01:38:49.526228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515842+0000","last_change":"2023-10-06T01:38:44.533111+0000","last_active":"2023-10-06T01:38:49.515842+0000","last_peered":"2023-10-06T01:38:49.515842+0000","last_clean":"2023-10-06T01:38:49.515842+0000","last_became_active":"2023-10-06T01:38:44.532838+0000","last_became_peered":"2023-10-06T01:38:44.532838+0000","last_unstale":"2023-10-06T01:38:49.515842+0000","last_undegraded":"2023-10-06T01:38:49.515842+0000","last_fullsized":"2023-10-06T01:38:49.515842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.513492+0000","last_change":"2023-10-06T01:38:48.666716+0000","last_active":"2023-10-06T01:38:49.513492+0000","last_peered":"2023-10-06T01:38:49.513492+0000","last_clean":"2023-10-06T01:38:49.513492+0000","last_became_active":"2023-10-06T01:38:48.666431+0000","last_became_peered":"2023-10-06T01:38:48.666431+0000","last_unstale":"2023-10-06T01:38:49.513492+0000","last_undegraded":"2023-10-06T01:38:49.513492+0000","last_fullsized":"2023-10-06T01:38:49.513492+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:33.441697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526310+0000","last_change":"2023-10-06T01:38:49.524629+0000","last_active":"2023-10-06T01:38:49.526310+0000","last_peered":"2023-10-06T01:38:49.526310+0000","last_clean":"2023-10-06T01:38:49.526310+0000","last_became_active":"2023-10-06T01:38:49.524372+0000","last_became_peered":"2023-10-06T01:38:49.524372+0000","last_unstale":"2023-10-06T01:38:49.526310+0000","last_undegraded":"2023-10-06T01:38:49.526310+0000","last_fullsized":"2023-10-06T01:38:49.526310+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:22.814342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.512226+0000","last_change":"2023-10-06T01:38:44.533897+0000","last_active":"2023-10-06T01:38:49.512226+0000","last_peered":"2023-10-06T01:38:49.512226+0000","last_clean":"2023-10-06T01:38:49.512226+0000","last_became_active":"2023-10-06T01:38:44.533611+0000","last_became_peered":"2023-10-06T01:38:44.533611+0000","last_unstale":"2023-10-06T01:38:49.512226+0000","last_undegraded":"2023-10-06T01:38:49.512226+0000","last_fullsized":"2023-10-06T01:38:49.512226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:24.411408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.520109+0000","last_change":"2023-10-06T01:38:48.666784+0000","last_active":"2023-10-06T01:38:49.520109+0000","last_peered":"2023-10-06T01:38:49.520109+0000","last_clean":"2023-10-06T01:38:49.520109+0000","last_became_active":"2023-10-06T01:38:48.666228+0000","last_became_peered":"2023-10-06T01:38:48.666228+0000","last_unstale":"2023-10-06T01:38:49.520109+0000","last_undegraded":"2023-10-06T01:38:49.520109+0000","last_fullsized":"2023-10-06T01:38:49.520109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:34.288288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526238+0000","last_change":"2023-10-06T01:38:49.520640+0000","last_active":"2023-10-06T01:38:49.526238+0000","last_peered":"2023-10-06T01:38:49.526238+0000","last_clean":"2023-10-06T01:38:49.526238+0000","last_became_active":"2023-10-06T01:38:49.520050+0000","last_became_peered":"2023-10-06T01:38:49.520050+0000","last_unstale":"2023-10-06T01:38:49.526238+0000","last_undegraded":"2023-10-06T01:38:49.526238+0000","last_fullsized":"2023-10-06T01:38:49.526238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:27.494951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.513741+0000","last_change":"2023-10-06T01:38:45.307814+0000","last_active":"2023-10-06T01:38:49.513741+0000","last_peered":"2023-10-06T01:38:49.513741+0000","last_clean":"2023-10-06T01:38:49.513741+0000","last_became_active":"2023-10-06T01:38:45.307536+0000","last_became_peered":"2023-10-06T01:38:45.307536+0000","last_unstale":"2023-10-06T01:38:49.513741+0000","last_undegraded":"2023-10-06T01:38:49.513741+0000","last_fullsized":"2023-10-06T01:38:49.513741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:09.503713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515587+0000","last_change":"2023-10-06T01:38:48.656055+0000","last_active":"2023-10-06T01:38:49.515587+0000","last_peered":"2023-10-06T01:38:49.515587+0000","last_clean":"2023-10-06T01:38:49.515587+0000","last_became_active":"2023-10-06T01:38:48.655769+0000","last_became_peered":"2023-10-06T01:38:48.655769+0000","last_unstale":"2023-10-06T01:38:49.515587+0000","last_undegraded":"2023-10-06T01:38:49.515587+0000","last_fullsized":"2023-10-06T01:38:49.515587+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:34.288288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527622+0000","last_change":"2023-10-06T01:38:49.524773+0000","last_active":"2023-10-06T01:38:49.527622+0000","last_peered":"2023-10-06T01:38:49.527622+0000","last_clean":"2023-10-06T01:38:49.527622+0000","last_became_active":"2023-10-06T01:38:49.524515+0000","last_became_peered":"2023-10-06T01:38:49.524515+0000","last_unstale":"2023-10-06T01:38:49.527622+0000","last_undegraded":"2023-10-06T01:38:49.527622+0000","last_fullsized":"2023-10-06T01:38:49.527622+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:52:57.306692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.512742+0000","last_change":"2023-10-06T01:38:44.534507+0000","last_active":"2023-10-06T01:38:49.512742+0000","last_peered":"2023-10-06T01:38:49.512742+0000","last_clean":"2023-10-06T01:38:49.512742+0000","last_became_active":"2023-10-06T01:38:44.534191+0000","last_became_peered":"2023-10-06T01:38:44.534191+0000","last_unstale":"2023-10-06T01:38:49.512742+0000","last_undegraded":"2023-10-06T01:38:49.512742+0000","last_fullsized":"2023-10-06T01:38:49.512742+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":166,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.514777+0000","last_change":"2023-10-06T01:38:40.115117+0000","last_active":"2023-10-06T01:38:49.514777+0000","last_peered":"2023-10-06T01:38:49.514777+0000","last_clean":"2023-10-06T01:38:49.514777+0000","last_became_active":"2023-10-06T01:38:40.114142+0000","last_became_peered":"2023-10-06T01:38:40.114142+0000","last_unstale":"2023-10-06T01:38:49.514777+0000","last_undegraded":"2023-10-06T01:38:49.514777+0000","last_fullsized":"2023-10-06T01:38:49.514777+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_clean_scrub_stamp":"2023-10-06T01:38:38.338797+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:52.870262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.508643+0000","last_change":"2023-10-06T01:38:48.663223+0000","last_active":"2023-10-06T01:38:49.508643+0000","last_peered":"2023-10-06T01:38:49.508643+0000","last_clean":"2023-10-06T01:38:49.508643+0000","last_became_active":"2023-10-06T01:38:48.662956+0000","last_became_peered":"2023-10-06T01:38:48.662956+0000","last_unstale":"2023-10-06T01:38:49.508643+0000","last_undegraded":"2023-10-06T01:38:49.508643+0000","last_fullsized":"2023-10-06T01:38:49.508643+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:54.859831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531599+0000","last_change":"2023-10-06T01:38:49.530401+0000","last_active":"2023-10-06T01:38:49.531599+0000","last_peered":"2023-10-06T01:38:49.531599+0000","last_clean":"2023-10-06T01:38:49.531599+0000","last_became_active":"2023-10-06T01:38:49.530107+0000","last_became_peered":"2023-10-06T01:38:49.530107+0000","last_unstale":"2023-10-06T01:38:49.531599+0000","last_undegraded":"2023-10-06T01:38:49.531599+0000","last_fullsized":"2023-10-06T01:38:49.531599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:55:12.827603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515221+0000","last_change":"2023-10-06T01:38:44.531831+0000","last_active":"2023-10-06T01:38:49.515221+0000","last_peered":"2023-10-06T01:38:49.515221+0000","last_clean":"2023-10-06T01:38:49.515221+0000","last_became_active":"2023-10-06T01:38:44.531496+0000","last_became_peered":"2023-10-06T01:38:44.531496+0000","last_unstale":"2023-10-06T01:38:49.515221+0000","last_undegraded":"2023-10-06T01:38:49.515221+0000","last_fullsized":"2023-10-06T01:38:49.515221+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:28.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.512340+0000","last_change":"2023-10-06T01:38:48.667413+0000","last_active":"2023-10-06T01:38:49.512340+0000","last_peered":"2023-10-06T01:38:49.512340+0000","last_clean":"2023-10-06T01:38:49.512340+0000","last_became_active":"2023-10-06T01:38:48.667114+0000","last_became_peered":"2023-10-06T01:38:48.667114+0000","last_unstale":"2023-10-06T01:38:49.512340+0000","last_undegraded":"2023-10-06T01:38:49.512340+0000","last_fullsized":"2023-10-06T01:38:49.512340+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:03.937447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531783+0000","last_change":"2023-10-06T01:38:49.524239+0000","last_active":"2023-10-06T01:38:49.531783+0000","last_peered":"2023-10-06T01:38:49.531783+0000","last_clean":"2023-10-06T01:38:49.531783+0000","last_became_active":"2023-10-06T01:38:49.523994+0000","last_became_peered":"2023-10-06T01:38:49.523994+0000","last_unstale":"2023-10-06T01:38:49.531783+0000","last_undegraded":"2023-10-06T01:38:49.531783+0000","last_fullsized":"2023-10-06T01:38:49.531783+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:31:19.856103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515175+0000","last_change":"2023-10-06T01:38:44.531335+0000","last_active":"2023-10-06T01:38:49.515175+0000","last_peered":"2023-10-06T01:38:49.515175+0000","last_clean":"2023-10-06T01:38:49.515175+0000","last_became_active":"2023-10-06T01:38:44.530966+0000","last_became_peered":"2023-10-06T01:38:44.530966+0000","last_unstale":"2023-10-06T01:38:49.515175+0000","last_undegraded":"2023-10-06T01:38:49.515175+0000","last_fullsized":"2023-10-06T01:38:49.515175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:33.926180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.515942+0000","last_change":"2023-10-06T01:38:48.660438+0000","last_active":"2023-10-06T01:38:49.515942+0000","last_peered":"2023-10-06T01:38:49.515942+0000","last_clean":"2023-10-06T01:38:49.515942+0000","last_became_active":"2023-10-06T01:38:48.660222+0000","last_became_peered":"2023-10-06T01:38:48.660222+0000","last_unstale":"2023-10-06T01:38:49.515942+0000","last_undegraded":"2023-10-06T01:38:49.515942+0000","last_fullsized":"2023-10-06T01:38:49.515942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:15:03.937447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.524781+0000","last_change":"2023-10-06T01:38:49.517014+0000","last_active":"2023-10-06T01:38:49.524781+0000","last_peered":"2023-10-06T01:38:49.524781+0000","last_clean":"2023-10-06T01:38:49.524781+0000","last_became_active":"2023-10-06T01:38:49.516679+0000","last_became_peered":"2023-10-06T01:38:49.516679+0000","last_unstale":"2023-10-06T01:38:49.524781+0000","last_undegraded":"2023-10-06T01:38:49.524781+0000","last_fullsized":"2023-10-06T01:38:49.524781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:38:23.293524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.658035+0000","last_change":"2023-10-06T01:38:48.663372+0000","last_active":"2023-10-06T01:38:49.658035+0000","last_peered":"2023-10-06T01:38:49.658035+0000","last_clean":"2023-10-06T01:38:49.658035+0000","last_became_active":"2023-10-06T01:38:48.663074+0000","last_became_peered":"2023-10-06T01:38:48.663074+0000","last_unstale":"2023-10-06T01:38:49.658035+0000","last_undegraded":"2023-10-06T01:38:49.658035+0000","last_fullsized":"2023-10-06T01:38:49.658035+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:22:09.299545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.516315+0000","last_change":"2023-10-06T01:38:44.533582+0000","last_active":"2023-10-06T01:38:49.516315+0000","last_peered":"2023-10-06T01:38:49.516315+0000","last_clean":"2023-10-06T01:38:49.516315+0000","last_became_active":"2023-10-06T01:38:44.533324+0000","last_became_peered":"2023-10-06T01:38:44.533324+0000","last_unstale":"2023-10-06T01:38:49.516315+0000","last_undegraded":"2023-10-06T01:38:49.516315+0000","last_fullsized":"2023-10-06T01:38:49.516315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.519956+0000","last_change":"2023-10-06T01:38:49.516429+0000","last_active":"2023-10-06T01:38:49.519956+0000","last_peered":"2023-10-06T01:38:49.519956+0000","last_clean":"2023-10-06T01:38:49.519956+0000","last_became_active":"2023-10-06T01:38:49.515639+0000","last_became_peered":"2023-10-06T01:38:49.515639+0000","last_unstale":"2023-10-06T01:38:49.519956+0000","last_undegraded":"2023-10-06T01:38:49.519956+0000","last_fullsized":"2023-10-06T01:38:49.519956+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:04:22.814342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.516330+0000","last_change":"2023-10-06T01:38:44.533765+0000","last_active":"2023-10-06T01:38:49.516330+0000","last_peered":"2023-10-06T01:38:49.516330+0000","last_clean":"2023-10-06T01:38:49.516330+0000","last_became_active":"2023-10-06T01:38:44.533406+0000","last_became_peered":"2023-10-06T01:38:44.533406+0000","last_unstale":"2023-10-06T01:38:49.516330+0000","last_undegraded":"2023-10-06T01:38:49.516330+0000","last_fullsized":"2023-10-06T01:38:49.516330+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"24'1","reported_seq":11,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-10-06T01:38:50.515561+0000","last_change":"2023-10-06T01:38:48.659164+0000","last_active":"2023-10-06T01:38:50.515561+0000","last_peered":"2023-10-06T01:38:50.515561+0000","last_clean":"2023-10-06T01:38:50.515561+0000","last_became_active":"2023-10-06T01:38:48.658890+0000","last_became_peered":"2023-10-06T01:38:48.658890+0000","last_unstale":"2023-10-06T01:38:50.515561+0000","last_undegraded":"2023-10-06T01:38:50.515561+0000","last_fullsized":"2023-10-06T01:38:50.515561+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:16:34.288288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533074+0000","last_change":"2023-10-06T01:38:49.529282+0000","last_active":"2023-10-06T01:38:49.533074+0000","last_peered":"2023-10-06T01:38:49.533074+0000","last_clean":"2023-10-06T01:38:49.533074+0000","last_became_active":"2023-10-06T01:38:49.528544+0000","last_became_peered":"2023-10-06T01:38:49.528544+0000","last_unstale":"2023-10-06T01:38:49.533074+0000","last_undegraded":"2023-10-06T01:38:49.533074+0000","last_fullsized":"2023-10-06T01:38:49.533074+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:43:21.430025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.656041+0000","last_change":"2023-10-06T01:38:48.668953+0000","last_active":"2023-10-06T01:38:49.656041+0000","last_peered":"2023-10-06T01:38:49.656041+0000","last_clean":"2023-10-06T01:38:49.656041+0000","last_became_active":"2023-10-06T01:38:48.668711+0000","last_became_peered":"2023-10-06T01:38:48.668711+0000","last_unstale":"2023-10-06T01:38:49.656041+0000","last_undegraded":"2023-10-06T01:38:49.656041+0000","last_fullsized":"2023-10-06T01:38:49.656041+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:07:41.517375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527535+0000","last_change":"2023-10-06T01:38:49.523156+0000","last_active":"2023-10-06T01:38:49.527535+0000","last_peered":"2023-10-06T01:38:49.527535+0000","last_clean":"2023-10-06T01:38:49.527535+0000","last_became_active":"2023-10-06T01:38:49.522238+0000","last_became_peered":"2023-10-06T01:38:49.522238+0000","last_unstale":"2023-10-06T01:38:49.527535+0000","last_undegraded":"2023-10-06T01:38:49.527535+0000","last_fullsized":"2023-10-06T01:38:49.527535+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:53:53.984718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.657984+0000","last_change":"2023-10-06T01:38:48.669432+0000","last_active":"2023-10-06T01:38:49.657984+0000","last_peered":"2023-10-06T01:38:49.657984+0000","last_clean":"2023-10-06T01:38:49.657984+0000","last_became_active":"2023-10-06T01:38:48.669170+0000","last_became_peered":"2023-10-06T01:38:48.669170+0000","last_unstale":"2023-10-06T01:38:49.657984+0000","last_undegraded":"2023-10-06T01:38:49.657984+0000","last_fullsized":"2023-10-06T01:38:49.657984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:31:31.036573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533202+0000","last_change":"2023-10-06T01:38:49.532440+0000","last_active":"2023-10-06T01:38:49.533202+0000","last_peered":"2023-10-06T01:38:49.533202+0000","last_clean":"2023-10-06T01:38:49.533202+0000","last_became_active":"2023-10-06T01:38:49.532184+0000","last_became_peered":"2023-10-06T01:38:49.532184+0000","last_unstale":"2023-10-06T01:38:49.533202+0000","last_undegraded":"2023-10-06T01:38:49.533202+0000","last_fullsized":"2023-10-06T01:38:49.533202+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:47:57.688866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"23'2","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.657725+0000","last_change":"2023-10-06T01:38:48.668877+0000","last_active":"2023-10-06T01:38:49.657725+0000","last_peered":"2023-10-06T01:38:49.657725+0000","last_clean":"2023-10-06T01:38:49.657725+0000","last_became_active":"2023-10-06T01:38:48.668564+0000","last_became_peered":"2023-10-06T01:38:48.668564+0000","last_unstale":"2023-10-06T01:38:49.657725+0000","last_undegraded":"2023-10-06T01:38:49.657725+0000","last_fullsized":"2023-10-06T01:38:49.657725+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:54.859831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533193+0000","last_change":"2023-10-06T01:38:49.532416+0000","last_active":"2023-10-06T01:38:49.533193+0000","last_peered":"2023-10-06T01:38:49.533193+0000","last_clean":"2023-10-06T01:38:49.533193+0000","last_became_active":"2023-10-06T01:38:49.532101+0000","last_became_peered":"2023-10-06T01:38:49.532101+0000","last_unstale":"2023-10-06T01:38:49.533193+0000","last_undegraded":"2023-10-06T01:38:49.533193+0000","last_fullsized":"2023-10-06T01:38:49.533193+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:12:30.023946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"23'1","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.654641+0000","last_change":"2023-10-06T01:38:48.665065+0000","last_active":"2023-10-06T01:38:49.654641+0000","last_peered":"2023-10-06T01:38:49.654641+0000","last_clean":"2023-10-06T01:38:49.654641+0000","last_became_active":"2023-10-06T01:38:48.664769+0000","last_became_peered":"2023-10-06T01:38:48.664769+0000","last_unstale":"2023-10-06T01:38:49.654641+0000","last_undegraded":"2023-10-06T01:38:49.654641+0000","last_fullsized":"2023-10-06T01:38:49.654641+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:33.441697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526916+0000","last_change":"2023-10-06T01:38:49.518384+0000","last_active":"2023-10-06T01:38:49.526916+0000","last_peered":"2023-10-06T01:38:49.526916+0000","last_clean":"2023-10-06T01:38:49.526916+0000","last_became_active":"2023-10-06T01:38:49.518100+0000","last_became_peered":"2023-10-06T01:38:49.518100+0000","last_unstale":"2023-10-06T01:38:49.526916+0000","last_undegraded":"2023-10-06T01:38:49.526916+0000","last_fullsized":"2023-10-06T01:38:49.526916+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:57.494182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"23'4","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.655794+0000","last_change":"2023-10-06T01:38:48.662504+0000","last_active":"2023-10-06T01:38:49.655794+0000","last_peered":"2023-10-06T01:38:49.655794+0000","last_clean":"2023-10-06T01:38:49.655794+0000","last_became_active":"2023-10-06T01:38:48.662220+0000","last_became_peered":"2023-10-06T01:38:48.662220+0000","last_unstale":"2023-10-06T01:38:49.655794+0000","last_undegraded":"2023-10-06T01:38:49.655794+0000","last_fullsized":"2023-10-06T01:38:49.655794+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:47.638867+0000","last_clean_scrub_stamp":"2023-10-06T01:38:47.638867+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:02:54.859831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.533135+0000","last_change":"2023-10-06T01:38:49.531208+0000","last_active":"2023-10-06T01:38:49.533135+0000","last_peered":"2023-10-06T01:38:49.533135+0000","last_clean":"2023-10-06T01:38:49.533135+0000","last_became_active":"2023-10-06T01:38:49.530797+0000","last_became_peered":"2023-10-06T01:38:49.530797+0000","last_unstale":"2023-10-06T01:38:49.533135+0000","last_undegraded":"2023-10-06T01:38:49.533135+0000","last_fullsized":"2023-10-06T01:38:49.533135+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:51:57.494182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527811+0000","last_change":"2023-10-06T01:38:49.521503+0000","last_active":"2023-10-06T01:38:49.527811+0000","last_peered":"2023-10-06T01:38:49.527811+0000","last_clean":"2023-10-06T01:38:49.527811+0000","last_became_active":"2023-10-06T01:38:49.521219+0000","last_became_peered":"2023-10-06T01:38:49.521219+0000","last_unstale":"2023-10-06T01:38:49.527811+0000","last_undegraded":"2023-10-06T01:38:49.527811+0000","last_fullsized":"2023-10-06T01:38:49.527811+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:43:34.443462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.531744+0000","last_change":"2023-10-06T01:38:49.522310+0000","last_active":"2023-10-06T01:38:49.531744+0000","last_peered":"2023-10-06T01:38:49.531744+0000","last_clean":"2023-10-06T01:38:49.531744+0000","last_became_active":"2023-10-06T01:38:49.522062+0000","last_became_peered":"2023-10-06T01:38:49.522062+0000","last_unstale":"2023-10-06T01:38:49.531744+0000","last_undegraded":"2023-10-06T01:38:49.531744+0000","last_fullsized":"2023-10-06T01:38:49.531744+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:09:04.188051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.532797+0000","last_change":"2023-10-06T01:38:49.527987+0000","last_active":"2023-10-06T01:38:49.532797+0000","last_peered":"2023-10-06T01:38:49.532797+0000","last_clean":"2023-10-06T01:38:49.532797+0000","last_became_active":"2023-10-06T01:38:49.527716+0000","last_became_peered":"2023-10-06T01:38:49.527716+0000","last_unstale":"2023-10-06T01:38:49.532797+0000","last_undegraded":"2023-10-06T01:38:49.532797+0000","last_fullsized":"2023-10-06T01:38:49.532797+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:54:11.839303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.526877+0000","last_change":"2023-10-06T01:38:49.519300+0000","last_active":"2023-10-06T01:38:49.526877+0000","last_peered":"2023-10-06T01:38:49.526877+0000","last_clean":"2023-10-06T01:38:49.526877+0000","last_became_active":"2023-10-06T01:38:49.519069+0000","last_became_peered":"2023-10-06T01:38:49.519069+0000","last_unstale":"2023-10-06T01:38:49.526877+0000","last_undegraded":"2023-10-06T01:38:49.526877+0000","last_fullsized":"2023-10-06T01:38:49.526877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:41:04.140534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-10-06T01:38:49.527983+0000","last_change":"2023-10-06T01:38:49.526134+0000","last_active":"2023-10-06T01:38:49.527983+0000","last_peered":"2023-10-06T01:38:49.527983+0000","last_clean":"2023-10-06T01:38:49.527983+0000","last_became_active":"2023-10-06T01:38:49.524965+0000","last_became_peered":"2023-10-06T01:38:49.524965+0000","last_unstale":"2023-10-06T01:38:49.527983+0000","last_undegraded":"2023-10-06T01:38:49.527983+0000","last_fullsized":"2023-10-06T01:38:49.527983+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:48.640632+0000","last_clean_scrub_stamp":"2023-10-06T01:38:48.640632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:09:27.359068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298144,"kb_used_data":856,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073696,"statfs":{"total":96636764160,"available":96331464704,"internally_reserved":0,"allocated":876544,"data_stored":686098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61599999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.31900000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28000000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38300000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298120,"kb_used_data":832,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073720,"statfs":{"total":96636764160,"available":96331489280,"internally_reserved":0,"allocated":851968,"data_stored":684900,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.439}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":253952,"data_stored":93978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297540,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074300,"statfs":{"total":96636764160,"available":96332083200,"internally_reserved":0,"allocated":258048,"data_stored":94068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32300000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297556,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074284,"statfs":{"total":96636764160,"available":96332066816,"internally_reserved":0,"allocated":274432,"data_stored":95570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297544,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074296,"statfs":{"total":96636764160,"available":96332079104,"internally_reserved":0,"allocated":262144,"data_stored":94602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46300000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:39:03.077 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T01:39:03.077 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-06T01:39:03.077 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-06T01:39:03.077 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-06T01:39:03.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.224+0000 7f2e8ca3b700 1 Processor -- start 2023-10-06T01:39:03.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.224+0000 7f2e8ca3b700 1 -- start start 2023-10-06T01:39:03.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.225+0000 7f2e8ca3b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2e880cb970 0x7f2e88159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:03.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.225+0000 7f2e8ca3b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2e8815a400 0x7f2e88156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:03.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.225+0000 7f2e8ca3b700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e8815ae40 con 0x7f2e880cb5a0 2023-10-06T01:39:03.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.225+0000 7f2e8ca3b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e880ce0f0 con 0x7f2e880cb970 2023-10-06T01:39:03.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.225+0000 7f2e8ca3b700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e880d13f0 con 0x7f2e8815a400 2023-10-06T01:39:03.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.225+0000 7f2e8659c700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f2e880cb5a0 0x7f2e880cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37504/0 (socket says 172.21.15.69:37504) 2023-10-06T01:39:03.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.225+0000 7f2e8659c700 1 -- 172.21.15.69:0/2217676016 learned_addr learned my addr 172.21.15.69:0/2217676016 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:03.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.225+0000 7f2e86d9d700 1 --2- 172.21.15.69:0/2217676016 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2e8815a400 0x7f2e88156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:03.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.225+0000 7f2e85d9b700 1 --2- 172.21.15.69:0/2217676016 >> v2:172.21.15.88:3300/0 conn(0x7f2e880cb970 0x7f2e88159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:03.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.225+0000 7f2e8559a700 1 -- 172.21.15.69:0/2217676016 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911457520 0 0) 0x7f2e8815ae40 con 0x7f2e880cb5a0 2023-10-06T01:39:03.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.225+0000 7f2e8559a700 1 -- 172.21.15.69:0/2217676016 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e74003570 con 0x7f2e880cb5a0 2023-10-06T01:39:03.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.226+0000 7f2e8559a700 1 -- 172.21.15.69:0/2217676016 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4231697409 0 0) 0x7f2e74003570 con 0x7f2e880cb5a0 2023-10-06T01:39:03.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.226+0000 7f2e8559a700 1 -- 172.21.15.69:0/2217676016 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2e8815a400 msgr2=0x7f2e88156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:03.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.226+0000 7f2e8559a700 1 --2- 172.21.15.69:0/2217676016 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2e8815a400 0x7f2e88156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.226+0000 7f2e8559a700 1 -- 172.21.15.69:0/2217676016 >> v2:172.21.15.88:3300/0 conn(0x7f2e880cb970 msgr2=0x7f2e88159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:03.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.226+0000 7f2e8559a700 1 --2- 172.21.15.69:0/2217676016 >> v2:172.21.15.88:3300/0 conn(0x7f2e880cb970 0x7f2e88159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.226+0000 7f2e8559a700 1 -- 172.21.15.69:0/2217676016 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e8815ab60 con 0x7f2e880cb5a0 2023-10-06T01:39:03.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.226+0000 7f2e8559a700 1 -- 172.21.15.69:0/2217676016 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f2e780017f0 con 0x7f2e880cb5a0 2023-10-06T01:39:03.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.226+0000 7f2e8559a700 1 -- 172.21.15.69:0/2217676016 >> v1:172.21.15.69:6789/0 conn(0x7f2e880cb5a0 legacy=0x7f2e880cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:03.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.226+0000 7f2e8559a700 1 --2- 172.21.15.69:0/2217676016 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e74003a60 0x7f2e74003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:03.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.226+0000 7f2e8559a700 1 --2- 172.21.15.69:0/2217676016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e74004810 0x7f2e74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:03.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.226+0000 7f2e8559a700 1 --2- 172.21.15.69:0/2217676016 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2e8815a400 0x7f2e740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:03.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.226+0000 7f2e8559a700 1 -- 172.21.15.69:0/2217676016 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e880ce0f0 con 0x7f2e74003a60 2023-10-06T01:39:03.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.226+0000 7f2e8559a700 1 -- 172.21.15.69:0/2217676016 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7400ba60 con 0x7f2e74004810 2023-10-06T01:39:03.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.226+0000 7f2e8559a700 1 -- 172.21.15.69:0/2217676016 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7400bba0 con 0x7f2e8815a400 2023-10-06T01:39:03.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.226+0000 7f2e8659c700 1 --2- 172.21.15.69:0/2217676016 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e74003a60 0x7f2e74003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:03.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.226+0000 7f2e85d9b700 1 --2- 172.21.15.69:0/2217676016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e74004810 0x7f2e74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:03.230 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.226+0000 7f2e86d9d700 1 --2- 172.21.15.69:0/2217676016 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2e8815a400 0x7f2e740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:03.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.226+0000 7f2e8659c700 1 -- 172.21.15.69:0/2217676016 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2e8815a400 msgr2=0x7f2e740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:03.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.226+0000 7f2e8659c700 1 --2- 172.21.15.69:0/2217676016 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2e8815a400 0x7f2e740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.226+0000 7f2e8659c700 1 -- 172.21.15.69:0/2217676016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e74004810 msgr2=0x7f2e74004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:03.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.226+0000 7f2e8659c700 1 --2- 172.21.15.69:0/2217676016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e74004810 0x7f2e74004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.226+0000 7f2e8659c700 1 -- 172.21.15.69:0/2217676016 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e74003570 con 0x7f2e74003a60 2023-10-06T01:39:03.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.226+0000 7f2e85d9b700 1 --2- 172.21.15.69:0/2217676016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e74004810 0x7f2e74004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:03.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.226+0000 7f2e8659c700 1 --2- 172.21.15.69:0/2217676016 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e74003a60 0x7f2e74003e70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2e7800a9a0 tx=0x7f2e78002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d64440c35ce22f49 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:03.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.226+0000 7f2e8559a700 1 -- 172.21.15.69:0/2217676016 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e78012440 con 0x7f2e74003a60 2023-10-06T01:39:03.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.226+0000 7f2e8559a700 1 -- 172.21.15.69:0/2217676016 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e780125c0 con 0x7f2e74003a60 2023-10-06T01:39:03.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.226+0000 7f2e8559a700 1 -- 172.21.15.69:0/2217676016 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e78012980 con 0x7f2e74003a60 2023-10-06T01:39:03.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.227+0000 7f2e8ca3b700 1 -- 172.21.15.69:0/2217676016 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e74003a60 msgr2=0x7f2e74003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:03.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.227+0000 7f2e8ca3b700 1 --2- 172.21.15.69:0/2217676016 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e74003a60 0x7f2e74003e70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2e7800a9a0 tx=0x7f2e78002210 comp rx=0 tx=0).stop 2023-10-06T01:39:03.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.227+0000 7f2e86d9d700 1 -- 172.21.15.69:0/2217676016 reap_dead start 2023-10-06T01:39:03.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.227+0000 7f2e8ca3b700 1 -- 172.21.15.69:0/2217676016 shutdown_connections 2023-10-06T01:39:03.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.227+0000 7f2e8ca3b700 1 -- 172.21.15.69:0/2217676016 >> 172.21.15.69:0/2217676016 conn(0x7f2e88070e30 msgr2=0x7f2e880d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:03.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.227+0000 7f2e8ca3b700 1 -- 172.21.15.69:0/2217676016 shutdown_connections 2023-10-06T01:39:03.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.227+0000 7f2e8ca3b700 1 -- 172.21.15.69:0/2217676016 wait complete. 2023-10-06T01:39:03.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.228+0000 7f2e8ca3b700 1 Processor -- start 2023-10-06T01:39:03.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.228+0000 7f2e8ca3b700 1 -- start start 2023-10-06T01:39:03.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.229+0000 7f2e8ca3b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2e74003a60 0x7f2e880b4170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:03.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.229+0000 7f2e8ca3b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e881512b0 0x7f2e88153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:03.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.229+0000 7f2e8ca3b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e88153aa0 0x7f2e88155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:03.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.229+0000 7f2e8ca3b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e88151cd0 con 0x7f2e881512b0 2023-10-06T01:39:03.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.229+0000 7f2e8ca3b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e88151fb0 con 0x7f2e88153aa0 2023-10-06T01:39:03.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.229+0000 7f2e8ca3b700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e88152290 con 0x7f2e74003a60 2023-10-06T01:39:03.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.229+0000 7f2e85d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e881512b0 0x7f2e88153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:03.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.229+0000 7f2e85d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e881512b0 0x7f2e88153560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57168/0 (socket says 172.21.15.69:57168) 2023-10-06T01:39:03.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.229+0000 7f2e85d9b700 1 -- 172.21.15.69:0/2753544604 learned_addr learned my addr 172.21.15.69:0/2753544604 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:03.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.229+0000 7f2e86d9d700 1 --2- 172.21.15.69:0/2753544604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e88153aa0 0x7f2e88155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:03.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.229+0000 7f2e8659c700 1 --2- 172.21.15.69:0/2753544604 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2e74003a60 0x7f2e880b4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:03.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.229+0000 7f2e85d9b700 1 -- 172.21.15.69:0/2753544604 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2e74003a60 msgr2=0x7f2e880b4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:03.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.229+0000 7f2e85d9b700 1 --2- 172.21.15.69:0/2753544604 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2e74003a60 0x7f2e880b4170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.229+0000 7f2e85d9b700 1 -- 172.21.15.69:0/2753544604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e88153aa0 msgr2=0x7f2e88155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:03.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.229+0000 7f2e85d9b700 1 --2- 172.21.15.69:0/2753544604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e88153aa0 0x7f2e88155650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.229+0000 7f2e85d9b700 1 -- 172.21.15.69:0/2753544604 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e88152570 con 0x7f2e881512b0 2023-10-06T01:39:03.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.229+0000 7f2e85d9b700 1 --2- 172.21.15.69:0/2753544604 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e881512b0 0x7f2e88153560 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2e700118e0 tx=0x7f2e70008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:03.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.229+0000 7f2e7e7fc700 1 -- 172.21.15.69:0/2753544604 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e70011e80 con 0x7f2e881512b0 2023-10-06T01:39:03.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.229+0000 7f2e7e7fc700 1 -- 172.21.15.69:0/2753544604 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7000f860 con 0x7f2e881512b0 2023-10-06T01:39:03.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.230+0000 7f2e8ca3b700 1 -- 172.21.15.69:0/2753544604 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e88152850 con 0x7f2e881512b0 2023-10-06T01:39:03.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.230+0000 7f2e7e7fc700 1 -- 172.21.15.69:0/2753544604 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7000fc00 con 0x7f2e881512b0 2023-10-06T01:39:03.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.230+0000 7f2e8ca3b700 1 -- 172.21.15.69:0/2753544604 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e88159f50 con 0x7f2e881512b0 2023-10-06T01:39:03.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.230+0000 7f2e8ca3b700 1 -- 172.21.15.69:0/2753544604 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e8816cf20 con 0x7f2e881512b0 2023-10-06T01:39:03.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.231+0000 7f2e7e7fc700 1 -- 172.21.15.69:0/2753544604 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2e70015460 con 0x7f2e881512b0 2023-10-06T01:39:03.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.231+0000 7f2e7e7fc700 1 --2- 172.21.15.69:0/2753544604 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2e68066f30 0x7f2e680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:03.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.231+0000 7f2e8659c700 1 --2- 172.21.15.69:0/2753544604 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2e68066f30 0x7f2e680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:03.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.231+0000 7f2e7e7fc700 1 -- 172.21.15.69:0/2753544604 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2e70084e30 con 0x7f2e881512b0 2023-10-06T01:39:03.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.232+0000 7f2e8659c700 1 --2- 172.21.15.69:0/2753544604 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2e68066f30 0x7f2e680693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2e7800a750 tx=0x7f2e78015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:03.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.235+0000 7f2e7e7fc700 1 -- 172.21.15.69:0/2753544604 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2e70051fa0 con 0x7f2e881512b0 2023-10-06T01:39:03.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.459+0000 7f2e8ca3b700 1 -- 172.21.15.69:0/2753544604 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2e8804c3c0 con 0x7f2e881512b0 2023-10-06T01:39:03.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.460+0000 7f2e7e7fc700 1 -- 172.21.15.69:0/2753544604 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f2e700555c0 con 0x7f2e881512b0 2023-10-06T01:39:03.460 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:03.461 INFO:teuthology.orchestra.run.smithi069.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-06T01:39:03.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.462+0000 7f2e8ca3b700 1 -- 172.21.15.69:0/2753544604 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2e68066f30 msgr2=0x7f2e680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:03.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.462+0000 7f2e8ca3b700 1 --2- 172.21.15.69:0/2753544604 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2e68066f30 0x7f2e680693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2e7800a750 tx=0x7f2e78015000 comp rx=0 tx=0).stop 2023-10-06T01:39:03.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.462+0000 7f2e8ca3b700 1 -- 172.21.15.69:0/2753544604 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e881512b0 msgr2=0x7f2e88153560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:03.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.462+0000 7f2e8ca3b700 1 --2- 172.21.15.69:0/2753544604 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e881512b0 0x7f2e88153560 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2e700118e0 tx=0x7f2e70008040 comp rx=0 tx=0).stop 2023-10-06T01:39:03.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.462+0000 7f2e8ca3b700 1 -- 172.21.15.69:0/2753544604 shutdown_connections 2023-10-06T01:39:03.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.462+0000 7f2e8ca3b700 1 --2- 172.21.15.69:0/2753544604 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2e68066f30 0x7f2e680693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.462+0000 7f2e8ca3b700 1 --2- 172.21.15.69:0/2753544604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2e88153aa0 0x7f2e88155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.462+0000 7f2e8ca3b700 1 --2- 172.21.15.69:0/2753544604 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2e74003a60 0x7f2e880b4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.462+0000 7f2e8ca3b700 1 --2- 172.21.15.69:0/2753544604 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e881512b0 0x7f2e88153560 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.462+0000 7f2e8ca3b700 1 -- 172.21.15.69:0/2753544604 >> 172.21.15.69:0/2753544604 conn(0x7f2e88070e30 msgr2=0x7f2e880c6790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:03.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.462+0000 7f2e8ca3b700 1 -- 172.21.15.69:0/2753544604 shutdown_connections 2023-10-06T01:39:03.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.462+0000 7f2e8ca3b700 1 -- 172.21.15.69:0/2753544604 wait complete. 2023-10-06T01:39:03.474 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-06T01:39:03.475 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:39:03.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.589+0000 7fc237b8e700 1 Processor -- start 2023-10-06T01:39:03.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.589+0000 7fc237b8e700 1 -- start start 2023-10-06T01:39:03.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.590+0000 7fc237b8e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc2300cb5a0 0x7fc2300cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:03.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.590+0000 7fc237b8e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc2300cd9e0 0x7fc230159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:03.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.590+0000 7fc237b8e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc2300cde50 0x7fc23015a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:03.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.590+0000 7fc237b8e700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2300d13f0 con 0x7fc2300cde50 2023-10-06T01:39:03.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.590+0000 7fc237b8e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc23015a940 con 0x7fc2300cd9e0 2023-10-06T01:39:03.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.590+0000 7fc237b8e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc23015ae40 con 0x7fc2300cb5a0 2023-10-06T01:39:03.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.590+0000 7fc23612b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc2300cde50 0x7fc23015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:03.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.590+0000 7fc23612b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc2300cde50 0x7fc23015a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57174/0 (socket says 172.21.15.69:57174) 2023-10-06T01:39:03.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.590+0000 7fc23612b700 1 -- 172.21.15.69:0/4141953891 learned_addr learned my addr 172.21.15.69:0/4141953891 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:03.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.590+0000 7fc235129700 1 --2- 172.21.15.69:0/4141953891 >> v2:172.21.15.88:3300/0 conn(0x7fc2300cd9e0 0x7fc230159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:03.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.590+0000 7fc23592a700 1 --2- 172.21.15.69:0/4141953891 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc2300cb5a0 0x7fc2300cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:03.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.590+0000 7fc23612b700 1 -- 172.21.15.69:0/4141953891 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc2300cb5a0 msgr2=0x7fc2300cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:03.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.590+0000 7fc23612b700 1 --2- 172.21.15.69:0/4141953891 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc2300cb5a0 0x7fc2300cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.590+0000 7fc23612b700 1 -- 172.21.15.69:0/4141953891 >> v2:172.21.15.88:3300/0 conn(0x7fc2300cd9e0 msgr2=0x7fc230159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:03.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.590+0000 7fc23612b700 1 --2- 172.21.15.69:0/4141953891 >> v2:172.21.15.88:3300/0 conn(0x7fc2300cd9e0 0x7fc230159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.590+0000 7fc23612b700 1 -- 172.21.15.69:0/4141953891 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc23015ab60 con 0x7fc2300cde50 2023-10-06T01:39:03.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.590+0000 7fc235129700 1 --2- 172.21.15.69:0/4141953891 >> v2:172.21.15.88:3300/0 conn(0x7fc2300cd9e0 0x7fc230159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:03.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.590+0000 7fc23592a700 1 --2- 172.21.15.69:0/4141953891 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc2300cb5a0 0x7fc2300cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:03.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.590+0000 7fc23612b700 1 --2- 172.21.15.69:0/4141953891 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2300cde50 0x7fc23015a400 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc23006ea90 tx=0x7fc228009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36e505168fceb79c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:03.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.590+0000 7fc234928700 1 -- 172.21.15.69:0/4141953891 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc22800e070 con 0x7fc2300cde50 2023-10-06T01:39:03.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.590+0000 7fc234928700 1 -- 172.21.15.69:0/4141953891 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22800ba40 con 0x7fc2300cde50 2023-10-06T01:39:03.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.590+0000 7fc234928700 1 -- 172.21.15.69:0/4141953891 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2280092e0 con 0x7fc2300cde50 2023-10-06T01:39:03.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.591+0000 7fc237b8e700 1 -- 172.21.15.69:0/4141953891 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2300cde50 msgr2=0x7fc23015a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:03.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.591+0000 7fc237b8e700 1 --2- 172.21.15.69:0/4141953891 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2300cde50 0x7fc23015a400 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fc23006ea90 tx=0x7fc228009840 comp rx=0 tx=0).stop 2023-10-06T01:39:03.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.591+0000 7fc237b8e700 1 -- 172.21.15.69:0/4141953891 shutdown_connections 2023-10-06T01:39:03.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.591+0000 7fc237b8e700 1 --2- 172.21.15.69:0/4141953891 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2300cde50 0x7fc23015a400 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.591+0000 7fc237b8e700 1 --2- 172.21.15.69:0/4141953891 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc2300cb5a0 0x7fc2300cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.591+0000 7fc237b8e700 1 --2- 172.21.15.69:0/4141953891 >> v2:172.21.15.88:3300/0 conn(0x7fc2300cd9e0 0x7fc230159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.591+0000 7fc237b8e700 1 -- 172.21.15.69:0/4141953891 >> 172.21.15.69:0/4141953891 conn(0x7fc230070e30 msgr2=0x7fc2300d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:03.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.591+0000 7fc237b8e700 1 -- 172.21.15.69:0/4141953891 shutdown_connections 2023-10-06T01:39:03.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.591+0000 7fc237b8e700 1 -- 172.21.15.69:0/4141953891 wait complete. 2023-10-06T01:39:03.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.592+0000 7fc237b8e700 1 Processor -- start 2023-10-06T01:39:03.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.592+0000 7fc237b8e700 1 -- start start 2023-10-06T01:39:03.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.593+0000 7fc237b8e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc2300cb5a0 0x7fc230144170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:03.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.593+0000 7fc237b8e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2300cd9e0 0x7fc230156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:03.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.593+0000 7fc237b8e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2301571a0 0x7fc2300c8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:03.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.593+0000 7fc237b8e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc230157620 con 0x7fc2301571a0 2023-10-06T01:39:03.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.593+0000 7fc237b8e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2301446b0 con 0x7fc2300cd9e0 2023-10-06T01:39:03.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.593+0000 7fc237b8e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2300c95a0 con 0x7fc2300cb5a0 2023-10-06T01:39:03.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.593+0000 7fc23612b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2301571a0 0x7fc2300c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:03.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.593+0000 7fc23612b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2301571a0 0x7fc2300c8870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57178/0 (socket says 172.21.15.69:57178) 2023-10-06T01:39:03.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.593+0000 7fc23612b700 1 -- 172.21.15.69:0/2703172263 learned_addr learned my addr 172.21.15.69:0/2703172263 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:03.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.593+0000 7fc235129700 1 --2- 172.21.15.69:0/2703172263 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2300cd9e0 0x7fc230156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:03.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.593+0000 7fc23592a700 1 --2- 172.21.15.69:0/2703172263 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc2300cb5a0 0x7fc230144170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:03.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.593+0000 7fc23612b700 1 -- 172.21.15.69:0/2703172263 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc2300cb5a0 msgr2=0x7fc230144170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:03.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.593+0000 7fc23612b700 1 --2- 172.21.15.69:0/2703172263 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc2300cb5a0 0x7fc230144170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.593+0000 7fc23612b700 1 -- 172.21.15.69:0/2703172263 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2300cd9e0 msgr2=0x7fc230156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:03.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.593+0000 7fc23612b700 1 --2- 172.21.15.69:0/2703172263 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2300cd9e0 0x7fc230156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.593+0000 7fc23612b700 1 -- 172.21.15.69:0/2703172263 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc228009ae0 con 0x7fc2301571a0 2023-10-06T01:39:03.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.593+0000 7fc23592a700 1 --2- 172.21.15.69:0/2703172263 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc2300cb5a0 0x7fc230144170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:03.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.593+0000 7fc23612b700 1 --2- 172.21.15.69:0/2703172263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2301571a0 0x7fc2300c8870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc23006ea60 tx=0x7fc228018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.593+0000 7fc225ffb700 1 -- 172.21.15.69:0/2703172263 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc228008d90 con 0x7fc2301571a0 2023-10-06T01:39:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.593+0000 7fc225ffb700 1 -- 172.21.15.69:0/2703172263 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc228025460 con 0x7fc2301571a0 2023-10-06T01:39:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.593+0000 7fc237b8e700 1 -- 172.21.15.69:0/2703172263 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2300c9880 con 0x7fc2301571a0 2023-10-06T01:39:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.593+0000 7fc225ffb700 1 -- 172.21.15.69:0/2703172263 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc228025820 con 0x7fc2301571a0 2023-10-06T01:39:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.594+0000 7fc237b8e700 1 -- 172.21.15.69:0/2703172263 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2300c9e40 con 0x7fc2301571a0 2023-10-06T01:39:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.594+0000 7fc237b8e700 1 -- 172.21.15.69:0/2703172263 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc23015ba40 con 0x7fc2301571a0 2023-10-06T01:39:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.595+0000 7fc225ffb700 1 -- 172.21.15.69:0/2703172263 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc228003040 con 0x7fc2301571a0 2023-10-06T01:39:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.595+0000 7fc225ffb700 1 --2- 172.21.15.69:0/2703172263 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc214066f30 0x7fc2140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.595+0000 7fc225ffb700 1 -- 172.21.15.69:0/2703172263 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc228085d20 con 0x7fc2301571a0 2023-10-06T01:39:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.595+0000 7fc23592a700 1 --2- 172.21.15.69:0/2703172263 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc214066f30 0x7fc2140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:03.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.596+0000 7fc23592a700 1 --2- 172.21.15.69:0/2703172263 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc214066f30 0x7fc2140693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00ab50 tx=0x7fc22c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:03.601 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.600+0000 7fc225ffb700 1 -- 172.21.15.69:0/2703172263 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc23015ba40 con 0x7fc2301571a0 2023-10-06T01:39:03.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.783+0000 7fc237b8e700 1 -- 172.21.15.69:0/2703172263 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc23015ba40 con 0x7fc2301571a0 2023-10-06T01:39:03.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.783+0000 7fc225ffb700 1 -- 172.21.15.69:0/2703172263 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16818 (secure 0 0 0) 0x7fc23015ba40 con 0x7fc2301571a0 2023-10-06T01:39:03.784 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:03.784 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":24,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:38:50.506861+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:38:43.046056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:38:47.525023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:38:47.992048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:39:03.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.786+0000 7fc237b8e700 1 -- 172.21.15.69:0/2703172263 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc214066f30 msgr2=0x7fc2140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:03.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.786+0000 7fc237b8e700 1 --2- 172.21.15.69:0/2703172263 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc214066f30 0x7fc2140693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00ab50 tx=0x7fc22c008040 comp rx=0 tx=0).stop 2023-10-06T01:39:03.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.786+0000 7fc237b8e700 1 -- 172.21.15.69:0/2703172263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2301571a0 msgr2=0x7fc2300c8870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:03.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.786+0000 7fc237b8e700 1 --2- 172.21.15.69:0/2703172263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2301571a0 0x7fc2300c8870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc23006ea60 tx=0x7fc228018000 comp rx=0 tx=0).stop 2023-10-06T01:39:03.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.786+0000 7fc237b8e700 1 -- 172.21.15.69:0/2703172263 shutdown_connections 2023-10-06T01:39:03.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.786+0000 7fc237b8e700 1 --2- 172.21.15.69:0/2703172263 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc214066f30 0x7fc2140693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.786+0000 7fc237b8e700 1 --2- 172.21.15.69:0/2703172263 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2301571a0 0x7fc2300c8870 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.786+0000 7fc237b8e700 1 --2- 172.21.15.69:0/2703172263 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc2300cb5a0 0x7fc230144170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.786+0000 7fc237b8e700 1 --2- 172.21.15.69:0/2703172263 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc2300cd9e0 0x7fc230156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.786+0000 7fc237b8e700 1 -- 172.21.15.69:0/2703172263 >> 172.21.15.69:0/2703172263 conn(0x7fc230070e30 msgr2=0x7fc2300c66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:03.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.786+0000 7fc237b8e700 1 -- 172.21.15.69:0/2703172263 shutdown_connections 2023-10-06T01:39:03.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.786+0000 7fc237b8e700 1 -- 172.21.15.69:0/2703172263 wait complete. 2023-10-06T01:39:03.798 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:38:38.288642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:38:43.046056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T01:38:47.525023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T01:38:47.992048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T01:39:03.799 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:39:03.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.915+0000 7faee1231700 1 Processor -- start 2023-10-06T01:39:03.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.915+0000 7faee1231700 1 -- start start 2023-10-06T01:39:03.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.916+0000 7faee1231700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faedc06dc70 0x7faedc159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:03.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.916+0000 7faee1231700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faedc06e0e0 0x7faedc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:03.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.916+0000 7faee1231700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faedc0ccfd0 con 0x7faedc159530 2023-10-06T01:39:03.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.916+0000 7faee1231700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faedc15a3d0 con 0x7faedc06e0e0 2023-10-06T01:39:03.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.916+0000 7faee1231700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faedc15a6b0 con 0x7faedc06dc70 2023-10-06T01:39:03.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.916+0000 7faed3fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faedc06dc70 0x7faedc159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:03.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.916+0000 7faedb59e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faedc06e0e0 0x7faedc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:03.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.916+0000 7faedad9d700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7faedc159530 0x7faedc0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.69:43112/0 (socket says 172.21.15.69:43112) 2023-10-06T01:39:03.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.916+0000 7faedad9d700 1 -- 172.21.15.69:0/3311989759 learned_addr learned my addr 172.21.15.69:0/3311989759 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:03.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.916+0000 7faed3fff700 1 --2- 172.21.15.69:0/3311989759 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faedc06dc70 0x7faedc159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.69:42736/0 (socket says 172.21.15.69:42736) 2023-10-06T01:39:03.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.916+0000 7faedb59e700 1 -- 172.21.15.69:0/3311989759 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faedc06dc70 msgr2=0x7faedc159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:03.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.916+0000 7faedb59e700 1 --2- 172.21.15.69:0/3311989759 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faedc06dc70 0x7faedc159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.916+0000 7faedb59e700 1 -- 172.21.15.69:0/3311989759 >> v1:172.21.15.88:6789/0 conn(0x7faedc159530 legacy=0x7faedc0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:03.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.916+0000 7faedb59e700 1 -- 172.21.15.69:0/3311989759 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faedc15a990 con 0x7faedc06e0e0 2023-10-06T01:39:03.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.916+0000 7faed3fff700 1 --2- 172.21.15.69:0/3311989759 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faedc06dc70 0x7faedc159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:03.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.916+0000 7faeda59c700 1 -- 172.21.15.69:0/3311989759 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363397988 0 0) 0x7faedc0ccfd0 con 0x7faedc159530 2023-10-06T01:39:03.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.917+0000 7faedb59e700 1 --2- 172.21.15.69:0/3311989759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faedc06e0e0 0x7faedc0cb6f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faed4009e60 tx=0x7faed4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b560124b172471ea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:03.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.917+0000 7faeda59c700 1 -- 172.21.15.69:0/3311989759 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed400e070 con 0x7faedc06e0e0 2023-10-06T01:39:03.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.917+0000 7faeda59c700 1 -- 172.21.15.69:0/3311989759 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed400bb60 con 0x7faedc06e0e0 2023-10-06T01:39:03.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.917+0000 7faeda59c700 1 -- 172.21.15.69:0/3311989759 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed4012430 con 0x7faedc06e0e0 2023-10-06T01:39:03.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.917+0000 7faee1231700 1 -- 172.21.15.69:0/3311989759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faedc06e0e0 msgr2=0x7faedc0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:03.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.917+0000 7faee1231700 1 --2- 172.21.15.69:0/3311989759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faedc06e0e0 0x7faedc0cb6f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7faed4009e60 tx=0x7faed4009780 comp rx=0 tx=0).stop 2023-10-06T01:39:03.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.917+0000 7faee1231700 1 -- 172.21.15.69:0/3311989759 shutdown_connections 2023-10-06T01:39:03.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.917+0000 7faee1231700 1 --2- 172.21.15.69:0/3311989759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faedc06e0e0 0x7faedc0cb6f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.917+0000 7faee1231700 1 --2- 172.21.15.69:0/3311989759 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faedc06dc70 0x7faedc159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.917+0000 7faee1231700 1 -- 172.21.15.69:0/3311989759 >> 172.21.15.69:0/3311989759 conn(0x7faedc0703a0 msgr2=0x7faedc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:03.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.917+0000 7faee1231700 1 -- 172.21.15.69:0/3311989759 shutdown_connections 2023-10-06T01:39:03.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.917+0000 7faee1231700 1 -- 172.21.15.69:0/3311989759 wait complete. 2023-10-06T01:39:03.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.918+0000 7faee1231700 1 Processor -- start 2023-10-06T01:39:03.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.918+0000 7faee1231700 1 -- start start 2023-10-06T01:39:03.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.919+0000 7faee1231700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faedc06dc70 0x7faedc154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:03.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.919+0000 7faee1231700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faedc06e0e0 0x7faedc0c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:03.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.919+0000 7faee1231700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faedc159530 0x7faedc0c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:03.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.919+0000 7faee1231700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc0c8bc0 con 0x7faedc06dc70 2023-10-06T01:39:03.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.919+0000 7faee1231700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc0b6500 con 0x7faedc159530 2023-10-06T01:39:03.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.919+0000 7faee1231700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faedc15ebd0 con 0x7faedc06e0e0 2023-10-06T01:39:03.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.919+0000 7faedad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faedc06dc70 0x7faedc154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:03.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.919+0000 7faedad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faedc06dc70 0x7faedc154d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57182/0 (socket says 172.21.15.69:57182) 2023-10-06T01:39:03.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.919+0000 7faedad9d700 1 -- 172.21.15.69:0/2194719933 learned_addr learned my addr 172.21.15.69:0/2194719933 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:03.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.919+0000 7faedb59e700 1 --2- 172.21.15.69:0/2194719933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faedc159530 0x7faedc0c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:03.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.919+0000 7faed3fff700 1 --2- 172.21.15.69:0/2194719933 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faedc06e0e0 0x7faedc0c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:03.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.919+0000 7faedad9d700 1 -- 172.21.15.69:0/2194719933 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faedc06e0e0 msgr2=0x7faedc0c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:03.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.919+0000 7faedad9d700 1 --2- 172.21.15.69:0/2194719933 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faedc06e0e0 0x7faedc0c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.919+0000 7faedad9d700 1 -- 172.21.15.69:0/2194719933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faedc159530 msgr2=0x7faedc0c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:03.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.919+0000 7faedad9d700 1 --2- 172.21.15.69:0/2194719933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faedc159530 0x7faedc0c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:03.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.919+0000 7faedad9d700 1 -- 172.21.15.69:0/2194719933 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faec4009420 con 0x7faedc06dc70 2023-10-06T01:39:03.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.920+0000 7faedad9d700 1 --2- 172.21.15.69:0/2194719933 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faedc06dc70 0x7faedc154d70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faecc00c5b0 tx=0x7faecc001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:03.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.920+0000 7faed2ffd700 1 -- 172.21.15.69:0/2194719933 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc005b30 con 0x7faedc06dc70 2023-10-06T01:39:03.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.920+0000 7faed2ffd700 1 -- 172.21.15.69:0/2194719933 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc005c90 con 0x7faedc06dc70 2023-10-06T01:39:03.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.920+0000 7faee1231700 1 -- 172.21.15.69:0/2194719933 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faed4009a20 con 0x7faedc06dc70 2023-10-06T01:39:03.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.920+0000 7faed2ffd700 1 -- 172.21.15.69:0/2194719933 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc007300 con 0x7faedc06dc70 2023-10-06T01:39:03.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.920+0000 7faee1231700 1 -- 172.21.15.69:0/2194719933 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faedc0b5f40 con 0x7faedc06dc70 2023-10-06T01:39:03.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.921+0000 7faee1231700 1 -- 172.21.15.69:0/2194719933 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faedc04c3c0 con 0x7faedc06dc70 2023-10-06T01:39:03.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.921+0000 7faed2ffd700 1 -- 172.21.15.69:0/2194719933 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faecc01b3b0 con 0x7faedc06dc70 2023-10-06T01:39:03.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.922+0000 7faed2ffd700 1 --2- 172.21.15.69:0/2194719933 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7faebc066f30 0x7faebc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:03.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.922+0000 7faed2ffd700 1 -- 172.21.15.69:0/2194719933 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7faecc083d00 con 0x7faedc06dc70 2023-10-06T01:39:03.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.922+0000 7faed3fff700 1 --2- 172.21.15.69:0/2194719933 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7faebc066f30 0x7faebc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:03.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.922+0000 7faed3fff700 1 --2- 172.21.15.69:0/2194719933 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7faebc066f30 0x7faebc0693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faec40093f0 tx=0x7faec4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:03.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:03.926+0000 7faed2ffd700 1 -- 172.21.15.69:0/2194719933 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faecc050d70 con 0x7faedc06dc70 2023-10-06T01:39:04.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.107+0000 7faee1231700 1 -- 172.21.15.69:0/2194719933 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faedc15ac70 con 0x7faedc06dc70 2023-10-06T01:39:04.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.107+0000 7faed2ffd700 1 -- 172.21.15.69:0/2194719933 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7faecc0170a0 con 0x7faedc06dc70 2023-10-06T01:39:04.108 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-10-06T01:39:04.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.109+0000 7faee1231700 1 -- 172.21.15.69:0/2194719933 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7faebc066f30 msgr2=0x7faebc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:04.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.109+0000 7faee1231700 1 --2- 172.21.15.69:0/2194719933 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7faebc066f30 0x7faebc0693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7faec40093f0 tx=0x7faec4008040 comp rx=0 tx=0).stop 2023-10-06T01:39:04.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.109+0000 7faee1231700 1 -- 172.21.15.69:0/2194719933 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faedc06dc70 msgr2=0x7faedc154d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:04.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.109+0000 7faee1231700 1 --2- 172.21.15.69:0/2194719933 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faedc06dc70 0x7faedc154d70 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7faecc00c5b0 tx=0x7faecc001070 comp rx=0 tx=0).stop 2023-10-06T01:39:04.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.109+0000 7faee1231700 1 -- 172.21.15.69:0/2194719933 shutdown_connections 2023-10-06T01:39:04.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.109+0000 7faee1231700 1 --2- 172.21.15.69:0/2194719933 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7faebc066f30 0x7faebc0693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:04.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.109+0000 7faee1231700 1 --2- 172.21.15.69:0/2194719933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faedc159530 0x7faedc0c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:04.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.109+0000 7faee1231700 1 --2- 172.21.15.69:0/2194719933 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faedc06dc70 0x7faedc154d70 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:04.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.109+0000 7faee1231700 1 --2- 172.21.15.69:0/2194719933 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faedc06e0e0 0x7faedc0c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:04.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.109+0000 7faee1231700 1 -- 172.21.15.69:0/2194719933 >> 172.21.15.69:0/2194719933 conn(0x7faedc0703a0 msgr2=0x7faedc15ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:04.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.109+0000 7faee1231700 1 -- 172.21.15.69:0/2194719933 shutdown_connections 2023-10-06T01:39:04.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.109+0000 7faee1231700 1 -- 172.21.15.69:0/2194719933 wait complete. 2023-10-06T01:39:04.121 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:39:04.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.238+0000 7f77c759e700 1 Processor -- start 2023-10-06T01:39:04.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.238+0000 7f77c759e700 1 -- start start 2023-10-06T01:39:04.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.239+0000 7f77c759e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f77c8153a00 0x7f77c8153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:04.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.239+0000 7f77c759e700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c815ac50 con 0x7f77c815de50 2023-10-06T01:39:04.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.239+0000 7f77c759e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77c815d010 con 0x7f77c80cea00 2023-10-06T01:39:04.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.239+0000 7f77c759e700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77c815af60 con 0x7f77c8153a00 2023-10-06T01:39:04.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.239+0000 7f77c659c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f77c8153a00 0x7f77c8153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:04.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.239+0000 7f77c5d9b700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f77c815de50 0x7f77c815a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37516/0 (socket says 172.21.15.69:37516) 2023-10-06T01:39:04.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.239+0000 7f77c5d9b700 1 -- 172.21.15.69:0/2392592835 learned_addr learned my addr 172.21.15.69:0/2392592835 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:04.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.239+0000 7f77c659c700 1 -- 172.21.15.69:0/2392592835 >> v1:172.21.15.88:6789/0 conn(0x7f77c80cea00 legacy=0x7f77c80cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:04.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.239+0000 7f77c659c700 1 -- 172.21.15.69:0/2392592835 >> v1:172.21.15.69:6789/0 conn(0x7f77c815de50 legacy=0x7f77c815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:04.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.239+0000 7f77c659c700 1 -- 172.21.15.69:0/2392592835 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c815b240 con 0x7f77c8153a00 2023-10-06T01:39:04.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.239+0000 7f77c559a700 1 -- 172.21.15.69:0/2392592835 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3781316005 0 0) 0x7f77c815ac50 con 0x7f77c815de50 2023-10-06T01:39:04.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.239+0000 7f77c659c700 1 --2- 172.21.15.69:0/2392592835 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77c8153a00 0x7f77c8153dd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f77b80098e0 tx=0x7f77b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d59ffef89fbc48f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:04.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.239+0000 7f77c559a700 1 -- 172.21.15.69:0/2392592835 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b8009e80 con 0x7f77c8153a00 2023-10-06T01:39:04.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.239+0000 7f77c559a700 1 -- 172.21.15.69:0/2392592835 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b800b860 con 0x7f77c8153a00 2023-10-06T01:39:04.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.239+0000 7f77c559a700 1 -- 172.21.15.69:0/2392592835 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b800bbe0 con 0x7f77c8153a00 2023-10-06T01:39:04.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.240+0000 7f77c759e700 1 -- 172.21.15.69:0/2392592835 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77c8153a00 msgr2=0x7f77c8153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:04.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.240+0000 7f77c759e700 1 --2- 172.21.15.69:0/2392592835 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77c8153a00 0x7f77c8153dd0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f77b80098e0 tx=0x7f77b80091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:04.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.240+0000 7f77c759e700 1 -- 172.21.15.69:0/2392592835 shutdown_connections 2023-10-06T01:39:04.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.240+0000 7f77c759e700 1 --2- 172.21.15.69:0/2392592835 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77c8153a00 0x7f77c8153dd0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:04.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.240+0000 7f77c759e700 1 -- 172.21.15.69:0/2392592835 >> 172.21.15.69:0/2392592835 conn(0x7f77c80703a0 msgr2=0x7f77c80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:04.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.240+0000 7f77c759e700 1 -- 172.21.15.69:0/2392592835 shutdown_connections 2023-10-06T01:39:04.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.240+0000 7f77c759e700 1 -- 172.21.15.69:0/2392592835 wait complete. 2023-10-06T01:39:04.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.241+0000 7f77c759e700 1 Processor -- start 2023-10-06T01:39:04.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.241+0000 7f77c759e700 1 -- start start 2023-10-06T01:39:04.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.242+0000 7f77c759e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77c80cea00 0x7f77c816cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:04.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.242+0000 7f77c759e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f77c8153a00 0x7f77c80b3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:04.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.242+0000 7f77c759e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77c815de50 0x7f77c816ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:04.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.242+0000 7f77c759e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c80cc0e0 con 0x7f77c80cea00 2023-10-06T01:39:04.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.242+0000 7f77c759e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77c80cc980 con 0x7f77c815de50 2023-10-06T01:39:04.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.242+0000 7f77c759e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77c816b340 con 0x7f77c8153a00 2023-10-06T01:39:04.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.242+0000 7f77c659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77c80cea00 0x7f77c816cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:04.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.242+0000 7f77c659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77c80cea00 0x7f77c816cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57200/0 (socket says 172.21.15.69:57200) 2023-10-06T01:39:04.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.242+0000 7f77c659c700 1 -- 172.21.15.69:0/4216780549 learned_addr learned my addr 172.21.15.69:0/4216780549 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:04.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.242+0000 7f77c6d9d700 1 --2- 172.21.15.69:0/4216780549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77c815de50 0x7f77c816ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:04.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.242+0000 7f77c5d9b700 1 --2- 172.21.15.69:0/4216780549 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f77c8153a00 0x7f77c80b3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:04.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.242+0000 7f77c659c700 1 -- 172.21.15.69:0/4216780549 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f77c8153a00 msgr2=0x7f77c80b3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:04.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.242+0000 7f77c659c700 1 --2- 172.21.15.69:0/4216780549 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f77c8153a00 0x7f77c80b3ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:04.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.242+0000 7f77c659c700 1 -- 172.21.15.69:0/4216780549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77c815de50 msgr2=0x7f77c816ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:04.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.242+0000 7f77c659c700 1 --2- 172.21.15.69:0/4216780549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77c815de50 0x7f77c816ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:04.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.242+0000 7f77c659c700 1 -- 172.21.15.69:0/4216780549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b8009420 con 0x7f77c80cea00 2023-10-06T01:39:04.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.242+0000 7f77c659c700 1 --2- 172.21.15.69:0/4216780549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77c80cea00 0x7f77c816cb80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f77b8009fa0 tx=0x7f77b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:04.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.242+0000 7f77b67fc700 1 -- 172.21.15.69:0/4216780549 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b801f070 con 0x7f77c80cea00 2023-10-06T01:39:04.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.242+0000 7f77b67fc700 1 -- 172.21.15.69:0/4216780549 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77b800b9d0 con 0x7f77c80cea00 2023-10-06T01:39:04.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.242+0000 7f77c759e700 1 -- 172.21.15.69:0/4216780549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77c816aa90 con 0x7f77c80cea00 2023-10-06T01:39:04.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.242+0000 7f77b67fc700 1 -- 172.21.15.69:0/4216780549 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77b8025670 con 0x7f77c80cea00 2023-10-06T01:39:04.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.242+0000 7f77c759e700 1 -- 172.21.15.69:0/4216780549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77c80cc610 con 0x7f77c80cea00 2023-10-06T01:39:04.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.243+0000 7f77c759e700 1 -- 172.21.15.69:0/4216780549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77c804c3c0 con 0x7f77c80cea00 2023-10-06T01:39:04.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.244+0000 7f77b67fc700 1 -- 172.21.15.69:0/4216780549 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f77b8023070 con 0x7f77c80cea00 2023-10-06T01:39:04.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.244+0000 7f77b67fc700 1 --2- 172.21.15.69:0/4216780549 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f77a8066f30 0x7f77a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:04.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.244+0000 7f77c5d9b700 1 --2- 172.21.15.69:0/4216780549 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f77a8066f30 0x7f77a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:04.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.244+0000 7f77b67fc700 1 -- 172.21.15.69:0/4216780549 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f77b8085c20 con 0x7f77c80cea00 2023-10-06T01:39:04.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.244+0000 7f77c5d9b700 1 --2- 172.21.15.69:0/4216780549 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f77a8066f30 0x7f77a80693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f77c80c6460 tx=0x7f77bc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:04.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.248+0000 7f77b67fc700 1 -- 172.21.15.69:0/4216780549 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77b8052d30 con 0x7f77c80cea00 2023-10-06T01:39:04.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.431+0000 7f77c759e700 1 -- 172.21.15.69:0/4216780549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f77c80cf610 con 0x7f77c80cea00 2023-10-06T01:39:04.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.431+0000 7f77b67fc700 1 -- 172.21.15.69:0/4216780549 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f77b80150a0 con 0x7f77c80cea00 2023-10-06T01:39:04.432 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 8 2023-10-06T01:39:04.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.433+0000 7f77c759e700 1 -- 172.21.15.69:0/4216780549 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f77a8066f30 msgr2=0x7f77a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:04.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.433+0000 7f77c759e700 1 --2- 172.21.15.69:0/4216780549 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f77a8066f30 0x7f77a80693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f77c80c6460 tx=0x7f77bc009040 comp rx=0 tx=0).stop 2023-10-06T01:39:04.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.433+0000 7f77c759e700 1 -- 172.21.15.69:0/4216780549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77c80cea00 msgr2=0x7f77c816cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:04.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.433+0000 7f77c759e700 1 --2- 172.21.15.69:0/4216780549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77c80cea00 0x7f77c816cb80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f77b8009fa0 tx=0x7f77b8017000 comp rx=0 tx=0).stop 2023-10-06T01:39:04.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.433+0000 7f77c759e700 1 -- 172.21.15.69:0/4216780549 shutdown_connections 2023-10-06T01:39:04.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.433+0000 7f77c759e700 1 --2- 172.21.15.69:0/4216780549 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f77a8066f30 0x7f77a80693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:04.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.433+0000 7f77c759e700 1 --2- 172.21.15.69:0/4216780549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f77c815de50 0x7f77c816ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:04.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.433+0000 7f77c759e700 1 --2- 172.21.15.69:0/4216780549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77c80cea00 0x7f77c816cb80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:04.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.433+0000 7f77c759e700 1 --2- 172.21.15.69:0/4216780549 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f77c8153a00 0x7f77c80b3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:04.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.433+0000 7f77c759e700 1 -- 172.21.15.69:0/4216780549 >> 172.21.15.69:0/4216780549 conn(0x7f77c80703a0 msgr2=0x7f77c80c5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:04.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.433+0000 7f77c759e700 1 -- 172.21.15.69:0/4216780549 shutdown_connections 2023-10-06T01:39:04.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.433+0000 7f77c759e700 1 -- 172.21.15.69:0/4216780549 wait complete. 2023-10-06T01:39:04.446 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T01:39:04.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.564+0000 7fe58e884700 1 Processor -- start 2023-10-06T01:39:04.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.564+0000 7fe58e884700 1 -- start start 2023-10-06T01:39:04.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.565+0000 7fe58e884700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe58806e0e0 0x7fe5880cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:04.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.565+0000 7fe58e884700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5880ccfd0 con 0x7fe588159530 2023-10-06T01:39:04.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.565+0000 7fe58e884700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe58815a3d0 con 0x7fe58806dc70 2023-10-06T01:39:04.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.565+0000 7fe58e884700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe58815a6b0 con 0x7fe58806e0e0 2023-10-06T01:39:04.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.565+0000 7fe587fff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fe588159530 0x7fe5880ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37520/0 (socket says 172.21.15.69:37520) 2023-10-06T01:39:04.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.565+0000 7fe58ce21700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe58806e0e0 0x7fe5880cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:04.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.565+0000 7fe587fff700 1 -- 172.21.15.69:0/1761247407 learned_addr learned my addr 172.21.15.69:0/1761247407 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:04.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.565+0000 7fe586ffd700 1 -- 172.21.15.69:0/1761247407 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484546863 0 0) 0x7fe5880ccfd0 con 0x7fe588159530 2023-10-06T01:39:04.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.565+0000 7fe586ffd700 1 -- 172.21.15.69:0/1761247407 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe570003570 con 0x7fe588159530 2023-10-06T01:39:04.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.565+0000 7fe58ce21700 1 -- 172.21.15.69:0/1761247407 >> v1:172.21.15.88:6789/0 conn(0x7fe58806dc70 legacy=0x7fe588159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:04.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.565+0000 7fe58ce21700 1 -- 172.21.15.69:0/1761247407 >> v1:172.21.15.69:6789/0 conn(0x7fe588159530 legacy=0x7fe5880ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:04.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.565+0000 7fe58ce21700 1 -- 172.21.15.69:0/1761247407 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58815a990 con 0x7fe58806e0e0 2023-10-06T01:39:04.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.566+0000 7fe58ce21700 1 --2- 172.21.15.69:0/1761247407 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe58806e0e0 0x7fe5880cb6f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe580009e60 tx=0x7fe580009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c55615301b5feb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:04.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.566+0000 7fe586ffd700 1 -- 172.21.15.69:0/1761247407 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe58000e070 con 0x7fe58806e0e0 2023-10-06T01:39:04.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.566+0000 7fe586ffd700 1 -- 172.21.15.69:0/1761247407 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe58000bb60 con 0x7fe58806e0e0 2023-10-06T01:39:04.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.566+0000 7fe586ffd700 1 -- 172.21.15.69:0/1761247407 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe580012430 con 0x7fe58806e0e0 2023-10-06T01:39:04.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.566+0000 7fe58e884700 1 -- 172.21.15.69:0/1761247407 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe58806e0e0 msgr2=0x7fe5880cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:04.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.566+0000 7fe58e884700 1 --2- 172.21.15.69:0/1761247407 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe58806e0e0 0x7fe5880cb6f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fe580009e60 tx=0x7fe580009780 comp rx=0 tx=0).stop 2023-10-06T01:39:04.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.566+0000 7fe58e884700 1 -- 172.21.15.69:0/1761247407 shutdown_connections 2023-10-06T01:39:04.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.566+0000 7fe58e884700 1 --2- 172.21.15.69:0/1761247407 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe58806e0e0 0x7fe5880cb6f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:04.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.566+0000 7fe58e884700 1 -- 172.21.15.69:0/1761247407 >> 172.21.15.69:0/1761247407 conn(0x7fe5880703a0 msgr2=0x7fe5880707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:04.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.566+0000 7fe58e884700 1 -- 172.21.15.69:0/1761247407 shutdown_connections 2023-10-06T01:39:04.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.566+0000 7fe58e884700 1 -- 172.21.15.69:0/1761247407 wait complete. 2023-10-06T01:39:04.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.567+0000 7fe58e884700 1 Processor -- start 2023-10-06T01:39:04.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.567+0000 7fe58e884700 1 -- start start 2023-10-06T01:39:04.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.568+0000 7fe58e884700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe58806dc70 0x7fe5880c7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:04.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.568+0000 7fe58e884700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe58806e0e0 0x7fe58814e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:04.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.568+0000 7fe58e884700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe588159530 0x7fe5880b51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:04.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.568+0000 7fe58e884700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5880c8550 con 0x7fe58806e0e0 2023-10-06T01:39:04.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.568+0000 7fe58e884700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5880b47e0 con 0x7fe58806dc70 2023-10-06T01:39:04.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.568+0000 7fe58e884700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5880c7d60 con 0x7fe588159530 2023-10-06T01:39:04.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.568+0000 7fe5877fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe58806e0e0 0x7fe58814e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:04.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.568+0000 7fe5877fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe58806e0e0 0x7fe58814e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57222/0 (socket says 172.21.15.69:57222) 2023-10-06T01:39:04.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.568+0000 7fe5877fe700 1 -- 172.21.15.69:0/208997384 learned_addr learned my addr 172.21.15.69:0/208997384 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:04.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.568+0000 7fe587fff700 1 --2- 172.21.15.69:0/208997384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe58806dc70 0x7fe5880c7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:04.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.568+0000 7fe58ce21700 1 --2- 172.21.15.69:0/208997384 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe588159530 0x7fe5880b51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:04.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.569+0000 7fe5877fe700 1 -- 172.21.15.69:0/208997384 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe588159530 msgr2=0x7fe5880b51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:04.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.569+0000 7fe5877fe700 1 --2- 172.21.15.69:0/208997384 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe588159530 0x7fe5880b51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:04.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.569+0000 7fe5877fe700 1 -- 172.21.15.69:0/208997384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe58806dc70 msgr2=0x7fe5880c7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:04.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.569+0000 7fe5877fe700 1 --2- 172.21.15.69:0/208997384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe58806dc70 0x7fe5880c7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:04.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.569+0000 7fe5877fe700 1 -- 172.21.15.69:0/208997384 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe580009a20 con 0x7fe58806e0e0 2023-10-06T01:39:04.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.569+0000 7fe587fff700 1 --2- 172.21.15.69:0/208997384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe58806dc70 0x7fe5880c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:04.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.569+0000 7fe5877fe700 1 --2- 172.21.15.69:0/208997384 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe58806e0e0 0x7fe58814e020 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00c510 tx=0x7fe57c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:04.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.569+0000 7fe56ffff700 1 -- 172.21.15.69:0/208997384 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c011590 con 0x7fe58806e0e0 2023-10-06T01:39:04.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.569+0000 7fe56ffff700 1 -- 172.21.15.69:0/208997384 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57c011710 con 0x7fe58806e0e0 2023-10-06T01:39:04.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.569+0000 7fe56ffff700 1 -- 172.21.15.69:0/208997384 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c011ad0 con 0x7fe58806e0e0 2023-10-06T01:39:04.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.569+0000 7fe58e884700 1 -- 172.21.15.69:0/208997384 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe58814e560 con 0x7fe58806e0e0 2023-10-06T01:39:04.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.569+0000 7fe58e884700 1 -- 172.21.15.69:0/208997384 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5880b4d60 con 0x7fe58806e0e0 2023-10-06T01:39:04.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.570+0000 7fe58e884700 1 -- 172.21.15.69:0/208997384 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5880b4ef0 con 0x7fe58806e0e0 2023-10-06T01:39:04.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.570+0000 7fe56ffff700 1 -- 172.21.15.69:0/208997384 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe57c01b3b0 con 0x7fe58806e0e0 2023-10-06T01:39:04.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.571+0000 7fe56ffff700 1 --2- 172.21.15.69:0/208997384 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe574066f30 0x7fe5740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:04.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.571+0000 7fe56ffff700 1 -- 172.21.15.69:0/208997384 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe57c083b80 con 0x7fe58806e0e0 2023-10-06T01:39:04.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.571+0000 7fe587fff700 1 --2- 172.21.15.69:0/208997384 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe574066f30 0x7fe5740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:04.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.571+0000 7fe587fff700 1 --2- 172.21.15.69:0/208997384 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe574066f30 0x7fe5740693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe5780058d0 tx=0x7fe578009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:04.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.575+0000 7fe56ffff700 1 -- 172.21.15.69:0/208997384 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe57c050c90 con 0x7fe58806e0e0 2023-10-06T01:39:04.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.762+0000 7fe58e884700 1 -- 172.21.15.69:0/208997384 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe58804c3c0 con 0x7fe58806e0e0 2023-10-06T01:39:04.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.762+0000 7fe56ffff700 1 -- 172.21.15.69:0/208997384 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe57c017020 con 0x7fe58806e0e0 2023-10-06T01:39:04.764 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-10-06T01:39:04.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.764+0000 7fe58e884700 1 -- 172.21.15.69:0/208997384 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe574066f30 msgr2=0x7fe5740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:04.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.764+0000 7fe58e884700 1 --2- 172.21.15.69:0/208997384 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe574066f30 0x7fe5740693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fe5780058d0 tx=0x7fe578009040 comp rx=0 tx=0).stop 2023-10-06T01:39:04.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.764+0000 7fe58e884700 1 -- 172.21.15.69:0/208997384 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe58806e0e0 msgr2=0x7fe58814e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:04.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.764+0000 7fe58e884700 1 --2- 172.21.15.69:0/208997384 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe58806e0e0 0x7fe58814e020 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00c510 tx=0x7fe57c00c8d0 comp rx=0 tx=0).stop 2023-10-06T01:39:04.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.764+0000 7fe58e884700 1 -- 172.21.15.69:0/208997384 shutdown_connections 2023-10-06T01:39:04.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.764+0000 7fe58e884700 1 --2- 172.21.15.69:0/208997384 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe574066f30 0x7fe5740693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:04.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.764+0000 7fe58e884700 1 --2- 172.21.15.69:0/208997384 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe588159530 0x7fe5880b51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:04.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.764+0000 7fe58e884700 1 --2- 172.21.15.69:0/208997384 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe58806dc70 0x7fe5880c7820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:04.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.764+0000 7fe58e884700 1 --2- 172.21.15.69:0/208997384 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe58806e0e0 0x7fe58814e020 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:04.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.764+0000 7fe58e884700 1 -- 172.21.15.69:0/208997384 >> 172.21.15.69:0/208997384 conn(0x7fe5880703a0 msgr2=0x7fe5880b0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:04.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.764+0000 7fe58e884700 1 -- 172.21.15.69:0/208997384 shutdown_connections 2023-10-06T01:39:04.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.764+0000 7fe58e884700 1 -- 172.21.15.69:0/208997384 wait complete. 2023-10-06T01:39:04.777 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T01:39:04.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.893+0000 7febe83f9700 1 Processor -- start 2023-10-06T01:39:04.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.893+0000 7febe83f9700 1 -- start start 2023-10-06T01:39:04.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.894+0000 7febe83f9700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7febe0159530 0x7febe00ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:04.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.894+0000 7febe83f9700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe00ccfd0 con 0x7febe006e0e0 2023-10-06T01:39:04.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.894+0000 7febe83f9700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe00cf0e0 con 0x7febe006dc70 2023-10-06T01:39:04.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.894+0000 7febe83f9700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe015a3d0 con 0x7febe0159530 2023-10-06T01:39:04.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.894+0000 7febe6996700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7febe006e0e0 0x7febe00cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37530/0 (socket says 172.21.15.69:37530) 2023-10-06T01:39:04.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.894+0000 7febe6996700 1 -- 172.21.15.69:0/798129358 learned_addr learned my addr 172.21.15.69:0/798129358 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:04.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.894+0000 7febe6195700 1 --2- 172.21.15.69:0/798129358 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7febe0159530 0x7febe00ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:04.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.894+0000 7febe5193700 1 -- 172.21.15.69:0/798129358 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578986572 0 0) 0x7febe00ccfd0 con 0x7febe006e0e0 2023-10-06T01:39:04.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.894+0000 7febe5193700 1 -- 172.21.15.69:0/798129358 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febc8003570 con 0x7febe006e0e0 2023-10-06T01:39:04.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe5193700 1 -- 172.21.15.69:0/798129358 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2765679108 0 0) 0x7febe00cf0e0 con 0x7febe006dc70 2023-10-06T01:39:04.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe5193700 1 -- 172.21.15.69:0/798129358 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febe00ccfd0 con 0x7febe006dc70 2023-10-06T01:39:04.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe5193700 1 -- 172.21.15.69:0/798129358 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2307178974 0 0) 0x7febc8003570 con 0x7febe006e0e0 2023-10-06T01:39:04.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe5193700 1 -- 172.21.15.69:0/798129358 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7febe0159530 msgr2=0x7febe00ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:04.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe5193700 1 --2- 172.21.15.69:0/798129358 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7febe0159530 0x7febe00ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:04.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe5193700 1 -- 172.21.15.69:0/798129358 >> v1:172.21.15.88:6789/0 conn(0x7febe006dc70 legacy=0x7febe0159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:04.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe5193700 1 -- 172.21.15.69:0/798129358 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe015a6b0 con 0x7febe006e0e0 2023-10-06T01:39:04.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe5193700 1 -- 172.21.15.69:0/798129358 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7febd8001470 con 0x7febe006e0e0 2023-10-06T01:39:04.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe5193700 1 -- 172.21.15.69:0/798129358 >> v1:172.21.15.69:6789/0 conn(0x7febe006e0e0 legacy=0x7febe00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:04.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe5193700 1 --2- 172.21.15.69:0/798129358 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7febc8003c20 0x7febc8004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:04.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe5193700 1 --2- 172.21.15.69:0/798129358 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7febe0159530 0x7febc8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:04.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe5193700 1 --2- 172.21.15.69:0/798129358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febc8004d50 0x7febc80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:04.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe5193700 1 -- 172.21.15.69:0/798129358 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe015a3d0 con 0x7febc8003c20 2023-10-06T01:39:04.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe5193700 1 -- 172.21.15.69:0/798129358 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc800bb40 con 0x7febc8004d50 2023-10-06T01:39:04.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe5193700 1 -- 172.21.15.69:0/798129358 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc800bd00 con 0x7febe0159530 2023-10-06T01:39:04.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe6195700 1 --2- 172.21.15.69:0/798129358 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7febc8003c20 0x7febc8004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:04.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe6996700 1 --2- 172.21.15.69:0/798129358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febc8004d50 0x7febc80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:04.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe5994700 1 --2- 172.21.15.69:0/798129358 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7febe0159530 0x7febc8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:04.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe6195700 1 -- 172.21.15.69:0/798129358 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7febe0159530 msgr2=0x7febc8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:04.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe6195700 1 --2- 172.21.15.69:0/798129358 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7febe0159530 0x7febc8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:04.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe6195700 1 -- 172.21.15.69:0/798129358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febc8004d50 msgr2=0x7febc80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:04.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe6195700 1 --2- 172.21.15.69:0/798129358 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febc8004d50 0x7febc80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:04.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe6195700 1 -- 172.21.15.69:0/798129358 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc8003570 con 0x7febc8003c20 2023-10-06T01:39:04.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe5994700 1 --2- 172.21.15.69:0/798129358 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7febe0159530 0x7febc8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:04.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe6195700 1 --2- 172.21.15.69:0/798129358 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7febc8003c20 0x7febc8004010 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7febd000e210 tx=0x7febd000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87bc09eef57282dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:04.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe5193700 1 -- 172.21.15.69:0/798129358 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd000eac0 con 0x7febc8003c20 2023-10-06T01:39:04.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe5193700 1 -- 172.21.15.69:0/798129358 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd000f040 con 0x7febc8003c20 2023-10-06T01:39:04.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.895+0000 7febe5193700 1 -- 172.21.15.69:0/798129358 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd000ee70 con 0x7febc8003c20 2023-10-06T01:39:04.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.896+0000 7febe83f9700 1 -- 172.21.15.69:0/798129358 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7febc8003c20 msgr2=0x7febc8004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:04.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.896+0000 7febe83f9700 1 --2- 172.21.15.69:0/798129358 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7febc8003c20 0x7febc8004010 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7febd000e210 tx=0x7febd000b040 comp rx=0 tx=0).stop 2023-10-06T01:39:04.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.896+0000 7febe6996700 1 -- 172.21.15.69:0/798129358 reap_dead start 2023-10-06T01:39:04.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.896+0000 7febe83f9700 1 -- 172.21.15.69:0/798129358 shutdown_connections 2023-10-06T01:39:04.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.896+0000 7febe83f9700 1 -- 172.21.15.69:0/798129358 >> 172.21.15.69:0/798129358 conn(0x7febe00703a0 msgr2=0x7febe00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:04.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.896+0000 7febe83f9700 1 -- 172.21.15.69:0/798129358 shutdown_connections 2023-10-06T01:39:04.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.896+0000 7febe83f9700 1 -- 172.21.15.69:0/798129358 wait complete. 2023-10-06T01:39:04.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.897+0000 7febe83f9700 1 Processor -- start 2023-10-06T01:39:04.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.897+0000 7febe83f9700 1 -- start start 2023-10-06T01:39:04.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.898+0000 7febe83f9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7febc8003c20 0x7febe0151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:04.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.898+0000 7febe83f9700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7febe0154020 0x7febe00d02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:04.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.898+0000 7febe83f9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febe00d0810 0x7febe016da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:04.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.898+0000 7febe83f9700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe015cb70 con 0x7febc8003c20 2023-10-06T01:39:04.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.898+0000 7febe83f9700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe00d0c80 con 0x7febe00d0810 2023-10-06T01:39:04.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.898+0000 7febe83f9700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe015bff0 con 0x7febe0154020 2023-10-06T01:39:04.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.898+0000 7febe6195700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7febc8003c20 0x7febe0151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:04.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.898+0000 7febe6195700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7febc8003c20 0x7febe0151280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57238/0 (socket says 172.21.15.69:57238) 2023-10-06T01:39:04.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.898+0000 7febe6195700 1 -- 172.21.15.69:0/271507467 learned_addr learned my addr 172.21.15.69:0/271507467 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:04.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.898+0000 7febe6996700 1 --2- 172.21.15.69:0/271507467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febe00d0810 0x7febe016da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:04.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.898+0000 7febe5994700 1 --2- 172.21.15.69:0/271507467 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7febe0154020 0x7febe00d02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:04.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.898+0000 7febe6195700 1 -- 172.21.15.69:0/271507467 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7febe0154020 msgr2=0x7febe00d02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:04.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.898+0000 7febe6195700 1 --2- 172.21.15.69:0/271507467 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7febe0154020 0x7febe00d02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:04.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.898+0000 7febe6195700 1 -- 172.21.15.69:0/271507467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febe00d0810 msgr2=0x7febe016da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:04.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.898+0000 7febe6195700 1 --2- 172.21.15.69:0/271507467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febe00d0810 0x7febe016da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:04.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.898+0000 7febe6195700 1 -- 172.21.15.69:0/271507467 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe0154490 con 0x7febc8003c20 2023-10-06T01:39:04.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.898+0000 7febe6996700 1 --2- 172.21.15.69:0/271507467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febe00d0810 0x7febe016da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:04.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.898+0000 7febe5994700 1 --2- 172.21.15.69:0/271507467 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7febe0154020 0x7febe00d02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:04.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.898+0000 7febe6195700 1 --2- 172.21.15.69:0/271507467 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7febc8003c20 0x7febe0151280 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7febd000e800 tx=0x7febd001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:04.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.898+0000 7febde7fc700 1 -- 172.21.15.69:0/271507467 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd001d420 con 0x7febc8003c20 2023-10-06T01:39:04.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.898+0000 7febde7fc700 1 -- 172.21.15.69:0/271507467 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febd001d5a0 con 0x7febc8003c20 2023-10-06T01:39:04.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.898+0000 7febe83f9700 1 -- 172.21.15.69:0/271507467 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe015c240 con 0x7febc8003c20 2023-10-06T01:39:04.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.899+0000 7febde7fc700 1 -- 172.21.15.69:0/271507467 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febd001d960 con 0x7febc8003c20 2023-10-06T01:39:04.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.899+0000 7febe83f9700 1 -- 172.21.15.69:0/271507467 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe015c800 con 0x7febc8003c20 2023-10-06T01:39:04.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.899+0000 7febe83f9700 1 -- 172.21.15.69:0/271507467 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe004c3c0 con 0x7febc8003c20 2023-10-06T01:39:04.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.900+0000 7febde7fc700 1 -- 172.21.15.69:0/271507467 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7febd0003040 con 0x7febc8003c20 2023-10-06T01:39:04.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.900+0000 7febde7fc700 1 --2- 172.21.15.69:0/271507467 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7febcc066f30 0x7febcc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:04.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.900+0000 7febde7fc700 1 -- 172.21.15.69:0/271507467 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7febd0086a60 con 0x7febc8003c20 2023-10-06T01:39:04.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.900+0000 7febe5994700 1 --2- 172.21.15.69:0/271507467 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7febcc066f30 0x7febcc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:04.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.901+0000 7febe5994700 1 --2- 172.21.15.69:0/271507467 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7febcc066f30 0x7febcc0693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7febe015f460 tx=0x7febd4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:04.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:04.904+0000 7febde7fc700 1 -- 172.21.15.69:0/271507467 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7febd0053b70 con 0x7febc8003c20 2023-10-06T01:39:05.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.085+0000 7febe83f9700 1 -- 172.21.15.69:0/271507467 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7febe015a990 con 0x7febc8003c20 2023-10-06T01:39:05.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.085+0000 7febde7fc700 1 -- 172.21.15.69:0/271507467 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7febd0018020 con 0x7febc8003c20 2023-10-06T01:39:05.086 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-10-06T01:39:05.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.088+0000 7febe83f9700 1 -- 172.21.15.69:0/271507467 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7febcc066f30 msgr2=0x7febcc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:05.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.088+0000 7febe83f9700 1 --2- 172.21.15.69:0/271507467 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7febcc066f30 0x7febcc0693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7febe015f460 tx=0x7febd4009040 comp rx=0 tx=0).stop 2023-10-06T01:39:05.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.088+0000 7febe83f9700 1 -- 172.21.15.69:0/271507467 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7febc8003c20 msgr2=0x7febe0151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:05.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.088+0000 7febe83f9700 1 --2- 172.21.15.69:0/271507467 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7febc8003c20 0x7febe0151280 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7febd000e800 tx=0x7febd001a000 comp rx=0 tx=0).stop 2023-10-06T01:39:05.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.088+0000 7febe83f9700 1 -- 172.21.15.69:0/271507467 shutdown_connections 2023-10-06T01:39:05.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.088+0000 7febe83f9700 1 --2- 172.21.15.69:0/271507467 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7febcc066f30 0x7febcc0693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.088+0000 7febe83f9700 1 --2- 172.21.15.69:0/271507467 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7febe00d0810 0x7febe016da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.088+0000 7febe83f9700 1 --2- 172.21.15.69:0/271507467 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7febc8003c20 0x7febe0151280 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.088+0000 7febe83f9700 1 --2- 172.21.15.69:0/271507467 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7febe0154020 0x7febe00d02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.088+0000 7febe83f9700 1 -- 172.21.15.69:0/271507467 >> 172.21.15.69:0/271507467 conn(0x7febe00703a0 msgr2=0x7febe00b2b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:05.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.088+0000 7febe83f9700 1 -- 172.21.15.69:0/271507467 shutdown_connections 2023-10-06T01:39:05.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.088+0000 7febe83f9700 1 -- 172.21.15.69:0/271507467 wait complete. 2023-10-06T01:39:05.100 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:39:05.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.214+0000 7fb896c0b700 1 Processor -- start 2023-10-06T01:39:05.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.214+0000 7fb896c0b700 1 -- start start 2023-10-06T01:39:05.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.215+0000 7fb896c0b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb8900a8be0 0x7fb8900a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:05.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.215+0000 7fb896c0b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8900aee90 0x7fb8900b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:05.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.215+0000 7fb896c0b700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8900ce1a0 con 0x7fb89006d280 2023-10-06T01:39:05.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.215+0000 7fb896c0b700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8900cd5d0 con 0x7fb8900a8be0 2023-10-06T01:39:05.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.215+0000 7fb896c0b700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8900cd870 con 0x7fb8900aee90 2023-10-06T01:39:05.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.215+0000 7fb8949a7700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb8900a8be0 0x7fb8900a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:05.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.215+0000 7fb88ffff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fb89006d280 0x7fb8900ae780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37534/0 (socket says 172.21.15.69:37534) 2023-10-06T01:39:05.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.215+0000 7fb88ffff700 1 -- 172.21.15.69:0/4109078419 learned_addr learned my addr 172.21.15.69:0/4109078419 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:05.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.215+0000 7fb8951a8700 1 --2- 172.21.15.69:0/4109078419 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8900aee90 0x7fb8900b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:05.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.216+0000 7fb8949a7700 1 -- 172.21.15.69:0/4109078419 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8900aee90 msgr2=0x7fb8900b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:05.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.216+0000 7fb8949a7700 1 --2- 172.21.15.69:0/4109078419 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8900aee90 0x7fb8900b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.216+0000 7fb8949a7700 1 -- 172.21.15.69:0/4109078419 >> v1:172.21.15.69:6789/0 conn(0x7fb89006d280 legacy=0x7fb8900ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:05.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.216+0000 7fb8949a7700 1 -- 172.21.15.69:0/4109078419 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8900cdb50 con 0x7fb8900a8be0 2023-10-06T01:39:05.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.216+0000 7fb88f7fe700 1 -- 172.21.15.69:0/4109078419 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 989049137 0 0) 0x7fb8900ce1a0 con 0x7fb89006d280 2023-10-06T01:39:05.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.216+0000 7fb8949a7700 1 --2- 172.21.15.69:0/4109078419 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8900a8be0 0x7fb8900a8fb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb8800098d0 tx=0x7fb880009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e74b3b95db407919 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:05.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.216+0000 7fb88f7fe700 1 -- 172.21.15.69:0/4109078419 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb880009e70 con 0x7fb8900a8be0 2023-10-06T01:39:05.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.216+0000 7fb88f7fe700 1 -- 172.21.15.69:0/4109078419 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb880005c10 con 0x7fb8900a8be0 2023-10-06T01:39:05.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.216+0000 7fb88f7fe700 1 -- 172.21.15.69:0/4109078419 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb88000b6e0 con 0x7fb8900a8be0 2023-10-06T01:39:05.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.216+0000 7fb896c0b700 1 -- 172.21.15.69:0/4109078419 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8900a8be0 msgr2=0x7fb8900a8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:05.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.216+0000 7fb896c0b700 1 --2- 172.21.15.69:0/4109078419 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8900a8be0 0x7fb8900a8fb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb8800098d0 tx=0x7fb880009120 comp rx=0 tx=0).stop 2023-10-06T01:39:05.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.216+0000 7fb896c0b700 1 -- 172.21.15.69:0/4109078419 shutdown_connections 2023-10-06T01:39:05.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.216+0000 7fb896c0b700 1 --2- 172.21.15.69:0/4109078419 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8900aee90 0x7fb8900b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.216+0000 7fb896c0b700 1 --2- 172.21.15.69:0/4109078419 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8900a8be0 0x7fb8900a8fb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.216+0000 7fb896c0b700 1 -- 172.21.15.69:0/4109078419 >> 172.21.15.69:0/4109078419 conn(0x7fb89006ce80 msgr2=0x7fb8900ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:05.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.216+0000 7fb896c0b700 1 -- 172.21.15.69:0/4109078419 shutdown_connections 2023-10-06T01:39:05.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.216+0000 7fb896c0b700 1 -- 172.21.15.69:0/4109078419 wait complete. 2023-10-06T01:39:05.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.217+0000 7fb896c0b700 1 Processor -- start 2023-10-06T01:39:05.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.218+0000 7fb896c0b700 1 -- start start 2023-10-06T01:39:05.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.218+0000 7fb896c0b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb89006d280 0x7fb890167f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:05.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.218+0000 7fb896c0b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8900a8be0 0x7fb8900ac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:05.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.218+0000 7fb896c0b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8900aee90 0x7fb890159fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:05.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.218+0000 7fb896c0b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb890098440 con 0x7fb8900aee90 2023-10-06T01:39:05.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.218+0000 7fb896c0b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb890168470 con 0x7fb8900a8be0 2023-10-06T01:39:05.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.218+0000 7fb896c0b700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8900a94b0 con 0x7fb89006d280 2023-10-06T01:39:05.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.218+0000 7fb8951a8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8900aee90 0x7fb890159fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:05.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.218+0000 7fb8951a8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8900aee90 0x7fb890159fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57264/0 (socket says 172.21.15.69:57264) 2023-10-06T01:39:05.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.219+0000 7fb8951a8700 1 -- 172.21.15.69:0/862202240 learned_addr learned my addr 172.21.15.69:0/862202240 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:05.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.219+0000 7fb88ffff700 1 --2- 172.21.15.69:0/862202240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8900a8be0 0x7fb8900ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:05.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.219+0000 7fb8949a7700 1 --2- 172.21.15.69:0/862202240 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb89006d280 0x7fb890167f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:05.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.219+0000 7fb8951a8700 1 -- 172.21.15.69:0/862202240 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb89006d280 msgr2=0x7fb890167f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:05.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.219+0000 7fb8951a8700 1 --2- 172.21.15.69:0/862202240 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb89006d280 0x7fb890167f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.219+0000 7fb8951a8700 1 -- 172.21.15.69:0/862202240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8900a8be0 msgr2=0x7fb8900ac7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:05.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.219+0000 7fb8951a8700 1 --2- 172.21.15.69:0/862202240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8900a8be0 0x7fb8900ac7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.219+0000 7fb8951a8700 1 -- 172.21.15.69:0/862202240 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8800093c0 con 0x7fb8900aee90 2023-10-06T01:39:05.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.219+0000 7fb88ffff700 1 --2- 172.21.15.69:0/862202240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8900a8be0 0x7fb8900ac7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:05.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.219+0000 7fb8951a8700 1 --2- 172.21.15.69:0/862202240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8900aee90 0x7fb890159fa0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb88800d860 tx=0x7fb888008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:05.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.219+0000 7fb88cff9700 1 -- 172.21.15.69:0/862202240 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8880125f0 con 0x7fb8900aee90 2023-10-06T01:39:05.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.219+0000 7fb88cff9700 1 -- 172.21.15.69:0/862202240 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb888012770 con 0x7fb8900aee90 2023-10-06T01:39:05.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.219+0000 7fb896c0b700 1 -- 172.21.15.69:0/862202240 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8900a9790 con 0x7fb8900aee90 2023-10-06T01:39:05.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.219+0000 7fb88cff9700 1 -- 172.21.15.69:0/862202240 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb888012b30 con 0x7fb8900aee90 2023-10-06T01:39:05.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.219+0000 7fb896c0b700 1 -- 172.21.15.69:0/862202240 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8900a9d50 con 0x7fb8900aee90 2023-10-06T01:39:05.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.220+0000 7fb896c0b700 1 -- 172.21.15.69:0/862202240 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb89004c3c0 con 0x7fb8900aee90 2023-10-06T01:39:05.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.220+0000 7fb88cff9700 1 -- 172.21.15.69:0/862202240 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb88801e460 con 0x7fb8900aee90 2023-10-06T01:39:05.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.221+0000 7fb88cff9700 1 --2- 172.21.15.69:0/862202240 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb870066f30 0x7fb8700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:05.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.221+0000 7fb8949a7700 1 --2- 172.21.15.69:0/862202240 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb870066f30 0x7fb8700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:05.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.221+0000 7fb88cff9700 1 -- 172.21.15.69:0/862202240 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb888084cf0 con 0x7fb8900aee90 2023-10-06T01:39:05.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.221+0000 7fb8949a7700 1 --2- 172.21.15.69:0/862202240 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb870066f30 0x7fb8700693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb880009160 tx=0x7fb880016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:05.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.225+0000 7fb88cff9700 1 -- 172.21.15.69:0/862202240 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb888089070 con 0x7fb8900aee90 2023-10-06T01:39:05.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.452+0000 7fb896c0b700 1 -- 172.21.15.69:0/862202240 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb890067b20 con 0x7fb8900aee90 2023-10-06T01:39:05.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.453+0000 7fb88cff9700 1 -- 172.21.15.69:0/862202240 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4591 (secure 0 0 0) 0x7fb888055890 con 0x7fb8900aee90 2023-10-06T01:39:05.454 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:05.454 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6836/2049506781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2049506781},{"type":"v1","addr":"172.21.15.69:6836","nonce":2049506781}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3367080201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6835","nonce":3367080201},{"type":"v1","addr":"172.21.15.69:6837","nonce":3367080201}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2692995813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":2692995813},{"type":"v1","addr":"172.21.15.88:6835","nonce":2692995813}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:38:49.072564+0000","modified":"2023-10-06T01:38:52.659297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6834/2097597935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":2097597935},{"type":"v1","addr":"172.21.15.88:6834","nonce":2097597935}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T01:39:05.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.455+0000 7fb896c0b700 1 -- 172.21.15.69:0/862202240 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb870066f30 msgr2=0x7fb8700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:05.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.455+0000 7fb896c0b700 1 --2- 172.21.15.69:0/862202240 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb870066f30 0x7fb8700693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fb880009160 tx=0x7fb880016000 comp rx=0 tx=0).stop 2023-10-06T01:39:05.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.455+0000 7fb896c0b700 1 -- 172.21.15.69:0/862202240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8900aee90 msgr2=0x7fb890159fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:05.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.455+0000 7fb896c0b700 1 --2- 172.21.15.69:0/862202240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8900aee90 0x7fb890159fa0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb88800d860 tx=0x7fb888008040 comp rx=0 tx=0).stop 2023-10-06T01:39:05.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.455+0000 7fb896c0b700 1 -- 172.21.15.69:0/862202240 shutdown_connections 2023-10-06T01:39:05.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.455+0000 7fb896c0b700 1 --2- 172.21.15.69:0/862202240 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb870066f30 0x7fb8700693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.455+0000 7fb896c0b700 1 --2- 172.21.15.69:0/862202240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8900aee90 0x7fb890159fa0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.455+0000 7fb896c0b700 1 --2- 172.21.15.69:0/862202240 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb89006d280 0x7fb890167f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.455+0000 7fb896c0b700 1 --2- 172.21.15.69:0/862202240 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb8900a8be0 0x7fb8900ac7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.455+0000 7fb896c0b700 1 -- 172.21.15.69:0/862202240 >> 172.21.15.69:0/862202240 conn(0x7fb89006ce80 msgr2=0x7fb8900b1a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:05.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.455+0000 7fb896c0b700 1 -- 172.21.15.69:0/862202240 shutdown_connections 2023-10-06T01:39:05.458 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.455+0000 7fb896c0b700 1 -- 172.21.15.69:0/862202240 wait complete. 2023-10-06T01:39:05.458 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 8 2023-10-06T01:39:05.468 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:39:05.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.584+0000 7f5631e19700 1 Processor -- start 2023-10-06T01:39:05.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.585+0000 7f5631e19700 1 -- start start 2023-10-06T01:39:05.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.585+0000 7f5631e19700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f562c0a8be0 0x7f562c0a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:05.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.585+0000 7f5631e19700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f562c06d280 0x7f562c0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:05.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.585+0000 7f5631e19700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f562c0ce1a0 con 0x7f562c0ae780 2023-10-06T01:39:05.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.585+0000 7f5631e19700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f562c0cd5d0 con 0x7f562c0a8be0 2023-10-06T01:39:05.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.585+0000 7f5631e19700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f562c0cd870 con 0x7f562c06d280 2023-10-06T01:39:05.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.585+0000 7f562bfff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f562c0ae780 0x7f562c0cc420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37538/0 (socket says 172.21.15.69:37538) 2023-10-06T01:39:05.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.585+0000 7f562bfff700 1 -- 172.21.15.69:0/3955724197 learned_addr learned my addr 172.21.15.69:0/3955724197 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:05.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562b7fe700 1 --2- 172.21.15.69:0/3955724197 >> v2:172.21.15.88:3300/0 conn(0x7f562c0a8be0 0x7f562c0a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:05.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562affd700 1 --2- 172.21.15.69:0/3955724197 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f562c06d280 0x7f562c0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:05.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562a7fc700 1 -- 172.21.15.69:0/3955724197 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3797470460 0 0) 0x7f562c0ce1a0 con 0x7f562c0ae780 2023-10-06T01:39:05.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562a7fc700 1 -- 172.21.15.69:0/3955724197 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5614003570 con 0x7f562c0ae780 2023-10-06T01:39:05.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562a7fc700 1 -- 172.21.15.69:0/3955724197 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3298820999 0 0) 0x7f5614003570 con 0x7f562c0ae780 2023-10-06T01:39:05.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562a7fc700 1 -- 172.21.15.69:0/3955724197 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f562c06d280 msgr2=0x7f562c0b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:05.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562a7fc700 1 --2- 172.21.15.69:0/3955724197 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f562c06d280 0x7f562c0b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562a7fc700 1 -- 172.21.15.69:0/3955724197 >> v2:172.21.15.88:3300/0 conn(0x7f562c0a8be0 msgr2=0x7f562c0a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:05.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562a7fc700 1 --2- 172.21.15.69:0/3955724197 >> v2:172.21.15.88:3300/0 conn(0x7f562c0a8be0 0x7f562c0a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562a7fc700 1 -- 172.21.15.69:0/3955724197 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f562c0cdb50 con 0x7f562c0ae780 2023-10-06T01:39:05.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562a7fc700 1 -- 172.21.15.69:0/3955724197 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f56240017f0 con 0x7f562c0ae780 2023-10-06T01:39:05.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562a7fc700 1 -- 172.21.15.69:0/3955724197 >> v1:172.21.15.69:6789/0 conn(0x7f562c0ae780 legacy=0x7f562c0cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:05.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562a7fc700 1 --2- 172.21.15.69:0/3955724197 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f562c06d280 0x7f5614003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:05.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562a7fc700 1 --2- 172.21.15.69:0/3955724197 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5614003fe0 0x7f5614004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:05.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562a7fc700 1 --2- 172.21.15.69:0/3955724197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5614004d50 0x7f56140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:05.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562a7fc700 1 -- 172.21.15.69:0/3955724197 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562c0cd5d0 con 0x7f5614003fe0 2023-10-06T01:39:05.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562a7fc700 1 -- 172.21.15.69:0/3955724197 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562c0cd870 con 0x7f5614004d50 2023-10-06T01:39:05.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562a7fc700 1 -- 172.21.15.69:0/3955724197 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f561400ba90 con 0x7f562c06d280 2023-10-06T01:39:05.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562b7fe700 1 --2- 172.21.15.69:0/3955724197 >> v2:172.21.15.88:3300/0 conn(0x7f562c0a8be0 0x7f562c0a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:05.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562affd700 1 --2- 172.21.15.69:0/3955724197 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5614003fe0 0x7f5614004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:05.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562bfff700 1 --2- 172.21.15.69:0/3955724197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5614004d50 0x7f56140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:05.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562b7fe700 1 --2- 172.21.15.69:0/3955724197 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f562c06d280 0x7f5614003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:05.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562affd700 1 -- 172.21.15.69:0/3955724197 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f562c06d280 msgr2=0x7f5614003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:05.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562affd700 1 --2- 172.21.15.69:0/3955724197 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f562c06d280 0x7f5614003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562affd700 1 -- 172.21.15.69:0/3955724197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5614004d50 msgr2=0x7f56140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:05.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562affd700 1 --2- 172.21.15.69:0/3955724197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5614004d50 0x7f56140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562affd700 1 -- 172.21.15.69:0/3955724197 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5614003570 con 0x7f5614003fe0 2023-10-06T01:39:05.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562bfff700 1 --2- 172.21.15.69:0/3955724197 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5614004d50 0x7f56140051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:05.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.586+0000 7f562b7fe700 1 --2- 172.21.15.69:0/3955724197 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f562c06d280 0x7f5614003a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:05.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.587+0000 7f562affd700 1 --2- 172.21.15.69:0/3955724197 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5614003fe0 0x7f5614004810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5620009bf0 tx=0x7f5620009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df56a2ca645c239d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:05.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.587+0000 7f562a7fc700 1 -- 172.21.15.69:0/3955724197 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5620005a00 con 0x7f5614003fe0 2023-10-06T01:39:05.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.587+0000 7f562a7fc700 1 -- 172.21.15.69:0/3955724197 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5620005b60 con 0x7f5614003fe0 2023-10-06T01:39:05.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.587+0000 7f562a7fc700 1 -- 172.21.15.69:0/3955724197 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f562000e6b0 con 0x7f5614003fe0 2023-10-06T01:39:05.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.587+0000 7f5631e19700 1 -- 172.21.15.69:0/3955724197 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5614003fe0 msgr2=0x7f5614004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:05.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.587+0000 7f5631e19700 1 --2- 172.21.15.69:0/3955724197 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5614003fe0 0x7f5614004810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5620009bf0 tx=0x7f5620009120 comp rx=0 tx=0).stop 2023-10-06T01:39:05.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.587+0000 7f562bfff700 1 -- 172.21.15.69:0/3955724197 reap_dead start 2023-10-06T01:39:05.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.587+0000 7f5631e19700 1 -- 172.21.15.69:0/3955724197 shutdown_connections 2023-10-06T01:39:05.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.587+0000 7f5631e19700 1 -- 172.21.15.69:0/3955724197 >> 172.21.15.69:0/3955724197 conn(0x7f562c06ce80 msgr2=0x7f562c0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:05.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.587+0000 7f5631e19700 1 -- 172.21.15.69:0/3955724197 shutdown_connections 2023-10-06T01:39:05.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.587+0000 7f5631e19700 1 -- 172.21.15.69:0/3955724197 wait complete. 2023-10-06T01:39:05.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.588+0000 7f5631e19700 1 Processor -- start 2023-10-06T01:39:05.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.589+0000 7f5631e19700 1 -- start start 2023-10-06T01:39:05.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.589+0000 7f5631e19700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5614003fe0 0x7f562c06ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:05.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.589+0000 7f5631e19700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f562c06d7b0 0x7f562c09b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:05.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.589+0000 7f5631e19700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f562c098910 0x7f562c15a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:05.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.589+0000 7f5631e19700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562c06e8f0 con 0x7f562c06d7b0 2023-10-06T01:39:05.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.589+0000 7f5631e19700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f562c06dce0 con 0x7f562c098910 2023-10-06T01:39:05.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.589+0000 7f5631e19700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f562c06dfc0 con 0x7f5614003fe0 2023-10-06T01:39:05.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.590+0000 7f562affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f562c06d7b0 0x7f562c09b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:05.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.590+0000 7f562affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f562c06d7b0 0x7f562c09b950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57276/0 (socket says 172.21.15.69:57276) 2023-10-06T01:39:05.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.590+0000 7f562affd700 1 -- 172.21.15.69:0/3306527477 learned_addr learned my addr 172.21.15.69:0/3306527477 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:05.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.590+0000 7f562b7fe700 1 --2- 172.21.15.69:0/3306527477 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5614003fe0 0x7f562c06ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:05.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.590+0000 7f562bfff700 1 --2- 172.21.15.69:0/3306527477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f562c098910 0x7f562c15a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:05.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.590+0000 7f562affd700 1 -- 172.21.15.69:0/3306527477 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5614003fe0 msgr2=0x7f562c06ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:05.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.590+0000 7f562affd700 1 --2- 172.21.15.69:0/3306527477 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5614003fe0 0x7f562c06ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.590+0000 7f562affd700 1 -- 172.21.15.69:0/3306527477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f562c098910 msgr2=0x7f562c15a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:05.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.590+0000 7f562affd700 1 --2- 172.21.15.69:0/3306527477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f562c098910 0x7f562c15a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.590+0000 7f562affd700 1 -- 172.21.15.69:0/3306527477 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f562c06e2a0 con 0x7f562c06d7b0 2023-10-06T01:39:05.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.590+0000 7f562bfff700 1 --2- 172.21.15.69:0/3306527477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f562c098910 0x7f562c15a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:05.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.590+0000 7f562b7fe700 1 --2- 172.21.15.69:0/3306527477 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5614003fe0 0x7f562c06ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:05.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.590+0000 7f562affd700 1 --2- 172.21.15.69:0/3306527477 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f562c06d7b0 0x7f562c09b950 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5614004730 tx=0x7f5620019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:05.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.590+0000 7f56137fe700 1 -- 172.21.15.69:0/3306527477 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5620006240 con 0x7f562c06d7b0 2023-10-06T01:39:05.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.590+0000 7f56137fe700 1 -- 172.21.15.69:0/3306527477 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56200063a0 con 0x7f562c06d7b0 2023-10-06T01:39:05.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.590+0000 7f5631e19700 1 -- 172.21.15.69:0/3306527477 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f562c06e580 con 0x7f562c06d7b0 2023-10-06T01:39:05.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.590+0000 7f56137fe700 1 -- 172.21.15.69:0/3306527477 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5620006760 con 0x7f562c06d7b0 2023-10-06T01:39:05.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.590+0000 7f5631e19700 1 -- 172.21.15.69:0/3306527477 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f562c098d70 con 0x7f562c06d7b0 2023-10-06T01:39:05.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.591+0000 7f5631e19700 1 -- 172.21.15.69:0/3306527477 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f562c06ea60 con 0x7f562c06d7b0 2023-10-06T01:39:05.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.591+0000 7f56137fe700 1 -- 172.21.15.69:0/3306527477 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5620013680 con 0x7f562c06d7b0 2023-10-06T01:39:05.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.592+0000 7f56137fe700 1 --2- 172.21.15.69:0/3306527477 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5618066f30 0x7f56180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:05.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.592+0000 7f56137fe700 1 -- 172.21.15.69:0/3306527477 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5620085c90 con 0x7f562c06d7b0 2023-10-06T01:39:05.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.592+0000 7f562b7fe700 1 --2- 172.21.15.69:0/3306527477 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5618066f30 0x7f56180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:05.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.592+0000 7f562b7fe700 1 --2- 172.21.15.69:0/3306527477 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5618066f30 0x7f56180693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f561c009390 tx=0x7f561c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:05.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.596+0000 7f56137fe700 1 -- 172.21.15.69:0/3306527477 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f56200b75a0 con 0x7f562c06d7b0 2023-10-06T01:39:05.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.783+0000 7f5631e19700 1 -- 172.21.15.69:0/3306527477 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f562c098ff0 con 0x7f562c06d7b0 2023-10-06T01:39:05.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.783+0000 7f56137fe700 1 -- 172.21.15.69:0/3306527477 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f5620052da0 con 0x7f562c06d7b0 2023-10-06T01:39:05.784 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:05.784 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":24,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:38:50.506861+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:38:43.046056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:38:47.525023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:38:47.992048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:39:05.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.786+0000 7f5631e19700 1 -- 172.21.15.69:0/3306527477 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5618066f30 msgr2=0x7f56180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:05.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.786+0000 7f5631e19700 1 --2- 172.21.15.69:0/3306527477 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5618066f30 0x7f56180693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f561c009390 tx=0x7f561c008040 comp rx=0 tx=0).stop 2023-10-06T01:39:05.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.786+0000 7f5631e19700 1 -- 172.21.15.69:0/3306527477 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f562c06d7b0 msgr2=0x7f562c09b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:05.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.786+0000 7f5631e19700 1 --2- 172.21.15.69:0/3306527477 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f562c06d7b0 0x7f562c09b950 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5614004730 tx=0x7f5620019000 comp rx=0 tx=0).stop 2023-10-06T01:39:05.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.786+0000 7f5631e19700 1 -- 172.21.15.69:0/3306527477 shutdown_connections 2023-10-06T01:39:05.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.786+0000 7f5631e19700 1 --2- 172.21.15.69:0/3306527477 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5618066f30 0x7f56180693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.786+0000 7f5631e19700 1 --2- 172.21.15.69:0/3306527477 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f562c098910 0x7f562c15a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.786+0000 7f5631e19700 1 --2- 172.21.15.69:0/3306527477 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5614003fe0 0x7f562c06ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.786+0000 7f5631e19700 1 --2- 172.21.15.69:0/3306527477 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f562c06d7b0 0x7f562c09b950 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.786+0000 7f5631e19700 1 -- 172.21.15.69:0/3306527477 >> 172.21.15.69:0/3306527477 conn(0x7f562c06ce80 msgr2=0x7f562c0adf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:05.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.786+0000 7f5631e19700 1 -- 172.21.15.69:0/3306527477 shutdown_connections 2023-10-06T01:39:05.787 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.786+0000 7f5631e19700 1 -- 172.21.15.69:0/3306527477 wait complete. 2023-10-06T01:39:05.798 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:38:38.288642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:38:43.046056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T01:38:47.525023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T01:38:47.992048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T01:39:05.799 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:39:05.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.914+0000 7fc65ab1a700 1 Processor -- start 2023-10-06T01:39:05.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.914+0000 7fc65ab1a700 1 -- start start 2023-10-06T01:39:05.918 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.915+0000 7fc65ab1a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc654159530 0x7fc6540ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:05.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.915+0000 7fc65ab1a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc65406e0e0 0x7fc6540cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:05.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.915+0000 7fc65ab1a700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6540ccfd0 con 0x7fc65406dc70 2023-10-06T01:39:05.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.915+0000 7fc65ab1a700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6540cf0e0 con 0x7fc65406e0e0 2023-10-06T01:39:05.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.915+0000 7fc65ab1a700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65415a3d0 con 0x7fc654159530 2023-10-06T01:39:05.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.915+0000 7fc653fff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fc65406dc70 0x7fc654159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37546/0 (socket says 172.21.15.69:37546) 2023-10-06T01:39:05.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.915+0000 7fc653fff700 1 -- 172.21.15.69:0/1283218844 learned_addr learned my addr 172.21.15.69:0/1283218844 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:05.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.916+0000 7fc6537fe700 1 -- 172.21.15.69:0/1283218844 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 439693303 0 0) 0x7fc6540ccfd0 con 0x7fc65406dc70 2023-10-06T01:39:05.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.916+0000 7fc6537fe700 1 -- 172.21.15.69:0/1283218844 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc63c003570 con 0x7fc65406dc70 2023-10-06T01:39:05.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.916+0000 7fc6588b6700 1 --2- 172.21.15.69:0/1283218844 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc654159530 0x7fc6540ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:05.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.916+0000 7fc6590b7700 1 --2- 172.21.15.69:0/1283218844 >> v2:172.21.15.88:3300/0 conn(0x7fc65406e0e0 0x7fc6540cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:05.919 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.916+0000 7fc6537fe700 1 -- 172.21.15.69:0/1283218844 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1593357454 0 0) 0x7fc63c003570 con 0x7fc65406dc70 2023-10-06T01:39:05.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.916+0000 7fc6537fe700 1 -- 172.21.15.69:0/1283218844 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc654159530 msgr2=0x7fc6540ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:05.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.916+0000 7fc6537fe700 1 --2- 172.21.15.69:0/1283218844 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc654159530 0x7fc6540ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.916+0000 7fc6537fe700 1 -- 172.21.15.69:0/1283218844 >> v2:172.21.15.88:3300/0 conn(0x7fc65406e0e0 msgr2=0x7fc6540cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:05.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.916+0000 7fc6537fe700 1 --2- 172.21.15.69:0/1283218844 >> v2:172.21.15.88:3300/0 conn(0x7fc65406e0e0 0x7fc6540cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.916+0000 7fc6537fe700 1 -- 172.21.15.69:0/1283218844 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65415a6b0 con 0x7fc65406dc70 2023-10-06T01:39:05.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.916+0000 7fc6537fe700 1 -- 172.21.15.69:0/1283218844 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7fc648001470 con 0x7fc65406dc70 2023-10-06T01:39:05.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.916+0000 7fc6537fe700 1 -- 172.21.15.69:0/1283218844 >> v1:172.21.15.69:6789/0 conn(0x7fc65406dc70 legacy=0x7fc654159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:05.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.916+0000 7fc6537fe700 1 --2- 172.21.15.69:0/1283218844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc63c003a60 0x7fc63c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:05.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.916+0000 7fc6537fe700 1 --2- 172.21.15.69:0/1283218844 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc654159530 0x7fc63c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:05.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.916+0000 7fc6537fe700 1 --2- 172.21.15.69:0/1283218844 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc63c004d50 0x7fc63c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:05.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.916+0000 7fc6537fe700 1 -- 172.21.15.69:0/1283218844 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6540cf0e0 con 0x7fc63c004d50 2023-10-06T01:39:05.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.916+0000 7fc6537fe700 1 -- 172.21.15.69:0/1283218844 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65415a3d0 con 0x7fc63c003a60 2023-10-06T01:39:05.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.916+0000 7fc6537fe700 1 -- 172.21.15.69:0/1283218844 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc63c00ba60 con 0x7fc654159530 2023-10-06T01:39:05.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.916+0000 7fc6590b7700 1 --2- 172.21.15.69:0/1283218844 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc63c004d50 0x7fc63c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:05.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.916+0000 7fc653fff700 1 --2- 172.21.15.69:0/1283218844 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc654159530 0x7fc63c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:05.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.916+0000 7fc6588b6700 1 --2- 172.21.15.69:0/1283218844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc63c003a60 0x7fc63c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:05.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.916+0000 7fc6590b7700 1 -- 172.21.15.69:0/1283218844 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc654159530 msgr2=0x7fc63c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:05.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.916+0000 7fc6590b7700 1 --2- 172.21.15.69:0/1283218844 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc654159530 0x7fc63c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.916+0000 7fc6590b7700 1 -- 172.21.15.69:0/1283218844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc63c003a60 msgr2=0x7fc63c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:05.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.916+0000 7fc6590b7700 1 --2- 172.21.15.69:0/1283218844 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc63c003a60 0x7fc63c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.916+0000 7fc6590b7700 1 -- 172.21.15.69:0/1283218844 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc63c003570 con 0x7fc63c004d50 2023-10-06T01:39:05.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.916+0000 7fc6590b7700 1 --2- 172.21.15.69:0/1283218844 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc63c004d50 0x7fc63c0051c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc6540cacd0 tx=0x7fc64c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31990482238a89c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:05.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.917+0000 7fc6537fe700 1 -- 172.21.15.69:0/1283218844 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c00e6b0 con 0x7fc63c004d50 2023-10-06T01:39:05.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.917+0000 7fc6537fe700 1 -- 172.21.15.69:0/1283218844 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64c00e810 con 0x7fc63c004d50 2023-10-06T01:39:05.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.917+0000 7fc6537fe700 1 -- 172.21.15.69:0/1283218844 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c00ebd0 con 0x7fc63c004d50 2023-10-06T01:39:05.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.917+0000 7fc65ab1a700 1 -- 172.21.15.69:0/1283218844 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc63c004d50 msgr2=0x7fc63c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:05.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.917+0000 7fc65ab1a700 1 --2- 172.21.15.69:0/1283218844 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc63c004d50 0x7fc63c0051c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc6540cacd0 tx=0x7fc64c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.917+0000 7fc6590b7700 1 -- 172.21.15.69:0/1283218844 reap_dead start 2023-10-06T01:39:05.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.917+0000 7fc65ab1a700 1 -- 172.21.15.69:0/1283218844 shutdown_connections 2023-10-06T01:39:05.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.917+0000 7fc65ab1a700 1 -- 172.21.15.69:0/1283218844 >> 172.21.15.69:0/1283218844 conn(0x7fc6540703a0 msgr2=0x7fc6540707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:05.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.917+0000 7fc65ab1a700 1 -- 172.21.15.69:0/1283218844 shutdown_connections 2023-10-06T01:39:05.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.917+0000 7fc65ab1a700 1 -- 172.21.15.69:0/1283218844 wait complete. 2023-10-06T01:39:05.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.918+0000 7fc65ab1a700 1 Processor -- start 2023-10-06T01:39:05.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.918+0000 7fc65ab1a700 1 -- start start 2023-10-06T01:39:05.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.919+0000 7fc65ab1a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6540d0df0 0x7fc6540b5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:05.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.919+0000 7fc65ab1a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6540d11c0 0x7fc654169ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:05.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.919+0000 7fc65ab1a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc65416a530 0x7fc6541553d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:05.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.919+0000 7fc65ab1a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc654169bd0 con 0x7fc6540d11c0 2023-10-06T01:39:05.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.919+0000 7fc65ab1a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6540b4350 con 0x7fc65416a530 2023-10-06T01:39:05.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.919+0000 7fc65ab1a700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6540b3480 con 0x7fc6540d0df0 2023-10-06T01:39:05.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.919+0000 7fc653fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6540d11c0 0x7fc654169ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:05.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.919+0000 7fc653fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6540d11c0 0x7fc654169ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57290/0 (socket says 172.21.15.69:57290) 2023-10-06T01:39:05.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.919+0000 7fc653fff700 1 -- 172.21.15.69:0/3770336058 learned_addr learned my addr 172.21.15.69:0/3770336058 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:05.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.919+0000 7fc653fff700 1 -- 172.21.15.69:0/3770336058 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6540d0df0 msgr2=0x7fc6540b5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:05.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.920+0000 7fc653fff700 1 --2- 172.21.15.69:0/3770336058 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6540d0df0 0x7fc6540b5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.920+0000 7fc653fff700 1 -- 172.21.15.69:0/3770336058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc65416a530 msgr2=0x7fc6541553d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:05.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.920+0000 7fc653fff700 1 --2- 172.21.15.69:0/3770336058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc65416a530 0x7fc6541553d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:05.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.920+0000 7fc653fff700 1 -- 172.21.15.69:0/3770336058 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6540b56d0 con 0x7fc6540d11c0 2023-10-06T01:39:05.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.920+0000 7fc653fff700 1 --2- 172.21.15.69:0/3770336058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6540d11c0 0x7fc654169ff0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc648001d20 tx=0x7fc648001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:05.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.920+0000 7fc650ff9700 1 -- 172.21.15.69:0/3770336058 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc648018030 con 0x7fc6540d11c0 2023-10-06T01:39:05.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.920+0000 7fc650ff9700 1 -- 172.21.15.69:0/3770336058 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64800f8a0 con 0x7fc6540d11c0 2023-10-06T01:39:05.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.920+0000 7fc650ff9700 1 -- 172.21.15.69:0/3770336058 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64800fc60 con 0x7fc6540d11c0 2023-10-06T01:39:05.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.920+0000 7fc65ab1a700 1 -- 172.21.15.69:0/3770336058 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6540b3740 con 0x7fc6540d11c0 2023-10-06T01:39:05.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.920+0000 7fc65ab1a700 1 -- 172.21.15.69:0/3770336058 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6540b3d00 con 0x7fc6540d11c0 2023-10-06T01:39:05.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.921+0000 7fc65ab1a700 1 -- 172.21.15.69:0/3770336058 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc65404c3c0 con 0x7fc6540d11c0 2023-10-06T01:39:05.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.921+0000 7fc650ff9700 1 -- 172.21.15.69:0/3770336058 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc64801b070 con 0x7fc6540d11c0 2023-10-06T01:39:05.926 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.921+0000 7fc650ff9700 1 --2- 172.21.15.69:0/3770336058 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc640066f30 0x7fc6400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:05.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.922+0000 7fc650ff9700 1 -- 172.21.15.69:0/3770336058 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc648019070 con 0x7fc6540d11c0 2023-10-06T01:39:05.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.922+0000 7fc6588b6700 1 --2- 172.21.15.69:0/3770336058 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc640066f30 0x7fc6400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:05.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.922+0000 7fc6588b6700 1 --2- 172.21.15.69:0/3770336058 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc640066f30 0x7fc6400693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc6440094d0 tx=0x7fc64400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:05.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:05.925+0000 7fc650ff9700 1 -- 172.21.15.69:0/3770336058 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc648051790 con 0x7fc6540d11c0 2023-10-06T01:39:06.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.106+0000 7fc65ab1a700 1 -- 172.21.15.69:0/3770336058 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc654169d10 con 0x7fc6540d11c0 2023-10-06T01:39:06.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.107+0000 7fc650ff9700 1 -- 172.21.15.69:0/3770336058 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc654169d10 con 0x7fc6540d11c0 2023-10-06T01:39:06.107 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-10-06T01:39:06.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.109+0000 7fc65ab1a700 1 -- 172.21.15.69:0/3770336058 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc640066f30 msgr2=0x7fc6400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:06.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.109+0000 7fc65ab1a700 1 --2- 172.21.15.69:0/3770336058 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc640066f30 0x7fc6400693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc6440094d0 tx=0x7fc64400b040 comp rx=0 tx=0).stop 2023-10-06T01:39:06.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.109+0000 7fc65ab1a700 1 -- 172.21.15.69:0/3770336058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6540d11c0 msgr2=0x7fc654169ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:06.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.109+0000 7fc65ab1a700 1 --2- 172.21.15.69:0/3770336058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6540d11c0 0x7fc654169ff0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc648001d20 tx=0x7fc648001e90 comp rx=0 tx=0).stop 2023-10-06T01:39:06.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.109+0000 7fc65ab1a700 1 -- 172.21.15.69:0/3770336058 shutdown_connections 2023-10-06T01:39:06.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.109+0000 7fc65ab1a700 1 --2- 172.21.15.69:0/3770336058 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc640066f30 0x7fc6400693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.109+0000 7fc65ab1a700 1 --2- 172.21.15.69:0/3770336058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc65416a530 0x7fc6541553d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.109+0000 7fc65ab1a700 1 --2- 172.21.15.69:0/3770336058 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc6540d0df0 0x7fc6540b5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.109+0000 7fc65ab1a700 1 --2- 172.21.15.69:0/3770336058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6540d11c0 0x7fc654169ff0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.109+0000 7fc65ab1a700 1 -- 172.21.15.69:0/3770336058 >> 172.21.15.69:0/3770336058 conn(0x7fc6540703a0 msgr2=0x7fc6540b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:06.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.109+0000 7fc65ab1a700 1 -- 172.21.15.69:0/3770336058 shutdown_connections 2023-10-06T01:39:06.111 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.109+0000 7fc65ab1a700 1 -- 172.21.15.69:0/3770336058 wait complete. 2023-10-06T01:39:06.121 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:39:06.239 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.239+0000 7f3da97f8700 1 Processor -- start 2023-10-06T01:39:06.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.239+0000 7f3da97f8700 1 -- start start 2023-10-06T01:39:06.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.240+0000 7f3da97f8700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3da40703a0 0x7f3da40c7030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:06.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.240+0000 7f3da97f8700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f3da40c7570 0x7f3da406d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:06.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.240+0000 7f3da97f8700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3da406c740 con 0x7f3da4159790 2023-10-06T01:39:06.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.240+0000 7f3da97f8700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3da406c9b0 con 0x7f3da40c7570 2023-10-06T01:39:06.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.240+0000 7f3da97f8700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da406cc90 con 0x7f3da40703a0 2023-10-06T01:39:06.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.240+0000 7f3da2ffd700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f3da4159790 0x7f3da406ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37558/0 (socket says 172.21.15.69:37558) 2023-10-06T01:39:06.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.240+0000 7f3da37fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f3da40c7570 0x7f3da406d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:06.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.240+0000 7f3da2ffd700 1 -- 172.21.15.69:0/3480171457 learned_addr learned my addr 172.21.15.69:0/3480171457 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:06.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.240+0000 7f3da37fe700 1 -- 172.21.15.69:0/3480171457 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3da40703a0 msgr2=0x7f3da40c7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:06.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.240+0000 7f3da27fc700 1 --2- 172.21.15.69:0/3480171457 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3da40703a0 0x7f3da40c7030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:06.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.240+0000 7f3da37fe700 1 --2- 172.21.15.69:0/3480171457 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3da40703a0 0x7f3da40c7030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.240+0000 7f3da37fe700 1 -- 172.21.15.69:0/3480171457 >> v1:172.21.15.69:6789/0 conn(0x7f3da4159790 legacy=0x7f3da406ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:06.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.240+0000 7f3da1ffb700 1 -- 172.21.15.69:0/3480171457 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 267732945 0 0) 0x7f3da406c740 con 0x7f3da4159790 2023-10-06T01:39:06.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.240+0000 7f3da37fe700 1 -- 172.21.15.69:0/3480171457 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da406cf70 con 0x7f3da40c7570 2023-10-06T01:39:06.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.240+0000 7f3da27fc700 1 --2- 172.21.15.69:0/3480171457 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3da40703a0 0x7f3da40c7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:06.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.241+0000 7f3da37fe700 1 --2- 172.21.15.69:0/3480171457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3da40c7570 0x7f3da406d490 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3d940098e0 tx=0x7f3d940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e9ff7feb6258dc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:06.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.241+0000 7f3da1ffb700 1 -- 172.21.15.69:0/3480171457 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d94009e80 con 0x7f3da40c7570 2023-10-06T01:39:06.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.241+0000 7f3da1ffb700 1 -- 172.21.15.69:0/3480171457 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d9400b860 con 0x7f3da40c7570 2023-10-06T01:39:06.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.241+0000 7f3da1ffb700 1 -- 172.21.15.69:0/3480171457 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d9400bbe0 con 0x7f3da40c7570 2023-10-06T01:39:06.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.241+0000 7f3da97f8700 1 -- 172.21.15.69:0/3480171457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3da40c7570 msgr2=0x7f3da406d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:06.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.241+0000 7f3da97f8700 1 --2- 172.21.15.69:0/3480171457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3da40c7570 0x7f3da406d490 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f3d940098e0 tx=0x7f3d940091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.241+0000 7f3da97f8700 1 -- 172.21.15.69:0/3480171457 shutdown_connections 2023-10-06T01:39:06.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.241+0000 7f3da97f8700 1 --2- 172.21.15.69:0/3480171457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3da40c7570 0x7f3da406d490 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.241+0000 7f3da97f8700 1 --2- 172.21.15.69:0/3480171457 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3da40703a0 0x7f3da40c7030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.241+0000 7f3da97f8700 1 -- 172.21.15.69:0/3480171457 >> 172.21.15.69:0/3480171457 conn(0x7f3da406ecd0 msgr2=0x7f3da406f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:06.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.241+0000 7f3da97f8700 1 -- 172.21.15.69:0/3480171457 shutdown_connections 2023-10-06T01:39:06.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.241+0000 7f3da97f8700 1 -- 172.21.15.69:0/3480171457 wait complete. 2023-10-06T01:39:06.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.243+0000 7f3da97f8700 1 Processor -- start 2023-10-06T01:39:06.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.243+0000 7f3da97f8700 1 -- start start 2023-10-06T01:39:06.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.243+0000 7f3da97f8700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3da40703a0 0x7f3da413b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:06.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.243+0000 7f3da97f8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3da40c7570 0x7f3da40b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:06.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.243+0000 7f3da97f8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3da4159790 0x7f3da4159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:06.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.243+0000 7f3da97f8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da413bc00 con 0x7f3da4159790 2023-10-06T01:39:06.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.243+0000 7f3da97f8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3da40c53f0 con 0x7f3da40c7570 2023-10-06T01:39:06.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.243+0000 7f3da97f8700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3da40c47e0 con 0x7f3da40703a0 2023-10-06T01:39:06.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.243+0000 7f3da37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3da4159790 0x7f3da4159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:06.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.244+0000 7f3da37fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3da4159790 0x7f3da4159b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57296/0 (socket says 172.21.15.69:57296) 2023-10-06T01:39:06.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.244+0000 7f3da37fe700 1 -- 172.21.15.69:0/2229135147 learned_addr learned my addr 172.21.15.69:0/2229135147 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:06.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.244+0000 7f3da2ffd700 1 --2- 172.21.15.69:0/2229135147 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3da40703a0 0x7f3da413b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:06.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.244+0000 7f3da27fc700 1 --2- 172.21.15.69:0/2229135147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3da40c7570 0x7f3da40b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:06.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.244+0000 7f3da37fe700 1 -- 172.21.15.69:0/2229135147 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3da40703a0 msgr2=0x7f3da413b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:06.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.244+0000 7f3da37fe700 1 --2- 172.21.15.69:0/2229135147 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3da40703a0 0x7f3da413b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.244+0000 7f3da37fe700 1 -- 172.21.15.69:0/2229135147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3da40c7570 msgr2=0x7f3da40b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:06.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.244+0000 7f3da37fe700 1 --2- 172.21.15.69:0/2229135147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3da40c7570 0x7f3da40b1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.244+0000 7f3da37fe700 1 -- 172.21.15.69:0/2229135147 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d94009420 con 0x7f3da4159790 2023-10-06T01:39:06.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.244+0000 7f3da37fe700 1 --2- 172.21.15.69:0/2229135147 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3da4159790 0x7f3da4159b60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3d9401bf90 tx=0x7f3d94017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:06.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.244+0000 7f3d8affd700 1 -- 172.21.15.69:0/2229135147 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d94011420 con 0x7f3da4159790 2023-10-06T01:39:06.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.244+0000 7f3d8affd700 1 -- 172.21.15.69:0/2229135147 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d940115a0 con 0x7f3da4159790 2023-10-06T01:39:06.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.244+0000 7f3da97f8700 1 -- 172.21.15.69:0/2229135147 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da40c4ac0 con 0x7f3da4159790 2023-10-06T01:39:06.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.244+0000 7f3d8affd700 1 -- 172.21.15.69:0/2229135147 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d94011960 con 0x7f3da4159790 2023-10-06T01:39:06.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.244+0000 7f3da97f8700 1 -- 172.21.15.69:0/2229135147 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3da40c5080 con 0x7f3da4159790 2023-10-06T01:39:06.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.245+0000 7f3da97f8700 1 -- 172.21.15.69:0/2229135147 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3da404c3c0 con 0x7f3da4159790 2023-10-06T01:39:06.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.245+0000 7f3d8affd700 1 -- 172.21.15.69:0/2229135147 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3d940253f0 con 0x7f3da4159790 2023-10-06T01:39:06.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.246+0000 7f3d8affd700 1 --2- 172.21.15.69:0/2229135147 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3d90066f30 0x7f3d900693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:06.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.246+0000 7f3d8affd700 1 -- 172.21.15.69:0/2229135147 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3d940863c0 con 0x7f3da4159790 2023-10-06T01:39:06.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.246+0000 7f3da2ffd700 1 --2- 172.21.15.69:0/2229135147 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3d90066f30 0x7f3d900693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:06.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.246+0000 7f3da2ffd700 1 --2- 172.21.15.69:0/2229135147 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3d90066f30 0x7f3d900693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c002250 tx=0x7f3d9c001a20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:06.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.250+0000 7f3d8affd700 1 -- 172.21.15.69:0/2229135147 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d940534d0 con 0x7f3da4159790 2023-10-06T01:39:06.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.433+0000 7f3da97f8700 1 -- 172.21.15.69:0/2229135147 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f3da40c5530 con 0x7f3da4159790 2023-10-06T01:39:06.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.434+0000 7f3d8affd700 1 -- 172.21.15.69:0/2229135147 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f3d94056af0 con 0x7f3da4159790 2023-10-06T01:39:06.434 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 8 2023-10-06T01:39:06.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.436+0000 7f3da97f8700 1 -- 172.21.15.69:0/2229135147 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3d90066f30 msgr2=0x7f3d900693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:06.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.436+0000 7f3da97f8700 1 --2- 172.21.15.69:0/2229135147 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3d90066f30 0x7f3d900693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c002250 tx=0x7f3d9c001a20 comp rx=0 tx=0).stop 2023-10-06T01:39:06.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.436+0000 7f3da97f8700 1 -- 172.21.15.69:0/2229135147 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3da4159790 msgr2=0x7f3da4159b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:06.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.436+0000 7f3da97f8700 1 --2- 172.21.15.69:0/2229135147 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3da4159790 0x7f3da4159b60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3d9401bf90 tx=0x7f3d94017000 comp rx=0 tx=0).stop 2023-10-06T01:39:06.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.436+0000 7f3da97f8700 1 -- 172.21.15.69:0/2229135147 shutdown_connections 2023-10-06T01:39:06.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.436+0000 7f3da97f8700 1 --2- 172.21.15.69:0/2229135147 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3d90066f30 0x7f3d900693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.436+0000 7f3da97f8700 1 --2- 172.21.15.69:0/2229135147 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3da4159790 0x7f3da4159b60 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.436+0000 7f3da97f8700 1 --2- 172.21.15.69:0/2229135147 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3da40703a0 0x7f3da413b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.436+0000 7f3da97f8700 1 --2- 172.21.15.69:0/2229135147 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3da40c7570 0x7f3da40b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.436+0000 7f3da97f8700 1 -- 172.21.15.69:0/2229135147 >> 172.21.15.69:0/2229135147 conn(0x7f3da406ecd0 msgr2=0x7f3da406a340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:06.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.436+0000 7f3da97f8700 1 -- 172.21.15.69:0/2229135147 shutdown_connections 2023-10-06T01:39:06.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.436+0000 7f3da97f8700 1 -- 172.21.15.69:0/2229135147 wait complete. 2023-10-06T01:39:06.448 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T01:39:06.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.566+0000 7fb82a1f6700 1 Processor -- start 2023-10-06T01:39:06.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.566+0000 7fb82a1f6700 1 -- start start 2023-10-06T01:39:06.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.567+0000 7fb82a1f6700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb824153dd0 0x7fb82415de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:06.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.567+0000 7fb82a1f6700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb8240cea00 0x7fb8240cee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:06.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.567+0000 7fb82a1f6700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb82415ac50 con 0x7fb824153a00 2023-10-06T01:39:06.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.567+0000 7fb82a1f6700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb82415d010 con 0x7fb8240cea00 2023-10-06T01:39:06.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.567+0000 7fb82a1f6700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb82415af60 con 0x7fb824153dd0 2023-10-06T01:39:06.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.567+0000 7fb8299f5700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb8240cea00 0x7fb8240cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:06.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.567+0000 7fb8291f4700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fb824153a00 0x7fb82415a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37562/0 (socket says 172.21.15.69:37562) 2023-10-06T01:39:06.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.567+0000 7fb8291f4700 1 -- 172.21.15.69:0/1184854254 learned_addr learned my addr 172.21.15.69:0/1184854254 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:06.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.567+0000 7fb8289f3700 1 --2- 172.21.15.69:0/1184854254 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb824153dd0 0x7fb82415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:06.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.567+0000 7fb8299f5700 1 -- 172.21.15.69:0/1184854254 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb824153dd0 msgr2=0x7fb82415de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:06.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.567+0000 7fb8299f5700 1 --2- 172.21.15.69:0/1184854254 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb824153dd0 0x7fb82415de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.567+0000 7fb8299f5700 1 -- 172.21.15.69:0/1184854254 >> v1:172.21.15.69:6789/0 conn(0x7fb824153a00 legacy=0x7fb82415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:06.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.567+0000 7fb8299f5700 1 -- 172.21.15.69:0/1184854254 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb82415b240 con 0x7fb8240cea00 2023-10-06T01:39:06.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.567+0000 7fb81bfff700 1 -- 172.21.15.69:0/1184854254 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 15956445 0 0) 0x7fb82415ac50 con 0x7fb824153a00 2023-10-06T01:39:06.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.567+0000 7fb8299f5700 1 --2- 172.21.15.69:0/1184854254 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8240cea00 0x7fb8240cee60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb81c009e90 tx=0x7fb81c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16248d939b03bf80 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:06.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.567+0000 7fb81bfff700 1 -- 172.21.15.69:0/1184854254 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c00e070 con 0x7fb8240cea00 2023-10-06T01:39:06.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.567+0000 7fb81bfff700 1 -- 172.21.15.69:0/1184854254 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb81c00bbf0 con 0x7fb8240cea00 2023-10-06T01:39:06.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.567+0000 7fb81bfff700 1 -- 172.21.15.69:0/1184854254 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb81c012430 con 0x7fb8240cea00 2023-10-06T01:39:06.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.568+0000 7fb82a1f6700 1 -- 172.21.15.69:0/1184854254 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8240cea00 msgr2=0x7fb8240cee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:06.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.568+0000 7fb82a1f6700 1 --2- 172.21.15.69:0/1184854254 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8240cea00 0x7fb8240cee60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb81c009e90 tx=0x7fb81c009780 comp rx=0 tx=0).stop 2023-10-06T01:39:06.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.568+0000 7fb82a1f6700 1 -- 172.21.15.69:0/1184854254 shutdown_connections 2023-10-06T01:39:06.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.568+0000 7fb82a1f6700 1 --2- 172.21.15.69:0/1184854254 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb8240cea00 0x7fb8240cee60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.568+0000 7fb82a1f6700 1 --2- 172.21.15.69:0/1184854254 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb824153dd0 0x7fb82415de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.568+0000 7fb82a1f6700 1 -- 172.21.15.69:0/1184854254 >> 172.21.15.69:0/1184854254 conn(0x7fb8240703a0 msgr2=0x7fb8240707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:06.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.568+0000 7fb82a1f6700 1 -- 172.21.15.69:0/1184854254 shutdown_connections 2023-10-06T01:39:06.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.568+0000 7fb82a1f6700 1 -- 172.21.15.69:0/1184854254 wait complete. 2023-10-06T01:39:06.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.569+0000 7fb82a1f6700 1 Processor -- start 2023-10-06T01:39:06.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.569+0000 7fb82a1f6700 1 -- start start 2023-10-06T01:39:06.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.570+0000 7fb82a1f6700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8240cea00 0x7fb8240ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:06.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.570+0000 7fb82a1f6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb824153a00 0x7fb824150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:06.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.570+0000 7fb82a1f6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb824153dd0 0x7fb8240cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:06.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.570+0000 7fb82a1f6700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8240cbbf0 con 0x7fb824153a00 2023-10-06T01:39:06.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.570+0000 7fb82a1f6700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8240cbed0 con 0x7fb824153dd0 2023-10-06T01:39:06.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.570+0000 7fb82a1f6700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8240cc1b0 con 0x7fb8240cea00 2023-10-06T01:39:06.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.570+0000 7fb8289f3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb824153a00 0x7fb824150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:06.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.570+0000 7fb8289f3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb824153a00 0x7fb824150390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57324/0 (socket says 172.21.15.69:57324) 2023-10-06T01:39:06.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.570+0000 7fb8289f3700 1 -- 172.21.15.69:0/3539328131 learned_addr learned my addr 172.21.15.69:0/3539328131 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:06.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.570+0000 7fb8291f4700 1 --2- 172.21.15.69:0/3539328131 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8240cea00 0x7fb8240ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:06.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.570+0000 7fb8299f5700 1 --2- 172.21.15.69:0/3539328131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb824153dd0 0x7fb8240cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:06.575 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.570+0000 7fb8289f3700 1 -- 172.21.15.69:0/3539328131 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8240cea00 msgr2=0x7fb8240ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:06.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.570+0000 7fb8289f3700 1 --2- 172.21.15.69:0/3539328131 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8240cea00 0x7fb8240ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.570+0000 7fb8289f3700 1 -- 172.21.15.69:0/3539328131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb824153dd0 msgr2=0x7fb8240cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:06.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.570+0000 7fb8289f3700 1 --2- 172.21.15.69:0/3539328131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb824153dd0 0x7fb8240cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.570+0000 7fb8289f3700 1 -- 172.21.15.69:0/3539328131 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb81c009a20 con 0x7fb824153a00 2023-10-06T01:39:06.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.570+0000 7fb8289f3700 1 --2- 172.21.15.69:0/3539328131 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb824153a00 0x7fb824150390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb81400d860 tx=0x7fb814008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:06.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.571+0000 7fb8197fa700 1 -- 172.21.15.69:0/3539328131 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb814012630 con 0x7fb824153a00 2023-10-06T01:39:06.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.571+0000 7fb8197fa700 1 -- 172.21.15.69:0/3539328131 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb814012790 con 0x7fb824153a00 2023-10-06T01:39:06.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.571+0000 7fb8197fa700 1 -- 172.21.15.69:0/3539328131 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb814012b50 con 0x7fb824153a00 2023-10-06T01:39:06.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.571+0000 7fb82a1f6700 1 -- 172.21.15.69:0/3539328131 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8240cc490 con 0x7fb824153a00 2023-10-06T01:39:06.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.571+0000 7fb82a1f6700 1 -- 172.21.15.69:0/3539328131 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8241595a0 con 0x7fb824153a00 2023-10-06T01:39:06.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.572+0000 7fb82a1f6700 1 -- 172.21.15.69:0/3539328131 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8240cc930 con 0x7fb824153a00 2023-10-06T01:39:06.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.572+0000 7fb8197fa700 1 -- 172.21.15.69:0/3539328131 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb81401d400 con 0x7fb824153a00 2023-10-06T01:39:06.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.572+0000 7fb8197fa700 1 --2- 172.21.15.69:0/3539328131 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb808066f30 0x7fb8080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:06.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.572+0000 7fb8291f4700 1 --2- 172.21.15.69:0/3539328131 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb808066f30 0x7fb8080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:06.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.572+0000 7fb8197fa700 1 -- 172.21.15.69:0/3539328131 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb814084aa0 con 0x7fb824153a00 2023-10-06T01:39:06.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.573+0000 7fb8291f4700 1 --2- 172.21.15.69:0/3539328131 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb808066f30 0x7fb8080693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb8240c72b0 tx=0x7fb820009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:06.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.577+0000 7fb8197fa700 1 -- 172.21.15.69:0/3539328131 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb814051bb0 con 0x7fb824153a00 2023-10-06T01:39:06.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.761+0000 7fb82a1f6700 1 -- 172.21.15.69:0/3539328131 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb82404c3c0 con 0x7fb824153a00 2023-10-06T01:39:06.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.761+0000 7fb8197fa700 1 -- 172.21.15.69:0/3539328131 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb8140551d0 con 0x7fb824153a00 2023-10-06T01:39:06.762 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-10-06T01:39:06.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.764+0000 7fb82a1f6700 1 -- 172.21.15.69:0/3539328131 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb808066f30 msgr2=0x7fb8080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:06.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.764+0000 7fb82a1f6700 1 --2- 172.21.15.69:0/3539328131 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb808066f30 0x7fb8080693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fb8240c72b0 tx=0x7fb820009040 comp rx=0 tx=0).stop 2023-10-06T01:39:06.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.764+0000 7fb82a1f6700 1 -- 172.21.15.69:0/3539328131 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb824153a00 msgr2=0x7fb824150390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:06.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.764+0000 7fb82a1f6700 1 --2- 172.21.15.69:0/3539328131 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb824153a00 0x7fb824150390 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fb81400d860 tx=0x7fb814008040 comp rx=0 tx=0).stop 2023-10-06T01:39:06.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.764+0000 7fb82a1f6700 1 -- 172.21.15.69:0/3539328131 shutdown_connections 2023-10-06T01:39:06.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.764+0000 7fb82a1f6700 1 --2- 172.21.15.69:0/3539328131 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb808066f30 0x7fb8080693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.764+0000 7fb82a1f6700 1 --2- 172.21.15.69:0/3539328131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb824153dd0 0x7fb8240cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.764+0000 7fb82a1f6700 1 --2- 172.21.15.69:0/3539328131 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb8240cea00 0x7fb8240ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.764+0000 7fb82a1f6700 1 --2- 172.21.15.69:0/3539328131 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb824153a00 0x7fb824150390 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.764+0000 7fb82a1f6700 1 -- 172.21.15.69:0/3539328131 >> 172.21.15.69:0/3539328131 conn(0x7fb8240703a0 msgr2=0x7fb8240d0db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:06.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.764+0000 7fb82a1f6700 1 -- 172.21.15.69:0/3539328131 shutdown_connections 2023-10-06T01:39:06.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.764+0000 7fb82a1f6700 1 -- 172.21.15.69:0/3539328131 wait complete. 2023-10-06T01:39:06.776 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T01:39:06.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.892+0000 7fd5b8e12700 1 Processor -- start 2023-10-06T01:39:06.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.892+0000 7fd5b8e12700 1 -- start start 2023-10-06T01:39:06.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.893+0000 7fd5b8e12700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd5b4159530 0x7fd5b40ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:06.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.893+0000 7fd5b8e12700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd5b406e0e0 0x7fd5b40cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:06.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.893+0000 7fd5b8e12700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5b40ccfd0 con 0x7fd5b406dc70 2023-10-06T01:39:06.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.893+0000 7fd5b8e12700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5b40cf0e0 con 0x7fd5b406e0e0 2023-10-06T01:39:06.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.893+0000 7fd5b8e12700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b415a3d0 con 0x7fd5b4159530 2023-10-06T01:39:06.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.893+0000 7fd5b2d9d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd5b406e0e0 0x7fd5b40cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:06.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.893+0000 7fd5b1d9b700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fd5b406dc70 0x7fd5b4159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37564/0 (socket says 172.21.15.69:37564) 2023-10-06T01:39:06.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.893+0000 7fd5b1d9b700 1 -- 172.21.15.69:0/259030170 learned_addr learned my addr 172.21.15.69:0/259030170 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:06.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.894+0000 7fd5b259c700 1 --2- 172.21.15.69:0/259030170 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd5b4159530 0x7fd5b40ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:06.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.894+0000 7fd5b2d9d700 1 -- 172.21.15.69:0/259030170 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd5b4159530 msgr2=0x7fd5b40ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:06.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.894+0000 7fd5b2d9d700 1 --2- 172.21.15.69:0/259030170 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd5b4159530 0x7fd5b40ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.894+0000 7fd5b2d9d700 1 -- 172.21.15.69:0/259030170 >> v1:172.21.15.69:6789/0 conn(0x7fd5b406dc70 legacy=0x7fd5b4159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:06.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.894+0000 7fd5b2d9d700 1 -- 172.21.15.69:0/259030170 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5b415a6b0 con 0x7fd5b406e0e0 2023-10-06T01:39:06.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.894+0000 7fd5b159a700 1 -- 172.21.15.69:0/259030170 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096129024 0 0) 0x7fd5b40ccfd0 con 0x7fd5b406dc70 2023-10-06T01:39:06.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.894+0000 7fd5b2d9d700 1 --2- 172.21.15.69:0/259030170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5b406e0e0 0x7fd5b40cb6f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac0098e0 tx=0x7fd5ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfc9a58f40056df6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:06.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.894+0000 7fd5b159a700 1 -- 172.21.15.69:0/259030170 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac009e80 con 0x7fd5b406e0e0 2023-10-06T01:39:06.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.894+0000 7fd5b159a700 1 -- 172.21.15.69:0/259030170 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5ac00b860 con 0x7fd5b406e0e0 2023-10-06T01:39:06.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.894+0000 7fd5b159a700 1 -- 172.21.15.69:0/259030170 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac00bbe0 con 0x7fd5b406e0e0 2023-10-06T01:39:06.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.894+0000 7fd5b8e12700 1 -- 172.21.15.69:0/259030170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5b406e0e0 msgr2=0x7fd5b40cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:06.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.894+0000 7fd5b8e12700 1 --2- 172.21.15.69:0/259030170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5b406e0e0 0x7fd5b40cb6f0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac0098e0 tx=0x7fd5ac0091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.894+0000 7fd5b8e12700 1 -- 172.21.15.69:0/259030170 shutdown_connections 2023-10-06T01:39:06.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.894+0000 7fd5b8e12700 1 --2- 172.21.15.69:0/259030170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5b406e0e0 0x7fd5b40cb6f0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.894+0000 7fd5b8e12700 1 --2- 172.21.15.69:0/259030170 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd5b4159530 0x7fd5b40ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.894+0000 7fd5b8e12700 1 -- 172.21.15.69:0/259030170 >> 172.21.15.69:0/259030170 conn(0x7fd5b40703a0 msgr2=0x7fd5b40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:06.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.895+0000 7fd5b8e12700 1 -- 172.21.15.69:0/259030170 shutdown_connections 2023-10-06T01:39:06.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.895+0000 7fd5b8e12700 1 -- 172.21.15.69:0/259030170 wait complete. 2023-10-06T01:39:06.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.896+0000 7fd5b8e12700 1 Processor -- start 2023-10-06T01:39:06.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.896+0000 7fd5b8e12700 1 -- start start 2023-10-06T01:39:06.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.896+0000 7fd5b8e12700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5b406dc70 0x7fd5b40c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:06.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.896+0000 7fd5b8e12700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5b406e0e0 0x7fd5b40cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:06.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.896+0000 7fd5b8e12700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd5b4159530 0x7fd5b40cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:06.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.896+0000 7fd5b8e12700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b415d960 con 0x7fd5b406dc70 2023-10-06T01:39:06.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.896+0000 7fd5b8e12700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b415cd90 con 0x7fd5b406e0e0 2023-10-06T01:39:06.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.896+0000 7fd5b8e12700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5b415ddf0 con 0x7fd5b4159530 2023-10-06T01:39:06.901 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.896+0000 7fd5b259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5b406dc70 0x7fd5b40c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:06.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.896+0000 7fd5b259c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5b406dc70 0x7fd5b40c7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57340/0 (socket says 172.21.15.69:57340) 2023-10-06T01:39:06.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.896+0000 7fd5b259c700 1 -- 172.21.15.69:0/2755345257 learned_addr learned my addr 172.21.15.69:0/2755345257 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:06.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.897+0000 7fd5b259c700 1 -- 172.21.15.69:0/2755345257 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd5b4159530 msgr2=0x7fd5b40cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:06.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.897+0000 7fd5b259c700 1 --2- 172.21.15.69:0/2755345257 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd5b4159530 0x7fd5b40cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.897+0000 7fd5b259c700 1 -- 172.21.15.69:0/2755345257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5b406e0e0 msgr2=0x7fd5b40cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:06.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.897+0000 7fd5b259c700 1 --2- 172.21.15.69:0/2755345257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5b406e0e0 0x7fd5b40cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:06.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.897+0000 7fd5b259c700 1 -- 172.21.15.69:0/2755345257 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5ac009420 con 0x7fd5b406dc70 2023-10-06T01:39:06.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.897+0000 7fd5b259c700 1 --2- 172.21.15.69:0/2755345257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5b406dc70 0x7fd5b40c7790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4009fa0 tx=0x7fd5a4009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:06.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.897+0000 7fd5a27fc700 1 -- 172.21.15.69:0/2755345257 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a400ed20 con 0x7fd5b406dc70 2023-10-06T01:39:06.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.897+0000 7fd5a27fc700 1 -- 172.21.15.69:0/2755345257 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5a400ee80 con 0x7fd5b406dc70 2023-10-06T01:39:06.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.897+0000 7fd5b8e12700 1 -- 172.21.15.69:0/2755345257 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5b415d030 con 0x7fd5b406dc70 2023-10-06T01:39:06.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.897+0000 7fd5a27fc700 1 -- 172.21.15.69:0/2755345257 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4014670 con 0x7fd5b406dc70 2023-10-06T01:39:06.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.897+0000 7fd5b8e12700 1 -- 172.21.15.69:0/2755345257 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5b415d5f0 con 0x7fd5b406dc70 2023-10-06T01:39:06.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.898+0000 7fd5b8e12700 1 -- 172.21.15.69:0/2755345257 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5b415dc40 con 0x7fd5b406dc70 2023-10-06T01:39:06.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.898+0000 7fd5a27fc700 1 -- 172.21.15.69:0/2755345257 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd5a40149e0 con 0x7fd5b406dc70 2023-10-06T01:39:06.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.898+0000 7fd5a27fc700 1 --2- 172.21.15.69:0/2755345257 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd594066f30 0x7fd5940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:06.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.899+0000 7fd5a27fc700 1 -- 172.21.15.69:0/2755345257 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd5a4084e20 con 0x7fd5b406dc70 2023-10-06T01:39:06.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.899+0000 7fd5b1d9b700 1 --2- 172.21.15.69:0/2755345257 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd594066f30 0x7fd5940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:06.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.899+0000 7fd5b1d9b700 1 --2- 172.21.15.69:0/2755345257 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd594066f30 0x7fd5940693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80011e0 tx=0x7fd5a80079d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:06.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:06.903+0000 7fd5a27fc700 1 -- 172.21.15.69:0/2755345257 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5a4051f30 con 0x7fd5b406dc70 2023-10-06T01:39:07.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.083+0000 7fd5b8e12700 1 -- 172.21.15.69:0/2755345257 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd5b404c3c0 con 0x7fd5b406dc70 2023-10-06T01:39:07.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.084+0000 7fd5a27fc700 1 -- 172.21.15.69:0/2755345257 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd5a4055550 con 0x7fd5b406dc70 2023-10-06T01:39:07.084 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-10-06T01:39:07.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.086+0000 7fd5b8e12700 1 -- 172.21.15.69:0/2755345257 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd594066f30 msgr2=0x7fd5940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:07.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.086+0000 7fd5b8e12700 1 --2- 172.21.15.69:0/2755345257 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd594066f30 0x7fd5940693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd5a80011e0 tx=0x7fd5a80079d0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.086+0000 7fd5b8e12700 1 -- 172.21.15.69:0/2755345257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5b406dc70 msgr2=0x7fd5b40c7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:07.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.086+0000 7fd5b8e12700 1 --2- 172.21.15.69:0/2755345257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5b406dc70 0x7fd5b40c7790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4009fa0 tx=0x7fd5a4009880 comp rx=0 tx=0).stop 2023-10-06T01:39:07.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.086+0000 7fd5b8e12700 1 -- 172.21.15.69:0/2755345257 shutdown_connections 2023-10-06T01:39:07.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.086+0000 7fd5b8e12700 1 --2- 172.21.15.69:0/2755345257 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd594066f30 0x7fd5940693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.086+0000 7fd5b8e12700 1 --2- 172.21.15.69:0/2755345257 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd5b4159530 0x7fd5b40cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.086+0000 7fd5b8e12700 1 --2- 172.21.15.69:0/2755345257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5b406dc70 0x7fd5b40c7790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.086+0000 7fd5b8e12700 1 --2- 172.21.15.69:0/2755345257 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd5b406e0e0 0x7fd5b40cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.086+0000 7fd5b8e12700 1 -- 172.21.15.69:0/2755345257 >> 172.21.15.69:0/2755345257 conn(0x7fd5b40703a0 msgr2=0x7fd5b40c6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:07.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.086+0000 7fd5b8e12700 1 -- 172.21.15.69:0/2755345257 shutdown_connections 2023-10-06T01:39:07.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.086+0000 7fd5b8e12700 1 -- 172.21.15.69:0/2755345257 wait complete. 2023-10-06T01:39:07.098 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:39:07.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.211+0000 7fe3637ad700 1 Processor -- start 2023-10-06T01:39:07.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.211+0000 7fe3637ad700 1 -- start start 2023-10-06T01:39:07.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.212+0000 7fe3637ad700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe35c15cf20 0x7fe35c0b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:07.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.212+0000 7fe3637ad700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe35c0b2d10 0x7fe35c1536c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:07.214 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.212+0000 7fe3637ad700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe35c15ad50 con 0x7fe35c15cb50 2023-10-06T01:39:07.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.212+0000 7fe3637ad700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe35c15a140 con 0x7fe35c15cf20 2023-10-06T01:39:07.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.212+0000 7fe3637ad700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c15a420 con 0x7fe35c0b2d10 2023-10-06T01:39:07.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.212+0000 7fe360d48700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe35c15cf20 0x7fe35c0b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:07.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.212+0000 7fe361549700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fe35c15cb50 0x7fe35c0b01d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:37566/0 (socket says 172.21.15.69:37566) 2023-10-06T01:39:07.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.212+0000 7fe361549700 1 -- 172.21.15.69:0/460856202 learned_addr learned my addr 172.21.15.69:0/460856202 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:07.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.212+0000 7fe361d4a700 1 --2- 172.21.15.69:0/460856202 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe35c0b2d10 0x7fe35c1536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:07.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.212+0000 7fe353fff700 1 -- 172.21.15.69:0/460856202 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 551348723 0 0) 0x7fe35c15ad50 con 0x7fe35c15cb50 2023-10-06T01:39:07.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.213+0000 7fe353fff700 1 -- 172.21.15.69:0/460856202 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe348003570 con 0x7fe35c15cb50 2023-10-06T01:39:07.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.213+0000 7fe360d48700 1 -- 172.21.15.69:0/460856202 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe35c0b2d10 msgr2=0x7fe35c1536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:07.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.213+0000 7fe360d48700 1 --2- 172.21.15.69:0/460856202 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe35c0b2d10 0x7fe35c1536c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.213+0000 7fe360d48700 1 -- 172.21.15.69:0/460856202 >> v1:172.21.15.69:6789/0 conn(0x7fe35c15cb50 legacy=0x7fe35c0b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:07.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.213+0000 7fe360d48700 1 -- 172.21.15.69:0/460856202 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe35c15a700 con 0x7fe35c15cf20 2023-10-06T01:39:07.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.213+0000 7fe360d48700 1 --2- 172.21.15.69:0/460856202 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe35c15cf20 0x7fe35c0b27d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0098e0 tx=0x7fe34c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb82b0a0b43f498 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:07.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.213+0000 7fe353fff700 1 -- 172.21.15.69:0/460856202 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c00b640 con 0x7fe35c15cf20 2023-10-06T01:39:07.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.213+0000 7fe353fff700 1 -- 172.21.15.69:0/460856202 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34c00b7a0 con 0x7fe35c15cf20 2023-10-06T01:39:07.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.213+0000 7fe353fff700 1 -- 172.21.15.69:0/460856202 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c00bb20 con 0x7fe35c15cf20 2023-10-06T01:39:07.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.213+0000 7fe3637ad700 1 -- 172.21.15.69:0/460856202 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe35c15cf20 msgr2=0x7fe35c0b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:07.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.213+0000 7fe3637ad700 1 --2- 172.21.15.69:0/460856202 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe35c15cf20 0x7fe35c0b27d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe34c0098e0 tx=0x7fe34c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.213+0000 7fe3637ad700 1 -- 172.21.15.69:0/460856202 shutdown_connections 2023-10-06T01:39:07.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.213+0000 7fe3637ad700 1 --2- 172.21.15.69:0/460856202 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe35c0b2d10 0x7fe35c1536c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.213+0000 7fe3637ad700 1 --2- 172.21.15.69:0/460856202 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe35c15cf20 0x7fe35c0b27d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.213+0000 7fe3637ad700 1 -- 172.21.15.69:0/460856202 >> 172.21.15.69:0/460856202 conn(0x7fe35c0cded0 msgr2=0x7fe35c06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:07.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.214+0000 7fe3637ad700 1 -- 172.21.15.69:0/460856202 shutdown_connections 2023-10-06T01:39:07.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.214+0000 7fe3637ad700 1 -- 172.21.15.69:0/460856202 wait complete. 2023-10-06T01:39:07.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.215+0000 7fe3637ad700 1 Processor -- start 2023-10-06T01:39:07.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.215+0000 7fe3637ad700 1 -- start start 2023-10-06T01:39:07.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.215+0000 7fe3637ad700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe35c0b2d10 0x7fe35c14e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:07.219 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.215+0000 7fe3637ad700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe35c15cb50 0x7fe35c1528b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:07.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.215+0000 7fe3637ad700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe35c15cf20 0x7fe35c152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:07.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.215+0000 7fe3637ad700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c153330 con 0x7fe35c15cb50 2023-10-06T01:39:07.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.215+0000 7fe3637ad700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c14eab0 con 0x7fe35c15cf20 2023-10-06T01:39:07.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.215+0000 7fe3637ad700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe35c1535c0 con 0x7fe35c0b2d10 2023-10-06T01:39:07.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.216+0000 7fe360d48700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe35c15cb50 0x7fe35c1528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:07.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.216+0000 7fe360d48700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe35c15cb50 0x7fe35c1528b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57368/0 (socket says 172.21.15.69:57368) 2023-10-06T01:39:07.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.216+0000 7fe360d48700 1 -- 172.21.15.69:0/1044919751 learned_addr learned my addr 172.21.15.69:0/1044919751 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:07.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.216+0000 7fe360d48700 1 -- 172.21.15.69:0/1044919751 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe35c0b2d10 msgr2=0x7fe35c14e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:07.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.216+0000 7fe360d48700 1 --2- 172.21.15.69:0/1044919751 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe35c0b2d10 0x7fe35c14e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.216+0000 7fe360d48700 1 -- 172.21.15.69:0/1044919751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe35c15cf20 msgr2=0x7fe35c152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:07.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.216+0000 7fe361d4a700 1 --2- 172.21.15.69:0/1044919751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe35c15cf20 0x7fe35c152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:07.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.216+0000 7fe360d48700 1 --2- 172.21.15.69:0/1044919751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe35c15cf20 0x7fe35c152df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.216+0000 7fe360d48700 1 -- 172.21.15.69:0/1044919751 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe34c009420 con 0x7fe35c15cb50 2023-10-06T01:39:07.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.216+0000 7fe360d48700 1 --2- 172.21.15.69:0/1044919751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe35c15cb50 0x7fe35c1528b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe34c013000 tx=0x7fe34c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:07.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.216+0000 7fe3517fa700 1 -- 172.21.15.69:0/1044919751 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c00b910 con 0x7fe35c15cb50 2023-10-06T01:39:07.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.216+0000 7fe3517fa700 1 -- 172.21.15.69:0/1044919751 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34c00bab0 con 0x7fe35c15cb50 2023-10-06T01:39:07.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.216+0000 7fe3637ad700 1 -- 172.21.15.69:0/1044919751 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe35c1538a0 con 0x7fe35c15cb50 2023-10-06T01:39:07.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.216+0000 7fe3517fa700 1 -- 172.21.15.69:0/1044919751 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34c025670 con 0x7fe35c15cb50 2023-10-06T01:39:07.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.216+0000 7fe3637ad700 1 -- 172.21.15.69:0/1044919751 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe35c153e60 con 0x7fe35c15cb50 2023-10-06T01:39:07.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.217+0000 7fe3637ad700 1 -- 172.21.15.69:0/1044919751 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe35c04c3c0 con 0x7fe35c15cb50 2023-10-06T01:39:07.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.217+0000 7fe3517fa700 1 -- 172.21.15.69:0/1044919751 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe34c023070 con 0x7fe35c15cb50 2023-10-06T01:39:07.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.218+0000 7fe3517fa700 1 --2- 172.21.15.69:0/1044919751 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe340066f30 0x7fe3400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:07.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.218+0000 7fe3517fa700 1 -- 172.21.15.69:0/1044919751 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe34c085b00 con 0x7fe35c15cb50 2023-10-06T01:39:07.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.218+0000 7fe361549700 1 --2- 172.21.15.69:0/1044919751 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe340066f30 0x7fe3400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:07.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.218+0000 7fe361549700 1 --2- 172.21.15.69:0/1044919751 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe340066f30 0x7fe3400693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe358005c50 tx=0x7fe3580016e0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:07.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.222+0000 7fe3517fa700 1 -- 172.21.15.69:0/1044919751 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe34c052cc0 con 0x7fe35c15cb50 2023-10-06T01:39:07.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.449+0000 7fe3637ad700 1 -- 172.21.15.69:0/1044919751 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe35c14ec70 con 0x7fe35c15cb50 2023-10-06T01:39:07.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.449+0000 7fe3517fa700 1 -- 172.21.15.69:0/1044919751 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4591 (secure 0 0 0) 0x7fe34c015090 con 0x7fe35c15cb50 2023-10-06T01:39:07.450 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:07.450 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6836/2049506781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2049506781},{"type":"v1","addr":"172.21.15.69:6836","nonce":2049506781}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3367080201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6835","nonce":3367080201},{"type":"v1","addr":"172.21.15.69:6837","nonce":3367080201}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2692995813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":2692995813},{"type":"v1","addr":"172.21.15.88:6835","nonce":2692995813}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:38:49.072564+0000","modified":"2023-10-06T01:38:52.659297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6834/2097597935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":2097597935},{"type":"v1","addr":"172.21.15.88:6834","nonce":2097597935}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T01:39:07.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.451+0000 7fe3637ad700 1 -- 172.21.15.69:0/1044919751 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe340066f30 msgr2=0x7fe3400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:07.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.451+0000 7fe3637ad700 1 --2- 172.21.15.69:0/1044919751 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe340066f30 0x7fe3400693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fe358005c50 tx=0x7fe3580016e0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.451+0000 7fe3637ad700 1 -- 172.21.15.69:0/1044919751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe35c15cb50 msgr2=0x7fe35c1528b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:07.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.451+0000 7fe3637ad700 1 --2- 172.21.15.69:0/1044919751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe35c15cb50 0x7fe35c1528b0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe34c013000 tx=0x7fe34c017000 comp rx=0 tx=0).stop 2023-10-06T01:39:07.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.451+0000 7fe3637ad700 1 -- 172.21.15.69:0/1044919751 shutdown_connections 2023-10-06T01:39:07.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.451+0000 7fe3637ad700 1 --2- 172.21.15.69:0/1044919751 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe340066f30 0x7fe3400693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.451+0000 7fe3637ad700 1 --2- 172.21.15.69:0/1044919751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe35c15cf20 0x7fe35c152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.451+0000 7fe3637ad700 1 --2- 172.21.15.69:0/1044919751 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe35c0b2d10 0x7fe35c14e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.451+0000 7fe3637ad700 1 --2- 172.21.15.69:0/1044919751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe35c15cb50 0x7fe35c1528b0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.451+0000 7fe3637ad700 1 -- 172.21.15.69:0/1044919751 >> 172.21.15.69:0/1044919751 conn(0x7fe35c0cded0 msgr2=0x7fe35c156f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:07.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.451+0000 7fe3637ad700 1 -- 172.21.15.69:0/1044919751 shutdown_connections 2023-10-06T01:39:07.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.451+0000 7fe3637ad700 1 -- 172.21.15.69:0/1044919751 wait complete. 2023-10-06T01:39:07.453 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 8 2023-10-06T01:39:07.463 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:39:07.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.577+0000 7f2cfd155700 1 Processor -- start 2023-10-06T01:39:07.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.577+0000 7f2cfd155700 1 -- start start 2023-10-06T01:39:07.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.578+0000 7f2cfd155700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2cf8153c30 0x7f2cf815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:07.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.578+0000 7f2cfd155700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf815afd0 con 0x7f2cf80cf110 2023-10-06T01:39:07.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.578+0000 7f2cfd155700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cf815b2b0 con 0x7f2cf815de50 2023-10-06T01:39:07.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.578+0000 7f2cfd155700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cf815b590 con 0x7f2cf8153c30 2023-10-06T01:39:07.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.578+0000 7f2cfc954700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f2cf80cf110 0x7f2cf815c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59796/0 (socket says 172.21.15.69:59796) 2023-10-06T01:39:07.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.578+0000 7f2cfc954700 1 -- 172.21.15.69:0/4086017278 learned_addr learned my addr 172.21.15.69:0/4086017278 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:07.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.578+0000 7f2cf7fff700 1 --2- 172.21.15.69:0/4086017278 >> v2:172.21.15.88:3300/0 conn(0x7f2cf8153c30 0x7f2cf815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:07.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.578+0000 7f2cf77fe700 1 -- 172.21.15.69:0/4086017278 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1976764176 0 0) 0x7f2cf815afd0 con 0x7f2cf80cf110 2023-10-06T01:39:07.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.579+0000 7f2cf77fe700 1 -- 172.21.15.69:0/4086017278 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2ce4003570 con 0x7f2cf80cf110 2023-10-06T01:39:07.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.579+0000 7f2cf7fff700 1 -- 172.21.15.69:0/4086017278 >> v1:172.21.15.88:6789/0 conn(0x7f2cf815de50 legacy=0x7f2cf80cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:07.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.579+0000 7f2cf7fff700 1 -- 172.21.15.69:0/4086017278 >> v1:172.21.15.69:6789/0 conn(0x7f2cf80cf110 legacy=0x7f2cf815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:07.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.579+0000 7f2cf7fff700 1 -- 172.21.15.69:0/4086017278 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cf815b870 con 0x7f2cf8153c30 2023-10-06T01:39:07.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.579+0000 7f2cf7fff700 1 --2- 172.21.15.69:0/4086017278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cf8153c30 0x7f2cf815a5e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80098e0 tx=0x7f2ce80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc94bcdabfa5c8ff server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:07.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.579+0000 7f2cf77fe700 1 -- 172.21.15.69:0/4086017278 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce800b640 con 0x7f2cf8153c30 2023-10-06T01:39:07.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.579+0000 7f2cf77fe700 1 -- 172.21.15.69:0/4086017278 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce800b7a0 con 0x7f2cf8153c30 2023-10-06T01:39:07.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.579+0000 7f2cf77fe700 1 -- 172.21.15.69:0/4086017278 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce800bb40 con 0x7f2cf8153c30 2023-10-06T01:39:07.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.579+0000 7f2cfd155700 1 -- 172.21.15.69:0/4086017278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cf8153c30 msgr2=0x7f2cf815a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:07.581 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.579+0000 7f2cfd155700 1 --2- 172.21.15.69:0/4086017278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cf8153c30 0x7f2cf815a5e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2ce80098e0 tx=0x7f2ce80091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.580+0000 7f2cfd155700 1 -- 172.21.15.69:0/4086017278 shutdown_connections 2023-10-06T01:39:07.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.580+0000 7f2cfd155700 1 --2- 172.21.15.69:0/4086017278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cf8153c30 0x7f2cf815a5e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.580+0000 7f2cfd155700 1 -- 172.21.15.69:0/4086017278 >> 172.21.15.69:0/4086017278 conn(0x7f2cf80703a0 msgr2=0x7f2cf80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:07.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.580+0000 7f2cfd155700 1 -- 172.21.15.69:0/4086017278 shutdown_connections 2023-10-06T01:39:07.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.580+0000 7f2cfd155700 1 -- 172.21.15.69:0/4086017278 wait complete. 2023-10-06T01:39:07.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.581+0000 7f2cfd155700 1 Processor -- start 2023-10-06T01:39:07.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.581+0000 7f2cfd155700 1 -- start start 2023-10-06T01:39:07.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.581+0000 7f2cfd155700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cf80cf110 0x7f2cf81408d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:07.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.581+0000 7f2cfd155700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2cf8153c30 0x7f2cf816d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:07.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.581+0000 7f2cfd155700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2cf815de50 0x7f2cf816d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:07.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.581+0000 7f2cfd155700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf8143f10 con 0x7f2cf8153c30 2023-10-06T01:39:07.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.581+0000 7f2cfd155700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf80b41c0 con 0x7f2cf80cf110 2023-10-06T01:39:07.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.581+0000 7f2cfd155700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cf80b44a0 con 0x7f2cf815de50 2023-10-06T01:39:07.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.581+0000 7f2ceffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2cf8153c30 0x7f2cf816d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:07.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.582+0000 7f2ceffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2cf8153c30 0x7f2cf816d010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59454/0 (socket says 172.21.15.69:59454) 2023-10-06T01:39:07.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.582+0000 7f2ceffff700 1 -- 172.21.15.69:0/3277068881 learned_addr learned my addr 172.21.15.69:0/3277068881 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:07.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.582+0000 7f2cf7fff700 1 --2- 172.21.15.69:0/3277068881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cf80cf110 0x7f2cf81408d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:07.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.582+0000 7f2cfc954700 1 --2- 172.21.15.69:0/3277068881 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2cf815de50 0x7f2cf816d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:07.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.582+0000 7f2ceffff700 1 -- 172.21.15.69:0/3277068881 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2cf815de50 msgr2=0x7f2cf816d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:07.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.582+0000 7f2ceffff700 1 --2- 172.21.15.69:0/3277068881 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2cf815de50 0x7f2cf816d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.582+0000 7f2ceffff700 1 -- 172.21.15.69:0/3277068881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cf80cf110 msgr2=0x7f2cf81408d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:07.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.582+0000 7f2ceffff700 1 --2- 172.21.15.69:0/3277068881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cf80cf110 0x7f2cf81408d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.582+0000 7f2ceffff700 1 -- 172.21.15.69:0/3277068881 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce8009420 con 0x7f2cf8153c30 2023-10-06T01:39:07.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.582+0000 7f2cf7fff700 1 --2- 172.21.15.69:0/3277068881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cf80cf110 0x7f2cf81408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:07.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.582+0000 7f2cfc954700 1 --2- 172.21.15.69:0/3277068881 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2cf815de50 0x7f2cf816d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:07.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.582+0000 7f2ceffff700 1 --2- 172.21.15.69:0/3277068881 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2cf8153c30 0x7f2cf816d010 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2ce000c4e0 tx=0x7f2ce000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:07.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.582+0000 7f2cf4ff9700 1 -- 172.21.15.69:0/3277068881 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0011590 con 0x7f2cf8153c30 2023-10-06T01:39:07.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.582+0000 7f2cf4ff9700 1 -- 172.21.15.69:0/3277068881 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ce0011710 con 0x7f2cf8153c30 2023-10-06T01:39:07.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.582+0000 7f2cfd155700 1 -- 172.21.15.69:0/3277068881 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cf80b4780 con 0x7f2cf8153c30 2023-10-06T01:39:07.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.582+0000 7f2cf4ff9700 1 -- 172.21.15.69:0/3277068881 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ce0011ad0 con 0x7f2cf8153c30 2023-10-06T01:39:07.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.582+0000 7f2cfd155700 1 -- 172.21.15.69:0/3277068881 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cf80b4d40 con 0x7f2cf8153c30 2023-10-06T01:39:07.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.583+0000 7f2cfd155700 1 -- 172.21.15.69:0/3277068881 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cf80b4f30 con 0x7f2cf8153c30 2023-10-06T01:39:07.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.583+0000 7f2cf4ff9700 1 -- 172.21.15.69:0/3277068881 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ce001b3b0 con 0x7f2cf8153c30 2023-10-06T01:39:07.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.584+0000 7f2cf4ff9700 1 --2- 172.21.15.69:0/3277068881 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2cd8066f30 0x7f2cd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:07.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.584+0000 7f2cf7fff700 1 --2- 172.21.15.69:0/3277068881 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2cd8066f30 0x7f2cd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:07.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.584+0000 7f2cf4ff9700 1 -- 172.21.15.69:0/3277068881 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2ce0083bd0 con 0x7f2cf8153c30 2023-10-06T01:39:07.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.584+0000 7f2cf7fff700 1 --2- 172.21.15.69:0/3277068881 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2cd8066f30 0x7f2cd80693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8003080 tx=0x7f2ce8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:07.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.588+0000 7f2cf4ff9700 1 -- 172.21.15.69:0/3277068881 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ce0050ce0 con 0x7f2cf8153c30 2023-10-06T01:39:07.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.771+0000 7f2cfd155700 1 -- 172.21.15.69:0/3277068881 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2cf804c3c0 con 0x7f2cf8153c30 2023-10-06T01:39:07.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.772+0000 7f2cf4ff9700 1 -- 172.21.15.69:0/3277068881 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f2ce0017070 con 0x7f2cf8153c30 2023-10-06T01:39:07.773 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:07.773 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":24,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:38:50.506861+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:38:43.046056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:38:47.525023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:38:47.992048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:39:07.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.774+0000 7f2cfd155700 1 -- 172.21.15.69:0/3277068881 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2cd8066f30 msgr2=0x7f2cd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:07.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.774+0000 7f2cfd155700 1 --2- 172.21.15.69:0/3277068881 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2cd8066f30 0x7f2cd80693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2ce8003080 tx=0x7f2ce8017000 comp rx=0 tx=0).stop 2023-10-06T01:39:07.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.774+0000 7f2cfd155700 1 -- 172.21.15.69:0/3277068881 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2cf8153c30 msgr2=0x7f2cf816d010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:07.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.774+0000 7f2cfd155700 1 --2- 172.21.15.69:0/3277068881 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2cf8153c30 0x7f2cf816d010 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2ce000c4e0 tx=0x7f2ce000c8a0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.774+0000 7f2cfd155700 1 -- 172.21.15.69:0/3277068881 shutdown_connections 2023-10-06T01:39:07.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.774+0000 7f2cfd155700 1 --2- 172.21.15.69:0/3277068881 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2cd8066f30 0x7f2cd80693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.774+0000 7f2cfd155700 1 --2- 172.21.15.69:0/3277068881 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2cf815de50 0x7f2cf816d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.774+0000 7f2cfd155700 1 --2- 172.21.15.69:0/3277068881 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2cf80cf110 0x7f2cf81408d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.774+0000 7f2cfd155700 1 --2- 172.21.15.69:0/3277068881 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2cf8153c30 0x7f2cf816d010 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.774+0000 7f2cfd155700 1 -- 172.21.15.69:0/3277068881 >> 172.21.15.69:0/3277068881 conn(0x7f2cf80703a0 msgr2=0x7f2cf8152fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:07.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.774+0000 7f2cfd155700 1 -- 172.21.15.69:0/3277068881 shutdown_connections 2023-10-06T01:39:07.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.774+0000 7f2cfd155700 1 -- 172.21.15.69:0/3277068881 wait complete. 2023-10-06T01:39:07.789 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:39:07.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.902+0000 7f347e787700 1 Processor -- start 2023-10-06T01:39:07.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.902+0000 7f347e787700 1 -- start start 2023-10-06T01:39:07.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.903+0000 7f347e787700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f34780cb970 0x7f3478159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:07.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.903+0000 7f347e787700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f347815a400 0x7f3478156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:07.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.903+0000 7f347e787700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f347815ae40 con 0x7f34780cb5a0 2023-10-06T01:39:07.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.903+0000 7f347e787700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34780ce0f0 con 0x7f34780cb970 2023-10-06T01:39:07.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.903+0000 7f347e787700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34780d13f0 con 0x7f347815a400 2023-10-06T01:39:07.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.903+0000 7f34777fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f34780cb970 0x7f3478159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:07.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.903+0000 7f3477fff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f34780cb5a0 0x7f34780cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.69:48312/0 (socket says 172.21.15.69:48312) 2023-10-06T01:39:07.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.903+0000 7f347cd24700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f347815a400 0x7f3478156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:07.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.903+0000 7f34777fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f34780cb970 0x7f3478159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.69:43178/0 (socket says 172.21.15.69:43178) 2023-10-06T01:39:07.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.903+0000 7f3477fff700 1 -- 172.21.15.69:0/1796119623 learned_addr learned my addr 172.21.15.69:0/1796119623 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:07.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.904+0000 7f347cd24700 1 -- 172.21.15.69:0/1796119623 >> v2:172.21.15.88:3300/0 conn(0x7f34780cb970 msgr2=0x7f3478159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:07.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.904+0000 7f347cd24700 1 --2- 172.21.15.69:0/1796119623 >> v2:172.21.15.88:3300/0 conn(0x7f34780cb970 0x7f3478159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.904+0000 7f347cd24700 1 -- 172.21.15.69:0/1796119623 >> v1:172.21.15.88:6789/0 conn(0x7f34780cb5a0 legacy=0x7f34780cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:07.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.904+0000 7f3476ffd700 1 -- 172.21.15.69:0/1796119623 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 624783912 0 0) 0x7f347815ae40 con 0x7f34780cb5a0 2023-10-06T01:39:07.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.904+0000 7f347cd24700 1 -- 172.21.15.69:0/1796119623 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f347815ab60 con 0x7f347815a400 2023-10-06T01:39:07.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.904+0000 7f34777fe700 1 --2- 172.21.15.69:0/1796119623 >> v2:172.21.15.88:3300/0 conn(0x7f34780cb970 0x7f3478159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:07.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.904+0000 7f347cd24700 1 --2- 172.21.15.69:0/1796119623 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f347815a400 0x7f3478156e90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3470009e60 tx=0x7f3470009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=366673aa26ce69e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:07.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.904+0000 7f3476ffd700 1 -- 172.21.15.69:0/1796119623 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347000e070 con 0x7f347815a400 2023-10-06T01:39:07.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.904+0000 7f3476ffd700 1 -- 172.21.15.69:0/1796119623 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347000bb60 con 0x7f347815a400 2023-10-06T01:39:07.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.904+0000 7f3476ffd700 1 -- 172.21.15.69:0/1796119623 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3470012430 con 0x7f347815a400 2023-10-06T01:39:07.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.904+0000 7f347e787700 1 -- 172.21.15.69:0/1796119623 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f347815a400 msgr2=0x7f3478156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:07.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.904+0000 7f347e787700 1 --2- 172.21.15.69:0/1796119623 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f347815a400 0x7f3478156e90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3470009e60 tx=0x7f3470009780 comp rx=0 tx=0).stop 2023-10-06T01:39:07.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.904+0000 7f347e787700 1 -- 172.21.15.69:0/1796119623 shutdown_connections 2023-10-06T01:39:07.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.904+0000 7f347e787700 1 --2- 172.21.15.69:0/1796119623 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f347815a400 0x7f3478156e90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.904+0000 7f347e787700 1 --2- 172.21.15.69:0/1796119623 >> v2:172.21.15.88:3300/0 conn(0x7f34780cb970 0x7f3478159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.904+0000 7f347e787700 1 -- 172.21.15.69:0/1796119623 >> 172.21.15.69:0/1796119623 conn(0x7f3478070e30 msgr2=0x7f34780d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:07.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.904+0000 7f347e787700 1 -- 172.21.15.69:0/1796119623 shutdown_connections 2023-10-06T01:39:07.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.905+0000 7f347e787700 1 -- 172.21.15.69:0/1796119623 wait complete. 2023-10-06T01:39:07.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.906+0000 7f347e787700 1 Processor -- start 2023-10-06T01:39:07.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.906+0000 7f347e787700 1 -- start start 2023-10-06T01:39:07.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.906+0000 7f347e787700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f34780cb5a0 0x7f347814fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:07.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.906+0000 7f347e787700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34780cb970 0x7f3478150710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:07.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.906+0000 7f347e787700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f347815a400 0x7f3478150c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:07.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.906+0000 7f347e787700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3478151840 con 0x7f347815a400 2023-10-06T01:39:07.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.906+0000 7f347e787700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34780c8f40 con 0x7f34780cb970 2023-10-06T01:39:07.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.906+0000 7f347e787700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34780c7a80 con 0x7f34780cb5a0 2023-10-06T01:39:07.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.907+0000 7f347cd24700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f347815a400 0x7f3478150c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:07.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.907+0000 7f347cd24700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f347815a400 0x7f3478150c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59460/0 (socket says 172.21.15.69:59460) 2023-10-06T01:39:07.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.907+0000 7f347cd24700 1 -- 172.21.15.69:0/3892511131 learned_addr learned my addr 172.21.15.69:0/3892511131 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:07.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.907+0000 7f34777fe700 1 --2- 172.21.15.69:0/3892511131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34780cb970 0x7f3478150710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:07.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.907+0000 7f3477fff700 1 --2- 172.21.15.69:0/3892511131 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f34780cb5a0 0x7f347814fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:07.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.907+0000 7f347cd24700 1 -- 172.21.15.69:0/3892511131 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f34780cb5a0 msgr2=0x7f347814fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:07.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.907+0000 7f347cd24700 1 --2- 172.21.15.69:0/3892511131 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f34780cb5a0 0x7f347814fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.907+0000 7f347cd24700 1 -- 172.21.15.69:0/3892511131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34780cb970 msgr2=0x7f3478150710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:07.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.907+0000 7f347cd24700 1 --2- 172.21.15.69:0/3892511131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34780cb970 0x7f3478150710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:07.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.907+0000 7f347cd24700 1 -- 172.21.15.69:0/3892511131 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f346c009420 con 0x7f347815a400 2023-10-06T01:39:07.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.907+0000 7f347cd24700 1 --2- 172.21.15.69:0/3892511131 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f347815a400 0x7f3478150c50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3470012ad0 tx=0x7f3470019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:07.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.907+0000 7f345ffff700 1 -- 172.21.15.69:0/3892511131 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3470012e10 con 0x7f347815a400 2023-10-06T01:39:07.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.907+0000 7f345ffff700 1 -- 172.21.15.69:0/3892511131 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347001e630 con 0x7f347815a400 2023-10-06T01:39:07.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.907+0000 7f347e787700 1 -- 172.21.15.69:0/3892511131 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3470009a20 con 0x7f347815a400 2023-10-06T01:39:07.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.907+0000 7f345ffff700 1 -- 172.21.15.69:0/3892511131 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347001e9f0 con 0x7f347815a400 2023-10-06T01:39:07.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.907+0000 7f347e787700 1 -- 172.21.15.69:0/3892511131 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3478151560 con 0x7f347815a400 2023-10-06T01:39:07.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.908+0000 7f347e787700 1 -- 172.21.15.69:0/3892511131 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f347804c3c0 con 0x7f347815a400 2023-10-06T01:39:07.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.909+0000 7f345ffff700 1 -- 172.21.15.69:0/3892511131 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3470024070 con 0x7f347815a400 2023-10-06T01:39:07.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.909+0000 7f345ffff700 1 --2- 172.21.15.69:0/3892511131 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3464066f30 0x7f34640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:07.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.909+0000 7f345ffff700 1 -- 172.21.15.69:0/3892511131 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3470086e60 con 0x7f347815a400 2023-10-06T01:39:07.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.909+0000 7f3477fff700 1 --2- 172.21.15.69:0/3892511131 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3464066f30 0x7f34640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:07.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.909+0000 7f3477fff700 1 --2- 172.21.15.69:0/3892511131 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3464066f30 0x7f34640693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f34680011e0 tx=0x7f3468009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:07.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:07.913+0000 7f345ffff700 1 -- 172.21.15.69:0/3892511131 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3470053f70 con 0x7f347815a400 2023-10-06T01:39:08.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.139+0000 7f347e787700 1 -- 172.21.15.69:0/3892511131 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f34780c9080 con 0x7f347815a400 2023-10-06T01:39:08.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.139+0000 7f345ffff700 1 -- 172.21.15.69:0/3892511131 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f347002c090 con 0x7f347815a400 2023-10-06T01:39:08.140 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:08.140 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6836/2049506781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2049506781},{"type":"v1","addr":"172.21.15.69:6836","nonce":2049506781}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3367080201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6835","nonce":3367080201},{"type":"v1","addr":"172.21.15.69:6837","nonce":3367080201}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2692995813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":2692995813},{"type":"v1","addr":"172.21.15.88:6835","nonce":2692995813}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:38:49.072564+0000","modified":"2023-10-06T01:38:52.659297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6834/2097597935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":2097597935},{"type":"v1","addr":"172.21.15.88:6834","nonce":2097597935}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T01:39:08.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.142+0000 7f347e787700 1 -- 172.21.15.69:0/3892511131 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3464066f30 msgr2=0x7f34640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:08.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.142+0000 7f347e787700 1 --2- 172.21.15.69:0/3892511131 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3464066f30 0x7f34640693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f34680011e0 tx=0x7f3468009040 comp rx=0 tx=0).stop 2023-10-06T01:39:08.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.142+0000 7f347e787700 1 -- 172.21.15.69:0/3892511131 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f347815a400 msgr2=0x7f3478150c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:08.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.142+0000 7f347e787700 1 --2- 172.21.15.69:0/3892511131 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f347815a400 0x7f3478150c50 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3470012ad0 tx=0x7f3470019000 comp rx=0 tx=0).stop 2023-10-06T01:39:08.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.142+0000 7f347e787700 1 -- 172.21.15.69:0/3892511131 shutdown_connections 2023-10-06T01:39:08.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.142+0000 7f347e787700 1 --2- 172.21.15.69:0/3892511131 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3464066f30 0x7f34640693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.142+0000 7f347e787700 1 --2- 172.21.15.69:0/3892511131 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f347815a400 0x7f3478150c50 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.142+0000 7f347e787700 1 --2- 172.21.15.69:0/3892511131 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f34780cb5a0 0x7f347814fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.142+0000 7f347e787700 1 --2- 172.21.15.69:0/3892511131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f34780cb970 0x7f3478150710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.142+0000 7f347e787700 1 -- 172.21.15.69:0/3892511131 >> 172.21.15.69:0/3892511131 conn(0x7f3478070e30 msgr2=0x7f34780d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:08.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.142+0000 7f347e787700 1 -- 172.21.15.69:0/3892511131 shutdown_connections 2023-10-06T01:39:08.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.142+0000 7f347e787700 1 -- 172.21.15.69:0/3892511131 wait complete. 2023-10-06T01:39:08.144 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 8 2023-10-06T01:39:08.556 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T01:38:49.072564+0000', 'modified': '2023-10-06T01:38:52.659297+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4302}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4302': {'gid': 4302, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.88:6834/2097597935', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6832', 'nonce': 2097597935}, {'type': 'v1', 'addr': '172.21.15.88:6834', 'nonce': 2097597935}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T01:39:08.556 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T01:39:08.557 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-06T01:39:08.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.674+0000 7ffb6b381700 1 Processor -- start 2023-10-06T01:39:08.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.674+0000 7ffb6b381700 1 -- start start 2023-10-06T01:39:08.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.675+0000 7ffb6b381700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb640cb5a0 0x7ffb640cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:08.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.675+0000 7ffb6b381700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ffb640cd9e0 0x7ffb64159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:08.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.675+0000 7ffb6b381700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb6415ae40 con 0x7ffb640cde50 2023-10-06T01:39:08.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.675+0000 7ffb6b381700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb640d13f0 con 0x7ffb640cd9e0 2023-10-06T01:39:08.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.675+0000 7ffb6b381700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6415ab60 con 0x7ffb640cb5a0 2023-10-06T01:39:08.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.675+0000 7ffb6891c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ffb640cd9e0 0x7ffb64159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:08.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.675+0000 7ffb6891c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ffb640cd9e0 0x7ffb64159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59466/0 (socket says 172.21.15.69:59466) 2023-10-06T01:39:08.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.675+0000 7ffb6891c700 1 -- 172.21.15.69:0/2260510903 learned_addr learned my addr 172.21.15.69:0/2260510903 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:08.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.675+0000 7ffb6911d700 1 --2- 172.21.15.69:0/2260510903 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb640cb5a0 0x7ffb640cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:08.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.675+0000 7ffb6891c700 1 -- 172.21.15.69:0/2260510903 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb640cb5a0 msgr2=0x7ffb640cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:08.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.675+0000 7ffb6891c700 1 --2- 172.21.15.69:0/2260510903 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb640cb5a0 0x7ffb640cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.675+0000 7ffb6891c700 1 -- 172.21.15.69:0/2260510903 >> v1:172.21.15.88:6789/0 conn(0x7ffb640cde50 legacy=0x7ffb64156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:08.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.675+0000 7ffb6891c700 1 -- 172.21.15.69:0/2260510903 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb640ccf00 con 0x7ffb640cd9e0 2023-10-06T01:39:08.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.675+0000 7ffb6891c700 1 --2- 172.21.15.69:0/2260510903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb640cd9e0 0x7ffb64159ec0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffb540099b0 tx=0x7ffb54009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=426ef17cf9a60fe0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:08.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.675+0000 7ffb5bfff700 1 -- 172.21.15.69:0/2260510903 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5400b820 con 0x7ffb640cd9e0 2023-10-06T01:39:08.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.675+0000 7ffb5bfff700 1 -- 172.21.15.69:0/2260510903 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5400b980 con 0x7ffb640cd9e0 2023-10-06T01:39:08.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.675+0000 7ffb5bfff700 1 -- 172.21.15.69:0/2260510903 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5400bd20 con 0x7ffb640cd9e0 2023-10-06T01:39:08.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.676+0000 7ffb6b381700 1 -- 172.21.15.69:0/2260510903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb640cd9e0 msgr2=0x7ffb64159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:08.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.676+0000 7ffb6b381700 1 --2- 172.21.15.69:0/2260510903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb640cd9e0 0x7ffb64159ec0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ffb540099b0 tx=0x7ffb54009250 comp rx=0 tx=0).stop 2023-10-06T01:39:08.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.676+0000 7ffb6b381700 1 -- 172.21.15.69:0/2260510903 shutdown_connections 2023-10-06T01:39:08.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.676+0000 7ffb6b381700 1 --2- 172.21.15.69:0/2260510903 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb640cb5a0 0x7ffb640cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.676+0000 7ffb6b381700 1 --2- 172.21.15.69:0/2260510903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb640cd9e0 0x7ffb64159ec0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.676+0000 7ffb6b381700 1 -- 172.21.15.69:0/2260510903 >> 172.21.15.69:0/2260510903 conn(0x7ffb64070e30 msgr2=0x7ffb640d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:08.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.676+0000 7ffb6b381700 1 -- 172.21.15.69:0/2260510903 shutdown_connections 2023-10-06T01:39:08.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.676+0000 7ffb6b381700 1 -- 172.21.15.69:0/2260510903 wait complete. 2023-10-06T01:39:08.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.677+0000 7ffb6b381700 1 Processor -- start 2023-10-06T01:39:08.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.677+0000 7ffb6b381700 1 -- start start 2023-10-06T01:39:08.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.678+0000 7ffb6b381700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb640cb5a0 0x7ffb6416a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:08.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.678+0000 7ffb6b381700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb640cd9e0 0x7ffb640b4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:08.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.678+0000 7ffb6b381700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb640c8ca0 0x7ffb64159580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:08.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.678+0000 7ffb6b381700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb64169fa0 con 0x7ffb640cd9e0 2023-10-06T01:39:08.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.678+0000 7ffb6b381700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6415a1b0 con 0x7ffb640cb5a0 2023-10-06T01:39:08.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.678+0000 7ffb6b381700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb64159ed0 con 0x7ffb640c8ca0 2023-10-06T01:39:08.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.678+0000 7ffb6891c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb640cd9e0 0x7ffb640b4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:08.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.678+0000 7ffb6891c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb640cd9e0 0x7ffb640b4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59468/0 (socket says 172.21.15.69:59468) 2023-10-06T01:39:08.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.678+0000 7ffb6891c700 1 -- 172.21.15.69:0/2862802549 learned_addr learned my addr 172.21.15.69:0/2862802549 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:08.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.678+0000 7ffb6991e700 1 --2- 172.21.15.69:0/2862802549 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb640c8ca0 0x7ffb64159580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:08.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.678+0000 7ffb6911d700 1 --2- 172.21.15.69:0/2862802549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb640cb5a0 0x7ffb6416a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:08.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.678+0000 7ffb6891c700 1 -- 172.21.15.69:0/2862802549 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb640c8ca0 msgr2=0x7ffb64159580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:08.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.678+0000 7ffb6891c700 1 --2- 172.21.15.69:0/2862802549 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb640c8ca0 0x7ffb64159580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.678+0000 7ffb6891c700 1 -- 172.21.15.69:0/2862802549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb640cb5a0 msgr2=0x7ffb6416a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:08.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.678+0000 7ffb6891c700 1 --2- 172.21.15.69:0/2862802549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb640cb5a0 0x7ffb6416a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.678+0000 7ffb6891c700 1 -- 172.21.15.69:0/2862802549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb540094f0 con 0x7ffb640cd9e0 2023-10-06T01:39:08.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.678+0000 7ffb6891c700 1 --2- 172.21.15.69:0/2862802549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb640cd9e0 0x7ffb640b4a30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ffb54009290 tx=0x7ffb54016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:08.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.679+0000 7ffb597fa700 1 -- 172.21.15.69:0/2862802549 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb54011d90 con 0x7ffb640cd9e0 2023-10-06T01:39:08.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.679+0000 7ffb597fa700 1 -- 172.21.15.69:0/2862802549 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb54020070 con 0x7ffb640cd9e0 2023-10-06T01:39:08.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.679+0000 7ffb6b381700 1 -- 172.21.15.69:0/2862802549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb64169950 con 0x7ffb640cd9e0 2023-10-06T01:39:08.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.679+0000 7ffb597fa700 1 -- 172.21.15.69:0/2862802549 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5401b6a0 con 0x7ffb640cd9e0 2023-10-06T01:39:08.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.679+0000 7ffb6b381700 1 -- 172.21.15.69:0/2862802549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb640b4f70 con 0x7ffb640cd9e0 2023-10-06T01:39:08.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.680+0000 7ffb597fa700 1 -- 172.21.15.69:0/2862802549 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffb54022030 con 0x7ffb640cd9e0 2023-10-06T01:39:08.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.680+0000 7ffb597fa700 1 --2- 172.21.15.69:0/2862802549 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ffb48066f30 0x7ffb480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:08.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.680+0000 7ffb597fa700 1 -- 172.21.15.69:0/2862802549 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ffb54086610 con 0x7ffb640cd9e0 2023-10-06T01:39:08.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.680+0000 7ffb6911d700 1 --2- 172.21.15.69:0/2862802549 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ffb48066f30 0x7ffb480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:08.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.681+0000 7ffb6911d700 1 --2- 172.21.15.69:0/2862802549 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ffb48066f30 0x7ffb480693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c006fd0 tx=0x7ffb5c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:08.687 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.682+0000 7ffb74679b80 1 Processor -- start 2023-10-06T01:39:08.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.682+0000 7ffb74679b80 1 -- start start 2023-10-06T01:39:08.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.683+0000 7ffb74679b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe260840 0x5561fe260c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:08.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.683+0000 7ffb74679b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5561fe261cc0 0x5561fe2b06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:08.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.683+0000 7ffb74679b80 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5561fe2b0c00 0x5561fe2b1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:08.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.683+0000 7ffb74679b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561fe1b7a70 con 0x5561fe260840 2023-10-06T01:39:08.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.683+0000 7ffb74679b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561fe1b5270 con 0x5561fe261cc0 2023-10-06T01:39:08.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.683+0000 7ffb74679b80 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561fe1b1060 con 0x5561fe2b0c00 2023-10-06T01:39:08.688 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.683+0000 7ffb6911d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe260840 0x5561fe260c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:08.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.683+0000 7ffb6911d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe260840 0x5561fe260c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59484/0 (socket says 172.21.15.69:59484) 2023-10-06T01:39:08.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.683+0000 7ffb6911d700 1 -- 172.21.15.69:0/2636579643 learned_addr learned my addr 172.21.15.69:0/2636579643 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:08.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.683+0000 7ffb6891c700 1 --2- 172.21.15.69:0/2636579643 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5561fe261cc0 0x5561fe2b06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:08.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.683+0000 7ffb6991e700 1 --2- 172.21.15.69:0/2636579643 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5561fe2b0c00 0x5561fe2b1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:08.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.683+0000 7ffb6911d700 1 -- 172.21.15.69:0/2636579643 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5561fe2b0c00 msgr2=0x5561fe2b1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:08.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.683+0000 7ffb6911d700 1 --2- 172.21.15.69:0/2636579643 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5561fe2b0c00 0x5561fe2b1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.683+0000 7ffb6911d700 1 -- 172.21.15.69:0/2636579643 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5561fe261cc0 msgr2=0x5561fe2b06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:08.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.683+0000 7ffb6911d700 1 --2- 172.21.15.69:0/2636579643 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5561fe261cc0 0x5561fe2b06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.683+0000 7ffb6911d700 1 -- 172.21.15.69:0/2636579643 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561fe04b270 con 0x5561fe260840 2023-10-06T01:39:08.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.683+0000 7ffb6911d700 1 --2- 172.21.15.69:0/2636579643 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe260840 0x5561fe260c10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00e9c0 tx=0x7ffb5c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d124d8194f3eeae4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:08.689 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.683+0000 7ffb4e7fc700 1 -- 172.21.15.69:0/2636579643 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c0155c0 con 0x5561fe260840 2023-10-06T01:39:08.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.684+0000 7ffb4e7fc700 1 -- 172.21.15.69:0/2636579643 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5c015720 con 0x5561fe260840 2023-10-06T01:39:08.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.684+0000 7ffb4e7fc700 1 -- 172.21.15.69:0/2636579643 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c015aa0 con 0x5561fe260840 2023-10-06T01:39:08.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.684+0000 7ffb74679b80 1 -- 172.21.15.69:0/2636579643 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe260840 msgr2=0x5561fe260c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:08.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.684+0000 7ffb74679b80 1 --2- 172.21.15.69:0/2636579643 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe260840 0x5561fe260c10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00e9c0 tx=0x7ffb5c015000 comp rx=0 tx=0).stop 2023-10-06T01:39:08.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.684+0000 7ffb74679b80 1 -- 172.21.15.69:0/2636579643 shutdown_connections 2023-10-06T01:39:08.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.684+0000 7ffb74679b80 1 --2- 172.21.15.69:0/2636579643 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5561fe2b0c00 0x5561fe2b1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.684+0000 7ffb74679b80 1 --2- 172.21.15.69:0/2636579643 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe260840 0x5561fe260c10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.684+0000 7ffb74679b80 1 --2- 172.21.15.69:0/2636579643 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5561fe261cc0 0x5561fe2b06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.684+0000 7ffb74679b80 1 -- 172.21.15.69:0/2636579643 >> 172.21.15.69:0/2636579643 conn(0x5561fe262160 msgr2=0x5561fe262530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:08.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.684+0000 7ffb74679b80 1 -- 172.21.15.69:0/2636579643 shutdown_connections 2023-10-06T01:39:08.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.684+0000 7ffb74679b80 1 -- 172.21.15.69:0/2636579643 wait complete. 2023-10-06T01:39:08.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.685+0000 7ffb74679b80 1 -- start start 2023-10-06T01:39:08.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.685+0000 7ffb74679b80 1 Processor -- start 2023-10-06T01:39:08.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.686+0000 7ffb74679b80 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5561fe260840 0x5561fe2860e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:08.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.686+0000 7ffb74679b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5561fe261cc0 0x5561fe29ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:08.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.686+0000 7ffb74679b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe2b0c00 0x5561fe2a10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:08.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.686+0000 7ffb74679b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561fe15c890 con 0x5561fe2b0c00 2023-10-06T01:39:08.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.686+0000 7ffb74679b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561fe177ea0 con 0x5561fe261cc0 2023-10-06T01:39:08.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.686+0000 7ffb74679b80 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561fe033e30 con 0x5561fe260840 2023-10-06T01:39:08.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.686+0000 7ffb6991e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe2b0c00 0x5561fe2a10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:08.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.686+0000 7ffb74679b80 10 client.0 _ll_register_callbacks cb 0x5561fe223e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T01:39:08.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.686+0000 7ffb6991e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe2b0c00 0x5561fe2a10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59498/0 (socket says 172.21.15.69:59498) 2023-10-06T01:39:08.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.686+0000 7ffb6991e700 1 -- 172.21.15.69:0/1233980222 learned_addr learned my addr 172.21.15.69:0/1233980222 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:08.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.686+0000 7ffb6911d700 1 --2- 172.21.15.69:0/1233980222 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5561fe260840 0x5561fe2860e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:08.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.686+0000 7ffb6891c700 1 --2- 172.21.15.69:0/1233980222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5561fe261cc0 0x5561fe29ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:08.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.686+0000 7ffb6991e700 1 -- 172.21.15.69:0/1233980222 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5561fe260840 msgr2=0x5561fe2860e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:08.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.686+0000 7ffb6991e700 1 --2- 172.21.15.69:0/1233980222 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5561fe260840 0x5561fe2860e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.686+0000 7ffb6991e700 1 -- 172.21.15.69:0/1233980222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5561fe261cc0 msgr2=0x5561fe29ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:08.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.686+0000 7ffb6991e700 1 --2- 172.21.15.69:0/1233980222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5561fe261cc0 0x5561fe29ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.686+0000 7ffb6991e700 1 -- 172.21.15.69:0/1233980222 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb5c00e620 con 0x5561fe2b0c00 2023-10-06T01:39:08.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.686+0000 7ffb6991e700 1 --2- 172.21.15.69:0/1233980222 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe2b0c00 0x5561fe2a10d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ffb6000fd20 tx=0x7ffb60007790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f345bfdb835a939f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:08.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.686+0000 7ffb437fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-10-06T01:39:08.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.686+0000 7ffb437fe700 1 -- 172.21.15.69:0/1233980222 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb60007bc0 con 0x5561fe2b0c00 2023-10-06T01:39:08.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.686+0000 7ffb437fe700 1 -- 172.21.15.69:0/1233980222 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ffb6000daa0 con 0x5561fe2b0c00 2023-10-06T01:39:08.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.686+0000 7ffb74679b80 1 -- 172.21.15.69:0/1233980222 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5561fe255940 con 0x5561fe2b0c00 2023-10-06T01:39:08.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.686+0000 7ffb437fe700 1 -- 172.21.15.69:0/1233980222 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb6000de70 con 0x5561fe2b0c00 2023-10-06T01:39:08.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.686+0000 7ffb74679b80 10 client.4731 fetch_fsmap learned FSMap version 8 2023-10-06T01:39:08.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.686+0000 7ffb74679b80 1 -- 172.21.15.69:0/1233980222 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5561fdfedfe0 con 0x5561fe2b0c00 2023-10-06T01:39:08.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.687+0000 7ffb437fe700 1 -- 172.21.15.69:0/1233980222 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5561fe255940 con 0x5561fe2b0c00 2023-10-06T01:39:08.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.687+0000 7ffb437fe700 1 -- 172.21.15.69:0/1233980222 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ffb60017020 con 0x5561fe2b0c00 2023-10-06T01:39:08.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.687+0000 7ffb74679b80 10 client.4731 fetch_fsmap finished waiting for FSMap version 8 2023-10-06T01:39:08.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.687+0000 7ffb74679b80 10 client.4731 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T01:39:08.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.687+0000 7ffb74679b80 20 client.4731 populate_metadata read hostname 'smithi069' 2023-10-06T01:39:08.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.687+0000 7ffb74679b80 1 --2- 172.21.15.69:0/1233980222 >> [v2:172.21.15.88:6832/2097597935,v1:172.21.15.88:6834/2097597935] conn(0x5561fe2b96e0 0x5561fe2b9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:08.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.687+0000 7ffb74679b80 4 client.4731 mds_command: new command op to 4302 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T01:39:08.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.687+0000 7ffb74679b80 1 -- 172.21.15.69:0/1233980222 --> [v2:172.21.15.88:6832/2097597935,v1:172.21.15.88:6834/2097597935] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5561fe232870 con 0x5561fe2b96e0 2023-10-06T01:39:08.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.687+0000 7ffb6911d700 1 --2- 172.21.15.69:0/1233980222 >> [v2:172.21.15.88:6832/2097597935,v1:172.21.15.88:6834/2097597935] conn(0x5561fe2b96e0 0x5561fe2b9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:08.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.687+0000 7ffb437fe700 10 client.4731 ms_handle_connect on v2:172.21.15.88:6832/2097597935 2023-10-06T01:39:08.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.687+0000 7ffb6911d700 1 --2- 172.21.15.69:0/1233980222 >> [v2:172.21.15.88:6832/2097597935,v1:172.21.15.88:6834/2097597935] conn(0x5561fe2b96e0 0x5561fe2b9ab0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d9551347db78da3b server_cookie=3db88ecec86df772 in_seq=0 out_seq=0 2023-10-06T01:39:08.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.688+0000 7ffb437fe700 1 -- 172.21.15.69:0/1233980222 <== mds.0 v2:172.21.15.88:6832/2097597935 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5561fe232870 con 0x5561fe2b96e0 2023-10-06T01:39:08.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.688+0000 7ffb437fe700 10 client.4731 handle_command_reply: tid=0 2023-10-06T01:39:08.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.688+0000 7ffb74679b80 1 client.4731 shutdown 2023-10-06T01:39:08.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.688+0000 7ffb74679b80 1 -- 172.21.15.69:0/1233980222 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe2b0c00 msgr2=0x5561fe2a10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:08.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.688+0000 7ffb74679b80 1 --2- 172.21.15.69:0/1233980222 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe2b0c00 0x5561fe2a10d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7ffb6000fd20 tx=0x7ffb60007790 comp rx=0 tx=0).stop 2023-10-06T01:39:08.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.688+0000 7ffb74679b80 1 -- 172.21.15.69:0/1233980222 shutdown_connections 2023-10-06T01:39:08.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.688+0000 7ffb74679b80 1 --2- 172.21.15.69:0/1233980222 >> [v2:172.21.15.88:6832/2097597935,v1:172.21.15.88:6834/2097597935] conn(0x5561fe2b96e0 0x5561fe2b9ab0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.688+0000 7ffb74679b80 1 --2- 172.21.15.69:0/1233980222 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe2b0c00 0x5561fe2a10d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.688+0000 7ffb437fe700 0 client.4731 ms_handle_reset on v2:172.21.15.88:6832/2097597935 2023-10-06T01:39:08.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.688+0000 7ffb74679b80 1 --2- 172.21.15.69:0/1233980222 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5561fe260840 0x5561fe2860e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.688+0000 7ffb74679b80 1 --2- 172.21.15.69:0/1233980222 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5561fe261cc0 0x5561fe29ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.688+0000 7ffb74679b80 1 -- 172.21.15.69:0/1233980222 >> 172.21.15.69:0/1233980222 conn(0x5561fe262160 msgr2=0x5561fe289b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:08.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.688+0000 7ffb74679b80 1 -- 172.21.15.69:0/1233980222 shutdown_connections 2023-10-06T01:39:08.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.688+0000 7ffb74679b80 1 -- 172.21.15.69:0/1233980222 wait complete. 2023-10-06T01:39:08.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.688+0000 7ffb74679b80 20 client.4731 trim_cache size 0 max 16384 2023-10-06T01:39:08.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.705+0000 7ffb74679b80 1 Processor -- start 2023-10-06T01:39:08.705 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.705+0000 7ffb74679b80 1 -- start start 2023-10-06T01:39:08.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.705+0000 7ffb74679b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe262160 0x5561fe2aa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:08.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.705+0000 7ffb74679b80 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5561fe260840 0x5561fe2aa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:08.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.705+0000 7ffb74679b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5561fe261cc0 0x5561fe29e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:08.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.705+0000 7ffb74679b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561fe29f3e0 con 0x5561fe262160 2023-10-06T01:39:08.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.705+0000 7ffb74679b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561fe2a7d60 con 0x5561fe261cc0 2023-10-06T01:39:08.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.705+0000 7ffb74679b80 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561fe2a5420 con 0x5561fe260840 2023-10-06T01:39:08.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.706+0000 7ffb6911d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe262160 0x5561fe2aa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:08.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.706+0000 7ffb6911d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe262160 0x5561fe2aa1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59514/0 (socket says 172.21.15.69:59514) 2023-10-06T01:39:08.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.706+0000 7ffb6911d700 1 -- 172.21.15.69:0/1488156131 learned_addr learned my addr 172.21.15.69:0/1488156131 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:08.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.706+0000 7ffb6911d700 1 -- 172.21.15.69:0/1488156131 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5561fe260840 msgr2=0x5561fe2aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:08.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.706+0000 7ffb6911d700 1 --2- 172.21.15.69:0/1488156131 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5561fe260840 0x5561fe2aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.706+0000 7ffb6911d700 1 -- 172.21.15.69:0/1488156131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5561fe261cc0 msgr2=0x5561fe29e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:08.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.706+0000 7ffb6991e700 1 --2- 172.21.15.69:0/1488156131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5561fe261cc0 0x5561fe29e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:08.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.706+0000 7ffb6911d700 1 --2- 172.21.15.69:0/1488156131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5561fe261cc0 0x5561fe29e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.706+0000 7ffb6911d700 1 -- 172.21.15.69:0/1488156131 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5561fe17f780 con 0x5561fe262160 2023-10-06T01:39:08.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.706+0000 7ffb6911d700 1 --2- 172.21.15.69:0/1488156131 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe262160 0x5561fe2aa1f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00a010 tx=0x7ffb5c017030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ae5d5e143401f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:08.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.706+0000 7ffb4effd700 1 -- 172.21.15.69:0/1488156131 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c015890 con 0x5561fe262160 2023-10-06T01:39:08.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.706+0000 7ffb4effd700 1 -- 172.21.15.69:0/1488156131 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5c0159f0 con 0x5561fe262160 2023-10-06T01:39:08.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.706+0000 7ffb4effd700 1 -- 172.21.15.69:0/1488156131 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c037440 con 0x5561fe262160 2023-10-06T01:39:08.709 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.706+0000 7ffb74679b80 1 -- 172.21.15.69:0/1488156131 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe262160 msgr2=0x5561fe2aa1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:08.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.706+0000 7ffb74679b80 1 --2- 172.21.15.69:0/1488156131 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe262160 0x5561fe2aa1f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c00a010 tx=0x7ffb5c017030 comp rx=0 tx=0).stop 2023-10-06T01:39:08.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.707+0000 7ffb74679b80 1 -- 172.21.15.69:0/1488156131 shutdown_connections 2023-10-06T01:39:08.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.707+0000 7ffb74679b80 1 --2- 172.21.15.69:0/1488156131 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5561fe261cc0 0x5561fe29e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.707+0000 7ffb74679b80 1 --2- 172.21.15.69:0/1488156131 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe262160 0x5561fe2aa1f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.707+0000 7ffb74679b80 1 --2- 172.21.15.69:0/1488156131 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5561fe260840 0x5561fe2aa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.707+0000 7ffb74679b80 1 -- 172.21.15.69:0/1488156131 >> 172.21.15.69:0/1488156131 conn(0x5561fe2a5b30 msgr2=0x5561fe263ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:08.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.707+0000 7ffb74679b80 1 -- 172.21.15.69:0/1488156131 shutdown_connections 2023-10-06T01:39:08.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.707+0000 7ffb74679b80 1 -- 172.21.15.69:0/1488156131 wait complete. 2023-10-06T01:39:08.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.707+0000 7ffb74679b80 1 -- start start 2023-10-06T01:39:08.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.707+0000 7ffb74679b80 1 Processor -- start 2023-10-06T01:39:08.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.708+0000 7ffb74679b80 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5561fe260840 0x5561fe30a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:08.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.708+0000 7ffb74679b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe261cc0 0x5561fe2aa1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:08.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.708+0000 7ffb74679b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5561fe262160 0x5561fe2aa730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:08.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.708+0000 7ffb74679b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561fe30df50 con 0x5561fe261cc0 2023-10-06T01:39:08.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.708+0000 7ffb74679b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5561fe30aa10 con 0x5561fe262160 2023-10-06T01:39:08.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.708+0000 7ffb74679b80 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x5561fe2a3fd0 con 0x5561fe260840 2023-10-06T01:39:08.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.708+0000 7ffb74679b80 10 client.0 _ll_register_callbacks cb 0x5561fe223e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T01:39:08.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.708+0000 7ffb6891c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe261cc0 0x5561fe2aa1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:08.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.708+0000 7ffb6891c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe261cc0 0x5561fe2aa1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59528/0 (socket says 172.21.15.69:59528) 2023-10-06T01:39:08.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.708+0000 7ffb6891c700 1 -- 172.21.15.69:0/2234072722 learned_addr learned my addr 172.21.15.69:0/2234072722 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:08.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.708+0000 7ffb6911d700 1 --2- 172.21.15.69:0/2234072722 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5561fe260840 0x5561fe30a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:08.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.708+0000 7ffb6991e700 1 --2- 172.21.15.69:0/2234072722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5561fe262160 0x5561fe2aa730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:08.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.708+0000 7ffb6891c700 1 -- 172.21.15.69:0/2234072722 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5561fe260840 msgr2=0x5561fe30a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:08.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.708+0000 7ffb6891c700 1 --2- 172.21.15.69:0/2234072722 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5561fe260840 0x5561fe30a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.708+0000 7ffb6891c700 1 -- 172.21.15.69:0/2234072722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5561fe262160 msgr2=0x5561fe2aa730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:08.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.708+0000 7ffb6891c700 1 --2- 172.21.15.69:0/2234072722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5561fe262160 0x5561fe2aa730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.708+0000 7ffb6891c700 1 -- 172.21.15.69:0/2234072722 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5561fe04b270 con 0x5561fe261cc0 2023-10-06T01:39:08.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.709+0000 7ffb6891c700 1 --2- 172.21.15.69:0/2234072722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe261cc0 0x5561fe2aa1f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ffb54084a00 tx=0x7ffb54008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6b2c7da2bfb747 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:08.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.709+0000 7ffb437fe700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-10-06T01:39:08.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.709+0000 7ffb437fe700 1 -- 172.21.15.69:0/2234072722 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5405e380 con 0x5561fe261cc0 2023-10-06T01:39:08.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.709+0000 7ffb437fe700 1 -- 172.21.15.69:0/2234072722 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ffb54055780 con 0x5561fe261cc0 2023-10-06T01:39:08.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.709+0000 7ffb74679b80 1 -- 172.21.15.69:0/2234072722 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5561fe2b6ba0 con 0x5561fe261cc0 2023-10-06T01:39:08.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.709+0000 7ffb437fe700 1 -- 172.21.15.69:0/2234072722 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7ffb54057640 con 0x5561fe261cc0 2023-10-06T01:39:08.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.709+0000 7ffb74679b80 10 client.4737 fetch_fsmap learned FSMap version 8 2023-10-06T01:39:08.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.709+0000 7ffb74679b80 1 -- 172.21.15.69:0/2234072722 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5561fe166470 con 0x5561fe261cc0 2023-10-06T01:39:08.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.709+0000 7ffb437fe700 1 -- 172.21.15.69:0/2234072722 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5561fe2b6ba0 con 0x5561fe261cc0 2023-10-06T01:39:08.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.709+0000 7ffb437fe700 1 -- 172.21.15.69:0/2234072722 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7ffb540568d0 con 0x5561fe261cc0 2023-10-06T01:39:08.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.709+0000 7ffb74679b80 10 client.4737 fetch_fsmap finished waiting for FSMap version 8 2023-10-06T01:39:08.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.709+0000 7ffb74679b80 10 client.4737 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-06T01:39:08.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.709+0000 7ffb74679b80 20 client.4737 populate_metadata read hostname 'smithi069' 2023-10-06T01:39:08.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.709+0000 7ffb74679b80 1 --2- 172.21.15.69:0/2234072722 >> [v2:172.21.15.88:6832/2097597935,v1:172.21.15.88:6834/2097597935] conn(0x5561fe2b0c00 0x5561fe284b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:08.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.709+0000 7ffb74679b80 4 client.4737 mds_command: new command op to 4302 tid=0[{"prefix": "status"}] 2023-10-06T01:39:08.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.709+0000 7ffb74679b80 1 -- 172.21.15.69:0/2234072722 --> [v2:172.21.15.88:6832/2097597935,v1:172.21.15.88:6834/2097597935] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7ffb5c015720 con 0x5561fe2b0c00 2023-10-06T01:39:08.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.709+0000 7ffb6911d700 1 --2- 172.21.15.69:0/2234072722 >> [v2:172.21.15.88:6832/2097597935,v1:172.21.15.88:6834/2097597935] conn(0x5561fe2b0c00 0x5561fe284b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:08.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.710+0000 7ffb437fe700 10 client.4737 ms_handle_connect on v2:172.21.15.88:6832/2097597935 2023-10-06T01:39:08.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.710+0000 7ffb6911d700 1 --2- 172.21.15.69:0/2234072722 >> [v2:172.21.15.88:6832/2097597935,v1:172.21.15.88:6834/2097597935] conn(0x5561fe2b0c00 0x5561fe284b50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3df4435ee715d94f server_cookie=56b7ca9e9dd10cdd in_seq=0 out_seq=0 2023-10-06T01:39:08.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.710+0000 7ffb437fe700 1 -- 172.21.15.69:0/2234072722 <== mds.0 v2:172.21.15.88:6832/2097597935 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x7ffb5c015720 con 0x5561fe2b0c00 2023-10-06T01:39:08.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.710+0000 7ffb437fe700 10 client.4737 handle_command_reply: tid=0 2023-10-06T01:39:08.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.710+0000 7ffb74679b80 1 client.4737 shutdown 2023-10-06T01:39:08.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.710+0000 7ffb74679b80 1 -- 172.21.15.69:0/2234072722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe261cc0 msgr2=0x5561fe2aa1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:08.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.710+0000 7ffb74679b80 1 --2- 172.21.15.69:0/2234072722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe261cc0 0x5561fe2aa1f0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ffb54084a00 tx=0x7ffb54008040 comp rx=0 tx=0).stop 2023-10-06T01:39:08.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.710+0000 7ffb74679b80 1 -- 172.21.15.69:0/2234072722 shutdown_connections 2023-10-06T01:39:08.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.710+0000 7ffb74679b80 1 --2- 172.21.15.69:0/2234072722 >> [v2:172.21.15.88:6832/2097597935,v1:172.21.15.88:6834/2097597935] conn(0x5561fe2b0c00 0x5561fe284b50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.710+0000 7ffb74679b80 1 --2- 172.21.15.69:0/2234072722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5561fe262160 0x5561fe2aa730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.710+0000 7ffb437fe700 0 client.4737 ms_handle_reset on v2:172.21.15.88:6832/2097597935 2023-10-06T01:39:08.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.710+0000 7ffb74679b80 1 --2- 172.21.15.69:0/2234072722 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5561fe260840 0x5561fe30a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.710+0000 7ffb74679b80 1 --2- 172.21.15.69:0/2234072722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5561fe261cc0 0x5561fe2aa1f0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.710+0000 7ffb74679b80 1 -- 172.21.15.69:0/2234072722 >> 172.21.15.69:0/2234072722 conn(0x5561fe2a5b30 msgr2=0x5561fe2a0780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:08.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.710+0000 7ffb74679b80 1 -- 172.21.15.69:0/2234072722 shutdown_connections 2023-10-06T01:39:08.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.710+0000 7ffb74679b80 1 -- 172.21.15.69:0/2234072722 wait complete. 2023-10-06T01:39:08.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.710+0000 7ffb74679b80 20 client.4737 trim_cache size 0 max 16384 2023-10-06T01:39:08.719 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-10-06T01:39:08.719 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6", 2023-10-06T01:39:08.719 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 0, 2023-10-06T01:39:08.720 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 4302, 2023-10-06T01:39:08.720 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2023-10-06T01:39:08.720 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2023-10-06T01:39:08.720 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2023-10-06T01:39:08.720 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 19.064177814000001, 2023-10-06T01:39:08.720 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 8, 2023-10-06T01:39:08.720 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 24, 2023-10-06T01:39:08.720 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 24, 2023-10-06T01:39:08.720 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 24.073646391 2023-10-06T01:39:08.720 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-10-06T01:39:08.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.710+0000 7ffb6b381700 1 -- 172.21.15.69:0/2862802549 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ffb48066f30 msgr2=0x7ffb480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:08.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.710+0000 7ffb6b381700 1 --2- 172.21.15.69:0/2862802549 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ffb48066f30 0x7ffb480693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c006fd0 tx=0x7ffb5c008040 comp rx=0 tx=0).stop 2023-10-06T01:39:08.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.711+0000 7ffb6b381700 1 -- 172.21.15.69:0/2862802549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb640cd9e0 msgr2=0x7ffb640b4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:08.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.711+0000 7ffb6b381700 1 --2- 172.21.15.69:0/2862802549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb640cd9e0 0x7ffb640b4a30 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7ffb54009290 tx=0x7ffb54016000 comp rx=0 tx=0).stop 2023-10-06T01:39:08.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.711+0000 7ffb6b381700 1 -- 172.21.15.69:0/2862802549 shutdown_connections 2023-10-06T01:39:08.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.711+0000 7ffb6b381700 1 --2- 172.21.15.69:0/2862802549 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ffb48066f30 0x7ffb480693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.711+0000 7ffb6b381700 1 --2- 172.21.15.69:0/2862802549 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ffb640c8ca0 0x7ffb64159580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.711+0000 7ffb6b381700 1 --2- 172.21.15.69:0/2862802549 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ffb640cb5a0 0x7ffb6416a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.711+0000 7ffb6b381700 1 --2- 172.21.15.69:0/2862802549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffb640cd9e0 0x7ffb640b4a30 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:08.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.711+0000 7ffb6b381700 1 -- 172.21.15.69:0/2862802549 >> 172.21.15.69:0/2862802549 conn(0x7ffb64070e30 msgr2=0x7ffb640c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:08.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.711+0000 7ffb6b381700 1 -- 172.21.15.69:0/2862802549 shutdown_connections 2023-10-06T01:39:08.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:08.711+0000 7ffb6b381700 1 -- 172.21.15.69:0/2862802549 wait complete. 2023-10-06T01:39:08.723 INFO:teuthology.run_tasks:Running task kclient... 2023-10-06T01:39:08.743 INFO:tasks.kclient:Mounting kernel clients... 2023-10-06T01:39:08.744 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-06T01:39:08.744 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:08.744 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2023-10-06T01:39:08.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:08.759 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link delete ceph-brx 2023-10-06T01:39:08.825 INFO:teuthology.orchestra.run.smithi069.stderr:Cannot find device "ceph-brx" 2023-10-06T01:39:08.826 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:39:08.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:08.827 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2023-10-06T01:39:08.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:08.881 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link delete ceph-brx 2023-10-06T01:39:08.946 INFO:teuthology.orchestra.run.smithi069.stderr:Cannot find device "ceph-brx" 2023-10-06T01:39:08.947 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:39:08.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:08.948 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-10-06T01:39:08.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:08.966 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2023-10-06T01:39:09.037 INFO:teuthology.orchestra.run.smithi088.stderr:Cannot find device "ceph-brx" 2023-10-06T01:39:09.038 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:39:09.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:09.039 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-10-06T01:39:09.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:09.097 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2023-10-06T01:39:09.165 INFO:teuthology.orchestra.run.smithi088.stderr:Cannot find device "ceph-brx" 2023-10-06T01:39:09.166 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:39:09.167 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2023-10-06T01:39:09.167 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T01:39:09.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.281+0000 7fc991c5e700 1 Processor -- start 2023-10-06T01:39:09.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.281+0000 7fc991c5e700 1 -- start start 2023-10-06T01:39:09.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.282+0000 7fc991c5e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc98c0cb5a0 0x7fc98c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:09.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.282+0000 7fc991c5e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc98c0cd9e0 0x7fc98c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:09.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.282+0000 7fc991c5e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc98c15ae40 con 0x7fc98c0cde50 2023-10-06T01:39:09.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.282+0000 7fc991c5e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc98c0d13f0 con 0x7fc98c0cd9e0 2023-10-06T01:39:09.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.282+0000 7fc991c5e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c15ab60 con 0x7fc98c0cb5a0 2023-10-06T01:39:09.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.282+0000 7fc98b7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc98c0cb5a0 0x7fc98c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:09.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.282+0000 7fc98affd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc98c0cd9e0 0x7fc98c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:09.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.282+0000 7fc98affd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc98c0cd9e0 0x7fc98c159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.69:43232/0 (socket says 172.21.15.69:43232) 2023-10-06T01:39:09.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.282+0000 7fc98bfff700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc98c0cde50 0x7fc98c156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.69:48336/0 (socket says 172.21.15.69:48336) 2023-10-06T01:39:09.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.282+0000 7fc98b7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc98c0cb5a0 0x7fc98c0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.69:50714/0 (socket says 172.21.15.69:50714) 2023-10-06T01:39:09.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.282+0000 7fc98affd700 1 -- 172.21.15.69:0/1491420176 learned_addr learned my addr 172.21.15.69:0/1491420176 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:09.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.283+0000 7fc98b7fe700 1 -- 172.21.15.69:0/1491420176 >> v2:172.21.15.88:3300/0 conn(0x7fc98c0cd9e0 msgr2=0x7fc98c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:09.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.283+0000 7fc98b7fe700 1 --2- 172.21.15.69:0/1491420176 >> v2:172.21.15.88:3300/0 conn(0x7fc98c0cd9e0 0x7fc98c159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:09.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.283+0000 7fc98b7fe700 1 -- 172.21.15.69:0/1491420176 >> v1:172.21.15.88:6789/0 conn(0x7fc98c0cde50 legacy=0x7fc98c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:09.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.283+0000 7fc98b7fe700 1 -- 172.21.15.69:0/1491420176 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc98c0ccf00 con 0x7fc98c0cb5a0 2023-10-06T01:39:09.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.283+0000 7fc98a7fc700 1 -- 172.21.15.69:0/1491420176 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2102446976 0 0) 0x7fc98c15ae40 con 0x7fc98c0cde50 2023-10-06T01:39:09.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.283+0000 7fc98affd700 1 --2- 172.21.15.69:0/1491420176 >> v2:172.21.15.88:3300/0 conn(0x7fc98c0cd9e0 0x7fc98c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:09.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.283+0000 7fc98b7fe700 1 --2- 172.21.15.69:0/1491420176 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc98c0cb5a0 0x7fc98c0cb970 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc97c009e60 tx=0x7fc97c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2def5256be82412 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:09.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.283+0000 7fc98a7fc700 1 -- 172.21.15.69:0/1491420176 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c00e070 con 0x7fc98c0cb5a0 2023-10-06T01:39:09.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.283+0000 7fc98a7fc700 1 -- 172.21.15.69:0/1491420176 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc97c00bb60 con 0x7fc98c0cb5a0 2023-10-06T01:39:09.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.283+0000 7fc98a7fc700 1 -- 172.21.15.69:0/1491420176 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc97c012430 con 0x7fc98c0cb5a0 2023-10-06T01:39:09.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.284+0000 7fc991c5e700 1 -- 172.21.15.69:0/1491420176 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc98c0cb5a0 msgr2=0x7fc98c0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:09.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.284+0000 7fc991c5e700 1 --2- 172.21.15.69:0/1491420176 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc98c0cb5a0 0x7fc98c0cb970 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc97c009e60 tx=0x7fc97c009780 comp rx=0 tx=0).stop 2023-10-06T01:39:09.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.284+0000 7fc991c5e700 1 -- 172.21.15.69:0/1491420176 shutdown_connections 2023-10-06T01:39:09.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.284+0000 7fc991c5e700 1 --2- 172.21.15.69:0/1491420176 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc98c0cb5a0 0x7fc98c0cb970 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:09.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.284+0000 7fc991c5e700 1 --2- 172.21.15.69:0/1491420176 >> v2:172.21.15.88:3300/0 conn(0x7fc98c0cd9e0 0x7fc98c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:09.286 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.284+0000 7fc991c5e700 1 -- 172.21.15.69:0/1491420176 >> 172.21.15.69:0/1491420176 conn(0x7fc98c070e30 msgr2=0x7fc98c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:09.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.284+0000 7fc991c5e700 1 -- 172.21.15.69:0/1491420176 shutdown_connections 2023-10-06T01:39:09.287 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.284+0000 7fc991c5e700 1 -- 172.21.15.69:0/1491420176 wait complete. 2023-10-06T01:39:09.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.285+0000 7fc991c5e700 1 Processor -- start 2023-10-06T01:39:09.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.285+0000 7fc991c5e700 1 -- start start 2023-10-06T01:39:09.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.286+0000 7fc991c5e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc98c0cb5a0 0x7fc98c15d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:09.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.286+0000 7fc991c5e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc98c0cd9e0 0x7fc98c0b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:09.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.286+0000 7fc991c5e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc98c0c92b0 0x7fc98c151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:09.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.286+0000 7fc991c5e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c15b1a0 con 0x7fc98c0cd9e0 2023-10-06T01:39:09.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.286+0000 7fc991c5e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c0c97f0 con 0x7fc98c0cb5a0 2023-10-06T01:39:09.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.286+0000 7fc991c5e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c0c9ad0 con 0x7fc98c0c92b0 2023-10-06T01:39:09.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.286+0000 7fc98affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc98c0cd9e0 0x7fc98c0b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:09.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.286+0000 7fc98affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc98c0cd9e0 0x7fc98c0b3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59536/0 (socket says 172.21.15.69:59536) 2023-10-06T01:39:09.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.286+0000 7fc98affd700 1 -- 172.21.15.69:0/2846308995 learned_addr learned my addr 172.21.15.69:0/2846308995 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:09.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.286+0000 7fc98b7fe700 1 --2- 172.21.15.69:0/2846308995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc98c0cb5a0 0x7fc98c15d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:09.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.286+0000 7fc98bfff700 1 --2- 172.21.15.69:0/2846308995 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc98c0c92b0 0x7fc98c151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:09.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.286+0000 7fc98affd700 1 -- 172.21.15.69:0/2846308995 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc98c0c92b0 msgr2=0x7fc98c151f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:09.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.286+0000 7fc98affd700 1 --2- 172.21.15.69:0/2846308995 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc98c0c92b0 0x7fc98c151f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:09.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.286+0000 7fc98affd700 1 -- 172.21.15.69:0/2846308995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc98c0cb5a0 msgr2=0x7fc98c15d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:09.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.286+0000 7fc98affd700 1 --2- 172.21.15.69:0/2846308995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc98c0cb5a0 0x7fc98c15d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:09.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.286+0000 7fc98affd700 1 -- 172.21.15.69:0/2846308995 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9800094f0 con 0x7fc98c0cd9e0 2023-10-06T01:39:09.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.286+0000 7fc98b7fe700 1 --2- 172.21.15.69:0/2846308995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc98c0cb5a0 0x7fc98c15d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:09.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.286+0000 7fc98affd700 1 --2- 172.21.15.69:0/2846308995 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc98c0cd9e0 0x7fc98c0b3bb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc98000ec50 tx=0x7fc980009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:09.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.286+0000 7fc9737fe700 1 -- 172.21.15.69:0/2846308995 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc98000c9d0 con 0x7fc98c0cd9e0 2023-10-06T01:39:09.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.286+0000 7fc9737fe700 1 -- 172.21.15.69:0/2846308995 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc98000cb30 con 0x7fc98c0cd9e0 2023-10-06T01:39:09.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.286+0000 7fc991c5e700 1 -- 172.21.15.69:0/2846308995 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc97c009a20 con 0x7fc98c0cd9e0 2023-10-06T01:39:09.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.286+0000 7fc9737fe700 1 -- 172.21.15.69:0/2846308995 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc980013470 con 0x7fc98c0cd9e0 2023-10-06T01:39:09.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.286+0000 7fc991c5e700 1 -- 172.21.15.69:0/2846308995 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc98c0ca090 con 0x7fc98c0cd9e0 2023-10-06T01:39:09.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.287+0000 7fc991c5e700 1 -- 172.21.15.69:0/2846308995 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc98c04c3c0 con 0x7fc98c0cd9e0 2023-10-06T01:39:09.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.288+0000 7fc9737fe700 1 -- 172.21.15.69:0/2846308995 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc980013860 con 0x7fc98c0cd9e0 2023-10-06T01:39:09.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.288+0000 7fc9737fe700 1 --2- 172.21.15.69:0/2846308995 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc978066f30 0x7fc9780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:09.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.288+0000 7fc98b7fe700 1 --2- 172.21.15.69:0/2846308995 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc978066f30 0x7fc9780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:09.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.288+0000 7fc9737fe700 1 -- 172.21.15.69:0/2846308995 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fc980084e80 con 0x7fc98c0cd9e0 2023-10-06T01:39:09.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.289+0000 7fc98b7fe700 1 --2- 172.21.15.69:0/2846308995 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc978066f30 0x7fc9780693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc97c0097c0 tx=0x7fc97c019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:09.292 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.293+0000 7fc9737fe700 1 -- 172.21.15.69:0/2846308995 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc980051f90 con 0x7fc98c0cd9e0 2023-10-06T01:39:09.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.520+0000 7fc991c5e700 1 -- 172.21.15.69:0/2846308995 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc98c15b2e0 con 0x7fc98c0cd9e0 2023-10-06T01:39:09.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.520+0000 7fc9737fe700 1 -- 172.21.15.69:0/2846308995 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc9800555b0 con 0x7fc98c0cd9e0 2023-10-06T01:39:09.521 INFO:teuthology.orchestra.run.smithi069.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T01:39:09.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.522+0000 7fc991c5e700 1 -- 172.21.15.69:0/2846308995 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc978066f30 msgr2=0x7fc9780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:09.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.522+0000 7fc991c5e700 1 --2- 172.21.15.69:0/2846308995 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc978066f30 0x7fc9780693e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fc97c0097c0 tx=0x7fc97c019000 comp rx=0 tx=0).stop 2023-10-06T01:39:09.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.522+0000 7fc991c5e700 1 -- 172.21.15.69:0/2846308995 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc98c0cd9e0 msgr2=0x7fc98c0b3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:09.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.522+0000 7fc991c5e700 1 --2- 172.21.15.69:0/2846308995 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc98c0cd9e0 0x7fc98c0b3bb0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc98000ec50 tx=0x7fc980009250 comp rx=0 tx=0).stop 2023-10-06T01:39:09.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.522+0000 7fc991c5e700 1 -- 172.21.15.69:0/2846308995 shutdown_connections 2023-10-06T01:39:09.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.522+0000 7fc991c5e700 1 --2- 172.21.15.69:0/2846308995 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc978066f30 0x7fc9780693e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:09.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.522+0000 7fc991c5e700 1 --2- 172.21.15.69:0/2846308995 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc98c0c92b0 0x7fc98c151f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:09.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.522+0000 7fc991c5e700 1 --2- 172.21.15.69:0/2846308995 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc98c0cb5a0 0x7fc98c15d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:09.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.522+0000 7fc991c5e700 1 --2- 172.21.15.69:0/2846308995 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc98c0cd9e0 0x7fc98c0b3bb0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:09.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.522+0000 7fc991c5e700 1 -- 172.21.15.69:0/2846308995 >> 172.21.15.69:0/2846308995 conn(0x7fc98c070e30 msgr2=0x7fc98c0c6690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:09.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.522+0000 7fc991c5e700 1 -- 172.21.15.69:0/2846308995 shutdown_connections 2023-10-06T01:39:09.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:09.522+0000 7fc991c5e700 1 -- 172.21.15.69:0/2846308995 wait complete. 2023-10-06T01:39:09.534 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T01:39:09.534 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T01:39:09.535 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi069.front.sepia.ceph.com 2023-10-06T01:39:09.535 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T01:39:09.535 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T01:39:09.535 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T01:39:09.535 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T01:39:09.535 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T01:39:09.535 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T01:39:09.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:09.536 DEBUG:teuthology.orchestra.run.smithi069:> ip addr 2023-10-06T01:39:09.551 INFO:teuthology.orchestra.run.smithi069.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:39:09.551 INFO:teuthology.orchestra.run.smithi069.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:39:09.551 INFO:teuthology.orchestra.run.smithi069.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:39:09.551 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:09.551 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 ::1/128 scope host 2023-10-06T01:39:09.551 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:09.551 INFO:teuthology.orchestra.run.smithi069.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:39:09.552 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c2 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:09.552 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f0 2023-10-06T01:39:09.552 INFO:teuthology.orchestra.run.smithi069.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:39:09.552 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c3 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:09.552 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f1 2023-10-06T01:39:09.552 INFO:teuthology.orchestra.run.smithi069.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:39:09.552 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:36 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:09.552 INFO:teuthology.orchestra.run.smithi069.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T01:39:09.552 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:37 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:09.553 INFO:teuthology.orchestra.run.smithi069.stdout: inet 172.21.15.69/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T01:39:09.553 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft 42484sec preferred_lft 42484sec 2023-10-06T01:39:09.553 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::ec4:7aff:fe8f:d737/64 scope link 2023-10-06T01:39:09.553 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:09.553 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T01:39:09.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:09.554 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-10-06T01:39:09.554 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-10-06T01:39:09.554 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link add name ceph-brx type bridge 2023-10-06T01:39:09.554 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip addr flush dev ceph-brx 2023-10-06T01:39:09.554 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set ceph-brx up 2023-10-06T01:39:09.554 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T01:39:09.554 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-10-06T01:39:09.712 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:09.712 DEBUG:teuthology.orchestra.run.smithi069:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T01:39:09.754 INFO:teuthology.orchestra.run.smithi069.stdout:1 2023-10-06T01:39:09.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:09.756 DEBUG:teuthology.orchestra.run.smithi069:> route 2023-10-06T01:39:09.845 INFO:teuthology.orchestra.run.smithi069.stdout:Kernel IP routing table 2023-10-06T01:39:09.845 INFO:teuthology.orchestra.run.smithi069.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T01:39:09.845 INFO:teuthology.orchestra.run.smithi069.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T01:39:09.845 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T01:39:09.845 INFO:teuthology.orchestra.run.smithi069.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T01:39:09.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:09.846 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-10-06T01:39:09.846 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-10-06T01:39:09.846 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T01:39:09.846 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T01:39:09.846 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T01:39:09.846 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-10-06T01:39:10.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:10.057 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2023-10-06T01:39:10.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:10.072 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list-id 2023-10-06T01:39:10.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:10.127 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-10-06T01:39:10.127 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-10-06T01:39:10.127 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T01:39:10.127 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-06T01:39:10.127 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-10-06T01:39:10.216 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-06T01:39:10.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:10.216 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-10-06T01:39:10.216 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-10-06T01:39:10.216 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-06T01:39:10.217 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T01:39:10.217 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-06T01:39:10.217 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-06T01:39:10.217 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-06T01:39:10.217 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-10-06T01:39:10.399 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:10.399 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-10-06T01:39:10.399 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-10-06T01:39:10.399 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set brx.0 up 2023-10-06T01:39:10.399 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T01:39:10.399 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-10-06T01:39:10.491 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:39:10.491 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T01:39:10.506 INFO:teuthology.orchestra.run.smithi069.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T01:39:10.506 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:39:10.506 DEBUG:teuthology.orchestra.run.smithi069:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T01:39:10.560 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T01:39:10.561 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T01:39:10.561 DEBUG:teuthology.orchestra.run.smithi069:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T01:39:10.650 INFO:teuthology.orchestra.run.smithi069.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T01:39:10.650 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T01:39:10.738 INFO:teuthology.orchestra.run.smithi069.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T01:39:10.739 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T01:39:10.739 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: resolved to: "172.21.15.69:3300,172.21.15.88:3300,172.21.15.88:3301" 2023-10-06T01:39:10.739 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: trying mount with new device syntax: 0@c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6.cephfs=/ 2023-10-06T01:39:10.739 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.69:3300/172.21.15.88:3300/172.21.15.88:3301" will pass to kernel 2023-10-06T01:39:10.739 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T01:39:10.739 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T01:39:10.739 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T01:39:10.761 INFO:teuthology.orchestra.run.smithi069.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T01:39:10.761 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T01:39:10.761 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: resolved to: "172.21.15.69:3300,172.21.15.88:3300,172.21.15.88:3301" 2023-10-06T01:39:10.761 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: trying mount with new device syntax: 0@c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6.cephfs=/ 2023-10-06T01:39:10.762 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.69:3300/172.21.15.88:3300/172.21.15.88:3301" will pass to kernel 2023-10-06T01:39:10.762 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T01:39:10.762 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T01:39:10.762 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T01:39:10.762 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: resolved to: "172.21.15.69:6789,172.21.15.88:6789,172.21.15.88:6790" 2023-10-06T01:39:10.762 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.69:6789,172.21.15.88:6789,172.21.15.88:6790:/ 2023-10-06T01:39:10.762 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6" will pass to kernel 2023-10-06T01:39:10.764 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T01:39:10.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:10.764 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T01:39:10.789 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2023-10-06T01:39:10.789 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T01:39:10.943 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.942+0000 7f430ffd8700 1 Processor -- start 2023-10-06T01:39:10.944 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.942+0000 7f430ffd8700 1 -- start start 2023-10-06T01:39:10.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.943+0000 7f430ffd8700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43080cb5a0 0x7f43080cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:10.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.943+0000 7f430ffd8700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f43080cde50 0x7f4308156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:10.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.943+0000 7f430ffd8700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f430815ae40 con 0x7f43080cd9e0 2023-10-06T01:39:10.946 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.943+0000 7f430ffd8700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43080d13f0 con 0x7f43080cde50 2023-10-06T01:39:10.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.943+0000 7f430ffd8700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f430815ab60 con 0x7f43080cb5a0 2023-10-06T01:39:10.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.943+0000 7f430e575700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f43080cde50 0x7f4308156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:10.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.943+0000 7f430e575700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f43080cde50 0x7f4308156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59538/0 (socket says 172.21.15.69:59538) 2023-10-06T01:39:10.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.943+0000 7f430e575700 1 -- 172.21.15.69:0/3518708473 learned_addr learned my addr 172.21.15.69:0/3518708473 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:10.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.943+0000 7f430dd74700 1 --2- 172.21.15.69:0/3518708473 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43080cb5a0 0x7f43080cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:10.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.944+0000 7f430e575700 1 -- 172.21.15.69:0/3518708473 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43080cb5a0 msgr2=0x7f43080cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:10.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.944+0000 7f430e575700 1 --2- 172.21.15.69:0/3518708473 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43080cb5a0 0x7f43080cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:10.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.944+0000 7f430e575700 1 -- 172.21.15.69:0/3518708473 >> v1:172.21.15.88:6789/0 conn(0x7f43080cd9e0 legacy=0x7f4308159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:10.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.944+0000 7f430e575700 1 -- 172.21.15.69:0/3518708473 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43080ccf00 con 0x7f43080cde50 2023-10-06T01:39:10.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.944+0000 7f430dd74700 1 --2- 172.21.15.69:0/3518708473 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43080cb5a0 0x7f43080cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:10.947 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.944+0000 7f430e575700 1 --2- 172.21.15.69:0/3518708473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43080cde50 0x7f4308156e90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4300009f20 tx=0x7f4300009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422f1cf33d7001ba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:10.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.944+0000 7f430cd72700 1 -- 172.21.15.69:0/3518708473 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f430000e070 con 0x7f43080cde50 2023-10-06T01:39:10.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.944+0000 7f430cd72700 1 -- 172.21.15.69:0/3518708473 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f430000ba80 con 0x7f43080cde50 2023-10-06T01:39:10.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.944+0000 7f430cd72700 1 -- 172.21.15.69:0/3518708473 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43000092e0 con 0x7f43080cde50 2023-10-06T01:39:10.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.944+0000 7f430ffd8700 1 -- 172.21.15.69:0/3518708473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43080cde50 msgr2=0x7f4308156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:10.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.944+0000 7f430ffd8700 1 --2- 172.21.15.69:0/3518708473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43080cde50 0x7f4308156e90 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4300009f20 tx=0x7f4300009840 comp rx=0 tx=0).stop 2023-10-06T01:39:10.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.945+0000 7f430ffd8700 1 -- 172.21.15.69:0/3518708473 shutdown_connections 2023-10-06T01:39:10.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.945+0000 7f430ffd8700 1 --2- 172.21.15.69:0/3518708473 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43080cb5a0 0x7f43080cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:10.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.945+0000 7f430ffd8700 1 --2- 172.21.15.69:0/3518708473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43080cde50 0x7f4308156e90 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:10.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.945+0000 7f430ffd8700 1 -- 172.21.15.69:0/3518708473 >> 172.21.15.69:0/3518708473 conn(0x7f4308070e30 msgr2=0x7f43080d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:10.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.945+0000 7f430ffd8700 1 -- 172.21.15.69:0/3518708473 shutdown_connections 2023-10-06T01:39:10.948 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.945+0000 7f430ffd8700 1 -- 172.21.15.69:0/3518708473 wait complete. 2023-10-06T01:39:10.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.946+0000 7f430ffd8700 1 Processor -- start 2023-10-06T01:39:10.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.946+0000 7f430ffd8700 1 -- start start 2023-10-06T01:39:10.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.947+0000 7f430ffd8700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43080cb5a0 0x7f430816a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:10.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.947+0000 7f430ffd8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43080cd9e0 0x7f430816d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:10.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.947+0000 7f430ffd8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43080c9cb0 0x7f43080c5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:10.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.947+0000 7f430ffd8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43080ca420 con 0x7f43080cd9e0 2023-10-06T01:39:10.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.947+0000 7f430ffd8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43080ca700 con 0x7f43080c9cb0 2023-10-06T01:39:10.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.947+0000 7f430ffd8700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4308169610 con 0x7f43080cb5a0 2023-10-06T01:39:10.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.947+0000 7f430d573700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43080cd9e0 0x7f430816d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:10.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.947+0000 7f430d573700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43080cd9e0 0x7f430816d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59546/0 (socket says 172.21.15.69:59546) 2023-10-06T01:39:10.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.947+0000 7f430d573700 1 -- 172.21.15.69:0/1923082675 learned_addr learned my addr 172.21.15.69:0/1923082675 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:10.952 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.947+0000 7f430dd74700 1 --2- 172.21.15.69:0/1923082675 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43080cb5a0 0x7f430816a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:10.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.947+0000 7f430e575700 1 --2- 172.21.15.69:0/1923082675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43080c9cb0 0x7f43080c5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:10.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.947+0000 7f430d573700 1 -- 172.21.15.69:0/1923082675 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43080cb5a0 msgr2=0x7f430816a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:10.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.947+0000 7f430d573700 1 --2- 172.21.15.69:0/1923082675 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43080cb5a0 0x7f430816a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:10.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.947+0000 7f430d573700 1 -- 172.21.15.69:0/1923082675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43080c9cb0 msgr2=0x7f43080c5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:10.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.947+0000 7f430d573700 1 --2- 172.21.15.69:0/1923082675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43080c9cb0 0x7f43080c5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:10.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.947+0000 7f430d573700 1 -- 172.21.15.69:0/1923082675 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4300009ae0 con 0x7f43080cd9e0 2023-10-06T01:39:10.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.947+0000 7f430e575700 1 --2- 172.21.15.69:0/1923082675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43080c9cb0 0x7f43080c5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:10.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.947+0000 7f430d573700 1 --2- 172.21.15.69:0/1923082675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43080cd9e0 0x7f430816d5c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f42f800c590 tx=0x7f42f800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:10.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.948+0000 7f42fdffb700 1 -- 172.21.15.69:0/1923082675 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f8011590 con 0x7f43080cd9e0 2023-10-06T01:39:10.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.948+0000 7f42fdffb700 1 -- 172.21.15.69:0/1923082675 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f8011710 con 0x7f43080cd9e0 2023-10-06T01:39:10.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.948+0000 7f430ffd8700 1 -- 172.21.15.69:0/1923082675 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43081698f0 con 0x7f43080cd9e0 2023-10-06T01:39:10.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.948+0000 7f42fdffb700 1 -- 172.21.15.69:0/1923082675 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f8011ad0 con 0x7f43080cd9e0 2023-10-06T01:39:10.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.948+0000 7f430ffd8700 1 -- 172.21.15.69:0/1923082675 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43080ca120 con 0x7f43080cd9e0 2023-10-06T01:39:10.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.949+0000 7f430ffd8700 1 -- 172.21.15.69:0/1923082675 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f430804c3c0 con 0x7f43080cd9e0 2023-10-06T01:39:10.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.949+0000 7f42fdffb700 1 -- 172.21.15.69:0/1923082675 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f42f801b3b0 con 0x7f43080cd9e0 2023-10-06T01:39:10.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.949+0000 7f42fdffb700 1 --2- 172.21.15.69:0/1923082675 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f42ec066f30 0x7f42ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:10.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.950+0000 7f430dd74700 1 --2- 172.21.15.69:0/1923082675 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f42ec066f30 0x7f42ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:10.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.950+0000 7f42fdffb700 1 -- 172.21.15.69:0/1923082675 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f42f8083b50 con 0x7f43080cd9e0 2023-10-06T01:39:10.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.950+0000 7f430dd74700 1 --2- 172.21.15.69:0/1923082675 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f42ec066f30 0x7f42ec0693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4304006f00 tx=0x7f4304008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:10.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:10.954+0000 7f42fdffb700 1 -- 172.21.15.69:0/1923082675 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42f8050c60 con 0x7f43080cd9e0 2023-10-06T01:39:11.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:11.180+0000 7f430ffd8700 1 -- 172.21.15.69:0/1923082675 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f43080cd1e0 con 0x7f43080cd9e0 2023-10-06T01:39:11.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:11.180+0000 7f42fdffb700 1 -- 172.21.15.69:0/1923082675 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f42f8017070 con 0x7f43080cd9e0 2023-10-06T01:39:11.182 INFO:teuthology.orchestra.run.smithi069.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T01:39:11.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:11.182+0000 7f430ffd8700 1 -- 172.21.15.69:0/1923082675 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f42ec066f30 msgr2=0x7f42ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:11.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:11.182+0000 7f430ffd8700 1 --2- 172.21.15.69:0/1923082675 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f42ec066f30 0x7f42ec0693e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4304006f00 tx=0x7f4304008040 comp rx=0 tx=0).stop 2023-10-06T01:39:11.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:11.182+0000 7f430ffd8700 1 -- 172.21.15.69:0/1923082675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43080cd9e0 msgr2=0x7f430816d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:11.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:11.182+0000 7f430ffd8700 1 --2- 172.21.15.69:0/1923082675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43080cd9e0 0x7f430816d5c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f42f800c590 tx=0x7f42f800c8a0 comp rx=0 tx=0).stop 2023-10-06T01:39:11.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:11.182+0000 7f430ffd8700 1 -- 172.21.15.69:0/1923082675 shutdown_connections 2023-10-06T01:39:11.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:11.182+0000 7f430ffd8700 1 --2- 172.21.15.69:0/1923082675 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f42ec066f30 0x7f42ec0693e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:11.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:11.182+0000 7f430ffd8700 1 --2- 172.21.15.69:0/1923082675 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f43080c9cb0 0x7f43080c5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:11.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:11.182+0000 7f430ffd8700 1 --2- 172.21.15.69:0/1923082675 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f43080cb5a0 0x7f430816a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:11.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:11.182+0000 7f430ffd8700 1 --2- 172.21.15.69:0/1923082675 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43080cd9e0 0x7f430816d5c0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:11.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:11.182+0000 7f430ffd8700 1 -- 172.21.15.69:0/1923082675 >> 172.21.15.69:0/1923082675 conn(0x7f4308070e30 msgr2=0x7f43080d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:11.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:11.182+0000 7f430ffd8700 1 -- 172.21.15.69:0/1923082675 shutdown_connections 2023-10-06T01:39:11.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:11.182+0000 7f430ffd8700 1 -- 172.21.15.69:0/1923082675 wait complete. 2023-10-06T01:39:11.196 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T01:39:11.196 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T01:39:11.196 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi069.front.sepia.ceph.com 2023-10-06T01:39:11.196 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-06T01:39:11.196 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-06T01:39:11.196 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T01:39:11.196 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T01:39:11.196 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T01:39:11.196 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-06T01:39:11.197 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:11.197 DEBUG:teuthology.orchestra.run.smithi069:> ip addr 2023-10-06T01:39:11.212 INFO:teuthology.orchestra.run.smithi069.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:39:11.212 INFO:teuthology.orchestra.run.smithi069.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:39:11.213 INFO:teuthology.orchestra.run.smithi069.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:39:11.213 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:11.213 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 ::1/128 scope host 2023-10-06T01:39:11.213 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:11.213 INFO:teuthology.orchestra.run.smithi069.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:39:11.213 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c2 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:11.213 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f0 2023-10-06T01:39:11.214 INFO:teuthology.orchestra.run.smithi069.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:39:11.214 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c3 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:11.214 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f1 2023-10-06T01:39:11.214 INFO:teuthology.orchestra.run.smithi069.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:39:11.214 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:36 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:11.214 INFO:teuthology.orchestra.run.smithi069.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T01:39:11.214 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:37 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:11.214 INFO:teuthology.orchestra.run.smithi069.stdout: inet 172.21.15.69/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T01:39:11.214 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft 42482sec preferred_lft 42482sec 2023-10-06T01:39:11.214 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::ec4:7aff:fe8f:d737/64 scope link 2023-10-06T01:39:11.214 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:11.215 INFO:teuthology.orchestra.run.smithi069.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:39:11.215 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 06:72:8e:36:69:38 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:11.215 INFO:teuthology.orchestra.run.smithi069.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T01:39:11.215 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:11.215 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::1803:a1ff:fe9b:457b/64 scope link tentative 2023-10-06T01:39:11.215 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:11.215 INFO:teuthology.orchestra.run.smithi069.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T01:39:11.215 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 06:72:8e:36:69:38 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T01:39:11.215 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::472:8eff:fe36:6938/64 scope link tentative 2023-10-06T01:39:11.215 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:11.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:11.216 DEBUG:teuthology.orchestra.run.smithi069:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T01:39:11.276 INFO:teuthology.orchestra.run.smithi069.stdout:1 2023-10-06T01:39:11.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:11.278 DEBUG:teuthology.orchestra.run.smithi069:> route 2023-10-06T01:39:11.334 INFO:teuthology.orchestra.run.smithi069.stdout:Kernel IP routing table 2023-10-06T01:39:11.334 INFO:teuthology.orchestra.run.smithi069.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T01:39:11.335 INFO:teuthology.orchestra.run.smithi069.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T01:39:11.335 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T01:39:11.335 INFO:teuthology.orchestra.run.smithi069.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T01:39:11.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:11.335 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-10-06T01:39:11.335 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-10-06T01:39:11.335 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T01:39:11.335 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T01:39:11.336 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T01:39:11.336 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-10-06T01:39:11.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:11.435 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2023-10-06T01:39:11.450 INFO:teuthology.orchestra.run.smithi069.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T01:39:11.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:11.451 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list-id 2023-10-06T01:39:11.505 INFO:teuthology.orchestra.run.smithi069.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-06T01:39:11.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:11.505 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-10-06T01:39:11.506 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-10-06T01:39:11.506 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T01:39:11.506 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-06T01:39:11.506 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-10-06T01:39:11.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:11.594 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T01:39:11.629 INFO:teuthology.orchestra.run.smithi069.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:39:11.629 INFO:teuthology.orchestra.run.smithi069.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:39:11.629 INFO:teuthology.orchestra.run.smithi069.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:39:11.629 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:11.629 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 ::1/128 scope host 2023-10-06T01:39:11.629 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:11.629 INFO:teuthology.orchestra.run.smithi069.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T01:39:11.630 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether ee:c6:e8:ac:9a:55 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T01:39:11.630 INFO:teuthology.orchestra.run.smithi069.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T01:39:11.630 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:11.630 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::ecc6:e8ff:feac:9a55/64 scope link 2023-10-06T01:39:11.630 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:11.645 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:11.645 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-06T01:39:11.718 INFO:teuthology.orchestra.run.smithi069.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:39:11.718 INFO:teuthology.orchestra.run.smithi069.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:39:11.718 INFO:teuthology.orchestra.run.smithi069.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:39:11.718 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:11.719 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 ::1/128 scope host 2023-10-06T01:39:11.719 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:11.719 INFO:teuthology.orchestra.run.smithi069.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T01:39:11.719 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether ee:c6:e8:ac:9a:55 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T01:39:11.719 INFO:teuthology.orchestra.run.smithi069.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T01:39:11.719 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:11.719 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::ecc6:e8ff:feac:9a55/64 scope link 2023-10-06T01:39:11.719 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:11.735 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-06T01:39:11.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:11.735 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-10-06T01:39:11.735 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-10-06T01:39:11.735 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-06T01:39:11.736 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T01:39:11.736 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-06T01:39:11.736 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-06T01:39:11.736 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-06T01:39:11.736 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-10-06T01:39:11.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:11.958 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-10-06T01:39:11.959 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-10-06T01:39:11.959 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set brx.1 up 2023-10-06T01:39:11.959 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T01:39:11.959 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-10-06T01:39:12.039 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:39:12.039 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-06T01:39:12.054 INFO:teuthology.orchestra.run.smithi069.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-06T01:39:12.054 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:39:12.054 DEBUG:teuthology.orchestra.run.smithi069:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-06T01:39:12.108 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2023-10-06T01:39:12.108 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T01:39:12.109 DEBUG:teuthology.orchestra.run.smithi069:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T01:39:12.187 INFO:teuthology.orchestra.run.smithi069.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T01:39:12.188 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T01:39:12.206 INFO:teuthology.orchestra.run.smithi069.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T01:39:12.206 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T01:39:12.207 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: resolved to: "172.21.15.69:3300,172.21.15.88:3300,172.21.15.88:3301" 2023-10-06T01:39:12.207 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: trying mount with new device syntax: 2@c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6.cephfs=/ 2023-10-06T01:39:12.207 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.69:3300/172.21.15.88:3300/172.21.15.88:3301" will pass to kernel 2023-10-06T01:39:12.207 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T01:39:12.207 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T01:39:12.207 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T01:39:12.229 INFO:teuthology.orchestra.run.smithi069.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T01:39:12.229 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T01:39:12.230 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: resolved to: "172.21.15.69:3300,172.21.15.88:3300,172.21.15.88:3301" 2023-10-06T01:39:12.230 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: trying mount with new device syntax: 2@c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6.cephfs=/ 2023-10-06T01:39:12.230 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.69:3300/172.21.15.88:3300/172.21.15.88:3301" will pass to kernel 2023-10-06T01:39:12.230 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T01:39:12.230 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T01:39:12.230 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T01:39:12.231 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: resolved to: "172.21.15.69:6789,172.21.15.88:6789,172.21.15.88:6790" 2023-10-06T01:39:12.231 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.69:6789,172.21.15.88:6789,172.21.15.88:6790:/ 2023-10-06T01:39:12.231 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,key=2,mds_namespace=cephfs,fsid=c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6" will pass to kernel 2023-10-06T01:39:12.232 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T01:39:12.232 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:12.232 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-06T01:39:12.296 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2023-10-06T01:39:12.297 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T01:39:12.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.450+0000 7f097e45b700 1 Processor -- start 2023-10-06T01:39:12.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.450+0000 7f097e45b700 1 -- start start 2023-10-06T01:39:12.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.451+0000 7f097e45b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0978153c30 0x7f097815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:12.452 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.451+0000 7f097e45b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f09780cf110 0x7f097815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:12.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.451+0000 7f097e45b700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f097815afd0 con 0x7f097815de50 2023-10-06T01:39:12.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.451+0000 7f097e45b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f097815b2b0 con 0x7f0978153c30 2023-10-06T01:39:12.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.451+0000 7f097e45b700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f097815b590 con 0x7f09780cf110 2023-10-06T01:39:12.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.451+0000 7f097dc5a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f09780cf110 0x7f097815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:12.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.451+0000 7f097d459700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0978153c30 0x7f097815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:12.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.451+0000 7f097cc58700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f097815de50 0x7f09780cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.69:48360/0 (socket says 172.21.15.69:48360) 2023-10-06T01:39:12.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.451+0000 7f097dc5a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f09780cf110 0x7f097815c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.69:50746/0 (socket says 172.21.15.69:50746) 2023-10-06T01:39:12.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.451+0000 7f097d459700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0978153c30 0x7f097815a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.69:43264/0 (socket says 172.21.15.69:43264) 2023-10-06T01:39:12.453 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.451+0000 7f097cc58700 1 -- 172.21.15.69:0/616799029 learned_addr learned my addr 172.21.15.69:0/616799029 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:12.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.452+0000 7f097dc5a700 1 -- 172.21.15.69:0/616799029 >> v2:172.21.15.88:3300/0 conn(0x7f0978153c30 msgr2=0x7f097815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:12.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.452+0000 7f097dc5a700 1 --2- 172.21.15.69:0/616799029 >> v2:172.21.15.88:3300/0 conn(0x7f0978153c30 0x7f097815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:12.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.452+0000 7f097dc5a700 1 -- 172.21.15.69:0/616799029 >> v1:172.21.15.88:6789/0 conn(0x7f097815de50 legacy=0x7f09780cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:12.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.452+0000 7f097dc5a700 1 -- 172.21.15.69:0/616799029 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f097815b870 con 0x7f09780cf110 2023-10-06T01:39:12.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.452+0000 7f097dc5a700 1 --2- 172.21.15.69:0/616799029 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f09780cf110 0x7f097815c070 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f09700098e0 tx=0x7f09700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=857caffee41c6f88 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:12.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.452+0000 7f0977fff700 1 -- 172.21.15.69:0/616799029 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097000b640 con 0x7f09780cf110 2023-10-06T01:39:12.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.452+0000 7f0977fff700 1 -- 172.21.15.69:0/616799029 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097000b7a0 con 0x7f09780cf110 2023-10-06T01:39:12.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.452+0000 7f0977fff700 1 -- 172.21.15.69:0/616799029 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097000bb40 con 0x7f09780cf110 2023-10-06T01:39:12.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.452+0000 7f097e45b700 1 -- 172.21.15.69:0/616799029 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f09780cf110 msgr2=0x7f097815c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:12.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.453+0000 7f097e45b700 1 --2- 172.21.15.69:0/616799029 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f09780cf110 0x7f097815c070 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f09700098e0 tx=0x7f09700091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:12.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.453+0000 7f097e45b700 1 -- 172.21.15.69:0/616799029 shutdown_connections 2023-10-06T01:39:12.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.453+0000 7f097e45b700 1 --2- 172.21.15.69:0/616799029 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f09780cf110 0x7f097815c070 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:12.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.453+0000 7f097e45b700 1 --2- 172.21.15.69:0/616799029 >> v2:172.21.15.88:3300/0 conn(0x7f0978153c30 0x7f097815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:12.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.453+0000 7f097e45b700 1 -- 172.21.15.69:0/616799029 >> 172.21.15.69:0/616799029 conn(0x7f09780703a0 msgr2=0x7f09780707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:12.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.453+0000 7f097e45b700 1 -- 172.21.15.69:0/616799029 shutdown_connections 2023-10-06T01:39:12.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.453+0000 7f097e45b700 1 -- 172.21.15.69:0/616799029 wait complete. 2023-10-06T01:39:12.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.454+0000 7f097e45b700 1 Processor -- start 2023-10-06T01:39:12.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.454+0000 7f097e45b700 1 -- start start 2023-10-06T01:39:12.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.455+0000 7f097e45b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09780cf110 0x7f09780cc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:12.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.455+0000 7f097e45b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0978153c30 0x7f09780ccbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:12.459 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.455+0000 7f097e45b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f097815de50 0x7f097814f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:12.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.455+0000 7f097e45b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09780c7e80 con 0x7f097815de50 2023-10-06T01:39:12.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.455+0000 7f097e45b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0978151fc0 con 0x7f09780cf110 2023-10-06T01:39:12.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.455+0000 7f097e45b700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09781522a0 con 0x7f0978153c30 2023-10-06T01:39:12.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.455+0000 7f097dc5a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f097815de50 0x7f097814f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:12.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.455+0000 7f097dc5a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f097815de50 0x7f097814f1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59560/0 (socket says 172.21.15.69:59560) 2023-10-06T01:39:12.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.455+0000 7f097dc5a700 1 -- 172.21.15.69:0/604566741 learned_addr learned my addr 172.21.15.69:0/604566741 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:12.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.455+0000 7f097cc58700 1 --2- 172.21.15.69:0/604566741 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0978153c30 0x7f09780ccbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:12.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.455+0000 7f097d459700 1 --2- 172.21.15.69:0/604566741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09780cf110 0x7f09780cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:12.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.455+0000 7f097dc5a700 1 -- 172.21.15.69:0/604566741 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0978153c30 msgr2=0x7f09780ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:12.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.455+0000 7f097dc5a700 1 --2- 172.21.15.69:0/604566741 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0978153c30 0x7f09780ccbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:12.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.455+0000 7f097dc5a700 1 -- 172.21.15.69:0/604566741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09780cf110 msgr2=0x7f09780cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:12.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.455+0000 7f097dc5a700 1 --2- 172.21.15.69:0/604566741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09780cf110 0x7f09780cc670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:12.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.455+0000 7f097dc5a700 1 -- 172.21.15.69:0/604566741 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0970009420 con 0x7f097815de50 2023-10-06T01:39:12.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.455+0000 7f097cc58700 1 --2- 172.21.15.69:0/604566741 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0978153c30 0x7f09780ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:12.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.455+0000 7f097dc5a700 1 --2- 172.21.15.69:0/604566741 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f097815de50 0x7f097814f1f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f097806eb00 tx=0x7f0970017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:12.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.455+0000 7f09757fa700 1 -- 172.21.15.69:0/604566741 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f097001be40 con 0x7f097815de50 2023-10-06T01:39:12.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.455+0000 7f09757fa700 1 -- 172.21.15.69:0/604566741 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0970011630 con 0x7f097815de50 2023-10-06T01:39:12.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.455+0000 7f097e45b700 1 -- 172.21.15.69:0/604566741 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0978152580 con 0x7f097815de50 2023-10-06T01:39:12.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.455+0000 7f09757fa700 1 -- 172.21.15.69:0/604566741 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09700119f0 con 0x7f097815de50 2023-10-06T01:39:12.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.455+0000 7f097e45b700 1 -- 172.21.15.69:0/604566741 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0978140210 con 0x7f097815de50 2023-10-06T01:39:12.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.456+0000 7f097e45b700 1 -- 172.21.15.69:0/604566741 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f097804c3c0 con 0x7f097815de50 2023-10-06T01:39:12.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.457+0000 7f09757fa700 1 -- 172.21.15.69:0/604566741 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f097002e440 con 0x7f097815de50 2023-10-06T01:39:12.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.457+0000 7f09757fa700 1 --2- 172.21.15.69:0/604566741 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0964066f30 0x7f09640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:12.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.457+0000 7f09757fa700 1 -- 172.21.15.69:0/604566741 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0970086320 con 0x7f097815de50 2023-10-06T01:39:12.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.457+0000 7f097d459700 1 --2- 172.21.15.69:0/604566741 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0964066f30 0x7f09640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:12.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.458+0000 7f097d459700 1 --2- 172.21.15.69:0/604566741 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0964066f30 0x7f09640693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f09680076a0 tx=0x7f096800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:12.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.461+0000 7f09757fa700 1 -- 172.21.15.69:0/604566741 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0970053430 con 0x7f097815de50 2023-10-06T01:39:12.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.692+0000 7f097e45b700 1 -- 172.21.15.69:0/604566741 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0978140460 con 0x7f097815de50 2023-10-06T01:39:12.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.692+0000 7f09757fa700 1 -- 172.21.15.69:0/604566741 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0970056a50 con 0x7f097815de50 2023-10-06T01:39:12.694 INFO:teuthology.orchestra.run.smithi069.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T01:39:12.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.694+0000 7f097e45b700 1 -- 172.21.15.69:0/604566741 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0964066f30 msgr2=0x7f09640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:12.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.694+0000 7f097e45b700 1 --2- 172.21.15.69:0/604566741 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0964066f30 0x7f09640693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f09680076a0 tx=0x7f096800b040 comp rx=0 tx=0).stop 2023-10-06T01:39:12.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.694+0000 7f097e45b700 1 -- 172.21.15.69:0/604566741 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f097815de50 msgr2=0x7f097814f1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:12.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.694+0000 7f097e45b700 1 --2- 172.21.15.69:0/604566741 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f097815de50 0x7f097814f1f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f097806eb00 tx=0x7f0970017000 comp rx=0 tx=0).stop 2023-10-06T01:39:12.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.694+0000 7f097e45b700 1 -- 172.21.15.69:0/604566741 shutdown_connections 2023-10-06T01:39:12.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.694+0000 7f097e45b700 1 --2- 172.21.15.69:0/604566741 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0964066f30 0x7f09640693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:12.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.694+0000 7f097e45b700 1 --2- 172.21.15.69:0/604566741 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f097815de50 0x7f097814f1f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:12.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.694+0000 7f097e45b700 1 --2- 172.21.15.69:0/604566741 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f09780cf110 0x7f09780cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:12.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.694+0000 7f097e45b700 1 --2- 172.21.15.69:0/604566741 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0978153c30 0x7f09780ccbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:12.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.694+0000 7f097e45b700 1 -- 172.21.15.69:0/604566741 >> 172.21.15.69:0/604566741 conn(0x7f09780703a0 msgr2=0x7f09780c5360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:12.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.694+0000 7f097e45b700 1 -- 172.21.15.69:0/604566741 shutdown_connections 2023-10-06T01:39:12.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:12.694+0000 7f097e45b700 1 -- 172.21.15.69:0/604566741 wait complete. 2023-10-06T01:39:12.707 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T01:39:12.707 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T01:39:12.708 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2023-10-06T01:39:12.708 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T01:39:12.708 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T01:39:12.708 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T01:39:12.708 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T01:39:12.708 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T01:39:12.708 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T01:39:12.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:12.709 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2023-10-06T01:39:12.727 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:39:12.727 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:39:12.727 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:39:12.728 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:12.728 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-10-06T01:39:12.728 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:12.728 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:39:12.728 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:12.728 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2023-10-06T01:39:12.728 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:39:12.728 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:12.728 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2023-10-06T01:39:12.728 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:39:12.729 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:12.729 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T01:39:12.729 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:12.729 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T01:39:12.729 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42492sec preferred_lft 42492sec 2023-10-06T01:39:12.729 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2023-10-06T01:39:12.729 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:12.729 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-06T01:39:12.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:12.730 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-10-06T01:39:12.730 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-10-06T01:39:12.730 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add name ceph-brx type bridge 2023-10-06T01:39:12.730 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr flush dev ceph-brx 2023-10-06T01:39:12.730 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set ceph-brx up 2023-10-06T01:39:12.730 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-06T01:39:12.730 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-10-06T01:39:12.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:12.890 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T01:39:12.932 INFO:teuthology.orchestra.run.smithi088.stdout:1 2023-10-06T01:39:12.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:12.933 DEBUG:teuthology.orchestra.run.smithi088:> route 2023-10-06T01:39:13.004 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2023-10-06T01:39:13.004 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T01:39:13.004 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T01:39:13.004 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T01:39:13.004 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T01:39:13.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:13.005 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-10-06T01:39:13.005 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-10-06T01:39:13.005 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T01:39:13.005 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T01:39:13.005 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T01:39:13.005 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-10-06T01:39:13.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:13.255 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-10-06T01:39:13.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:13.270 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list-id 2023-10-06T01:39:13.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:13.325 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-10-06T01:39:13.325 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-10-06T01:39:13.325 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T01:39:13.325 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-06T01:39:13.325 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-10-06T01:39:13.413 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-06T01:39:13.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:13.413 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-10-06T01:39:13.414 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-10-06T01:39:13.414 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-06T01:39:13.414 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-06T01:39:13.414 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-06T01:39:13.414 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-06T01:39:13.414 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-06T01:39:13.414 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-10-06T01:39:13.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:13.591 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-10-06T01:39:13.591 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-10-06T01:39:13.591 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2023-10-06T01:39:13.592 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set dev brx.0 master ceph-brx 2023-10-06T01:39:13.592 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-10-06T01:39:13.683 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:39:13.981 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T01:39:13.996 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T01:39:13.997 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:39:13.997 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T01:39:14.053 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T01:39:14.053 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T01:39:14.054 DEBUG:teuthology.orchestra.run.smithi088:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T01:39:14.143 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T01:39:14.143 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T01:39:14.239 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T01:39:14.239 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T01:39:14.239 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: resolved to: "172.21.15.69:3300,172.21.15.88:3300,172.21.15.88:3301" 2023-10-06T01:39:14.239 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: trying mount with new device syntax: 1@c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6.cephfs=/ 2023-10-06T01:39:14.239 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.69:3300/172.21.15.88:3300/172.21.15.88:3301" will pass to kernel 2023-10-06T01:39:14.239 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T01:39:14.239 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T01:39:14.240 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T01:39:14.260 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T01:39:14.260 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T01:39:14.260 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: resolved to: "172.21.15.69:3300,172.21.15.88:3300,172.21.15.88:3301" 2023-10-06T01:39:14.260 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: trying mount with new device syntax: 1@c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6.cephfs=/ 2023-10-06T01:39:14.260 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.69:3300/172.21.15.88:3300/172.21.15.88:3301" will pass to kernel 2023-10-06T01:39:14.260 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T01:39:14.260 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T01:39:14.260 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T01:39:14.261 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: resolved to: "172.21.15.69:6789,172.21.15.88:6789,172.21.15.88:6790" 2023-10-06T01:39:14.261 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.69:6789,172.21.15.88:6789,172.21.15.88:6790:/ 2023-10-06T01:39:14.261 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6" will pass to kernel 2023-10-06T01:39:14.262 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T01:39:14.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:14.263 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T01:39:14.287 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2023-10-06T01:39:14.288 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T01:39:14.415 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.414+0000 7f738bfff700 1 Processor -- start 2023-10-06T01:39:14.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.414+0000 7f738bfff700 1 -- start start 2023-10-06T01:39:14.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.415+0000 7f738bfff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f738c0b2980 0x7f738c0cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:14.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.415+0000 7f738bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f738c15a8c0 0x7f738c06d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:14.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.415+0000 7f738bfff700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f738c06e240 con 0x7f738c06ddd0 2023-10-06T01:39:14.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.415+0000 7f738bfff700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f738c0cec30 con 0x7f738c0b2980 2023-10-06T01:39:14.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.415+0000 7f738bfff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f738c0ce930 con 0x7f738c15a8c0 2023-10-06T01:39:14.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.415+0000 7f738affd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f738c0b2980 0x7f738c0cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:14.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.415+0000 7f738b7fe700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f738c06ddd0 0x7f738c15d280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59812/0 (socket says 172.21.15.69:59812) 2023-10-06T01:39:14.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.415+0000 7f738b7fe700 1 -- 172.21.15.69:0/3714523926 learned_addr learned my addr 172.21.15.69:0/3714523926 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:14.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.415+0000 7f738a7fc700 1 --2- 172.21.15.69:0/3714523926 >> v2:172.21.15.88:3300/0 conn(0x7f738c15a8c0 0x7f738c06d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:14.418 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.415+0000 7f738affd700 1 -- 172.21.15.69:0/3714523926 >> v2:172.21.15.88:3300/0 conn(0x7f738c15a8c0 msgr2=0x7f738c06d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:14.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.416+0000 7f738affd700 1 --2- 172.21.15.69:0/3714523926 >> v2:172.21.15.88:3300/0 conn(0x7f738c15a8c0 0x7f738c06d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:14.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.416+0000 7f738affd700 1 -- 172.21.15.69:0/3714523926 >> v1:172.21.15.69:6789/0 conn(0x7f738c06ddd0 legacy=0x7f738c15d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:14.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.416+0000 7f738affd700 1 -- 172.21.15.69:0/3714523926 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738c0d00d0 con 0x7f738c0b2980 2023-10-06T01:39:14.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.416+0000 7f7389ffb700 1 -- 172.21.15.69:0/3714523926 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4133708920 0 0) 0x7f738c06e240 con 0x7f738c06ddd0 2023-10-06T01:39:14.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.416+0000 7f738affd700 1 --2- 172.21.15.69:0/3714523926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f738c0b2980 0x7f738c0cce00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f738c0b6590 tx=0x7f737c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eed2ed8df88c1c28 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:14.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.416+0000 7f7389ffb700 1 -- 172.21.15.69:0/3714523926 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c00e070 con 0x7f738c0b2980 2023-10-06T01:39:14.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.416+0000 7f7389ffb700 1 -- 172.21.15.69:0/3714523926 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f737c00bb60 con 0x7f738c0b2980 2023-10-06T01:39:14.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.416+0000 7f7389ffb700 1 -- 172.21.15.69:0/3714523926 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f737c012430 con 0x7f738c0b2980 2023-10-06T01:39:14.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.416+0000 7f738bfff700 1 -- 172.21.15.69:0/3714523926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f738c0b2980 msgr2=0x7f738c0cce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:14.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.416+0000 7f738bfff700 1 --2- 172.21.15.69:0/3714523926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f738c0b2980 0x7f738c0cce00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f738c0b6590 tx=0x7f737c009780 comp rx=0 tx=0).stop 2023-10-06T01:39:14.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.416+0000 7f738bfff700 1 -- 172.21.15.69:0/3714523926 shutdown_connections 2023-10-06T01:39:14.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.416+0000 7f738bfff700 1 --2- 172.21.15.69:0/3714523926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f738c0b2980 0x7f738c0cce00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:14.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.416+0000 7f738bfff700 1 --2- 172.21.15.69:0/3714523926 >> v2:172.21.15.88:3300/0 conn(0x7f738c15a8c0 0x7f738c06d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:14.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.416+0000 7f738bfff700 1 -- 172.21.15.69:0/3714523926 >> 172.21.15.69:0/3714523926 conn(0x7f738c0703a0 msgr2=0x7f738c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:14.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.416+0000 7f738bfff700 1 -- 172.21.15.69:0/3714523926 shutdown_connections 2023-10-06T01:39:14.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.416+0000 7f738bfff700 1 -- 172.21.15.69:0/3714523926 wait complete. 2023-10-06T01:39:14.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.418+0000 7f738bfff700 1 Processor -- start 2023-10-06T01:39:14.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.418+0000 7f738bfff700 1 -- start start 2023-10-06T01:39:14.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.418+0000 7f738bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f738c06ddd0 0x7f738c153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:14.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.418+0000 7f738bfff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f738c0b2980 0x7f738c1698f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:14.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.418+0000 7f738bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f738c15a8c0 0x7f738c169e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:14.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.418+0000 7f738bfff700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c151e40 con 0x7f738c15a8c0 2023-10-06T01:39:14.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.418+0000 7f738bfff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f738c151230 con 0x7f738c06ddd0 2023-10-06T01:39:14.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.418+0000 7f738bfff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f738c151510 con 0x7f738c0b2980 2023-10-06T01:39:14.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.419+0000 7f738b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f738c15a8c0 0x7f738c169e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:14.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.419+0000 7f738b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f738c15a8c0 0x7f738c169e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59572/0 (socket says 172.21.15.69:59572) 2023-10-06T01:39:14.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.419+0000 7f738b7fe700 1 -- 172.21.15.69:0/3520957926 learned_addr learned my addr 172.21.15.69:0/3520957926 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:14.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.419+0000 7f738affd700 1 --2- 172.21.15.69:0/3520957926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f738c06ddd0 0x7f738c153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:14.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.419+0000 7f738a7fc700 1 --2- 172.21.15.69:0/3520957926 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f738c0b2980 0x7f738c1698f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:14.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.419+0000 7f738b7fe700 1 -- 172.21.15.69:0/3520957926 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f738c0b2980 msgr2=0x7f738c1698f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:14.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.419+0000 7f738b7fe700 1 --2- 172.21.15.69:0/3520957926 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f738c0b2980 0x7f738c1698f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:14.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.419+0000 7f738b7fe700 1 -- 172.21.15.69:0/3520957926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f738c06ddd0 msgr2=0x7f738c153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:14.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.419+0000 7f738b7fe700 1 --2- 172.21.15.69:0/3520957926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f738c06ddd0 0x7f738c153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:14.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.419+0000 7f738b7fe700 1 -- 172.21.15.69:0/3520957926 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f737c009a20 con 0x7f738c15a8c0 2023-10-06T01:39:14.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.419+0000 7f738affd700 1 --2- 172.21.15.69:0/3520957926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f738c06ddd0 0x7f738c153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:14.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.419+0000 7f738b7fe700 1 --2- 172.21.15.69:0/3520957926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f738c15a8c0 0x7f738c169e30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f738400c7e0 tx=0x7f7384007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:14.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.419+0000 7f7382ffd700 1 -- 172.21.15.69:0/3520957926 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7384005c00 con 0x7f738c15a8c0 2023-10-06T01:39:14.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.419+0000 7f7382ffd700 1 -- 172.21.15.69:0/3520957926 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7384005d60 con 0x7f738c15a8c0 2023-10-06T01:39:14.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.419+0000 7f738bfff700 1 -- 172.21.15.69:0/3520957926 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f738c1517f0 con 0x7f738c15a8c0 2023-10-06T01:39:14.424 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.419+0000 7f7382ffd700 1 -- 172.21.15.69:0/3520957926 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7384004a80 con 0x7f738c15a8c0 2023-10-06T01:39:14.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.419+0000 7f738bfff700 1 -- 172.21.15.69:0/3520957926 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738c153e60 con 0x7f738c15a8c0 2023-10-06T01:39:14.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.420+0000 7f738bfff700 1 -- 172.21.15.69:0/3520957926 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f738c04c3c0 con 0x7f738c15a8c0 2023-10-06T01:39:14.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.420+0000 7f7382ffd700 1 -- 172.21.15.69:0/3520957926 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7384005030 con 0x7f738c15a8c0 2023-10-06T01:39:14.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.421+0000 7f7382ffd700 1 --2- 172.21.15.69:0/3520957926 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f736c066f30 0x7f736c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:14.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.421+0000 7f7382ffd700 1 -- 172.21.15.69:0/3520957926 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7384083b00 con 0x7f738c15a8c0 2023-10-06T01:39:14.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.421+0000 7f738affd700 1 --2- 172.21.15.69:0/3520957926 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f736c066f30 0x7f736c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:14.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.421+0000 7f738affd700 1 --2- 172.21.15.69:0/3520957926 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f736c066f30 0x7f736c0693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f738c0ca1f0 tx=0x7f737c019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:14.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.425+0000 7f7382ffd700 1 -- 172.21.15.69:0/3520957926 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f738404b5a0 con 0x7f738c15a8c0 2023-10-06T01:39:14.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.654+0000 7f738bfff700 1 -- 172.21.15.69:0/3520957926 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f738c1521d0 con 0x7f738c15a8c0 2023-10-06T01:39:14.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.654+0000 7f7382ffd700 1 -- 172.21.15.69:0/3520957926 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7384050c10 con 0x7f738c15a8c0 2023-10-06T01:39:14.656 INFO:teuthology.orchestra.run.smithi069.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T01:39:14.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.656+0000 7f738bfff700 1 -- 172.21.15.69:0/3520957926 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f736c066f30 msgr2=0x7f736c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:14.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.656+0000 7f738bfff700 1 --2- 172.21.15.69:0/3520957926 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f736c066f30 0x7f736c0693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f738c0ca1f0 tx=0x7f737c019000 comp rx=0 tx=0).stop 2023-10-06T01:39:14.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.656+0000 7f738bfff700 1 -- 172.21.15.69:0/3520957926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f738c15a8c0 msgr2=0x7f738c169e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:14.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.656+0000 7f738bfff700 1 --2- 172.21.15.69:0/3520957926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f738c15a8c0 0x7f738c169e30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f738400c7e0 tx=0x7f7384007d90 comp rx=0 tx=0).stop 2023-10-06T01:39:14.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.656+0000 7f738bfff700 1 -- 172.21.15.69:0/3520957926 shutdown_connections 2023-10-06T01:39:14.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.656+0000 7f738bfff700 1 --2- 172.21.15.69:0/3520957926 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f736c066f30 0x7f736c0693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:14.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.656+0000 7f738bfff700 1 --2- 172.21.15.69:0/3520957926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f738c15a8c0 0x7f738c169e30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:14.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.656+0000 7f738bfff700 1 --2- 172.21.15.69:0/3520957926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f738c06ddd0 0x7f738c153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:14.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.656+0000 7f738bfff700 1 --2- 172.21.15.69:0/3520957926 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f738c0b2980 0x7f738c1698f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:14.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.656+0000 7f738bfff700 1 -- 172.21.15.69:0/3520957926 >> 172.21.15.69:0/3520957926 conn(0x7f738c0703a0 msgr2=0x7f738c0c6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:14.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.656+0000 7f738bfff700 1 -- 172.21.15.69:0/3520957926 shutdown_connections 2023-10-06T01:39:14.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:14.656+0000 7f738bfff700 1 -- 172.21.15.69:0/3520957926 wait complete. 2023-10-06T01:39:14.669 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-06T01:39:14.669 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T01:39:14.669 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2023-10-06T01:39:14.669 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-06T01:39:14.669 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-06T01:39:14.670 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-06T01:39:14.670 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-06T01:39:14.670 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T01:39:14.670 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-06T01:39:14.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:14.670 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2023-10-06T01:39:14.686 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:39:14.686 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:39:14.687 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:39:14.687 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:14.687 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-10-06T01:39:14.687 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:14.687 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:39:14.687 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:14.687 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2023-10-06T01:39:14.687 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:39:14.687 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:14.687 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2023-10-06T01:39:14.687 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:39:14.687 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:14.688 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T01:39:14.688 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:14.688 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T01:39:14.688 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42490sec preferred_lft 42490sec 2023-10-06T01:39:14.688 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2023-10-06T01:39:14.688 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:14.688 INFO:teuthology.orchestra.run.smithi088.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T01:39:14.688 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether aa:11:25:2a:8f:74 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:14.688 INFO:teuthology.orchestra.run.smithi088.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T01:39:14.688 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:14.688 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::a4bf:d5ff:feec:cd89/64 scope link 2023-10-06T01:39:14.688 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:14.689 INFO:teuthology.orchestra.run.smithi088.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T01:39:14.689 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether aa:11:25:2a:8f:74 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T01:39:14.689 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::a811:25ff:fe2a:8f74/64 scope link tentative 2023-10-06T01:39:14.689 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:14.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:14.689 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T01:39:14.750 INFO:teuthology.orchestra.run.smithi088.stdout:1 2023-10-06T01:39:14.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:14.752 DEBUG:teuthology.orchestra.run.smithi088:> route 2023-10-06T01:39:14.807 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2023-10-06T01:39:14.807 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T01:39:14.807 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T01:39:14.807 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T01:39:14.807 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T01:39:14.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:14.808 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-10-06T01:39:14.808 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-10-06T01:39:14.808 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T01:39:14.808 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T01:39:14.808 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T01:39:14.808 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-10-06T01:39:14.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:14.906 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-10-06T01:39:14.921 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T01:39:14.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:14.922 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list-id 2023-10-06T01:39:14.976 INFO:teuthology.orchestra.run.smithi088.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-06T01:39:14.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:14.976 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-10-06T01:39:14.976 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-10-06T01:39:14.976 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T01:39:14.976 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-06T01:39:14.976 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-10-06T01:39:15.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:15.065 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T01:39:15.097 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:39:15.097 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:39:15.097 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:39:15.098 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:15.098 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-10-06T01:39:15.098 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:15.098 INFO:teuthology.orchestra.run.smithi088.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T01:39:15.098 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether ce:59:64:67:46:23 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T01:39:15.098 INFO:teuthology.orchestra.run.smithi088.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T01:39:15.098 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:15.098 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::cc59:64ff:fe67:4623/64 scope link tentative 2023-10-06T01:39:15.098 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:15.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:15.109 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-06T01:39:15.183 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:39:15.183 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:39:15.183 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:39:15.184 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:15.184 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-10-06T01:39:15.184 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:15.184 INFO:teuthology.orchestra.run.smithi088.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T01:39:15.184 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether ce:59:64:67:46:23 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-06T01:39:15.184 INFO:teuthology.orchestra.run.smithi088.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-06T01:39:15.184 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:15.184 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::cc59:64ff:fe67:4623/64 scope link tentative 2023-10-06T01:39:15.184 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:15.198 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-06T01:39:15.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:15.198 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-10-06T01:39:15.199 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-10-06T01:39:15.199 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-06T01:39:15.199 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-06T01:39:15.199 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-06T01:39:15.199 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-06T01:39:15.199 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-06T01:39:15.199 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-10-06T01:39:15.410 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:15.410 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-10-06T01:39:15.410 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-10-06T01:39:15.410 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.1 up 2023-10-06T01:39:15.410 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set dev brx.1 master ceph-brx 2023-10-06T01:39:15.411 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-10-06T01:39:15.490 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:39:15.490 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-06T01:39:15.504 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-06T01:39:15.505 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:39:15.505 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-06T01:39:15.559 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2023-10-06T01:39:15.559 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T01:39:15.559 DEBUG:teuthology.orchestra.run.smithi088:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T01:39:15.639 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T01:39:15.640 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T01:39:15.658 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T01:39:15.658 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T01:39:15.658 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: resolved to: "172.21.15.69:3300,172.21.15.88:3300,172.21.15.88:3301" 2023-10-06T01:39:15.658 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: trying mount with new device syntax: 3@c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6.cephfs=/ 2023-10-06T01:39:15.658 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.69:3300/172.21.15.88:3300/172.21.15.88:3301" will pass to kernel 2023-10-06T01:39:15.659 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T01:39:15.659 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T01:39:15.659 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T01:39:15.679 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T01:39:15.679 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T01:39:15.679 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: resolved to: "172.21.15.69:3300,172.21.15.88:3300,172.21.15.88:3301" 2023-10-06T01:39:15.679 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: trying mount with new device syntax: 3@c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6.cephfs=/ 2023-10-06T01:39:15.679 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.69:3300/172.21.15.88:3300/172.21.15.88:3301" will pass to kernel 2023-10-06T01:39:15.679 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T01:39:15.680 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T01:39:15.680 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T01:39:15.680 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: resolved to: "172.21.15.69:6789,172.21.15.88:6789,172.21.15.88:6790" 2023-10-06T01:39:15.680 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.69:6789,172.21.15.88:6789,172.21.15.88:6790:/ 2023-10-06T01:39:15.680 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,key=3,mds_namespace=cephfs,fsid=c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6" will pass to kernel 2023-10-06T01:39:15.681 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T01:39:15.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:15.681 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-06T01:39:15.746 INFO:teuthology.run_tasks:Running task check-counter... 2023-10-06T01:39:15.776 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-06T01:39:15.793 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:39:15.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.919+0000 7f4e14e3d700 1 Processor -- start 2023-10-06T01:39:15.920 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.919+0000 7f4e14e3d700 1 -- start start 2023-10-06T01:39:15.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.920+0000 7f4e14e3d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f4e100cb5a0 0x7f4e100cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:15.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.920+0000 7f4e14e3d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4e100cd9e0 0x7f4e10159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:15.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.920+0000 7f4e14e3d700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e1015ae40 con 0x7f4e1015a400 2023-10-06T01:39:15.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.920+0000 7f4e14e3d700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e100d13f0 con 0x7f4e100cd9e0 2023-10-06T01:39:15.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.920+0000 7f4e14e3d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e1015ab60 con 0x7f4e100cb5a0 2023-10-06T01:39:15.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.920+0000 7f4e0dd9b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f4e100cd9e0 0x7f4e10159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:15.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.920+0000 7f4e0ed9d700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f4e1015a400 0x7f4e10156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59824/0 (socket says 172.21.15.69:59824) 2023-10-06T01:39:15.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.920+0000 7f4e0ed9d700 1 -- 172.21.15.69:0/22185738 learned_addr learned my addr 172.21.15.69:0/22185738 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:15.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.920+0000 7f4e0e59c700 1 --2- 172.21.15.69:0/22185738 >> v2:172.21.15.88:3300/0 conn(0x7f4e100cb5a0 0x7f4e100cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:15.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.920+0000 7f4e0dd9b700 1 -- 172.21.15.69:0/22185738 >> v2:172.21.15.88:3300/0 conn(0x7f4e100cb5a0 msgr2=0x7f4e100cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:15.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.920+0000 7f4e0dd9b700 1 --2- 172.21.15.69:0/22185738 >> v2:172.21.15.88:3300/0 conn(0x7f4e100cb5a0 0x7f4e100cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:15.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.920+0000 7f4e0dd9b700 1 -- 172.21.15.69:0/22185738 >> v1:172.21.15.69:6789/0 conn(0x7f4e1015a400 legacy=0x7f4e10156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:15.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.920+0000 7f4e0dd9b700 1 -- 172.21.15.69:0/22185738 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e100ccf00 con 0x7f4e100cd9e0 2023-10-06T01:39:15.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.920+0000 7f4e0d59a700 1 -- 172.21.15.69:0/22185738 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3319657742 0 0) 0x7f4e1015ae40 con 0x7f4e1015a400 2023-10-06T01:39:15.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.920+0000 7f4e0dd9b700 1 --2- 172.21.15.69:0/22185738 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e100cd9e0 0x7f4e10159ec0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4df80098e0 tx=0x7f4df80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0585d1eb1344864 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:15.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.920+0000 7f4e0d59a700 1 -- 172.21.15.69:0/22185738 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df8009e80 con 0x7f4e100cd9e0 2023-10-06T01:39:15.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.921+0000 7f4e0d59a700 1 -- 172.21.15.69:0/22185738 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df800b820 con 0x7f4e100cd9e0 2023-10-06T01:39:15.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.921+0000 7f4e0d59a700 1 -- 172.21.15.69:0/22185738 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df800bba0 con 0x7f4e100cd9e0 2023-10-06T01:39:15.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.921+0000 7f4e14e3d700 1 -- 172.21.15.69:0/22185738 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e100cd9e0 msgr2=0x7f4e10159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:15.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.921+0000 7f4e14e3d700 1 --2- 172.21.15.69:0/22185738 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e100cd9e0 0x7f4e10159ec0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4df80098e0 tx=0x7f4df80091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:15.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.921+0000 7f4e14e3d700 1 -- 172.21.15.69:0/22185738 shutdown_connections 2023-10-06T01:39:15.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.921+0000 7f4e14e3d700 1 --2- 172.21.15.69:0/22185738 >> v2:172.21.15.88:3300/0 conn(0x7f4e100cb5a0 0x7f4e100cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:15.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.921+0000 7f4e14e3d700 1 --2- 172.21.15.69:0/22185738 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e100cd9e0 0x7f4e10159ec0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:15.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.921+0000 7f4e14e3d700 1 -- 172.21.15.69:0/22185738 >> 172.21.15.69:0/22185738 conn(0x7f4e10070e30 msgr2=0x7f4e100d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:15.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.921+0000 7f4e14e3d700 1 -- 172.21.15.69:0/22185738 shutdown_connections 2023-10-06T01:39:15.925 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.921+0000 7f4e14e3d700 1 -- 172.21.15.69:0/22185738 wait complete. 2023-10-06T01:39:15.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.922+0000 7f4e14e3d700 1 Processor -- start 2023-10-06T01:39:15.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.922+0000 7f4e14e3d700 1 -- start start 2023-10-06T01:39:15.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.923+0000 7f4e14e3d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e100cb5a0 0x7f4e10153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:15.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.923+0000 7f4e14e3d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4e100cd9e0 0x7f4e1015d880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:15.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.923+0000 7f4e14e3d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e1015a400 0x7f4e1015ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:15.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.923+0000 7f4e14e3d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e100b44b0 con 0x7f4e1015a400 2023-10-06T01:39:15.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.923+0000 7f4e14e3d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e100b5030 con 0x7f4e100cb5a0 2023-10-06T01:39:15.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.923+0000 7f4e14e3d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e1015e300 con 0x7f4e100cd9e0 2023-10-06T01:39:15.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.923+0000 7f4e0ed9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e1015a400 0x7f4e1015ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:15.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.923+0000 7f4e0ed9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e1015a400 0x7f4e1015ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59592/0 (socket says 172.21.15.69:59592) 2023-10-06T01:39:15.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.923+0000 7f4e0ed9d700 1 -- 172.21.15.69:0/2525425016 learned_addr learned my addr 172.21.15.69:0/2525425016 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:15.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.923+0000 7f4e0e59c700 1 --2- 172.21.15.69:0/2525425016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e100cb5a0 0x7f4e10153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:15.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.923+0000 7f4e0dd9b700 1 --2- 172.21.15.69:0/2525425016 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4e100cd9e0 0x7f4e1015d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:15.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.923+0000 7f4e0ed9d700 1 -- 172.21.15.69:0/2525425016 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4e100cd9e0 msgr2=0x7f4e1015d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:15.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.923+0000 7f4e0ed9d700 1 --2- 172.21.15.69:0/2525425016 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4e100cd9e0 0x7f4e1015d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:15.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.923+0000 7f4e0ed9d700 1 -- 172.21.15.69:0/2525425016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e100cb5a0 msgr2=0x7f4e10153270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:15.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.923+0000 7f4e0ed9d700 1 --2- 172.21.15.69:0/2525425016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e100cb5a0 0x7f4e10153270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:15.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.923+0000 7f4e0ed9d700 1 -- 172.21.15.69:0/2525425016 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df8009420 con 0x7f4e1015a400 2023-10-06T01:39:15.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.923+0000 7f4e0ed9d700 1 --2- 172.21.15.69:0/2525425016 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e1015a400 0x7f4e1015ddc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800c4f0 tx=0x7f4e08007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:15.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.924+0000 7f4e067fc700 1 -- 172.21.15.69:0/2525425016 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0800cea0 con 0x7f4e1015a400 2023-10-06T01:39:15.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.924+0000 7f4e067fc700 1 -- 172.21.15.69:0/2525425016 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e08005b30 con 0x7f4e1015a400 2023-10-06T01:39:15.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.924+0000 7f4e14e3d700 1 -- 172.21.15.69:0/2525425016 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e1015b330 con 0x7f4e1015a400 2023-10-06T01:39:15.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.924+0000 7f4e067fc700 1 -- 172.21.15.69:0/2525425016 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e080070d0 con 0x7f4e1015a400 2023-10-06T01:39:15.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.924+0000 7f4e14e3d700 1 -- 172.21.15.69:0/2525425016 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e100b49e0 con 0x7f4e1015a400 2023-10-06T01:39:15.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.925+0000 7f4e14e3d700 1 -- 172.21.15.69:0/2525425016 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e100b51a0 con 0x7f4e1015a400 2023-10-06T01:39:15.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.925+0000 7f4e067fc700 1 -- 172.21.15.69:0/2525425016 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4e08007500 con 0x7f4e1015a400 2023-10-06T01:39:15.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.925+0000 7f4e067fc700 1 --2- 172.21.15.69:0/2525425016 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4df0066f30 0x7f4df00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:15.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.925+0000 7f4e067fc700 1 -- 172.21.15.69:0/2525425016 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4e08083a10 con 0x7f4e1015a400 2023-10-06T01:39:15.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.925+0000 7f4e0e59c700 1 --2- 172.21.15.69:0/2525425016 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4df0066f30 0x7f4df00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:15.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.926+0000 7f4e0e59c700 1 --2- 172.21.15.69:0/2525425016 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4df0066f30 0x7f4df00693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4e00009fd0 tx=0x7f4e00009880 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:15.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:15.930+0000 7f4e067fc700 1 -- 172.21.15.69:0/2525425016 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e08050b20 con 0x7f4e1015a400 2023-10-06T01:39:16.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.112+0000 7f4e14e3d700 1 -- 172.21.15.69:0/2525425016 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e1004c3c0 con 0x7f4e1015a400 2023-10-06T01:39:16.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.113+0000 7f4e067fc700 1 -- 172.21.15.69:0/2525425016 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f4e08017070 con 0x7f4e1015a400 2023-10-06T01:39:16.115 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:16.115 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":24,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:38:50.506861+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:38:43.046056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:38:47.525023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:38:47.992048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:39:16.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.115+0000 7f4e14e3d700 1 -- 172.21.15.69:0/2525425016 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4df0066f30 msgr2=0x7f4df00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:16.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.115+0000 7f4e14e3d700 1 --2- 172.21.15.69:0/2525425016 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4df0066f30 0x7f4df00693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4e00009fd0 tx=0x7f4e00009880 comp rx=0 tx=0).stop 2023-10-06T01:39:16.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.115+0000 7f4e14e3d700 1 -- 172.21.15.69:0/2525425016 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e1015a400 msgr2=0x7f4e1015ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:16.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.115+0000 7f4e14e3d700 1 --2- 172.21.15.69:0/2525425016 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e1015a400 0x7f4e1015ddc0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4e0800c4f0 tx=0x7f4e08007f50 comp rx=0 tx=0).stop 2023-10-06T01:39:16.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.115+0000 7f4e14e3d700 1 -- 172.21.15.69:0/2525425016 shutdown_connections 2023-10-06T01:39:16.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.115+0000 7f4e14e3d700 1 --2- 172.21.15.69:0/2525425016 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4df0066f30 0x7f4df00693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.115+0000 7f4e14e3d700 1 --2- 172.21.15.69:0/2525425016 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e1015a400 0x7f4e1015ddc0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.115+0000 7f4e14e3d700 1 --2- 172.21.15.69:0/2525425016 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4e100cb5a0 0x7f4e10153270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.115+0000 7f4e14e3d700 1 --2- 172.21.15.69:0/2525425016 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4e100cd9e0 0x7f4e1015d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.115+0000 7f4e14e3d700 1 -- 172.21.15.69:0/2525425016 >> 172.21.15.69:0/2525425016 conn(0x7f4e10070e30 msgr2=0x7f4e100cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:16.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.115+0000 7f4e14e3d700 1 -- 172.21.15.69:0/2525425016 shutdown_connections 2023-10-06T01:39:16.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.115+0000 7f4e14e3d700 1 -- 172.21.15.69:0/2525425016 wait complete. 2023-10-06T01:39:16.129 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:38:38.288642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:38:43.046056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T01:38:47.525023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T01:38:47.992048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T01:39:16.129 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:39:16.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.246+0000 7f01a983f700 1 Processor -- start 2023-10-06T01:39:16.248 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.246+0000 7f01a983f700 1 -- start start 2023-10-06T01:39:16.250 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.247+0000 7f01a983f700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f01a4153a00 0x7f01a4153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:16.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.247+0000 7f01a983f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f01a415de50 0x7f01a415a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:16.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.247+0000 7f01a983f700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01a415af60 con 0x7f01a40cea00 2023-10-06T01:39:16.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.247+0000 7f01a983f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01a415d010 con 0x7f01a415de50 2023-10-06T01:39:16.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.247+0000 7f01a983f700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a415b240 con 0x7f01a4153a00 2023-10-06T01:39:16.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.247+0000 7f01a903e700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f01a40cea00 0x7f01a40cee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59826/0 (socket says 172.21.15.69:59826) 2023-10-06T01:39:16.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.247+0000 7f01a903e700 1 -- 172.21.15.69:0/1978456354 learned_addr learned my addr 172.21.15.69:0/1978456354 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:16.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.247+0000 7f01a3fff700 1 --2- 172.21.15.69:0/1978456354 >> v2:172.21.15.88:3300/0 conn(0x7f01a415de50 0x7f01a415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:16.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.247+0000 7f01a883d700 1 --2- 172.21.15.69:0/1978456354 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f01a4153a00 0x7f01a4153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:16.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.247+0000 7f01a37fe700 1 -- 172.21.15.69:0/1978456354 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3052436285 0 0) 0x7f01a415af60 con 0x7f01a40cea00 2023-10-06T01:39:16.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.247+0000 7f01a37fe700 1 -- 172.21.15.69:0/1978456354 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0190003570 con 0x7f01a40cea00 2023-10-06T01:39:16.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.247+0000 7f01a3fff700 1 -- 172.21.15.69:0/1978456354 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f01a4153a00 msgr2=0x7f01a4153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:16.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.247+0000 7f01a3fff700 1 --2- 172.21.15.69:0/1978456354 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f01a4153a00 0x7f01a4153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.247+0000 7f01a3fff700 1 -- 172.21.15.69:0/1978456354 >> v1:172.21.15.69:6789/0 conn(0x7f01a40cea00 legacy=0x7f01a40cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:16.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.247+0000 7f01a3fff700 1 -- 172.21.15.69:0/1978456354 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01a415b520 con 0x7f01a415de50 2023-10-06T01:39:16.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.247+0000 7f01a3fff700 1 --2- 172.21.15.69:0/1978456354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01a415de50 0x7f01a415a540 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f018c0098e0 tx=0x7f018c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1d2e9fe54b7a2a9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:16.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.247+0000 7f01a37fe700 1 -- 172.21.15.69:0/1978456354 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c011630 con 0x7f01a415de50 2023-10-06T01:39:16.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.248+0000 7f01a37fe700 1 -- 172.21.15.69:0/1978456354 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018c011790 con 0x7f01a415de50 2023-10-06T01:39:16.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.248+0000 7f01a37fe700 1 -- 172.21.15.69:0/1978456354 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018c011b30 con 0x7f01a415de50 2023-10-06T01:39:16.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.248+0000 7f01a983f700 1 -- 172.21.15.69:0/1978456354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01a415de50 msgr2=0x7f01a415a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:16.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.248+0000 7f01a983f700 1 --2- 172.21.15.69:0/1978456354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01a415de50 0x7f01a415a540 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f018c0098e0 tx=0x7f018c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.248+0000 7f01a983f700 1 -- 172.21.15.69:0/1978456354 shutdown_connections 2023-10-06T01:39:16.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.248+0000 7f01a983f700 1 --2- 172.21.15.69:0/1978456354 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f01a4153a00 0x7f01a4153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.248+0000 7f01a983f700 1 --2- 172.21.15.69:0/1978456354 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01a415de50 0x7f01a415a540 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.248+0000 7f01a983f700 1 -- 172.21.15.69:0/1978456354 >> 172.21.15.69:0/1978456354 conn(0x7f01a40703a0 msgr2=0x7f01a40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:16.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.248+0000 7f01a983f700 1 -- 172.21.15.69:0/1978456354 shutdown_connections 2023-10-06T01:39:16.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.248+0000 7f01a983f700 1 -- 172.21.15.69:0/1978456354 wait complete. 2023-10-06T01:39:16.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.249+0000 7f01a983f700 1 Processor -- start 2023-10-06T01:39:16.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.249+0000 7f01a983f700 1 -- start start 2023-10-06T01:39:16.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.250+0000 7f01a983f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01a40cea00 0x7f01a40b5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:16.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.250+0000 7f01a983f700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f01a4153a00 0x7f01a4152210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:16.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.250+0000 7f01a983f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01a415de50 0x7f01a40ccfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:16.256 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.250+0000 7f01a983f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a4152750 con 0x7f01a415de50 2023-10-06T01:39:16.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.250+0000 7f01a983f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a40cd520 con 0x7f01a40cea00 2023-10-06T01:39:16.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.250+0000 7f01a983f700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01a40c83e0 con 0x7f01a4153a00 2023-10-06T01:39:16.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.250+0000 7f01a903e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01a415de50 0x7f01a40ccfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:16.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.250+0000 7f01a903e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01a415de50 0x7f01a40ccfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59598/0 (socket says 172.21.15.69:59598) 2023-10-06T01:39:16.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.250+0000 7f01a903e700 1 -- 172.21.15.69:0/1124730527 learned_addr learned my addr 172.21.15.69:0/1124730527 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:16.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.250+0000 7f01a3fff700 1 --2- 172.21.15.69:0/1124730527 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f01a4153a00 0x7f01a4152210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:16.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.250+0000 7f01a883d700 1 --2- 172.21.15.69:0/1124730527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01a40cea00 0x7f01a40b5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:16.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.251+0000 7f01a903e700 1 -- 172.21.15.69:0/1124730527 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f01a4153a00 msgr2=0x7f01a4152210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:16.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.251+0000 7f01a903e700 1 --2- 172.21.15.69:0/1124730527 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f01a4153a00 0x7f01a4152210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.251+0000 7f01a903e700 1 -- 172.21.15.69:0/1124730527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01a40cea00 msgr2=0x7f01a40b5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:16.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.251+0000 7f01a903e700 1 --2- 172.21.15.69:0/1124730527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01a40cea00 0x7f01a40b5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.251+0000 7f01a903e700 1 -- 172.21.15.69:0/1124730527 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f018c009420 con 0x7f01a415de50 2023-10-06T01:39:16.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.251+0000 7f01a3fff700 1 --2- 172.21.15.69:0/1124730527 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f01a4153a00 0x7f01a4152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:16.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.251+0000 7f01a903e700 1 --2- 172.21.15.69:0/1124730527 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01a415de50 0x7f01a40ccfe0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f019c00c790 tx=0x7f019c007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:16.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.251+0000 7f01a0ff9700 1 -- 172.21.15.69:0/1124730527 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c005c00 con 0x7f01a415de50 2023-10-06T01:39:16.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.251+0000 7f01a0ff9700 1 -- 172.21.15.69:0/1124730527 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f019c005d60 con 0x7f01a415de50 2023-10-06T01:39:16.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.251+0000 7f01a0ff9700 1 -- 172.21.15.69:0/1124730527 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f019c0072e0 con 0x7f01a415de50 2023-10-06T01:39:16.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.251+0000 7f01a983f700 1 -- 172.21.15.69:0/1124730527 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a40b6160 con 0x7f01a415de50 2023-10-06T01:39:16.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.251+0000 7f01a983f700 1 -- 172.21.15.69:0/1124730527 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a40c7d90 con 0x7f01a415de50 2023-10-06T01:39:16.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.252+0000 7f01a983f700 1 -- 172.21.15.69:0/1124730527 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a404c3c0 con 0x7f01a415de50 2023-10-06T01:39:16.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.252+0000 7f01a0ff9700 1 -- 172.21.15.69:0/1124730527 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f019c012400 con 0x7f01a415de50 2023-10-06T01:39:16.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.252+0000 7f01a0ff9700 1 --2- 172.21.15.69:0/1124730527 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0184066f30 0x7f01840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:16.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.253+0000 7f01a0ff9700 1 -- 172.21.15.69:0/1124730527 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f019c083a10 con 0x7f01a415de50 2023-10-06T01:39:16.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.253+0000 7f01a883d700 1 --2- 172.21.15.69:0/1124730527 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0184066f30 0x7f01840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:16.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.253+0000 7f01a883d700 1 --2- 172.21.15.69:0/1124730527 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0184066f30 0x7f01840693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f019400f570 tx=0x7f019400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:16.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.257+0000 7f01a0ff9700 1 -- 172.21.15.69:0/1124730527 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f019c050bd0 con 0x7f01a415de50 2023-10-06T01:39:16.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.440+0000 7f01a983f700 1 -- 172.21.15.69:0/1124730527 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f01a40c8520 con 0x7f01a415de50 2023-10-06T01:39:16.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.440+0000 7f01a0ff9700 1 -- 172.21.15.69:0/1124730527 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f019c017020 con 0x7f01a415de50 2023-10-06T01:39:16.442 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-10-06T01:39:16.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.442+0000 7f01a983f700 1 -- 172.21.15.69:0/1124730527 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0184066f30 msgr2=0x7f01840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:16.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.442+0000 7f01a983f700 1 --2- 172.21.15.69:0/1124730527 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0184066f30 0x7f01840693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f019400f570 tx=0x7f019400b040 comp rx=0 tx=0).stop 2023-10-06T01:39:16.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.442+0000 7f01a983f700 1 -- 172.21.15.69:0/1124730527 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01a415de50 msgr2=0x7f01a40ccfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:16.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.442+0000 7f01a983f700 1 --2- 172.21.15.69:0/1124730527 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01a415de50 0x7f01a40ccfe0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f019c00c790 tx=0x7f019c007dd0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.442+0000 7f01a983f700 1 -- 172.21.15.69:0/1124730527 shutdown_connections 2023-10-06T01:39:16.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.442+0000 7f01a983f700 1 --2- 172.21.15.69:0/1124730527 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0184066f30 0x7f01840693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.444 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.442+0000 7f01a983f700 1 --2- 172.21.15.69:0/1124730527 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01a415de50 0x7f01a40ccfe0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.442+0000 7f01a983f700 1 --2- 172.21.15.69:0/1124730527 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f01a40cea00 0x7f01a40b5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.442+0000 7f01a983f700 1 --2- 172.21.15.69:0/1124730527 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f01a4153a00 0x7f01a4152210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.442+0000 7f01a983f700 1 -- 172.21.15.69:0/1124730527 >> 172.21.15.69:0/1124730527 conn(0x7f01a40703a0 msgr2=0x7f01a4152e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:16.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.442+0000 7f01a983f700 1 -- 172.21.15.69:0/1124730527 shutdown_connections 2023-10-06T01:39:16.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.442+0000 7f01a983f700 1 -- 172.21.15.69:0/1124730527 wait complete. 2023-10-06T01:39:16.455 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:39:16.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.573+0000 7faf2759e700 1 Processor -- start 2023-10-06T01:39:16.574 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.573+0000 7faf2759e700 1 -- start start 2023-10-06T01:39:16.576 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.574+0000 7faf2759e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7faf28157420 0x7faf280b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:16.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.574+0000 7faf2759e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faf2806d250 0x7faf280aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:16.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.574+0000 7faf2759e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faf280ceac0 0x7faf280af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:16.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.574+0000 7faf2759e700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf280ac840 con 0x7faf28157420 2023-10-06T01:39:16.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.574+0000 7faf2759e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf280b18f0 con 0x7faf2806d250 2023-10-06T01:39:16.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.574+0000 7faf2759e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf280abf50 con 0x7faf280ceac0 2023-10-06T01:39:16.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.574+0000 7faf2659c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7faf28157420 0x7faf280b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:16.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.574+0000 7faf2659c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7faf28157420 0x7faf280b13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59602/0 (socket says 172.21.15.69:59602) 2023-10-06T01:39:16.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.574+0000 7faf2659c700 1 -- 172.21.15.69:0/1965163209 learned_addr learned my addr 172.21.15.69:0/1965163209 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:16.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.574+0000 7faf25d9b700 1 --2- 172.21.15.69:0/1965163209 >> v2:172.21.15.88:3300/0 conn(0x7faf2806d250 0x7faf280aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:16.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.574+0000 7faf26d9d700 1 --2- 172.21.15.69:0/1965163209 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faf280ceac0 0x7faf280af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:16.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.574+0000 7faf2659c700 1 -- 172.21.15.69:0/1965163209 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faf280ceac0 msgr2=0x7faf280af4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:16.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.574+0000 7faf2659c700 1 --2- 172.21.15.69:0/1965163209 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faf280ceac0 0x7faf280af4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.574+0000 7faf2659c700 1 -- 172.21.15.69:0/1965163209 >> v2:172.21.15.88:3300/0 conn(0x7faf2806d250 msgr2=0x7faf280aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:16.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.574+0000 7faf2659c700 1 --2- 172.21.15.69:0/1965163209 >> v2:172.21.15.88:3300/0 conn(0x7faf2806d250 0x7faf280aefa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.574+0000 7faf2659c700 1 -- 172.21.15.69:0/1965163209 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf280aea60 con 0x7faf28157420 2023-10-06T01:39:16.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.574+0000 7faf2659c700 1 --2- 172.21.15.69:0/1965163209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf28157420 0x7faf280b13b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faf2806aa90 tx=0x7faf20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e320fc6b08b7730b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:16.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.574+0000 7faf2559a700 1 -- 172.21.15.69:0/1965163209 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2000b640 con 0x7faf28157420 2023-10-06T01:39:16.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.574+0000 7faf2559a700 1 -- 172.21.15.69:0/1965163209 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf2000b7a0 con 0x7faf28157420 2023-10-06T01:39:16.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.574+0000 7faf2559a700 1 -- 172.21.15.69:0/1965163209 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf2000bb60 con 0x7faf28157420 2023-10-06T01:39:16.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.575+0000 7faf2759e700 1 -- 172.21.15.69:0/1965163209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf28157420 msgr2=0x7faf280b13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:16.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.575+0000 7faf2759e700 1 --2- 172.21.15.69:0/1965163209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf28157420 0x7faf280b13b0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7faf2806aa90 tx=0x7faf20009250 comp rx=0 tx=0).stop 2023-10-06T01:39:16.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.575+0000 7faf2759e700 1 -- 172.21.15.69:0/1965163209 shutdown_connections 2023-10-06T01:39:16.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.575+0000 7faf2759e700 1 --2- 172.21.15.69:0/1965163209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf28157420 0x7faf280b13b0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.575+0000 7faf2759e700 1 --2- 172.21.15.69:0/1965163209 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faf280ceac0 0x7faf280af4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.575+0000 7faf2759e700 1 --2- 172.21.15.69:0/1965163209 >> v2:172.21.15.88:3300/0 conn(0x7faf2806d250 0x7faf280aefa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.575+0000 7faf2759e700 1 -- 172.21.15.69:0/1965163209 >> 172.21.15.69:0/1965163209 conn(0x7faf2806ce80 msgr2=0x7faf280ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:16.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.575+0000 7faf2759e700 1 -- 172.21.15.69:0/1965163209 shutdown_connections 2023-10-06T01:39:16.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.575+0000 7faf2759e700 1 -- 172.21.15.69:0/1965163209 wait complete. 2023-10-06T01:39:16.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.576+0000 7faf2759e700 1 Processor -- start 2023-10-06T01:39:16.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.576+0000 7faf2759e700 1 -- start start 2023-10-06T01:39:16.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.577+0000 7faf2759e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faf2806d250 0x7faf2813e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:16.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.577+0000 7faf2759e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf280ceac0 0x7faf2809b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:16.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.577+0000 7faf2759e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf28157420 0x7faf28159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:16.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.577+0000 7faf2759e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf28150540 con 0x7faf280ceac0 2023-10-06T01:39:16.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.577+0000 7faf2759e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf2809bdf0 con 0x7faf28157420 2023-10-06T01:39:16.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.577+0000 7faf2759e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf2813f1f0 con 0x7faf2806d250 2023-10-06T01:39:16.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.577+0000 7faf25d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf280ceac0 0x7faf2809b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:16.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.577+0000 7faf25d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf280ceac0 0x7faf2809b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59616/0 (socket says 172.21.15.69:59616) 2023-10-06T01:39:16.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.577+0000 7faf25d9b700 1 -- 172.21.15.69:0/313999057 learned_addr learned my addr 172.21.15.69:0/313999057 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:16.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.577+0000 7faf2659c700 1 --2- 172.21.15.69:0/313999057 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faf2806d250 0x7faf2813e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:16.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.577+0000 7faf26d9d700 1 --2- 172.21.15.69:0/313999057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf28157420 0x7faf28159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:16.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.577+0000 7faf25d9b700 1 -- 172.21.15.69:0/313999057 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faf2806d250 msgr2=0x7faf2813e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:16.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.577+0000 7faf25d9b700 1 --2- 172.21.15.69:0/313999057 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faf2806d250 0x7faf2813e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.577+0000 7faf25d9b700 1 -- 172.21.15.69:0/313999057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf28157420 msgr2=0x7faf28159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:16.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.577+0000 7faf25d9b700 1 --2- 172.21.15.69:0/313999057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf28157420 0x7faf28159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.577+0000 7faf25d9b700 1 -- 172.21.15.69:0/313999057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf200094f0 con 0x7faf280ceac0 2023-10-06T01:39:16.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.578+0000 7faf25d9b700 1 --2- 172.21.15.69:0/313999057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf280ceac0 0x7faf2809b470 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00e900 tx=0x7faf1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:16.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.578+0000 7faf167fc700 1 -- 172.21.15.69:0/313999057 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c013680 con 0x7faf280ceac0 2023-10-06T01:39:16.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.578+0000 7faf167fc700 1 -- 172.21.15.69:0/313999057 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf1c0137e0 con 0x7faf280ceac0 2023-10-06T01:39:16.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.578+0000 7faf2759e700 1 -- 172.21.15.69:0/313999057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf2813f4d0 con 0x7faf280ceac0 2023-10-06T01:39:16.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.578+0000 7faf167fc700 1 -- 172.21.15.69:0/313999057 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf1c013ba0 con 0x7faf280ceac0 2023-10-06T01:39:16.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.578+0000 7faf2759e700 1 -- 172.21.15.69:0/313999057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf2809b9b0 con 0x7faf280ceac0 2023-10-06T01:39:16.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.579+0000 7faf2759e700 1 -- 172.21.15.69:0/313999057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf2813f050 con 0x7faf280ceac0 2023-10-06T01:39:16.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.579+0000 7faf167fc700 1 -- 172.21.15.69:0/313999057 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf1c0123d0 con 0x7faf280ceac0 2023-10-06T01:39:16.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.579+0000 7faf167fc700 1 --2- 172.21.15.69:0/313999057 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7faf08066f30 0x7faf080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:16.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.580+0000 7faf167fc700 1 -- 172.21.15.69:0/313999057 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7faf1c084740 con 0x7faf280ceac0 2023-10-06T01:39:16.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.580+0000 7faf2659c700 1 --2- 172.21.15.69:0/313999057 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7faf08066f30 0x7faf080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:16.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.580+0000 7faf2659c700 1 --2- 172.21.15.69:0/313999057 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7faf08066f30 0x7faf080693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7faf2806aa90 tx=0x7faf20017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:16.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.584+0000 7faf167fc700 1 -- 172.21.15.69:0/313999057 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf2813f050 con 0x7faf280ceac0 2023-10-06T01:39:16.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.767+0000 7faf2759e700 1 -- 172.21.15.69:0/313999057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7faf2813f050 con 0x7faf280ceac0 2023-10-06T01:39:16.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.768+0000 7faf167fc700 1 -- 172.21.15.69:0/313999057 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7faf2813f050 con 0x7faf280ceac0 2023-10-06T01:39:16.769 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 8 2023-10-06T01:39:16.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.770+0000 7faf2759e700 1 -- 172.21.15.69:0/313999057 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7faf08066f30 msgr2=0x7faf080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:16.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.770+0000 7faf2759e700 1 --2- 172.21.15.69:0/313999057 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7faf08066f30 0x7faf080693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7faf2806aa90 tx=0x7faf20017000 comp rx=0 tx=0).stop 2023-10-06T01:39:16.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.770+0000 7faf2759e700 1 -- 172.21.15.69:0/313999057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf280ceac0 msgr2=0x7faf2809b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:16.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.770+0000 7faf2759e700 1 --2- 172.21.15.69:0/313999057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf280ceac0 0x7faf2809b470 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7faf1c00e900 tx=0x7faf1c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.770+0000 7faf2759e700 1 -- 172.21.15.69:0/313999057 shutdown_connections 2023-10-06T01:39:16.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.770+0000 7faf2759e700 1 --2- 172.21.15.69:0/313999057 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7faf08066f30 0x7faf080693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.770+0000 7faf2759e700 1 --2- 172.21.15.69:0/313999057 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faf28157420 0x7faf28159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.770+0000 7faf2759e700 1 --2- 172.21.15.69:0/313999057 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faf2806d250 0x7faf2813e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.770+0000 7faf2759e700 1 --2- 172.21.15.69:0/313999057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faf280ceac0 0x7faf2809b470 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.770+0000 7faf2759e700 1 -- 172.21.15.69:0/313999057 >> 172.21.15.69:0/313999057 conn(0x7faf2806ce80 msgr2=0x7faf280b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:16.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.770+0000 7faf2759e700 1 -- 172.21.15.69:0/313999057 shutdown_connections 2023-10-06T01:39:16.773 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.770+0000 7faf2759e700 1 -- 172.21.15.69:0/313999057 wait complete. 2023-10-06T01:39:16.783 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T01:39:16.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.899+0000 7f9b2759e700 1 Processor -- start 2023-10-06T01:39:16.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.899+0000 7f9b2759e700 1 -- start start 2023-10-06T01:39:16.902 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.899+0000 7f9b2759e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9b28159580 0x7f9b280b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:16.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.899+0000 7f9b2759e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9b280cb1e0 0x7f9b280b2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:16.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.899+0000 7f9b2759e700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b2815bc40 con 0x7f9b2806d7c0 2023-10-06T01:39:16.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.899+0000 7f9b2759e700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b2815b070 con 0x7f9b28159580 2023-10-06T01:39:16.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.899+0000 7f9b2759e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2815b310 con 0x7f9b280cb1e0 2023-10-06T01:39:16.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.900+0000 7f9b2659c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9b28159580 0x7f9b280b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:16.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.900+0000 7f9b26d9d700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f9b2806d7c0 0x7f9b2815c0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59830/0 (socket says 172.21.15.69:59830) 2023-10-06T01:39:16.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.900+0000 7f9b26d9d700 1 -- 172.21.15.69:0/3663941258 learned_addr learned my addr 172.21.15.69:0/3663941258 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:16.903 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.900+0000 7f9b1dd9b700 1 --2- 172.21.15.69:0/3663941258 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9b280cb1e0 0x7f9b280b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:16.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.900+0000 7f9b2659c700 1 -- 172.21.15.69:0/3663941258 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9b280cb1e0 msgr2=0x7f9b280b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:16.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.900+0000 7f9b2659c700 1 --2- 172.21.15.69:0/3663941258 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9b280cb1e0 0x7f9b280b2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.900+0000 7f9b2659c700 1 -- 172.21.15.69:0/3663941258 >> v1:172.21.15.69:6789/0 conn(0x7f9b2806d7c0 legacy=0x7f9b2815c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:16.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.900+0000 7f9b2659c700 1 -- 172.21.15.69:0/3663941258 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2815b5f0 con 0x7f9b28159580 2023-10-06T01:39:16.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.900+0000 7f9b25d9b700 1 -- 172.21.15.69:0/3663941258 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1431318468 0 0) 0x7f9b2815bc40 con 0x7f9b2806d7c0 2023-10-06T01:39:16.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.900+0000 7f9b2659c700 1 --2- 172.21.15.69:0/3663941258 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b28159580 0x7f9b280b23f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9b180098e0 tx=0x7f9b180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c9d9d5b8d3dbf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:16.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.900+0000 7f9b25d9b700 1 -- 172.21.15.69:0/3663941258 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1800b640 con 0x7f9b28159580 2023-10-06T01:39:16.904 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.900+0000 7f9b25d9b700 1 -- 172.21.15.69:0/3663941258 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1800b7a0 con 0x7f9b28159580 2023-10-06T01:39:16.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.900+0000 7f9b25d9b700 1 -- 172.21.15.69:0/3663941258 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1800bb40 con 0x7f9b28159580 2023-10-06T01:39:16.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.901+0000 7f9b2759e700 1 -- 172.21.15.69:0/3663941258 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b28159580 msgr2=0x7f9b280b23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:16.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.901+0000 7f9b2759e700 1 --2- 172.21.15.69:0/3663941258 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b28159580 0x7f9b280b23f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9b180098e0 tx=0x7f9b180091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.901+0000 7f9b2759e700 1 -- 172.21.15.69:0/3663941258 shutdown_connections 2023-10-06T01:39:16.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.901+0000 7f9b2759e700 1 --2- 172.21.15.69:0/3663941258 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b28159580 0x7f9b280b23f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.901+0000 7f9b2759e700 1 --2- 172.21.15.69:0/3663941258 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9b280cb1e0 0x7f9b280b2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.901+0000 7f9b2759e700 1 -- 172.21.15.69:0/3663941258 >> 172.21.15.69:0/3663941258 conn(0x7f9b280703a0 msgr2=0x7f9b280707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:16.905 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.901+0000 7f9b2759e700 1 -- 172.21.15.69:0/3663941258 shutdown_connections 2023-10-06T01:39:16.906 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.901+0000 7f9b2759e700 1 -- 172.21.15.69:0/3663941258 wait complete. 2023-10-06T01:39:16.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.902+0000 7f9b2759e700 1 Processor -- start 2023-10-06T01:39:16.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.902+0000 7f9b2759e700 1 -- start start 2023-10-06T01:39:16.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.903+0000 7f9b2759e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9b2806d7c0 0x7f9b280c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:16.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.903+0000 7f9b2759e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b280cb1e0 0x7f9b280c7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:16.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.903+0000 7f9b2759e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b28159580 0x7f9b280b03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:16.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.903+0000 7f9b2759e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b280c8fc0 con 0x7f9b28159580 2023-10-06T01:39:16.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.903+0000 7f9b2759e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b280c83b0 con 0x7f9b280cb1e0 2023-10-06T01:39:16.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.903+0000 7f9b2759e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b280c8690 con 0x7f9b2806d7c0 2023-10-06T01:39:16.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.903+0000 7f9b26d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b28159580 0x7f9b280b03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:16.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.903+0000 7f9b26d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b28159580 0x7f9b280b03e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59628/0 (socket says 172.21.15.69:59628) 2023-10-06T01:39:16.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.903+0000 7f9b26d9d700 1 -- 172.21.15.69:0/999714001 learned_addr learned my addr 172.21.15.69:0/999714001 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:16.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.903+0000 7f9b2659c700 1 --2- 172.21.15.69:0/999714001 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9b2806d7c0 0x7f9b280c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:16.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.903+0000 7f9b1dd9b700 1 --2- 172.21.15.69:0/999714001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b280cb1e0 0x7f9b280c7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:16.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.903+0000 7f9b26d9d700 1 -- 172.21.15.69:0/999714001 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9b2806d7c0 msgr2=0x7f9b280c6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:16.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.903+0000 7f9b26d9d700 1 --2- 172.21.15.69:0/999714001 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9b2806d7c0 0x7f9b280c6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.903+0000 7f9b26d9d700 1 -- 172.21.15.69:0/999714001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b280cb1e0 msgr2=0x7f9b280c7cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:16.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.903+0000 7f9b26d9d700 1 --2- 172.21.15.69:0/999714001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b280cb1e0 0x7f9b280c7cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:16.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.903+0000 7f9b26d9d700 1 -- 172.21.15.69:0/999714001 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b18009420 con 0x7f9b28159580 2023-10-06T01:39:16.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.903+0000 7f9b26d9d700 1 --2- 172.21.15.69:0/999714001 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b28159580 0x7f9b280b03e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000cc90 tx=0x7f9b20001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:16.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.903+0000 7f9b1effd700 1 -- 172.21.15.69:0/999714001 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2000a8b0 con 0x7f9b28159580 2023-10-06T01:39:16.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.903+0000 7f9b1effd700 1 -- 172.21.15.69:0/999714001 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2000aa10 con 0x7f9b28159580 2023-10-06T01:39:16.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.903+0000 7f9b2759e700 1 -- 172.21.15.69:0/999714001 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b280c8970 con 0x7f9b28159580 2023-10-06T01:39:16.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.903+0000 7f9b1effd700 1 -- 172.21.15.69:0/999714001 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2000add0 con 0x7f9b28159580 2023-10-06T01:39:16.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.903+0000 7f9b2759e700 1 -- 172.21.15.69:0/999714001 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b280c9450 con 0x7f9b28159580 2023-10-06T01:39:16.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.904+0000 7f9b2759e700 1 -- 172.21.15.69:0/999714001 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b28088b50 con 0x7f9b28159580 2023-10-06T01:39:16.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.905+0000 7f9b1effd700 1 -- 172.21.15.69:0/999714001 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b20007300 con 0x7f9b28159580 2023-10-06T01:39:16.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.905+0000 7f9b1effd700 1 --2- 172.21.15.69:0/999714001 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9b08066f30 0x7f9b080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:16.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.905+0000 7f9b1effd700 1 -- 172.21.15.69:0/999714001 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9b200849f0 con 0x7f9b28159580 2023-10-06T01:39:16.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.905+0000 7f9b2659c700 1 --2- 172.21.15.69:0/999714001 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9b08066f30 0x7f9b080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:16.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.905+0000 7f9b2659c700 1 --2- 172.21.15.69:0/999714001 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9b08066f30 0x7f9b080693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9b180093f0 tx=0x7f9b18017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:16.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:16.909+0000 7f9b1effd700 1 -- 172.21.15.69:0/999714001 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b20051b80 con 0x7f9b28159580 2023-10-06T01:39:17.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.091+0000 7f9b2759e700 1 -- 172.21.15.69:0/999714001 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9b280c9100 con 0x7f9b28159580 2023-10-06T01:39:17.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.092+0000 7f9b1effd700 1 -- 172.21.15.69:0/999714001 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9b200551a0 con 0x7f9b28159580 2023-10-06T01:39:17.093 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-10-06T01:39:17.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.094+0000 7f9b2759e700 1 -- 172.21.15.69:0/999714001 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9b08066f30 msgr2=0x7f9b080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:17.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.094+0000 7f9b2759e700 1 --2- 172.21.15.69:0/999714001 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9b08066f30 0x7f9b080693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9b180093f0 tx=0x7f9b18017000 comp rx=0 tx=0).stop 2023-10-06T01:39:17.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.094+0000 7f9b2759e700 1 -- 172.21.15.69:0/999714001 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b28159580 msgr2=0x7f9b280b03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:17.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.094+0000 7f9b2759e700 1 --2- 172.21.15.69:0/999714001 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b28159580 0x7f9b280b03e0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000cc90 tx=0x7f9b20001a80 comp rx=0 tx=0).stop 2023-10-06T01:39:17.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.094+0000 7f9b2759e700 1 -- 172.21.15.69:0/999714001 shutdown_connections 2023-10-06T01:39:17.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.094+0000 7f9b2759e700 1 --2- 172.21.15.69:0/999714001 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9b08066f30 0x7f9b080693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:17.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.094+0000 7f9b2759e700 1 --2- 172.21.15.69:0/999714001 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b28159580 0x7f9b280b03e0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:17.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.094+0000 7f9b2759e700 1 --2- 172.21.15.69:0/999714001 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9b2806d7c0 0x7f9b280c6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:17.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.094+0000 7f9b2759e700 1 --2- 172.21.15.69:0/999714001 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9b280cb1e0 0x7f9b280c7cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:17.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.094+0000 7f9b2759e700 1 -- 172.21.15.69:0/999714001 >> 172.21.15.69:0/999714001 conn(0x7f9b280703a0 msgr2=0x7f9b2806dc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:17.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.094+0000 7f9b2759e700 1 -- 172.21.15.69:0/999714001 shutdown_connections 2023-10-06T01:39:17.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.094+0000 7f9b2759e700 1 -- 172.21.15.69:0/999714001 wait complete. 2023-10-06T01:39:17.107 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T01:39:17.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.222+0000 7f343a03d700 1 Processor -- start 2023-10-06T01:39:17.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.222+0000 7f343a03d700 1 -- start start 2023-10-06T01:39:17.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.223+0000 7f343a03d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f3434159530 0x7f34340ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:17.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.223+0000 7f343a03d700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34340ccfd0 con 0x7f343406dc70 2023-10-06T01:39:17.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.223+0000 7f343a03d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34340cf0e0 con 0x7f343406e0e0 2023-10-06T01:39:17.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.223+0000 7f343a03d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f343415a3d0 con 0x7f3434159530 2023-10-06T01:39:17.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.223+0000 7f3432ffd700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f343406dc70 0x7f3434159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:59846/0 (socket says 172.21.15.69:59846) 2023-10-06T01:39:17.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.223+0000 7f3432ffd700 1 -- 172.21.15.69:0/1770389294 learned_addr learned my addr 172.21.15.69:0/1770389294 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:17.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.223+0000 7f34337fe700 1 --2- 172.21.15.69:0/1770389294 >> v2:172.21.15.88:3300/0 conn(0x7f3434159530 0x7f34340ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:17.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.223+0000 7f34327fc700 1 -- 172.21.15.69:0/1770389294 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2494571618 0 0) 0x7f34340ccfd0 con 0x7f343406dc70 2023-10-06T01:39:17.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.224+0000 7f34327fc700 1 -- 172.21.15.69:0/1770389294 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f341c003570 con 0x7f343406dc70 2023-10-06T01:39:17.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.224+0000 7f34327fc700 1 -- 172.21.15.69:0/1770389294 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912608509 0 0) 0x7f34340cf0e0 con 0x7f343406e0e0 2023-10-06T01:39:17.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.224+0000 7f34327fc700 1 -- 172.21.15.69:0/1770389294 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34340ccfd0 con 0x7f343406e0e0 2023-10-06T01:39:17.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.224+0000 7f34337fe700 1 -- 172.21.15.69:0/1770389294 >> v1:172.21.15.88:6789/0 conn(0x7f343406e0e0 legacy=0x7f34340cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:17.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.224+0000 7f34337fe700 1 -- 172.21.15.69:0/1770389294 >> v1:172.21.15.69:6789/0 conn(0x7f343406dc70 legacy=0x7f3434159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:17.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.224+0000 7f34337fe700 1 -- 172.21.15.69:0/1770389294 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343415a6b0 con 0x7f3434159530 2023-10-06T01:39:17.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.224+0000 7f34337fe700 1 --2- 172.21.15.69:0/1770389294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3434159530 0x7f34340ceba0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3424009e60 tx=0x7f3424009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3bdfc43450165564 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:17.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.224+0000 7f34327fc700 1 -- 172.21.15.69:0/1770389294 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342400e070 con 0x7f3434159530 2023-10-06T01:39:17.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.224+0000 7f34327fc700 1 -- 172.21.15.69:0/1770389294 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342400bab0 con 0x7f3434159530 2023-10-06T01:39:17.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.224+0000 7f34327fc700 1 -- 172.21.15.69:0/1770389294 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342400be70 con 0x7f3434159530 2023-10-06T01:39:17.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.224+0000 7f343a03d700 1 -- 172.21.15.69:0/1770389294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3434159530 msgr2=0x7f34340ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:17.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.224+0000 7f343a03d700 1 --2- 172.21.15.69:0/1770389294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3434159530 0x7f34340ceba0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3424009e60 tx=0x7f3424009780 comp rx=0 tx=0).stop 2023-10-06T01:39:17.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.225+0000 7f343a03d700 1 -- 172.21.15.69:0/1770389294 shutdown_connections 2023-10-06T01:39:17.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.225+0000 7f343a03d700 1 --2- 172.21.15.69:0/1770389294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3434159530 0x7f34340ceba0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:17.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.225+0000 7f343a03d700 1 -- 172.21.15.69:0/1770389294 >> 172.21.15.69:0/1770389294 conn(0x7f34340703a0 msgr2=0x7f34340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:17.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.225+0000 7f343a03d700 1 -- 172.21.15.69:0/1770389294 shutdown_connections 2023-10-06T01:39:17.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.225+0000 7f343a03d700 1 -- 172.21.15.69:0/1770389294 wait complete. 2023-10-06T01:39:17.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.226+0000 7f343a03d700 1 Processor -- start 2023-10-06T01:39:17.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.226+0000 7f343a03d700 1 -- start start 2023-10-06T01:39:17.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.227+0000 7f343a03d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f343406dc70 0x7f3434140760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:17.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.227+0000 7f343a03d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f343406e0e0 0x7f34340b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:17.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.227+0000 7f343a03d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3434159530 0x7f343416d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:17.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.227+0000 7f343a03d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34340b39c0 con 0x7f343406dc70 2023-10-06T01:39:17.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.227+0000 7f343a03d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34340b3c40 con 0x7f3434159530 2023-10-06T01:39:17.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.227+0000 7f343a03d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34340b3f20 con 0x7f343406e0e0 2023-10-06T01:39:17.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.227+0000 7f34337fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f343406dc70 0x7f3434140760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:17.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.227+0000 7f34337fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f343406dc70 0x7f3434140760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59630/0 (socket says 172.21.15.69:59630) 2023-10-06T01:39:17.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.227+0000 7f34337fe700 1 -- 172.21.15.69:0/2941785178 learned_addr learned my addr 172.21.15.69:0/2941785178 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:17.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.227+0000 7f3433fff700 1 --2- 172.21.15.69:0/2941785178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3434159530 0x7f343416d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:17.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.227+0000 7f3432ffd700 1 --2- 172.21.15.69:0/2941785178 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f343406e0e0 0x7f34340b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:17.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.227+0000 7f34337fe700 1 -- 172.21.15.69:0/2941785178 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f343406e0e0 msgr2=0x7f34340b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:17.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.227+0000 7f34337fe700 1 --2- 172.21.15.69:0/2941785178 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f343406e0e0 0x7f34340b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:17.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.227+0000 7f34337fe700 1 -- 172.21.15.69:0/2941785178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3434159530 msgr2=0x7f343416d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:17.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.227+0000 7f34337fe700 1 --2- 172.21.15.69:0/2941785178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3434159530 0x7f343416d850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:17.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.227+0000 7f34337fe700 1 -- 172.21.15.69:0/2941785178 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3424009a20 con 0x7f343406dc70 2023-10-06T01:39:17.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.227+0000 7f34337fe700 1 --2- 172.21.15.69:0/2941785178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f343406dc70 0x7f3434140760 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3424009460 tx=0x7f3424019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:17.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.227+0000 7f341b7fe700 1 -- 172.21.15.69:0/2941785178 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3424012e60 con 0x7f343406dc70 2023-10-06T01:39:17.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.227+0000 7f341b7fe700 1 -- 172.21.15.69:0/2941785178 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3424026480 con 0x7f343406dc70 2023-10-06T01:39:17.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.228+0000 7f343a03d700 1 -- 172.21.15.69:0/2941785178 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34340b4200 con 0x7f343406dc70 2023-10-06T01:39:17.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.228+0000 7f341b7fe700 1 -- 172.21.15.69:0/2941785178 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3424026840 con 0x7f343406dc70 2023-10-06T01:39:17.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.228+0000 7f343a03d700 1 -- 172.21.15.69:0/2941785178 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f343416d330 con 0x7f343406dc70 2023-10-06T01:39:17.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.229+0000 7f343a03d700 1 -- 172.21.15.69:0/2941785178 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f343404c3c0 con 0x7f343406dc70 2023-10-06T01:39:17.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.229+0000 7f341b7fe700 1 -- 172.21.15.69:0/2941785178 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f342401c400 con 0x7f343406dc70 2023-10-06T01:39:17.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.229+0000 7f341b7fe700 1 --2- 172.21.15.69:0/2941785178 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3420066f60 0x7f3420069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:17.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.229+0000 7f341b7fe700 1 -- 172.21.15.69:0/2941785178 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f3424086460 con 0x7f343406dc70 2023-10-06T01:39:17.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.229+0000 7f3432ffd700 1 --2- 172.21.15.69:0/2941785178 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3420066f60 0x7f3420069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:17.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.230+0000 7f3432ffd700 1 --2- 172.21.15.69:0/2941785178 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3420066f60 0x7f3420069410 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f34280058d0 tx=0x7f3428009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:17.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.234+0000 7f341b7fe700 1 -- 172.21.15.69:0/2941785178 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3424053570 con 0x7f343406dc70 2023-10-06T01:39:17.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.415+0000 7f343a03d700 1 -- 172.21.15.69:0/2941785178 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f343415a990 con 0x7f343406dc70 2023-10-06T01:39:17.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.415+0000 7f341b7fe700 1 -- 172.21.15.69:0/2941785178 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3424056b90 con 0x7f343406dc70 2023-10-06T01:39:17.417 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-10-06T01:39:17.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.417+0000 7f343a03d700 1 -- 172.21.15.69:0/2941785178 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3420066f60 msgr2=0x7f3420069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:17.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.417+0000 7f343a03d700 1 --2- 172.21.15.69:0/2941785178 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3420066f60 0x7f3420069410 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f34280058d0 tx=0x7f3428009040 comp rx=0 tx=0).stop 2023-10-06T01:39:17.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.417+0000 7f343a03d700 1 -- 172.21.15.69:0/2941785178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f343406dc70 msgr2=0x7f3434140760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:17.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.417+0000 7f343a03d700 1 --2- 172.21.15.69:0/2941785178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f343406dc70 0x7f3434140760 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f3424009460 tx=0x7f3424019000 comp rx=0 tx=0).stop 2023-10-06T01:39:17.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.417+0000 7f343a03d700 1 -- 172.21.15.69:0/2941785178 shutdown_connections 2023-10-06T01:39:17.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.417+0000 7f343a03d700 1 --2- 172.21.15.69:0/2941785178 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3420066f60 0x7f3420069410 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:17.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.417+0000 7f343a03d700 1 --2- 172.21.15.69:0/2941785178 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f3434159530 0x7f343416d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:17.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.417+0000 7f343a03d700 1 --2- 172.21.15.69:0/2941785178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f343406dc70 0x7f3434140760 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:17.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.417+0000 7f343a03d700 1 --2- 172.21.15.69:0/2941785178 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f343406e0e0 0x7f34340b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:17.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.417+0000 7f343a03d700 1 -- 172.21.15.69:0/2941785178 >> 172.21.15.69:0/2941785178 conn(0x7f34340703a0 msgr2=0x7f3434153dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:17.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.417+0000 7f343a03d700 1 -- 172.21.15.69:0/2941785178 shutdown_connections 2023-10-06T01:39:17.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.418+0000 7f343a03d700 1 -- 172.21.15.69:0/2941785178 wait complete. 2023-10-06T01:39:17.431 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:39:17.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.546+0000 7f800d621700 1 Processor -- start 2023-10-06T01:39:17.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.546+0000 7f800d621700 1 -- start start 2023-10-06T01:39:17.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.547+0000 7f800d621700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f80080cb5a0 0x7f80080cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:17.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.547+0000 7f800d621700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80080cd9e0 0x7f8008159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:17.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.547+0000 7f800d621700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f800815ae40 con 0x7f80080cde50 2023-10-06T01:39:17.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.547+0000 7f800d621700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80080d13f0 con 0x7f80080cb5a0 2023-10-06T01:39:17.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.547+0000 7f800d621700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800815ab60 con 0x7f80080cd9e0 2023-10-06T01:39:17.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.547+0000 7f8006ffd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f80080cb5a0 0x7f80080cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:17.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.547+0000 7f80077fe700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f80080cde50 0x7f8008156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44816/0 (socket says 172.21.15.69:44816) 2023-10-06T01:39:17.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.547+0000 7f8006ffd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f80080cb5a0 0x7f80080cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52058/0 (socket says 172.21.15.69:52058) 2023-10-06T01:39:17.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.547+0000 7f80077fe700 1 -- 172.21.15.69:0/3705301983 learned_addr learned my addr 172.21.15.69:0/3705301983 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:17.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.547+0000 7f7ffffff700 1 --2- 172.21.15.69:0/3705301983 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80080cd9e0 0x7f8008159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:17.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.547+0000 7f8006ffd700 1 -- 172.21.15.69:0/3705301983 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80080cd9e0 msgr2=0x7f8008159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:17.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.547+0000 7f8006ffd700 1 --2- 172.21.15.69:0/3705301983 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80080cd9e0 0x7f8008159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:17.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.547+0000 7f8006ffd700 1 -- 172.21.15.69:0/3705301983 >> v1:172.21.15.69:6789/0 conn(0x7f80080cde50 legacy=0x7f8008156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:17.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.547+0000 7f8006ffd700 1 -- 172.21.15.69:0/3705301983 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80080ccf00 con 0x7f80080cb5a0 2023-10-06T01:39:17.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.547+0000 7f80067fc700 1 -- 172.21.15.69:0/3705301983 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2348262716 0 0) 0x7f800815ae40 con 0x7f80080cde50 2023-10-06T01:39:17.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.547+0000 7f8006ffd700 1 --2- 172.21.15.69:0/3705301983 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80080cb5a0 0x7f80080cb970 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7ff80098e0 tx=0x7f7ff80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50aa47e174028506 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:17.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.548+0000 7f80067fc700 1 -- 172.21.15.69:0/3705301983 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff800b640 con 0x7f80080cb5a0 2023-10-06T01:39:17.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.548+0000 7f80067fc700 1 -- 172.21.15.69:0/3705301983 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff800b7a0 con 0x7f80080cb5a0 2023-10-06T01:39:17.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.548+0000 7f80067fc700 1 -- 172.21.15.69:0/3705301983 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff800bb40 con 0x7f80080cb5a0 2023-10-06T01:39:17.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.548+0000 7f800d621700 1 -- 172.21.15.69:0/3705301983 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80080cb5a0 msgr2=0x7f80080cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:17.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.548+0000 7f800d621700 1 --2- 172.21.15.69:0/3705301983 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80080cb5a0 0x7f80080cb970 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7ff80098e0 tx=0x7f7ff80091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:17.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.548+0000 7f800d621700 1 -- 172.21.15.69:0/3705301983 shutdown_connections 2023-10-06T01:39:17.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.548+0000 7f800d621700 1 --2- 172.21.15.69:0/3705301983 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80080cb5a0 0x7f80080cb970 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:17.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.548+0000 7f800d621700 1 --2- 172.21.15.69:0/3705301983 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80080cd9e0 0x7f8008159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:17.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.548+0000 7f800d621700 1 -- 172.21.15.69:0/3705301983 >> 172.21.15.69:0/3705301983 conn(0x7f8008070e30 msgr2=0x7f80080d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:17.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.548+0000 7f800d621700 1 -- 172.21.15.69:0/3705301983 shutdown_connections 2023-10-06T01:39:17.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.548+0000 7f800d621700 1 -- 172.21.15.69:0/3705301983 wait complete. 2023-10-06T01:39:17.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.549+0000 7f800d621700 1 Processor -- start 2023-10-06T01:39:17.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.549+0000 7f800d621700 1 -- start start 2023-10-06T01:39:17.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.550+0000 7f800d621700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80080cb5a0 0x7f800815a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:17.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.550+0000 7f800d621700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80080cd9e0 0x7f80081697c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:17.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.550+0000 7f800d621700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f800815d780 0x7f80080cf230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:17.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.550+0000 7f800d621700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800815dc00 con 0x7f800815d780 2023-10-06T01:39:17.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.550+0000 7f800d621700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80080b47d0 con 0x7f80080cb5a0 2023-10-06T01:39:17.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.550+0000 7f800d621700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8008169e20 con 0x7f80080cd9e0 2023-10-06T01:39:17.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.550+0000 7f80077fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f800815d780 0x7f80080cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:17.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.550+0000 7f80077fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f800815d780 0x7f80080cf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52068/0 (socket says 172.21.15.69:52068) 2023-10-06T01:39:17.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.550+0000 7f80077fe700 1 -- 172.21.15.69:0/2541331916 learned_addr learned my addr 172.21.15.69:0/2541331916 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:17.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.550+0000 7f8006ffd700 1 --2- 172.21.15.69:0/2541331916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80080cb5a0 0x7f800815a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:17.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.550+0000 7f7ffffff700 1 --2- 172.21.15.69:0/2541331916 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80080cd9e0 0x7f80081697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:17.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.550+0000 7f80077fe700 1 -- 172.21.15.69:0/2541331916 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80080cd9e0 msgr2=0x7f80081697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:17.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.550+0000 7f80077fe700 1 --2- 172.21.15.69:0/2541331916 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80080cd9e0 0x7f80081697c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:17.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.550+0000 7f80077fe700 1 -- 172.21.15.69:0/2541331916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80080cb5a0 msgr2=0x7f800815a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:17.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.550+0000 7f80077fe700 1 --2- 172.21.15.69:0/2541331916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80080cb5a0 0x7f800815a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:17.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.550+0000 7f80077fe700 1 -- 172.21.15.69:0/2541331916 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff8009420 con 0x7f800815d780 2023-10-06T01:39:17.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.551+0000 7f80077fe700 1 --2- 172.21.15.69:0/2541331916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f800815d780 0x7f80080cf230 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f800000cbf0 tx=0x7f80000019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:17.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.551+0000 7f7ffeffd700 1 -- 172.21.15.69:0/2541331916 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800000a8b0 con 0x7f800815d780 2023-10-06T01:39:17.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.551+0000 7f7ffeffd700 1 -- 172.21.15.69:0/2541331916 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800000aa10 con 0x7f800815d780 2023-10-06T01:39:17.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.551+0000 7f800d621700 1 -- 172.21.15.69:0/2541331916 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f800816a100 con 0x7f800815d780 2023-10-06T01:39:17.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.551+0000 7f7ffeffd700 1 -- 172.21.15.69:0/2541331916 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800000add0 con 0x7f800815d780 2023-10-06T01:39:17.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.551+0000 7f800d621700 1 -- 172.21.15.69:0/2541331916 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800816a6c0 con 0x7f800815d780 2023-10-06T01:39:17.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.552+0000 7f800d621700 1 -- 172.21.15.69:0/2541331916 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f800804c3c0 con 0x7f800815d780 2023-10-06T01:39:17.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.552+0000 7f7ffeffd700 1 -- 172.21.15.69:0/2541331916 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8000007300 con 0x7f800815d780 2023-10-06T01:39:17.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.552+0000 7f7ffeffd700 1 --2- 172.21.15.69:0/2541331916 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7fe8066f30 0x7f7fe80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:17.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.553+0000 7f7ffeffd700 1 -- 172.21.15.69:0/2541331916 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8000084960 con 0x7f800815d780 2023-10-06T01:39:17.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.553+0000 7f8006ffd700 1 --2- 172.21.15.69:0/2541331916 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7fe8066f30 0x7f7fe80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:17.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.553+0000 7f8006ffd700 1 --2- 172.21.15.69:0/2541331916 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7fe8066f30 0x7f7fe80693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7ff80093f0 tx=0x7f7ff8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:17.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.557+0000 7f7ffeffd700 1 -- 172.21.15.69:0/2541331916 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8000051af0 con 0x7f800815d780 2023-10-06T01:39:17.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.742+0000 7f800d621700 1 -- 172.21.15.69:0/2541331916 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f80080b4910 con 0x7f800815d780 2023-10-06T01:39:17.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.743+0000 7f7ffeffd700 1 -- 172.21.15.69:0/2541331916 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f8000055110 con 0x7f800815d780 2023-10-06T01:39:17.744 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:17.744 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":24,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:38:50.506861+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:38:43.046056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:38:47.525023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:38:47.992048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:39:17.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.744+0000 7f800d621700 1 -- 172.21.15.69:0/2541331916 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7fe8066f30 msgr2=0x7f7fe80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:17.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.744+0000 7f800d621700 1 --2- 172.21.15.69:0/2541331916 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7fe8066f30 0x7f7fe80693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7ff80093f0 tx=0x7f7ff8017000 comp rx=0 tx=0).stop 2023-10-06T01:39:17.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.744+0000 7f800d621700 1 -- 172.21.15.69:0/2541331916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f800815d780 msgr2=0x7f80080cf230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:17.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.744+0000 7f800d621700 1 --2- 172.21.15.69:0/2541331916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f800815d780 0x7f80080cf230 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f800000cbf0 tx=0x7f80000019b0 comp rx=0 tx=0).stop 2023-10-06T01:39:17.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.744+0000 7f800d621700 1 -- 172.21.15.69:0/2541331916 shutdown_connections 2023-10-06T01:39:17.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.744+0000 7f800d621700 1 --2- 172.21.15.69:0/2541331916 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7fe8066f30 0x7f7fe80693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:17.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.744+0000 7f800d621700 1 --2- 172.21.15.69:0/2541331916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f800815d780 0x7f80080cf230 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:17.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.744+0000 7f800d621700 1 --2- 172.21.15.69:0/2541331916 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f80080cb5a0 0x7f800815a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:17.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.744+0000 7f800d621700 1 --2- 172.21.15.69:0/2541331916 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80080cd9e0 0x7f80081697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:17.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.744+0000 7f800d621700 1 -- 172.21.15.69:0/2541331916 >> 172.21.15.69:0/2541331916 conn(0x7f8008070e30 msgr2=0x7f8008155720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:17.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.745+0000 7f800d621700 1 -- 172.21.15.69:0/2541331916 shutdown_connections 2023-10-06T01:39:17.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.745+0000 7f800d621700 1 -- 172.21.15.69:0/2541331916 wait complete. 2023-10-06T01:39:17.758 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:38:38.288642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:38:43.046056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T01:38:47.525023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T01:38:47.992048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T01:39:17.758 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:39:17.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.874+0000 7f0941d55700 1 Processor -- start 2023-10-06T01:39:17.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.874+0000 7f0941d55700 1 -- start start 2023-10-06T01:39:17.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.874+0000 7f0941d55700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f093c159530 0x7f093c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:17.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.874+0000 7f0941d55700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f093c06e0e0 0x7f093c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:17.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.874+0000 7f0941d55700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f093c0ccfd0 con 0x7f093c06dc70 2023-10-06T01:39:17.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.874+0000 7f0941d55700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f093c0cf0e0 con 0x7f093c159530 2023-10-06T01:39:17.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.875+0000 7f0941d55700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093c15a3d0 con 0x7f093c06e0e0 2023-10-06T01:39:17.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.875+0000 7f093b7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f093c159530 0x7f093c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:17.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.875+0000 7f093b7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f093c159530 0x7f093c0ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52080/0 (socket says 172.21.15.69:52080) 2023-10-06T01:39:17.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.875+0000 7f093b7fe700 1 -- 172.21.15.69:0/898888612 learned_addr learned my addr 172.21.15.69:0/898888612 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:17.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.875+0000 7f093bfff700 1 --2- 172.21.15.69:0/898888612 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f093c06e0e0 0x7f093c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:17.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.875+0000 7f093b7fe700 1 -- 172.21.15.69:0/898888612 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f093c06e0e0 msgr2=0x7f093c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:17.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.875+0000 7f093b7fe700 1 --2- 172.21.15.69:0/898888612 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f093c06e0e0 0x7f093c0cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:17.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.875+0000 7f093b7fe700 1 -- 172.21.15.69:0/898888612 >> v1:172.21.15.88:6789/0 conn(0x7f093c06dc70 legacy=0x7f093c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:17.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.875+0000 7f093b7fe700 1 -- 172.21.15.69:0/898888612 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f093c15a6b0 con 0x7f093c159530 2023-10-06T01:39:17.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.875+0000 7f093b7fe700 1 --2- 172.21.15.69:0/898888612 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f093c159530 0x7f093c0ceba0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f09240099b0 tx=0x7f0924009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3ba69f0d8330e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:17.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.875+0000 7f093a7fc700 1 -- 172.21.15.69:0/898888612 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092400b820 con 0x7f093c159530 2023-10-06T01:39:17.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.875+0000 7f093a7fc700 1 -- 172.21.15.69:0/898888612 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f092400b980 con 0x7f093c159530 2023-10-06T01:39:17.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.875+0000 7f093a7fc700 1 -- 172.21.15.69:0/898888612 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092400bd20 con 0x7f093c159530 2023-10-06T01:39:17.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.876+0000 7f0941d55700 1 -- 172.21.15.69:0/898888612 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f093c159530 msgr2=0x7f093c0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:17.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.876+0000 7f0941d55700 1 --2- 172.21.15.69:0/898888612 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f093c159530 0x7f093c0ceba0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f09240099b0 tx=0x7f0924009250 comp rx=0 tx=0).stop 2023-10-06T01:39:17.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.876+0000 7f0941d55700 1 -- 172.21.15.69:0/898888612 shutdown_connections 2023-10-06T01:39:17.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.876+0000 7f0941d55700 1 --2- 172.21.15.69:0/898888612 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f093c06e0e0 0x7f093c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:17.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.876+0000 7f0941d55700 1 --2- 172.21.15.69:0/898888612 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f093c159530 0x7f093c0ceba0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:17.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.876+0000 7f0941d55700 1 -- 172.21.15.69:0/898888612 >> 172.21.15.69:0/898888612 conn(0x7f093c0703a0 msgr2=0x7f093c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:17.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.876+0000 7f0941d55700 1 -- 172.21.15.69:0/898888612 shutdown_connections 2023-10-06T01:39:17.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.876+0000 7f0941d55700 1 -- 172.21.15.69:0/898888612 wait complete. 2023-10-06T01:39:17.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.877+0000 7f0941d55700 1 Processor -- start 2023-10-06T01:39:17.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.877+0000 7f0941d55700 1 -- start start 2023-10-06T01:39:17.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.878+0000 7f0941d55700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f093c06dc70 0x7f093c1535b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:17.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.878+0000 7f0941d55700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f093c06e0e0 0x7f093c15d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:17.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.878+0000 7f0941d55700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f093c159530 0x7f093c14c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:17.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.878+0000 7f0941d55700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093c15e4e0 con 0x7f093c06dc70 2023-10-06T01:39:17.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.878+0000 7f0941d55700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f093c15e7f0 con 0x7f093c159530 2023-10-06T01:39:17.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.878+0000 7f0941d55700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f093c15eab0 con 0x7f093c06e0e0 2023-10-06T01:39:17.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.878+0000 7f093b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f093c06dc70 0x7f093c1535b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:17.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.878+0000 7f093b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f093c06dc70 0x7f093c1535b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52086/0 (socket says 172.21.15.69:52086) 2023-10-06T01:39:17.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.878+0000 7f093b7fe700 1 -- 172.21.15.69:0/4195380706 learned_addr learned my addr 172.21.15.69:0/4195380706 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:17.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.878+0000 7f093bfff700 1 --2- 172.21.15.69:0/4195380706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f093c159530 0x7f093c14c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:17.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.878+0000 7f093affd700 1 --2- 172.21.15.69:0/4195380706 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f093c06e0e0 0x7f093c15d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:17.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.878+0000 7f093b7fe700 1 -- 172.21.15.69:0/4195380706 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f093c06e0e0 msgr2=0x7f093c15d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:17.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.878+0000 7f093b7fe700 1 --2- 172.21.15.69:0/4195380706 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f093c06e0e0 0x7f093c15d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:17.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.878+0000 7f093b7fe700 1 -- 172.21.15.69:0/4195380706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f093c159530 msgr2=0x7f093c14c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:17.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.878+0000 7f093b7fe700 1 --2- 172.21.15.69:0/4195380706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f093c159530 0x7f093c14c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:17.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.878+0000 7f093b7fe700 1 -- 172.21.15.69:0/4195380706 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09240094f0 con 0x7f093c06dc70 2023-10-06T01:39:17.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.878+0000 7f093affd700 1 --2- 172.21.15.69:0/4195380706 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f093c06e0e0 0x7f093c15d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:17.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.878+0000 7f093b7fe700 1 --2- 172.21.15.69:0/4195380706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f093c06dc70 0x7f093c1535b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0924009290 tx=0x7f0924016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:17.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.878+0000 7f09337fe700 1 -- 172.21.15.69:0/4195380706 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0924011d70 con 0x7f093c06dc70 2023-10-06T01:39:17.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.878+0000 7f09337fe700 1 -- 172.21.15.69:0/4195380706 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0924020070 con 0x7f093c06dc70 2023-10-06T01:39:17.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.878+0000 7f0941d55700 1 -- 172.21.15.69:0/4195380706 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f093c15ed90 con 0x7f093c06dc70 2023-10-06T01:39:17.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.878+0000 7f09337fe700 1 -- 172.21.15.69:0/4195380706 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f092401b6a0 con 0x7f093c06dc70 2023-10-06T01:39:17.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.879+0000 7f0941d55700 1 -- 172.21.15.69:0/4195380706 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f093c153af0 con 0x7f093c06dc70 2023-10-06T01:39:17.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.879+0000 7f0941d55700 1 -- 172.21.15.69:0/4195380706 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f093c04c3c0 con 0x7f093c06dc70 2023-10-06T01:39:17.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.880+0000 7f09337fe700 1 -- 172.21.15.69:0/4195380706 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0924022030 con 0x7f093c06dc70 2023-10-06T01:39:17.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.880+0000 7f09337fe700 1 --2- 172.21.15.69:0/4195380706 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f091c066f30 0x7f091c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:17.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.880+0000 7f093affd700 1 --2- 172.21.15.69:0/4195380706 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f091c066f30 0x7f091c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:17.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.880+0000 7f09337fe700 1 -- 172.21.15.69:0/4195380706 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f09240865c0 con 0x7f093c06dc70 2023-10-06T01:39:17.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.881+0000 7f093affd700 1 --2- 172.21.15.69:0/4195380706 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f091c066f30 0x7f091c0693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f092c007fd0 tx=0x7f092c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:17.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:17.885+0000 7f09337fe700 1 -- 172.21.15.69:0/4195380706 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09240536d0 con 0x7f093c06dc70 2023-10-06T01:39:18.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.065+0000 7f0941d55700 1 -- 172.21.15.69:0/4195380706 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f093c04c3c0 con 0x7f093c06dc70 2023-10-06T01:39:18.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.065+0000 7f09337fe700 1 -- 172.21.15.69:0/4195380706 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0924056cf0 con 0x7f093c06dc70 2023-10-06T01:39:18.067 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-10-06T01:39:18.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.067+0000 7f0941d55700 1 -- 172.21.15.69:0/4195380706 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f091c066f30 msgr2=0x7f091c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:18.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.067+0000 7f0941d55700 1 --2- 172.21.15.69:0/4195380706 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f091c066f30 0x7f091c0693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f092c007fd0 tx=0x7f092c009040 comp rx=0 tx=0).stop 2023-10-06T01:39:18.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.067+0000 7f0941d55700 1 -- 172.21.15.69:0/4195380706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f093c06dc70 msgr2=0x7f093c1535b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:18.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.067+0000 7f0941d55700 1 --2- 172.21.15.69:0/4195380706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f093c06dc70 0x7f093c1535b0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0924009290 tx=0x7f0924016000 comp rx=0 tx=0).stop 2023-10-06T01:39:18.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.067+0000 7f0941d55700 1 -- 172.21.15.69:0/4195380706 shutdown_connections 2023-10-06T01:39:18.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.067+0000 7f0941d55700 1 --2- 172.21.15.69:0/4195380706 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f091c066f30 0x7f091c0693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.067+0000 7f0941d55700 1 --2- 172.21.15.69:0/4195380706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f093c159530 0x7f093c14c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.067+0000 7f0941d55700 1 --2- 172.21.15.69:0/4195380706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f093c06dc70 0x7f093c1535b0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.067+0000 7f0941d55700 1 --2- 172.21.15.69:0/4195380706 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f093c06e0e0 0x7f093c15d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.067+0000 7f0941d55700 1 -- 172.21.15.69:0/4195380706 >> 172.21.15.69:0/4195380706 conn(0x7f093c0703a0 msgr2=0x7f093c0d0ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:18.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.067+0000 7f0941d55700 1 -- 172.21.15.69:0/4195380706 shutdown_connections 2023-10-06T01:39:18.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.067+0000 7f0941d55700 1 -- 172.21.15.69:0/4195380706 wait complete. 2023-10-06T01:39:18.080 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:39:18.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.196+0000 7f053ec66700 1 Processor -- start 2023-10-06T01:39:18.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.197+0000 7f053ec66700 1 -- start start 2023-10-06T01:39:18.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.197+0000 7f053ec66700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0538150c80 0x7f05380ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:18.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.197+0000 7f053ec66700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f05380675a0 0x7f05380679e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:18.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.197+0000 7f053ec66700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05380cddf0 con 0x7f05381508b0 2023-10-06T01:39:18.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.197+0000 7f053ec66700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05380b0360 con 0x7f0538150c80 2023-10-06T01:39:18.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.197+0000 7f053ec66700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0538067f20 con 0x7f05380675a0 2023-10-06T01:39:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.198+0000 7f053ca02700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f05381508b0 0x7f05381573e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44830/0 (socket says 172.21.15.69:44830) 2023-10-06T01:39:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.198+0000 7f053ca02700 1 -- 172.21.15.69:0/163260218 learned_addr learned my addr 172.21.15.69:0/163260218 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.198+0000 7f0537fff700 1 --2- 172.21.15.69:0/163260218 >> v2:172.21.15.88:3300/0 conn(0x7f0538150c80 0x7f05380ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.198+0000 7f053d203700 1 --2- 172.21.15.69:0/163260218 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f05380675a0 0x7f05380679e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.198+0000 7f05377fe700 1 -- 172.21.15.69:0/163260218 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2163992650 0 0) 0x7f05380cddf0 con 0x7f05381508b0 2023-10-06T01:39:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.198+0000 7f05377fe700 1 -- 172.21.15.69:0/163260218 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0524003570 con 0x7f05381508b0 2023-10-06T01:39:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.198+0000 7f05377fe700 1 -- 172.21.15.69:0/163260218 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3624730582 0 0) 0x7f0524003570 con 0x7f05381508b0 2023-10-06T01:39:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.198+0000 7f05377fe700 1 -- 172.21.15.69:0/163260218 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f05380675a0 msgr2=0x7f05380679e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.198+0000 7f05377fe700 1 --2- 172.21.15.69:0/163260218 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f05380675a0 0x7f05380679e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.198+0000 7f05377fe700 1 -- 172.21.15.69:0/163260218 >> v2:172.21.15.88:3300/0 conn(0x7f0538150c80 msgr2=0x7f05380ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.198+0000 7f05377fe700 1 --2- 172.21.15.69:0/163260218 >> v2:172.21.15.88:3300/0 conn(0x7f0538150c80 0x7f05380ccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.198+0000 7f05377fe700 1 -- 172.21.15.69:0/163260218 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05380cd550 con 0x7f05381508b0 2023-10-06T01:39:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.198+0000 7f05377fe700 1 -- 172.21.15.69:0/163260218 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f05280017f0 con 0x7f05381508b0 2023-10-06T01:39:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.198+0000 7f0537fff700 1 --2- 172.21.15.69:0/163260218 >> v2:172.21.15.88:3300/0 conn(0x7f0538150c80 0x7f05380ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.198+0000 7f053d203700 1 --2- 172.21.15.69:0/163260218 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f05380675a0 0x7f05380679e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.198+0000 7f05377fe700 1 -- 172.21.15.69:0/163260218 >> v1:172.21.15.69:6789/0 conn(0x7f05381508b0 legacy=0x7f05381573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.198+0000 7f05377fe700 1 --2- 172.21.15.69:0/163260218 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0524003a60 0x7f0524003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.198+0000 7f05377fe700 1 --2- 172.21.15.69:0/163260218 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f05380675a0 0x7f0524004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.198+0000 7f05377fe700 1 --2- 172.21.15.69:0/163260218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0524004d50 0x7f05240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.198+0000 7f05377fe700 1 -- 172.21.15.69:0/163260218 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05380b0360 con 0x7f0524003a60 2023-10-06T01:39:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.198+0000 7f05377fe700 1 -- 172.21.15.69:0/163260218 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0538067f20 con 0x7f0524004d50 2023-10-06T01:39:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.198+0000 7f05377fe700 1 -- 172.21.15.69:0/163260218 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f052400ba60 con 0x7f05380675a0 2023-10-06T01:39:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.198+0000 7f053ca02700 1 --2- 172.21.15.69:0/163260218 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0524003a60 0x7f0524003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.198+0000 7f0537fff700 1 --2- 172.21.15.69:0/163260218 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f05380675a0 0x7f0524004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.198+0000 7f053d203700 1 --2- 172.21.15.69:0/163260218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0524004d50 0x7f05240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.199+0000 7f053ca02700 1 -- 172.21.15.69:0/163260218 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f05380675a0 msgr2=0x7f0524004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.199+0000 7f053ca02700 1 --2- 172.21.15.69:0/163260218 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f05380675a0 0x7f0524004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.199+0000 7f053ca02700 1 -- 172.21.15.69:0/163260218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0524004d50 msgr2=0x7f05240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.199+0000 7f053ca02700 1 --2- 172.21.15.69:0/163260218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0524004d50 0x7f05240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.199+0000 7f053ca02700 1 -- 172.21.15.69:0/163260218 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0530009420 con 0x7f0524003a60 2023-10-06T01:39:18.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.199+0000 7f053d203700 1 --2- 172.21.15.69:0/163260218 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0524004d50 0x7f05240051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:18.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.199+0000 7f053ca02700 1 --2- 172.21.15.69:0/163260218 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0524003a60 0x7f0524003e70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f052800a970 tx=0x7f05380b02d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e226ca70b8d1d021 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:18.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.199+0000 7f05377fe700 1 -- 172.21.15.69:0/163260218 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05280070d0 con 0x7f0524003a60 2023-10-06T01:39:18.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.199+0000 7f05377fe700 1 -- 172.21.15.69:0/163260218 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0528007270 con 0x7f0524003a60 2023-10-06T01:39:18.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.199+0000 7f05377fe700 1 -- 172.21.15.69:0/163260218 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0528007630 con 0x7f0524003a60 2023-10-06T01:39:18.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.199+0000 7f053ec66700 1 -- 172.21.15.69:0/163260218 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0524003a60 msgr2=0x7f0524003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:18.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.199+0000 7f053ec66700 1 --2- 172.21.15.69:0/163260218 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0524003a60 0x7f0524003e70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f052800a970 tx=0x7f05380b02d0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.199+0000 7f053d203700 1 -- 172.21.15.69:0/163260218 reap_dead start 2023-10-06T01:39:18.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.199+0000 7f053ec66700 1 -- 172.21.15.69:0/163260218 shutdown_connections 2023-10-06T01:39:18.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.199+0000 7f053ec66700 1 -- 172.21.15.69:0/163260218 >> 172.21.15.69:0/163260218 conn(0x7f053806d7b0 msgr2=0x7f053806dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:18.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.199+0000 7f053ec66700 1 -- 172.21.15.69:0/163260218 shutdown_connections 2023-10-06T01:39:18.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.199+0000 7f053ec66700 1 -- 172.21.15.69:0/163260218 wait complete. 2023-10-06T01:39:18.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.200+0000 7f053ec66700 1 Processor -- start 2023-10-06T01:39:18.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.201+0000 7f053ec66700 1 -- start start 2023-10-06T01:39:18.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.201+0000 7f053ec66700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0524003a60 0x7f053814f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:18.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.201+0000 7f053ec66700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f053816a760 0x7f0538154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:18.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.201+0000 7f053ec66700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f053816abd0 0x7f0538154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:18.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.201+0000 7f053ec66700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053814f9c0 con 0x7f053816abd0 2023-10-06T01:39:18.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.201+0000 7f053ec66700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05380b1cc0 con 0x7f0524003a60 2023-10-06T01:39:18.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.201+0000 7f053ec66700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05380b10b0 con 0x7f053816a760 2023-10-06T01:39:18.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.202+0000 7f053d203700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f053816abd0 0x7f0538154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:18.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.202+0000 7f053d203700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f053816abd0 0x7f0538154b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52108/0 (socket says 172.21.15.69:52108) 2023-10-06T01:39:18.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.202+0000 7f053d203700 1 -- 172.21.15.69:0/1719387466 learned_addr learned my addr 172.21.15.69:0/1719387466 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:18.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.202+0000 7f053ca02700 1 --2- 172.21.15.69:0/1719387466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0524003a60 0x7f053814f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:18.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.202+0000 7f0537fff700 1 --2- 172.21.15.69:0/1719387466 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f053816a760 0x7f0538154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:18.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.202+0000 7f053d203700 1 -- 172.21.15.69:0/1719387466 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f053816a760 msgr2=0x7f0538154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.202+0000 7f053d203700 1 --2- 172.21.15.69:0/1719387466 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f053816a760 0x7f0538154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.202+0000 7f053d203700 1 -- 172.21.15.69:0/1719387466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0524003a60 msgr2=0x7f053814f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.202+0000 7f053d203700 1 --2- 172.21.15.69:0/1719387466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0524003a60 0x7f053814f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.202+0000 7f053d203700 1 -- 172.21.15.69:0/1719387466 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05380b1390 con 0x7f053816abd0 2023-10-06T01:39:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.202+0000 7f053d203700 1 --2- 172.21.15.69:0/1719387466 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f053816abd0 0x7f0538154b60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f05380b3490 tx=0x7f0530008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.202+0000 7f0534ff9700 1 -- 172.21.15.69:0/1719387466 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0530015670 con 0x7f053816abd0 2023-10-06T01:39:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.202+0000 7f0534ff9700 1 -- 172.21.15.69:0/1719387466 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05300157f0 con 0x7f053816abd0 2023-10-06T01:39:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.202+0000 7f0534ff9700 1 -- 172.21.15.69:0/1719387466 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0530015bb0 con 0x7f053816abd0 2023-10-06T01:39:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.202+0000 7f053ec66700 1 -- 172.21.15.69:0/1719387466 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05380b1670 con 0x7f053816abd0 2023-10-06T01:39:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.202+0000 7f053ec66700 1 -- 172.21.15.69:0/1719387466 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f053816a1a0 con 0x7f053816abd0 2023-10-06T01:39:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.203+0000 7f053ec66700 1 -- 172.21.15.69:0/1719387466 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f053804c3c0 con 0x7f053816abd0 2023-10-06T01:39:18.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.204+0000 7f0534ff9700 1 -- 172.21.15.69:0/1719387466 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f053001f410 con 0x7f053816abd0 2023-10-06T01:39:18.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.204+0000 7f0534ff9700 1 --2- 172.21.15.69:0/1719387466 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0518066f60 0x7f0518069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:18.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.204+0000 7f0534ff9700 1 -- 172.21.15.69:0/1719387466 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f05300845f0 con 0x7f053816abd0 2023-10-06T01:39:18.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.204+0000 7f053ca02700 1 --2- 172.21.15.69:0/1719387466 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0518066f60 0x7f0518069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:18.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.204+0000 7f053ca02700 1 --2- 172.21.15.69:0/1719387466 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0518066f60 0x7f0518069410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f052800a970 tx=0x7f0528016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:18.212 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.208+0000 7f0534ff9700 1 -- 172.21.15.69:0/1719387466 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0530051700 con 0x7f053816abd0 2023-10-06T01:39:18.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.390+0000 7f053ec66700 1 -- 172.21.15.69:0/1719387466 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f05380cd830 con 0x7f053816abd0 2023-10-06T01:39:18.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.390+0000 7f0534ff9700 1 -- 172.21.15.69:0/1719387466 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0530054d20 con 0x7f053816abd0 2023-10-06T01:39:18.392 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 8 2023-10-06T01:39:18.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.392+0000 7f053ec66700 1 -- 172.21.15.69:0/1719387466 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0518066f60 msgr2=0x7f0518069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:18.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.392+0000 7f053ec66700 1 --2- 172.21.15.69:0/1719387466 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0518066f60 0x7f0518069410 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f052800a970 tx=0x7f0528016000 comp rx=0 tx=0).stop 2023-10-06T01:39:18.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.392+0000 7f053ec66700 1 -- 172.21.15.69:0/1719387466 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f053816abd0 msgr2=0x7f0538154b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:18.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.392+0000 7f053ec66700 1 --2- 172.21.15.69:0/1719387466 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f053816abd0 0x7f0538154b60 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f05380b3490 tx=0x7f0530008040 comp rx=0 tx=0).stop 2023-10-06T01:39:18.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.393+0000 7f053ec66700 1 -- 172.21.15.69:0/1719387466 shutdown_connections 2023-10-06T01:39:18.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.393+0000 7f053ec66700 1 --2- 172.21.15.69:0/1719387466 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0518066f60 0x7f0518069410 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.393+0000 7f053ec66700 1 --2- 172.21.15.69:0/1719387466 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f053816abd0 0x7f0538154b60 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.393+0000 7f053ec66700 1 --2- 172.21.15.69:0/1719387466 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0524003a60 0x7f053814f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.393+0000 7f053ec66700 1 --2- 172.21.15.69:0/1719387466 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f053816a760 0x7f0538154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.393+0000 7f053ec66700 1 -- 172.21.15.69:0/1719387466 >> 172.21.15.69:0/1719387466 conn(0x7f053806d7b0 msgr2=0x7f05380cc440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:18.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.393+0000 7f053ec66700 1 -- 172.21.15.69:0/1719387466 shutdown_connections 2023-10-06T01:39:18.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.393+0000 7f053ec66700 1 -- 172.21.15.69:0/1719387466 wait complete. 2023-10-06T01:39:18.406 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T01:39:18.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.523+0000 7f6e7759e700 1 Processor -- start 2023-10-06T01:39:18.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.523+0000 7f6e7759e700 1 -- start start 2023-10-06T01:39:18.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.523+0000 7f6e7759e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f6e780caec0 0x7f6e7815a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:18.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.523+0000 7f6e7759e700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e7815ada0 con 0x7f6e78153c90 2023-10-06T01:39:18.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.524+0000 7f6e7759e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e7806ca80 con 0x7f6e7806db20 2023-10-06T01:39:18.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.524+0000 7f6e7759e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e7806cd60 con 0x7f6e780caec0 2023-10-06T01:39:18.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.524+0000 7f6e7659c700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f6e78153c90 0x7f6e780ca7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44846/0 (socket says 172.21.15.69:44846) 2023-10-06T01:39:18.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.524+0000 7f6e7659c700 1 -- 172.21.15.69:0/2286773722 learned_addr learned my addr 172.21.15.69:0/2286773722 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:18.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.524+0000 7f6e76d9d700 1 --2- 172.21.15.69:0/2286773722 >> v2:172.21.15.88:3300/0 conn(0x7f6e780caec0 0x7f6e7815a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:18.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.524+0000 7f6e75d9b700 1 -- 172.21.15.69:0/2286773722 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2743194541 0 0) 0x7f6e68001110 con 0x7f6e78153c90 2023-10-06T01:39:18.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.524+0000 7f6e75d9b700 1 -- 172.21.15.69:0/2286773722 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e64003570 con 0x7f6e78153c90 2023-10-06T01:39:18.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.524+0000 7f6e75d9b700 1 -- 172.21.15.69:0/2286773722 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3153790153 0 0) 0x7f6e7806ca80 con 0x7f6e7806db20 2023-10-06T01:39:18.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.524+0000 7f6e75d9b700 1 -- 172.21.15.69:0/2286773722 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e68001110 con 0x7f6e7806db20 2023-10-06T01:39:18.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.524+0000 7f6e75d9b700 1 -- 172.21.15.69:0/2286773722 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3008103483 0 0) 0x7f6e64003570 con 0x7f6e78153c90 2023-10-06T01:39:18.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.524+0000 7f6e76d9d700 1 -- 172.21.15.69:0/2286773722 >> v1:172.21.15.88:6789/0 conn(0x7f6e7806db20 legacy=0x7f6e7815afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:18.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.524+0000 7f6e76d9d700 1 -- 172.21.15.69:0/2286773722 >> v1:172.21.15.69:6789/0 conn(0x7f6e78153c90 legacy=0x7f6e780ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:18.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.524+0000 7f6e76d9d700 1 -- 172.21.15.69:0/2286773722 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e7806d040 con 0x7f6e780caec0 2023-10-06T01:39:18.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.524+0000 7f6e76d9d700 1 --2- 172.21.15.69:0/2286773722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e780caec0 0x7f6e7815a860 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6e70009e60 tx=0x7f6e70009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99193ce12b756645 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:18.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.524+0000 7f6e75d9b700 1 -- 172.21.15.69:0/2286773722 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7000e070 con 0x7f6e780caec0 2023-10-06T01:39:18.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.525+0000 7f6e75d9b700 1 -- 172.21.15.69:0/2286773722 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7000b7a0 con 0x7f6e780caec0 2023-10-06T01:39:18.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.525+0000 7f6e75d9b700 1 -- 172.21.15.69:0/2286773722 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e68001600 con 0x7f6e780caec0 2023-10-06T01:39:18.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.525+0000 7f6e7759e700 1 -- 172.21.15.69:0/2286773722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e780caec0 msgr2=0x7f6e7815a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:18.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.525+0000 7f6e7759e700 1 --2- 172.21.15.69:0/2286773722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e780caec0 0x7f6e7815a860 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6e70009e60 tx=0x7f6e70009780 comp rx=0 tx=0).stop 2023-10-06T01:39:18.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.525+0000 7f6e7759e700 1 -- 172.21.15.69:0/2286773722 shutdown_connections 2023-10-06T01:39:18.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.525+0000 7f6e7759e700 1 --2- 172.21.15.69:0/2286773722 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e780caec0 0x7f6e7815a860 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.525+0000 7f6e7759e700 1 -- 172.21.15.69:0/2286773722 >> 172.21.15.69:0/2286773722 conn(0x7f6e7806e720 msgr2=0x7f6e7806eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:18.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.525+0000 7f6e7759e700 1 -- 172.21.15.69:0/2286773722 shutdown_connections 2023-10-06T01:39:18.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.525+0000 7f6e7759e700 1 -- 172.21.15.69:0/2286773722 wait complete. 2023-10-06T01:39:18.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.526+0000 7f6e7759e700 1 Processor -- start 2023-10-06T01:39:18.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.526+0000 7f6e7759e700 1 -- start start 2023-10-06T01:39:18.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.527+0000 7f6e7759e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e7806db20 0x7f6e780c5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:18.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.527+0000 7f6e7759e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e780caec0 0x7f6e780c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:18.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.527+0000 7f6e7759e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e78153c90 0x7f6e780c8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:18.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.527+0000 7f6e7759e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e780c4b50 con 0x7f6e78153c90 2023-10-06T01:39:18.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.527+0000 7f6e7759e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e780c5690 con 0x7f6e7806db20 2023-10-06T01:39:18.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.527+0000 7f6e7759e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e780c8050 con 0x7f6e780caec0 2023-10-06T01:39:18.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.527+0000 7f6e76d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e78153c90 0x7f6e780c8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:18.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.527+0000 7f6e76d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e78153c90 0x7f6e780c8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52120/0 (socket says 172.21.15.69:52120) 2023-10-06T01:39:18.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.527+0000 7f6e76d9d700 1 -- 172.21.15.69:0/4196403737 learned_addr learned my addr 172.21.15.69:0/4196403737 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:18.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.527+0000 7f6e7659c700 1 --2- 172.21.15.69:0/4196403737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e7806db20 0x7f6e780c5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:18.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.527+0000 7f6e6dd9b700 1 --2- 172.21.15.69:0/4196403737 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e780caec0 0x7f6e780c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:18.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.527+0000 7f6e76d9d700 1 -- 172.21.15.69:0/4196403737 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e780caec0 msgr2=0x7f6e780c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:18.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.527+0000 7f6e76d9d700 1 --2- 172.21.15.69:0/4196403737 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e780caec0 0x7f6e780c79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.527+0000 7f6e76d9d700 1 -- 172.21.15.69:0/4196403737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e7806db20 msgr2=0x7f6e780c5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:18.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.527+0000 7f6e76d9d700 1 --2- 172.21.15.69:0/4196403737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e7806db20 0x7f6e780c5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.527+0000 7f6e76d9d700 1 -- 172.21.15.69:0/4196403737 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e70009a20 con 0x7f6e78153c90 2023-10-06T01:39:18.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.527+0000 7f6e6dd9b700 1 --2- 172.21.15.69:0/4196403737 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e780caec0 0x7f6e780c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:18.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.528+0000 7f6e76d9d700 1 --2- 172.21.15.69:0/4196403737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e78153c90 0x7f6e780c8da0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6e700097c0 tx=0x7f6e70017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:18.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.528+0000 7f6e6effd700 1 -- 172.21.15.69:0/4196403737 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e70012cb0 con 0x7f6e78153c90 2023-10-06T01:39:18.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.528+0000 7f6e6effd700 1 -- 172.21.15.69:0/4196403737 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e70012e10 con 0x7f6e78153c90 2023-10-06T01:39:18.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.528+0000 7f6e7759e700 1 -- 172.21.15.69:0/4196403737 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e780c92e0 con 0x7f6e78153c90 2023-10-06T01:39:18.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.528+0000 7f6e6effd700 1 -- 172.21.15.69:0/4196403737 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7001e680 con 0x7f6e78153c90 2023-10-06T01:39:18.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.528+0000 7f6e7759e700 1 -- 172.21.15.69:0/4196403737 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e780c50c0 con 0x7f6e78153c90 2023-10-06T01:39:18.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.529+0000 7f6e6effd700 1 -- 172.21.15.69:0/4196403737 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e7001e9f0 con 0x7f6e78153c90 2023-10-06T01:39:18.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.529+0000 7f6e7759e700 1 -- 172.21.15.69:0/4196403737 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e780c5840 con 0x7f6e78153c90 2023-10-06T01:39:18.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.529+0000 7f6e6effd700 1 --2- 172.21.15.69:0/4196403737 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6e58066f30 0x7f6e580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:18.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.530+0000 7f6e6effd700 1 -- 172.21.15.69:0/4196403737 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6e70086a70 con 0x7f6e78153c90 2023-10-06T01:39:18.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.530+0000 7f6e7659c700 1 --2- 172.21.15.69:0/4196403737 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6e58066f30 0x7f6e580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:18.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.530+0000 7f6e7659c700 1 --2- 172.21.15.69:0/4196403737 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6e58066f30 0x7f6e580693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6e680010e0 tx=0x7f6e68001330 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:18.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.534+0000 7f6e6effd700 1 -- 172.21.15.69:0/4196403737 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e780c5840 con 0x7f6e78153c90 2023-10-06T01:39:18.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.714+0000 7f6e7759e700 1 -- 172.21.15.69:0/4196403737 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6e780c5840 con 0x7f6e78153c90 2023-10-06T01:39:18.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.714+0000 7f6e6effd700 1 -- 172.21.15.69:0/4196403737 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6e780c5840 con 0x7f6e78153c90 2023-10-06T01:39:18.716 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-10-06T01:39:18.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.716+0000 7f6e7759e700 1 -- 172.21.15.69:0/4196403737 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6e58066f30 msgr2=0x7f6e580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:18.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.716+0000 7f6e7759e700 1 --2- 172.21.15.69:0/4196403737 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6e58066f30 0x7f6e580693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6e680010e0 tx=0x7f6e68001330 comp rx=0 tx=0).stop 2023-10-06T01:39:18.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.716+0000 7f6e7759e700 1 -- 172.21.15.69:0/4196403737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e78153c90 msgr2=0x7f6e780c8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:18.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.716+0000 7f6e7759e700 1 --2- 172.21.15.69:0/4196403737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e78153c90 0x7f6e780c8da0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6e700097c0 tx=0x7f6e70017000 comp rx=0 tx=0).stop 2023-10-06T01:39:18.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.716+0000 7f6e7759e700 1 -- 172.21.15.69:0/4196403737 shutdown_connections 2023-10-06T01:39:18.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.716+0000 7f6e7759e700 1 --2- 172.21.15.69:0/4196403737 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6e58066f30 0x7f6e580693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.716+0000 7f6e7759e700 1 --2- 172.21.15.69:0/4196403737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6e78153c90 0x7f6e780c8da0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.716+0000 7f6e7759e700 1 --2- 172.21.15.69:0/4196403737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6e7806db20 0x7f6e780c5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.716+0000 7f6e7759e700 1 --2- 172.21.15.69:0/4196403737 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6e780caec0 0x7f6e780c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.716+0000 7f6e7759e700 1 -- 172.21.15.69:0/4196403737 >> 172.21.15.69:0/4196403737 conn(0x7f6e7806e720 msgr2=0x7f6e78153090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:18.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.716+0000 7f6e7759e700 1 -- 172.21.15.69:0/4196403737 shutdown_connections 2023-10-06T01:39:18.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.716+0000 7f6e7759e700 1 -- 172.21.15.69:0/4196403737 wait complete. 2023-10-06T01:39:18.729 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T01:39:18.746 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:39:18.774 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:39:18.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.848+0000 7f8d61ab0700 1 Processor -- start 2023-10-06T01:39:18.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.848+0000 7f8d61ab0700 1 -- start start 2023-10-06T01:39:18.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.849+0000 7f8d61ab0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8d5c0ce220 0x7f8d5c0cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:18.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.849+0000 7f8d61ab0700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d5c0cf510 con 0x7f8d5c0ccfa0 2023-10-06T01:39:18.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.849+0000 7f8d61ab0700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d5c0ce6a0 con 0x7f8d5c159860 2023-10-06T01:39:18.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.849+0000 7f8d61ab0700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d5c0d00b0 con 0x7f8d5c0ce220 2023-10-06T01:39:18.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.849+0000 7f8d5bfff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f8d5c0ccfa0 0x7f8d5c0cd400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44858/0 (socket says 172.21.15.69:44858) 2023-10-06T01:39:18.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.849+0000 7f8d5bfff700 1 -- 172.21.15.69:0/600446668 learned_addr learned my addr 172.21.15.69:0/600446668 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:18.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.850+0000 7f8d5affd700 1 --2- 172.21.15.69:0/600446668 >> v2:172.21.15.88:3300/0 conn(0x7f8d5c0ce220 0x7f8d5c0cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:18.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.850+0000 7f8d5a7fc700 1 -- 172.21.15.69:0/600446668 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1975601269 0 0) 0x7f8d5c0cf510 con 0x7f8d5c0ccfa0 2023-10-06T01:39:18.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.850+0000 7f8d5a7fc700 1 -- 172.21.15.69:0/600446668 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d44003570 con 0x7f8d5c0ccfa0 2023-10-06T01:39:18.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.850+0000 7f8d5a7fc700 1 -- 172.21.15.69:0/600446668 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 408188990 0 0) 0x7f8d44003570 con 0x7f8d5c0ccfa0 2023-10-06T01:39:18.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.850+0000 7f8d5a7fc700 1 -- 172.21.15.69:0/600446668 >> v2:172.21.15.88:3300/0 conn(0x7f8d5c0ce220 msgr2=0x7f8d5c0cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:18.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.850+0000 7f8d5a7fc700 1 --2- 172.21.15.69:0/600446668 >> v2:172.21.15.88:3300/0 conn(0x7f8d5c0ce220 0x7f8d5c0cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.850+0000 7f8d5a7fc700 1 -- 172.21.15.69:0/600446668 >> v1:172.21.15.88:6789/0 conn(0x7f8d5c159860 legacy=0x7f8d5c0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:18.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.850+0000 7f8d5a7fc700 1 -- 172.21.15.69:0/600446668 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5c0ce900 con 0x7f8d5c0ccfa0 2023-10-06T01:39:18.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.850+0000 7f8d5a7fc700 1 -- 172.21.15.69:0/600446668 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f8d54001470 con 0x7f8d5c0ccfa0 2023-10-06T01:39:18.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.850+0000 7f8d5a7fc700 1 -- 172.21.15.69:0/600446668 >> v1:172.21.15.69:6789/0 conn(0x7f8d5c0ccfa0 legacy=0x7f8d5c0cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:18.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.850+0000 7f8d5a7fc700 1 --2- 172.21.15.69:0/600446668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d44003a60 0x7f8d44003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:18.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.850+0000 7f8d5a7fc700 1 --2- 172.21.15.69:0/600446668 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d44004810 0x7f8d44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:18.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.850+0000 7f8d5a7fc700 1 --2- 172.21.15.69:0/600446668 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d440051c0 0x7f8d4400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:18.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.850+0000 7f8d5a7fc700 1 -- 172.21.15.69:0/600446668 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c0d00b0 con 0x7f8d44004810 2023-10-06T01:39:18.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.850+0000 7f8d5a7fc700 1 -- 172.21.15.69:0/600446668 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4400c0d0 con 0x7f8d44003a60 2023-10-06T01:39:18.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.850+0000 7f8d5a7fc700 1 -- 172.21.15.69:0/600446668 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d4400c290 con 0x7f8d440051c0 2023-10-06T01:39:18.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.850+0000 7f8d5affd700 1 --2- 172.21.15.69:0/600446668 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d44004810 0x7f8d44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:18.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.850+0000 7f8d5b7fe700 1 --2- 172.21.15.69:0/600446668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d44003a60 0x7f8d44003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:18.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.850+0000 7f8d5bfff700 1 --2- 172.21.15.69:0/600446668 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d440051c0 0x7f8d4400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:18.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.850+0000 7f8d5affd700 1 -- 172.21.15.69:0/600446668 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d440051c0 msgr2=0x7f8d4400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:18.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.850+0000 7f8d5affd700 1 --2- 172.21.15.69:0/600446668 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d440051c0 0x7f8d4400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.850+0000 7f8d5affd700 1 -- 172.21.15.69:0/600446668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d44003a60 msgr2=0x7f8d44003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:18.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.850+0000 7f8d5affd700 1 --2- 172.21.15.69:0/600446668 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d44003a60 0x7f8d44003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.850+0000 7f8d5affd700 1 -- 172.21.15.69:0/600446668 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d44003570 con 0x7f8d44004810 2023-10-06T01:39:18.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.850+0000 7f8d5bfff700 1 -- 172.21.15.69:0/600446668 reap_dead start 2023-10-06T01:39:18.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.851+0000 7f8d5affd700 1 --2- 172.21.15.69:0/600446668 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d44004810 0x7f8d44004c80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8d50009bf0 tx=0x7f8d50009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f25bec7d18bec9a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:18.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.851+0000 7f8d5a7fc700 1 -- 172.21.15.69:0/600446668 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d50005a00 con 0x7f8d44004810 2023-10-06T01:39:18.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.851+0000 7f8d5a7fc700 1 -- 172.21.15.69:0/600446668 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d50005b60 con 0x7f8d44004810 2023-10-06T01:39:18.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.851+0000 7f8d5a7fc700 1 -- 172.21.15.69:0/600446668 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d5000e710 con 0x7f8d44004810 2023-10-06T01:39:18.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.851+0000 7f8d61ab0700 1 -- 172.21.15.69:0/600446668 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d44004810 msgr2=0x7f8d44004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:18.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.851+0000 7f8d61ab0700 1 --2- 172.21.15.69:0/600446668 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d44004810 0x7f8d44004c80 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8d50009bf0 tx=0x7f8d50009120 comp rx=0 tx=0).stop 2023-10-06T01:39:18.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.851+0000 7f8d61ab0700 1 -- 172.21.15.69:0/600446668 shutdown_connections 2023-10-06T01:39:18.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.851+0000 7f8d61ab0700 1 --2- 172.21.15.69:0/600446668 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d44004810 0x7f8d44004c80 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.851+0000 7f8d61ab0700 1 -- 172.21.15.69:0/600446668 >> 172.21.15.69:0/600446668 conn(0x7f8d5c0999b0 msgr2=0x7f8d5c070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:18.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.851+0000 7f8d61ab0700 1 -- 172.21.15.69:0/600446668 shutdown_connections 2023-10-06T01:39:18.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.851+0000 7f8d61ab0700 1 -- 172.21.15.69:0/600446668 wait complete. 2023-10-06T01:39:18.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.852+0000 7f8d61ab0700 1 Processor -- start 2023-10-06T01:39:18.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.852+0000 7f8d61ab0700 1 -- start start 2023-10-06T01:39:18.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.853+0000 7f8d61ab0700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d44004810 0x7f8d5c14bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:18.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.853+0000 7f8d61ab0700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d5c16c730 0x7f8d5c16acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:18.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.853+0000 7f8d61ab0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d5c16b1f0 0x7f8d5c0c5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:18.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.853+0000 7f8d61ab0700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c16c2a0 con 0x7f8d5c16b1f0 2023-10-06T01:39:18.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.853+0000 7f8d61ab0700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c16b690 con 0x7f8d44004810 2023-10-06T01:39:18.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.853+0000 7f8d61ab0700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5c16b970 con 0x7f8d5c16c730 2023-10-06T01:39:18.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.853+0000 7f8d5bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d5c16b1f0 0x7f8d5c0c5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:18.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.853+0000 7f8d5bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d5c16b1f0 0x7f8d5c0c5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52148/0 (socket says 172.21.15.69:52148) 2023-10-06T01:39:18.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.853+0000 7f8d5bfff700 1 -- 172.21.15.69:0/1076838961 learned_addr learned my addr 172.21.15.69:0/1076838961 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:18.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.853+0000 7f8d5affd700 1 --2- 172.21.15.69:0/1076838961 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d5c16c730 0x7f8d5c16acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:18.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.853+0000 7f8d5b7fe700 1 --2- 172.21.15.69:0/1076838961 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d44004810 0x7f8d5c14bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:18.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.853+0000 7f8d5bfff700 1 -- 172.21.15.69:0/1076838961 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d5c16c730 msgr2=0x7f8d5c16acb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:18.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.853+0000 7f8d5bfff700 1 --2- 172.21.15.69:0/1076838961 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d5c16c730 0x7f8d5c16acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.853+0000 7f8d5bfff700 1 -- 172.21.15.69:0/1076838961 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d44004810 msgr2=0x7f8d5c14bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:18.866 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.853+0000 7f8d5bfff700 1 --2- 172.21.15.69:0/1076838961 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d44004810 0x7f8d5c14bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:18.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.854+0000 7f8d5bfff700 1 -- 172.21.15.69:0/1076838961 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d5c16bc50 con 0x7f8d5c16b1f0 2023-10-06T01:39:18.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.854+0000 7f8d5bfff700 1 --2- 172.21.15.69:0/1076838961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d5c16b1f0 0x7f8d5c0c5100 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c06c760 tx=0x7f8d54000c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:18.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.854+0000 7f8d437fe700 1 -- 172.21.15.69:0/1076838961 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d54012590 con 0x7f8d5c16b1f0 2023-10-06T01:39:18.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.854+0000 7f8d437fe700 1 -- 172.21.15.69:0/1076838961 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d54012710 con 0x7f8d5c16b1f0 2023-10-06T01:39:18.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.854+0000 7f8d61ab0700 1 -- 172.21.15.69:0/1076838961 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d5c16bf30 con 0x7f8d5c16b1f0 2023-10-06T01:39:18.867 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.854+0000 7f8d437fe700 1 -- 172.21.15.69:0/1076838961 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d54012ad0 con 0x7f8d5c16b1f0 2023-10-06T01:39:18.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.854+0000 7f8d61ab0700 1 -- 172.21.15.69:0/1076838961 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d5c0ad9c0 con 0x7f8d5c16b1f0 2023-10-06T01:39:18.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.855+0000 7f8d61ab0700 1 -- 172.21.15.69:0/1076838961 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d5c16c410 con 0x7f8d5c16b1f0 2023-10-06T01:39:18.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.855+0000 7f8d437fe700 1 -- 172.21.15.69:0/1076838961 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d5401d460 con 0x7f8d5c16b1f0 2023-10-06T01:39:18.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.856+0000 7f8d437fe700 1 --2- 172.21.15.69:0/1076838961 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8d48066f30 0x7f8d480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:18.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.856+0000 7f8d437fe700 1 -- 172.21.15.69:0/1076838961 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8d54084430 con 0x7f8d5c16b1f0 2023-10-06T01:39:18.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.856+0000 7f8d5b7fe700 1 --2- 172.21.15.69:0/1076838961 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8d48066f30 0x7f8d480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:18.868 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.856+0000 7f8d5b7fe700 1 --2- 172.21.15.69:0/1076838961 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8d48066f30 0x7f8d480693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c000f80 tx=0x7f8d4c001a70 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:18.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:18.860+0000 7f8d437fe700 1 -- 172.21.15.69:0/1076838961 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d54051540 con 0x7f8d5c16b1f0 2023-10-06T01:39:19.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.043+0000 7f8d61ab0700 1 -- 172.21.15.69:0/1076838961 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8d5c04c3c0 con 0x7f8d5c16b1f0 2023-10-06T01:39:19.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.043+0000 7f8d437fe700 1 -- 172.21.15.69:0/1076838961 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8d54054b60 con 0x7f8d5c16b1f0 2023-10-06T01:39:19.047 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-10-06T01:39:19.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.045+0000 7f8d61ab0700 1 -- 172.21.15.69:0/1076838961 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8d48066f30 msgr2=0x7f8d480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:19.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.045+0000 7f8d61ab0700 1 --2- 172.21.15.69:0/1076838961 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8d48066f30 0x7f8d480693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8d4c000f80 tx=0x7f8d4c001a70 comp rx=0 tx=0).stop 2023-10-06T01:39:19.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.045+0000 7f8d61ab0700 1 -- 172.21.15.69:0/1076838961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d5c16b1f0 msgr2=0x7f8d5c0c5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:19.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.045+0000 7f8d61ab0700 1 --2- 172.21.15.69:0/1076838961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d5c16b1f0 0x7f8d5c0c5100 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c06c760 tx=0x7f8d54000c30 comp rx=0 tx=0).stop 2023-10-06T01:39:19.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.045+0000 7f8d61ab0700 1 -- 172.21.15.69:0/1076838961 shutdown_connections 2023-10-06T01:39:19.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.045+0000 7f8d61ab0700 1 --2- 172.21.15.69:0/1076838961 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8d48066f30 0x7f8d480693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.045+0000 7f8d61ab0700 1 --2- 172.21.15.69:0/1076838961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d5c16b1f0 0x7f8d5c0c5100 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.045+0000 7f8d61ab0700 1 --2- 172.21.15.69:0/1076838961 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8d44004810 0x7f8d5c14bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.045+0000 7f8d61ab0700 1 --2- 172.21.15.69:0/1076838961 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8d5c16c730 0x7f8d5c16acb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.045+0000 7f8d61ab0700 1 -- 172.21.15.69:0/1076838961 >> 172.21.15.69:0/1076838961 conn(0x7f8d5c0999b0 msgr2=0x7f8d5c06f120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:19.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.045+0000 7f8d61ab0700 1 -- 172.21.15.69:0/1076838961 shutdown_connections 2023-10-06T01:39:19.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.045+0000 7f8d61ab0700 1 -- 172.21.15.69:0/1076838961 wait complete. 2023-10-06T01:39:19.059 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:39:19.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.212+0000 7f5c44f4c700 1 Processor -- start 2023-10-06T01:39:19.213 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.212+0000 7f5c44f4c700 1 -- start start 2023-10-06T01:39:19.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.213+0000 7f5c44f4c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5c400cb5a0 0x7f5c400cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:19.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.213+0000 7f5c44f4c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5c400cd9e0 0x7f5c40159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:19.215 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.213+0000 7f5c44f4c700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c4015ae40 con 0x7f5c400cde50 2023-10-06T01:39:19.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.213+0000 7f5c44f4c700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c400d13f0 con 0x7f5c400cd9e0 2023-10-06T01:39:19.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.213+0000 7f5c44f4c700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4015ab60 con 0x7f5c400cb5a0 2023-10-06T01:39:19.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.213+0000 7f5c35d9b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5c400cd9e0 0x7f5c40159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:19.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.213+0000 7f5c35d9b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5c400cd9e0 0x7f5c40159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52158/0 (socket says 172.21.15.69:52158) 2023-10-06T01:39:19.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.213+0000 7f5c35d9b700 1 -- 172.21.15.69:0/3799569092 learned_addr learned my addr 172.21.15.69:0/3799569092 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:19.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.213+0000 7f5c3e59c700 1 --2- 172.21.15.69:0/3799569092 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5c400cb5a0 0x7f5c400cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:19.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.213+0000 7f5c35d9b700 1 -- 172.21.15.69:0/3799569092 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5c400cb5a0 msgr2=0x7f5c400cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:19.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.213+0000 7f5c35d9b700 1 --2- 172.21.15.69:0/3799569092 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5c400cb5a0 0x7f5c400cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.213+0000 7f5c35d9b700 1 -- 172.21.15.69:0/3799569092 >> v1:172.21.15.69:6789/0 conn(0x7f5c400cde50 legacy=0x7f5c40156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:19.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.213+0000 7f5c35d9b700 1 -- 172.21.15.69:0/3799569092 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c400ccf00 con 0x7f5c400cd9e0 2023-10-06T01:39:19.216 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.213+0000 7f5c3dd9b700 1 -- 172.21.15.69:0/3799569092 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2425736446 0 0) 0x7f5c4015ae40 con 0x7f5c400cde50 2023-10-06T01:39:19.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.213+0000 7f5c35d9b700 1 --2- 172.21.15.69:0/3799569092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c400cd9e0 0x7f5c40159ec0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5c280099b0 tx=0x7f5c28009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dbb3865e5fbe63a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:19.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.213+0000 7f5c3dd9b700 1 -- 172.21.15.69:0/3799569092 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2800b860 con 0x7f5c400cd9e0 2023-10-06T01:39:19.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.213+0000 7f5c3dd9b700 1 -- 172.21.15.69:0/3799569092 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c2800b9c0 con 0x7f5c400cd9e0 2023-10-06T01:39:19.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.213+0000 7f5c3dd9b700 1 -- 172.21.15.69:0/3799569092 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c2800bd60 con 0x7f5c400cd9e0 2023-10-06T01:39:19.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.214+0000 7f5c44f4c700 1 -- 172.21.15.69:0/3799569092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c400cd9e0 msgr2=0x7f5c40159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:19.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.214+0000 7f5c44f4c700 1 --2- 172.21.15.69:0/3799569092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c400cd9e0 0x7f5c40159ec0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f5c280099b0 tx=0x7f5c28009250 comp rx=0 tx=0).stop 2023-10-06T01:39:19.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.214+0000 7f5c44f4c700 1 -- 172.21.15.69:0/3799569092 shutdown_connections 2023-10-06T01:39:19.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.214+0000 7f5c44f4c700 1 --2- 172.21.15.69:0/3799569092 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5c400cb5a0 0x7f5c400cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.214+0000 7f5c44f4c700 1 --2- 172.21.15.69:0/3799569092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c400cd9e0 0x7f5c40159ec0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.214+0000 7f5c44f4c700 1 -- 172.21.15.69:0/3799569092 >> 172.21.15.69:0/3799569092 conn(0x7f5c40070e30 msgr2=0x7f5c400d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:19.217 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.214+0000 7f5c44f4c700 1 -- 172.21.15.69:0/3799569092 shutdown_connections 2023-10-06T01:39:19.218 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.214+0000 7f5c44f4c700 1 -- 172.21.15.69:0/3799569092 wait complete. 2023-10-06T01:39:19.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.215+0000 7f5c44f4c700 1 Processor -- start 2023-10-06T01:39:19.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.215+0000 7f5c44f4c700 1 -- start start 2023-10-06T01:39:19.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.216+0000 7f5c44f4c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c400cb5a0 0x7f5c4015a290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:19.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.216+0000 7f5c44f4c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5c400cd9e0 0x7f5c40155c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:19.220 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.216+0000 7f5c44f4c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c40156140 0x7f5c400c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:19.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.216+0000 7f5c44f4c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c4015a7d0 con 0x7f5c400cb5a0 2023-10-06T01:39:19.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.216+0000 7f5c44f4c700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c400b5f40 con 0x7f5c40156140 2023-10-06T01:39:19.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.216+0000 7f5c44f4c700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c400b5090 con 0x7f5c400cd9e0 2023-10-06T01:39:19.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.216+0000 7f5c3e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c400cb5a0 0x7f5c4015a290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:19.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.216+0000 7f5c3e59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c400cb5a0 0x7f5c4015a290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52168/0 (socket says 172.21.15.69:52168) 2023-10-06T01:39:19.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.216+0000 7f5c3e59c700 1 -- 172.21.15.69:0/3497971719 learned_addr learned my addr 172.21.15.69:0/3497971719 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:19.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.216+0000 7f5c35d9b700 1 --2- 172.21.15.69:0/3497971719 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5c400cd9e0 0x7f5c40155c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:19.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.216+0000 7f5c3ed9d700 1 --2- 172.21.15.69:0/3497971719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c40156140 0x7f5c400c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:19.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.216+0000 7f5c3e59c700 1 -- 172.21.15.69:0/3497971719 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5c400cd9e0 msgr2=0x7f5c40155c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:19.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.216+0000 7f5c3e59c700 1 --2- 172.21.15.69:0/3497971719 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5c400cd9e0 0x7f5c40155c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.216+0000 7f5c3e59c700 1 -- 172.21.15.69:0/3497971719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c40156140 msgr2=0x7f5c400c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:19.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.216+0000 7f5c3e59c700 1 --2- 172.21.15.69:0/3497971719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c40156140 0x7f5c400c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.216+0000 7f5c3e59c700 1 -- 172.21.15.69:0/3497971719 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c280094f0 con 0x7f5c400cb5a0 2023-10-06T01:39:19.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.216+0000 7f5c35d9b700 1 --2- 172.21.15.69:0/3497971719 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5c400cd9e0 0x7f5c40155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:19.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.216+0000 7f5c3e59c700 1 --2- 172.21.15.69:0/3497971719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c400cb5a0 0x7f5c4015a290 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000d860 tx=0x7f5c30008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:19.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.217+0000 7f5c36ffd700 1 -- 172.21.15.69:0/3497971719 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c30009610 con 0x7f5c400cb5a0 2023-10-06T01:39:19.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.217+0000 7f5c36ffd700 1 -- 172.21.15.69:0/3497971719 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c30009770 con 0x7f5c400cb5a0 2023-10-06T01:39:19.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.217+0000 7f5c44f4c700 1 -- 172.21.15.69:0/3497971719 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c400b5330 con 0x7f5c400cb5a0 2023-10-06T01:39:19.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.217+0000 7f5c36ffd700 1 -- 172.21.15.69:0/3497971719 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c30009b30 con 0x7f5c400cb5a0 2023-10-06T01:39:19.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.217+0000 7f5c44f4c700 1 -- 172.21.15.69:0/3497971719 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c400b58f0 con 0x7f5c400cb5a0 2023-10-06T01:39:19.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.218+0000 7f5c44f4c700 1 -- 172.21.15.69:0/3497971719 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c40156540 con 0x7f5c400cb5a0 2023-10-06T01:39:19.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.218+0000 7f5c36ffd700 1 -- 172.21.15.69:0/3497971719 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5c3001e460 con 0x7f5c400cb5a0 2023-10-06T01:39:19.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.218+0000 7f5c36ffd700 1 --2- 172.21.15.69:0/3497971719 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5c20066f30 0x7f5c200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:19.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.218+0000 7f5c36ffd700 1 -- 172.21.15.69:0/3497971719 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5c30084d60 con 0x7f5c400cb5a0 2023-10-06T01:39:19.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.218+0000 7f5c35d9b700 1 --2- 172.21.15.69:0/3497971719 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5c20066f30 0x7f5c200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:19.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.219+0000 7f5c35d9b700 1 --2- 172.21.15.69:0/3497971719 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5c20066f30 0x7f5c200693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5c280099b0 tx=0x7f5c28017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:19.223 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.223+0000 7f5c36ffd700 1 -- 172.21.15.69:0/3497971719 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c30051dd0 con 0x7f5c400cb5a0 2023-10-06T01:39:19.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.406+0000 7f5c44f4c700 1 -- 172.21.15.69:0/3497971719 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5c4004c3c0 con 0x7f5c400cb5a0 2023-10-06T01:39:19.408 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.407+0000 7f5c36ffd700 1 -- 172.21.15.69:0/3497971719 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f5c300553f0 con 0x7f5c400cb5a0 2023-10-06T01:39:19.408 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:19.408 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":24,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:38:50.506861+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:38:43.046056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:38:47.525023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:38:47.992048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:39:19.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.408+0000 7f5c44f4c700 1 -- 172.21.15.69:0/3497971719 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5c20066f30 msgr2=0x7f5c200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:19.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.408+0000 7f5c44f4c700 1 --2- 172.21.15.69:0/3497971719 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5c20066f30 0x7f5c200693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5c280099b0 tx=0x7f5c28017000 comp rx=0 tx=0).stop 2023-10-06T01:39:19.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.408+0000 7f5c44f4c700 1 -- 172.21.15.69:0/3497971719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c400cb5a0 msgr2=0x7f5c4015a290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:19.410 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.408+0000 7f5c44f4c700 1 --2- 172.21.15.69:0/3497971719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c400cb5a0 0x7f5c4015a290 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f5c3000d860 tx=0x7f5c30008040 comp rx=0 tx=0).stop 2023-10-06T01:39:19.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.408+0000 7f5c44f4c700 1 -- 172.21.15.69:0/3497971719 shutdown_connections 2023-10-06T01:39:19.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.408+0000 7f5c44f4c700 1 --2- 172.21.15.69:0/3497971719 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5c20066f30 0x7f5c200693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.409+0000 7f5c44f4c700 1 --2- 172.21.15.69:0/3497971719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c40156140 0x7f5c400c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.409+0000 7f5c44f4c700 1 --2- 172.21.15.69:0/3497971719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c400cb5a0 0x7f5c4015a290 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.409+0000 7f5c44f4c700 1 --2- 172.21.15.69:0/3497971719 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5c400cd9e0 0x7f5c40155c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.409+0000 7f5c44f4c700 1 -- 172.21.15.69:0/3497971719 >> 172.21.15.69:0/3497971719 conn(0x7f5c40070e30 msgr2=0x7f5c400b0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:19.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.409+0000 7f5c44f4c700 1 -- 172.21.15.69:0/3497971719 shutdown_connections 2023-10-06T01:39:19.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.409+0000 7f5c44f4c700 1 -- 172.21.15.69:0/3497971719 wait complete. 2023-10-06T01:39:19.422 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:38:38.288642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:38:43.046056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T01:38:47.525023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T01:38:47.992048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T01:39:19.422 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:39:19.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.540+0000 7f2fe198e700 1 Processor -- start 2023-10-06T01:39:19.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.540+0000 7f2fe198e700 1 -- start start 2023-10-06T01:39:19.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.541+0000 7f2fe198e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2fdc0cdb70 0x7f2fdc164660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:19.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.541+0000 7f2fe198e700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fdc0c9310 con 0x7f2fdc1598c0 2023-10-06T01:39:19.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.541+0000 7f2fe198e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fdc0ce090 con 0x7f2fdc0c4580 2023-10-06T01:39:19.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.541+0000 7f2fe198e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc0ad990 con 0x7f2fdc0cdb70 2023-10-06T01:39:19.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.541+0000 7f2fdaffd700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f2fdc1598c0 0x7f2fdc0c3e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44874/0 (socket says 172.21.15.69:44874) 2023-10-06T01:39:19.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.541+0000 7f2fdaffd700 1 -- 172.21.15.69:0/2034022573 learned_addr learned my addr 172.21.15.69:0/2034022573 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:19.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.542+0000 7f2fdb7fe700 1 --2- 172.21.15.69:0/2034022573 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2fdc0cdb70 0x7f2fdc164660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:19.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.542+0000 7f2fd9ffb700 1 -- 172.21.15.69:0/2034022573 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2390491289 0 0) 0x7f2fdc0c9310 con 0x7f2fdc1598c0 2023-10-06T01:39:19.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.542+0000 7f2fd9ffb700 1 -- 172.21.15.69:0/2034022573 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fc4003570 con 0x7f2fdc1598c0 2023-10-06T01:39:19.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.542+0000 7f2fd9ffb700 1 -- 172.21.15.69:0/2034022573 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3319038464 0 0) 0x7f2fc4003570 con 0x7f2fdc1598c0 2023-10-06T01:39:19.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.542+0000 7f2fd9ffb700 1 -- 172.21.15.69:0/2034022573 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2fdc0cdb70 msgr2=0x7f2fdc164660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:19.546 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.542+0000 7f2fd9ffb700 1 --2- 172.21.15.69:0/2034022573 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2fdc0cdb70 0x7f2fdc164660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.542+0000 7f2fd9ffb700 1 -- 172.21.15.69:0/2034022573 >> v1:172.21.15.88:6789/0 conn(0x7f2fdc0c4580 legacy=0x7f2fdc0cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:19.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.542+0000 7f2fd9ffb700 1 -- 172.21.15.69:0/2034022573 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc0c8cc0 con 0x7f2fdc1598c0 2023-10-06T01:39:19.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.542+0000 7f2fd9ffb700 1 -- 172.21.15.69:0/2034022573 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f2fcc0017f0 con 0x7f2fdc1598c0 2023-10-06T01:39:19.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.542+0000 7f2fd9ffb700 1 -- 172.21.15.69:0/2034022573 >> v1:172.21.15.69:6789/0 conn(0x7f2fdc1598c0 legacy=0x7f2fdc0c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:19.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.542+0000 7f2fd9ffb700 1 --2- 172.21.15.69:0/2034022573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fc4003a90 0x7f2fc4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:19.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.542+0000 7f2fd9ffb700 1 --2- 172.21.15.69:0/2034022573 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2fdc0cdb70 0x7f2fc4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:19.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.542+0000 7f2fd9ffb700 1 --2- 172.21.15.69:0/2034022573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fc4004d50 0x7f2fc40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:19.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.542+0000 7f2fd9ffb700 1 -- 172.21.15.69:0/2034022573 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc0ad990 con 0x7f2fc4004d50 2023-10-06T01:39:19.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.542+0000 7f2fd9ffb700 1 -- 172.21.15.69:0/2034022573 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc400bb70 con 0x7f2fc4003a90 2023-10-06T01:39:19.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.542+0000 7f2fd9ffb700 1 -- 172.21.15.69:0/2034022573 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fc400bd30 con 0x7f2fdc0cdb70 2023-10-06T01:39:19.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.542+0000 7f2fdb7fe700 1 --2- 172.21.15.69:0/2034022573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fc4004d50 0x7f2fc40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:19.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.542+0000 7f2fdaffd700 1 --2- 172.21.15.69:0/2034022573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fc4003a90 0x7f2fc4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:19.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.542+0000 7f2fda7fc700 1 --2- 172.21.15.69:0/2034022573 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2fdc0cdb70 0x7f2fc4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:19.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.542+0000 7f2fdb7fe700 1 -- 172.21.15.69:0/2034022573 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2fdc0cdb70 msgr2=0x7f2fc4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:19.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.542+0000 7f2fdb7fe700 1 --2- 172.21.15.69:0/2034022573 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2fdc0cdb70 0x7f2fc4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.542+0000 7f2fdb7fe700 1 -- 172.21.15.69:0/2034022573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fc4003a90 msgr2=0x7f2fc4003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:19.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.542+0000 7f2fdb7fe700 1 --2- 172.21.15.69:0/2034022573 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fc4003a90 0x7f2fc4003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.542+0000 7f2fdb7fe700 1 -- 172.21.15.69:0/2034022573 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc4003570 con 0x7f2fc4004d50 2023-10-06T01:39:19.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.542+0000 7f2fdb7fe700 1 --2- 172.21.15.69:0/2034022573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fc4004d50 0x7f2fc40051c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4009c00 tx=0x7f2fd40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b7942d51e410076 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:19.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.543+0000 7f2fd9ffb700 1 -- 172.21.15.69:0/2034022573 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd400e710 con 0x7f2fc4004d50 2023-10-06T01:39:19.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.543+0000 7f2fd9ffb700 1 -- 172.21.15.69:0/2034022573 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd400e870 con 0x7f2fc4004d50 2023-10-06T01:39:19.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.543+0000 7f2fd9ffb700 1 -- 172.21.15.69:0/2034022573 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd400ec30 con 0x7f2fc4004d50 2023-10-06T01:39:19.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.543+0000 7f2fe198e700 1 -- 172.21.15.69:0/2034022573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fc4004d50 msgr2=0x7f2fc40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:19.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.543+0000 7f2fe198e700 1 --2- 172.21.15.69:0/2034022573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fc4004d50 0x7f2fc40051c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2fd4009c00 tx=0x7f2fd40091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.543+0000 7f2fdb7fe700 1 -- 172.21.15.69:0/2034022573 reap_dead start 2023-10-06T01:39:19.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.543+0000 7f2fe198e700 1 -- 172.21.15.69:0/2034022573 shutdown_connections 2023-10-06T01:39:19.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.543+0000 7f2fe198e700 1 -- 172.21.15.69:0/2034022573 >> 172.21.15.69:0/2034022573 conn(0x7f2fdc088000 msgr2=0x7f2fdc0883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:19.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.543+0000 7f2fe198e700 1 -- 172.21.15.69:0/2034022573 shutdown_connections 2023-10-06T01:39:19.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.543+0000 7f2fe198e700 1 -- 172.21.15.69:0/2034022573 wait complete. 2023-10-06T01:39:19.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.544+0000 7f2fe198e700 1 Processor -- start 2023-10-06T01:39:19.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.544+0000 7f2fe198e700 1 -- start start 2023-10-06T01:39:19.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.545+0000 7f2fe198e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fdc1568a0 0x7f2fdc0b0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:19.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.545+0000 7f2fe198e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fdc0c5f60 0x7f2fdc06e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:19.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.545+0000 7f2fe198e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2fdc06ecc0 0x7f2fdc0b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:19.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.545+0000 7f2fe198e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc06f130 con 0x7f2fdc1568a0 2023-10-06T01:39:19.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.545+0000 7f2fe198e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc0c7090 con 0x7f2fdc0c5f60 2023-10-06T01:39:19.552 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.545+0000 7f2fe198e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fdc0c6480 con 0x7f2fdc06ecc0 2023-10-06T01:39:19.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.545+0000 7f2fdaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fdc1568a0 0x7f2fdc0b0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:19.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.545+0000 7f2fdaffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fdc1568a0 0x7f2fdc0b0810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52182/0 (socket says 172.21.15.69:52182) 2023-10-06T01:39:19.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.545+0000 7f2fdaffd700 1 -- 172.21.15.69:0/621816046 learned_addr learned my addr 172.21.15.69:0/621816046 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:19.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.545+0000 7f2fda7fc700 1 --2- 172.21.15.69:0/621816046 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fdc0c5f60 0x7f2fdc06e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:19.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.545+0000 7f2fdb7fe700 1 --2- 172.21.15.69:0/621816046 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2fdc06ecc0 0x7f2fdc0b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:19.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.545+0000 7f2fdaffd700 1 -- 172.21.15.69:0/621816046 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2fdc06ecc0 msgr2=0x7f2fdc0b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:19.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.545+0000 7f2fdaffd700 1 --2- 172.21.15.69:0/621816046 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2fdc06ecc0 0x7f2fdc0b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.545+0000 7f2fdaffd700 1 -- 172.21.15.69:0/621816046 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fdc0c5f60 msgr2=0x7f2fdc06e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:19.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.545+0000 7f2fdaffd700 1 --2- 172.21.15.69:0/621816046 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fdc0c5f60 0x7f2fdc06e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.545+0000 7f2fdaffd700 1 -- 172.21.15.69:0/621816046 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fdc0c6760 con 0x7f2fdc1568a0 2023-10-06T01:39:19.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.545+0000 7f2fdb7fe700 1 --2- 172.21.15.69:0/621816046 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2fdc06ecc0 0x7f2fdc0b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:19.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.545+0000 7f2fda7fc700 1 --2- 172.21.15.69:0/621816046 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fdc0c5f60 0x7f2fdc06e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:19.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.546+0000 7f2fdaffd700 1 --2- 172.21.15.69:0/621816046 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fdc1568a0 0x7f2fdc0b0810 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc001920 tx=0x7f2fcc0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:19.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.546+0000 7f2fc2ffd700 1 -- 172.21.15.69:0/621816046 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc013600 con 0x7f2fdc1568a0 2023-10-06T01:39:19.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.546+0000 7f2fc2ffd700 1 -- 172.21.15.69:0/621816046 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fcc013780 con 0x7f2fdc1568a0 2023-10-06T01:39:19.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.546+0000 7f2fe198e700 1 -- 172.21.15.69:0/621816046 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fdc0c6a40 con 0x7f2fdc1568a0 2023-10-06T01:39:19.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.546+0000 7f2fc2ffd700 1 -- 172.21.15.69:0/621816046 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc013b40 con 0x7f2fdc1568a0 2023-10-06T01:39:19.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.546+0000 7f2fe198e700 1 -- 172.21.15.69:0/621816046 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fdc156c70 con 0x7f2fdc1568a0 2023-10-06T01:39:19.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.547+0000 7f2fe198e700 1 -- 172.21.15.69:0/621816046 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fdc0ad7d0 con 0x7f2fdc1568a0 2023-10-06T01:39:19.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.547+0000 7f2fc2ffd700 1 -- 172.21.15.69:0/621816046 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2fcc01c400 con 0x7f2fdc1568a0 2023-10-06T01:39:19.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.547+0000 7f2fc2ffd700 1 --2- 172.21.15.69:0/621816046 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2fc8066f30 0x7f2fc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:19.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.547+0000 7f2fc2ffd700 1 -- 172.21.15.69:0/621816046 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2fcc085820 con 0x7f2fdc1568a0 2023-10-06T01:39:19.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.547+0000 7f2fda7fc700 1 --2- 172.21.15.69:0/621816046 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2fc8066f30 0x7f2fc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:19.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.548+0000 7f2fda7fc700 1 --2- 172.21.15.69:0/621816046 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2fc8066f30 0x7f2fc80693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0b31e0 tx=0x7f2fd0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:19.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.552+0000 7f2fc2ffd700 1 -- 172.21.15.69:0/621816046 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fcc052930 con 0x7f2fdc1568a0 2023-10-06T01:39:19.738 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.737+0000 7f2fe198e700 1 -- 172.21.15.69:0/621816046 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2fdc04c3c0 con 0x7f2fdc1568a0 2023-10-06T01:39:19.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.737+0000 7f2fc2ffd700 1 -- 172.21.15.69:0/621816046 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2fcc055f50 con 0x7f2fdc1568a0 2023-10-06T01:39:19.739 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-10-06T01:39:19.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.739+0000 7f2fe198e700 1 -- 172.21.15.69:0/621816046 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2fc8066f30 msgr2=0x7f2fc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:19.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.739+0000 7f2fe198e700 1 --2- 172.21.15.69:0/621816046 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2fc8066f30 0x7f2fc80693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0b31e0 tx=0x7f2fd0009040 comp rx=0 tx=0).stop 2023-10-06T01:39:19.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.739+0000 7f2fe198e700 1 -- 172.21.15.69:0/621816046 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fdc1568a0 msgr2=0x7f2fdc0b0810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:19.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.739+0000 7f2fe198e700 1 --2- 172.21.15.69:0/621816046 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fdc1568a0 0x7f2fdc0b0810 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc001920 tx=0x7f2fcc0021d0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.739+0000 7f2fe198e700 1 -- 172.21.15.69:0/621816046 shutdown_connections 2023-10-06T01:39:19.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.739+0000 7f2fe198e700 1 --2- 172.21.15.69:0/621816046 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2fc8066f30 0x7f2fc80693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.739+0000 7f2fe198e700 1 --2- 172.21.15.69:0/621816046 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2fdc06ecc0 0x7f2fdc0b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.739+0000 7f2fe198e700 1 --2- 172.21.15.69:0/621816046 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fdc1568a0 0x7f2fdc0b0810 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.741 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.739+0000 7f2fe198e700 1 --2- 172.21.15.69:0/621816046 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2fdc0c5f60 0x7f2fdc06e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.739+0000 7f2fe198e700 1 -- 172.21.15.69:0/621816046 >> 172.21.15.69:0/621816046 conn(0x7f2fdc088000 msgr2=0x7f2fdc0c3dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:19.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.739+0000 7f2fe198e700 1 -- 172.21.15.69:0/621816046 shutdown_connections 2023-10-06T01:39:19.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.739+0000 7f2fe198e700 1 -- 172.21.15.69:0/621816046 wait complete. 2023-10-06T01:39:19.752 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:39:19.869 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.868+0000 7f66bb59e700 1 Processor -- start 2023-10-06T01:39:19.870 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.868+0000 7f66bb59e700 1 -- start start 2023-10-06T01:39:19.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.868+0000 7f66bb59e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66bc153dd0 0x7f66bc15de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:19.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.868+0000 7f66bb59e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f66bc0cea00 0x7f66bc0cee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:19.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.868+0000 7f66bb59e700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66bc15ac50 con 0x7f66bc153a00 2023-10-06T01:39:19.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.868+0000 7f66bb59e700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66bc15d010 con 0x7f66bc0cea00 2023-10-06T01:39:19.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.868+0000 7f66bb59e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc15af60 con 0x7f66bc153dd0 2023-10-06T01:39:19.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.869+0000 7f66ba59c700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f66bc153a00 0x7f66bc15a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44880/0 (socket says 172.21.15.69:44880) 2023-10-06T01:39:19.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.869+0000 7f66ba59c700 1 -- 172.21.15.69:0/3866371032 learned_addr learned my addr 172.21.15.69:0/3866371032 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:19.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.869+0000 7f66bad9d700 1 --2- 172.21.15.69:0/3866371032 >> v2:172.21.15.69:3300/0 conn(0x7f66bc0cea00 0x7f66bc0cee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:19.872 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.869+0000 7f66b1d9b700 1 --2- 172.21.15.69:0/3866371032 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66bc153dd0 0x7f66bc15de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:19.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.869+0000 7f66bad9d700 1 -- 172.21.15.69:0/3866371032 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66bc153dd0 msgr2=0x7f66bc15de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:19.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.869+0000 7f66bad9d700 1 --2- 172.21.15.69:0/3866371032 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66bc153dd0 0x7f66bc15de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.869+0000 7f66bad9d700 1 -- 172.21.15.69:0/3866371032 >> v1:172.21.15.69:6789/0 conn(0x7f66bc153a00 legacy=0x7f66bc15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:19.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.869+0000 7f66bad9d700 1 -- 172.21.15.69:0/3866371032 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66bc15b240 con 0x7f66bc0cea00 2023-10-06T01:39:19.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.869+0000 7f66b1d9b700 1 --2- 172.21.15.69:0/3866371032 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66bc153dd0 0x7f66bc15de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:19.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.869+0000 7f66bad9d700 1 --2- 172.21.15.69:0/3866371032 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66bc0cea00 0x7f66bc0cee60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f66b4009e90 tx=0x7f66b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2a2a862bf32cea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:19.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.869+0000 7f66b9d9b700 1 -- 172.21.15.69:0/3866371032 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b400e070 con 0x7f66bc0cea00 2023-10-06T01:39:19.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.869+0000 7f66b9d9b700 1 -- 172.21.15.69:0/3866371032 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b400bbf0 con 0x7f66bc0cea00 2023-10-06T01:39:19.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.869+0000 7f66b9d9b700 1 -- 172.21.15.69:0/3866371032 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b4012430 con 0x7f66bc0cea00 2023-10-06T01:39:19.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.870+0000 7f66bb59e700 1 -- 172.21.15.69:0/3866371032 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66bc0cea00 msgr2=0x7f66bc0cee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:19.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.870+0000 7f66bb59e700 1 --2- 172.21.15.69:0/3866371032 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66bc0cea00 0x7f66bc0cee60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f66b4009e90 tx=0x7f66b4009780 comp rx=0 tx=0).stop 2023-10-06T01:39:19.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.870+0000 7f66bb59e700 1 -- 172.21.15.69:0/3866371032 shutdown_connections 2023-10-06T01:39:19.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.870+0000 7f66bb59e700 1 --2- 172.21.15.69:0/3866371032 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66bc0cea00 0x7f66bc0cee60 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.870+0000 7f66bb59e700 1 --2- 172.21.15.69:0/3866371032 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66bc153dd0 0x7f66bc15de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.870+0000 7f66bb59e700 1 -- 172.21.15.69:0/3866371032 >> 172.21.15.69:0/3866371032 conn(0x7f66bc0703a0 msgr2=0x7f66bc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:19.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.870+0000 7f66bb59e700 1 -- 172.21.15.69:0/3866371032 shutdown_connections 2023-10-06T01:39:19.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.870+0000 7f66bb59e700 1 -- 172.21.15.69:0/3866371032 wait complete. 2023-10-06T01:39:19.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.871+0000 7f66bb59e700 1 Processor -- start 2023-10-06T01:39:19.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.871+0000 7f66bb59e700 1 -- start start 2023-10-06T01:39:19.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.872+0000 7f66bb59e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66bc0cea00 0x7f66bc151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:19.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.872+0000 7f66bb59e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66bc153a00 0x7f66bc15ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:19.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.872+0000 7f66bb59e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66bc153dd0 0x7f66bc152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:19.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.872+0000 7f66bb59e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc16a730 con 0x7f66bc153dd0 2023-10-06T01:39:19.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.872+0000 7f66bb59e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc169b20 con 0x7f66bc0cea00 2023-10-06T01:39:19.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.872+0000 7f66bb59e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66bc169e00 con 0x7f66bc153a00 2023-10-06T01:39:19.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.872+0000 7f66bad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66bc153dd0 0x7f66bc152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:19.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.872+0000 7f66bad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66bc153dd0 0x7f66bc152260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52200/0 (socket says 172.21.15.69:52200) 2023-10-06T01:39:19.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.872+0000 7f66bad9d700 1 -- 172.21.15.69:0/2872220376 learned_addr learned my addr 172.21.15.69:0/2872220376 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:19.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.872+0000 7f66b1d9b700 1 --2- 172.21.15.69:0/2872220376 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66bc153a00 0x7f66bc15ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:19.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.872+0000 7f66ba59c700 1 --2- 172.21.15.69:0/2872220376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66bc0cea00 0x7f66bc151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:19.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.872+0000 7f66bad9d700 1 -- 172.21.15.69:0/2872220376 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66bc153a00 msgr2=0x7f66bc15ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:19.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.872+0000 7f66bad9d700 1 --2- 172.21.15.69:0/2872220376 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66bc153a00 0x7f66bc15ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.872+0000 7f66bad9d700 1 -- 172.21.15.69:0/2872220376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66bc0cea00 msgr2=0x7f66bc151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:19.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.872+0000 7f66bad9d700 1 --2- 172.21.15.69:0/2872220376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66bc0cea00 0x7f66bc151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:19.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.872+0000 7f66bad9d700 1 -- 172.21.15.69:0/2872220376 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b4009a20 con 0x7f66bc153dd0 2023-10-06T01:39:19.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.872+0000 7f66bad9d700 1 --2- 172.21.15.69:0/2872220376 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66bc153dd0 0x7f66bc152260 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f66bc06eb00 tx=0x7f66b4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:19.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.872+0000 7f66b2ffd700 1 -- 172.21.15.69:0/2872220376 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b401e630 con 0x7f66bc153dd0 2023-10-06T01:39:19.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.873+0000 7f66b2ffd700 1 -- 172.21.15.69:0/2872220376 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66b401e7b0 con 0x7f66bc153dd0 2023-10-06T01:39:19.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.873+0000 7f66bb59e700 1 -- 172.21.15.69:0/2872220376 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66bc16a0e0 con 0x7f66bc153dd0 2023-10-06T01:39:19.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.873+0000 7f66b2ffd700 1 -- 172.21.15.69:0/2872220376 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66b401eb70 con 0x7f66bc153dd0 2023-10-06T01:39:19.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.873+0000 7f66bb59e700 1 -- 172.21.15.69:0/2872220376 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66bc169830 con 0x7f66bc153dd0 2023-10-06T01:39:19.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.873+0000 7f66bb59e700 1 -- 172.21.15.69:0/2872220376 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66bc16a8e0 con 0x7f66bc153dd0 2023-10-06T01:39:19.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.874+0000 7f66b2ffd700 1 -- 172.21.15.69:0/2872220376 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f66b4024070 con 0x7f66bc153dd0 2023-10-06T01:39:19.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.874+0000 7f66b2ffd700 1 --2- 172.21.15.69:0/2872220376 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f669c066f30 0x7f669c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:19.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.874+0000 7f66b2ffd700 1 -- 172.21.15.69:0/2872220376 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f66b4086e70 con 0x7f66bc153dd0 2023-10-06T01:39:19.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.874+0000 7f66ba59c700 1 --2- 172.21.15.69:0/2872220376 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f669c066f30 0x7f669c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:19.881 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.875+0000 7f66ba59c700 1 --2- 172.21.15.69:0/2872220376 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f669c066f30 0x7f669c0693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f66ac001820 tx=0x7f66ac009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:19.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:19.878+0000 7f66b2ffd700 1 -- 172.21.15.69:0/2872220376 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f66bc16a8e0 con 0x7f66bc153dd0 2023-10-06T01:39:20.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.061+0000 7f66bb59e700 1 -- 172.21.15.69:0/2872220376 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f66bc16a8e0 con 0x7f66bc153dd0 2023-10-06T01:39:20.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.062+0000 7f66b2ffd700 1 -- 172.21.15.69:0/2872220376 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f66bc16a8e0 con 0x7f66bc153dd0 2023-10-06T01:39:20.063 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 8 2023-10-06T01:39:20.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.064+0000 7f66bb59e700 1 -- 172.21.15.69:0/2872220376 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f669c066f30 msgr2=0x7f669c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:20.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.064+0000 7f66bb59e700 1 --2- 172.21.15.69:0/2872220376 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f669c066f30 0x7f669c0693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f66ac001820 tx=0x7f66ac009040 comp rx=0 tx=0).stop 2023-10-06T01:39:20.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.064+0000 7f66bb59e700 1 -- 172.21.15.69:0/2872220376 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66bc153dd0 msgr2=0x7f66bc152260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:20.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.064+0000 7f66bb59e700 1 --2- 172.21.15.69:0/2872220376 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66bc153dd0 0x7f66bc152260 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f66bc06eb00 tx=0x7f66b4019000 comp rx=0 tx=0).stop 2023-10-06T01:39:20.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.064+0000 7f66bb59e700 1 -- 172.21.15.69:0/2872220376 shutdown_connections 2023-10-06T01:39:20.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.064+0000 7f66bb59e700 1 --2- 172.21.15.69:0/2872220376 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f669c066f30 0x7f669c0693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:20.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.064+0000 7f66bb59e700 1 --2- 172.21.15.69:0/2872220376 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66bc153dd0 0x7f66bc152260 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:20.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.064+0000 7f66bb59e700 1 --2- 172.21.15.69:0/2872220376 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f66bc0cea00 0x7f66bc151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:20.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.064+0000 7f66bb59e700 1 --2- 172.21.15.69:0/2872220376 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f66bc153a00 0x7f66bc15ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:20.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.064+0000 7f66bb59e700 1 -- 172.21.15.69:0/2872220376 >> 172.21.15.69:0/2872220376 conn(0x7f66bc0703a0 msgr2=0x7f66bc0d0e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:20.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.064+0000 7f66bb59e700 1 -- 172.21.15.69:0/2872220376 shutdown_connections 2023-10-06T01:39:20.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.064+0000 7f66bb59e700 1 -- 172.21.15.69:0/2872220376 wait complete. 2023-10-06T01:39:20.077 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T01:39:20.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.192+0000 7f21b099e700 1 Processor -- start 2023-10-06T01:39:20.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.192+0000 7f21b099e700 1 -- start start 2023-10-06T01:39:20.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.193+0000 7f21b099e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f21ac159530 0x7f21ac0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:20.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.193+0000 7f21b099e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f21ac06dc70 0x7f21ac159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:20.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.193+0000 7f21b099e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21ac0ccfd0 con 0x7f21ac06e0e0 2023-10-06T01:39:20.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.193+0000 7f21b099e700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21ac0cf0e0 con 0x7f21ac159530 2023-10-06T01:39:20.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.193+0000 7f21b099e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21ac15a3d0 con 0x7f21ac06dc70 2023-10-06T01:39:20.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.193+0000 7f21aa59c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f21ac159530 0x7f21ac0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:20.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.193+0000 7f21aa59c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f21ac159530 0x7f21ac0ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52212/0 (socket says 172.21.15.69:52212) 2023-10-06T01:39:20.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.193+0000 7f21aa59c700 1 -- 172.21.15.69:0/3385891230 learned_addr learned my addr 172.21.15.69:0/3385891230 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:20.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.193+0000 7f21a9d9b700 1 --2- 172.21.15.69:0/3385891230 >> v2:172.21.15.88:3300/0 conn(0x7f21ac06dc70 0x7f21ac159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:20.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.194+0000 7f21aa59c700 1 -- 172.21.15.69:0/3385891230 >> v2:172.21.15.88:3300/0 conn(0x7f21ac06dc70 msgr2=0x7f21ac159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:20.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.194+0000 7f21aa59c700 1 --2- 172.21.15.69:0/3385891230 >> v2:172.21.15.88:3300/0 conn(0x7f21ac06dc70 0x7f21ac159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:20.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.194+0000 7f21aa59c700 1 -- 172.21.15.69:0/3385891230 >> v1:172.21.15.88:6789/0 conn(0x7f21ac06e0e0 legacy=0x7f21ac0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:20.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.194+0000 7f21aa59c700 1 -- 172.21.15.69:0/3385891230 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ac15a6b0 con 0x7f21ac159530 2023-10-06T01:39:20.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.194+0000 7f21aa59c700 1 --2- 172.21.15.69:0/3385891230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21ac159530 0x7f21ac0ceba0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f21ac0b66e0 tx=0x7f21a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afdbcf1fd08a00d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:20.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.194+0000 7f21a959a700 1 -- 172.21.15.69:0/3385891230 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a400e070 con 0x7f21ac159530 2023-10-06T01:39:20.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.194+0000 7f21a959a700 1 -- 172.21.15.69:0/3385891230 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a400ba20 con 0x7f21ac159530 2023-10-06T01:39:20.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.194+0000 7f21a959a700 1 -- 172.21.15.69:0/3385891230 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a40092e0 con 0x7f21ac159530 2023-10-06T01:39:20.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.194+0000 7f21b099e700 1 -- 172.21.15.69:0/3385891230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21ac159530 msgr2=0x7f21ac0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:20.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.194+0000 7f21b099e700 1 --2- 172.21.15.69:0/3385891230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21ac159530 0x7f21ac0ceba0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f21ac0b66e0 tx=0x7f21a4009840 comp rx=0 tx=0).stop 2023-10-06T01:39:20.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.194+0000 7f21b099e700 1 -- 172.21.15.69:0/3385891230 shutdown_connections 2023-10-06T01:39:20.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.194+0000 7f21b099e700 1 --2- 172.21.15.69:0/3385891230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21ac159530 0x7f21ac0ceba0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:20.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.194+0000 7f21b099e700 1 --2- 172.21.15.69:0/3385891230 >> v2:172.21.15.88:3300/0 conn(0x7f21ac06dc70 0x7f21ac159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:20.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.195+0000 7f21b099e700 1 -- 172.21.15.69:0/3385891230 >> 172.21.15.69:0/3385891230 conn(0x7f21ac0703a0 msgr2=0x7f21ac0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:20.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.195+0000 7f21b099e700 1 -- 172.21.15.69:0/3385891230 shutdown_connections 2023-10-06T01:39:20.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.195+0000 7f21b099e700 1 -- 172.21.15.69:0/3385891230 wait complete. 2023-10-06T01:39:20.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.196+0000 7f21b099e700 1 Processor -- start 2023-10-06T01:39:20.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.196+0000 7f21b099e700 1 -- start start 2023-10-06T01:39:20.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.196+0000 7f21b099e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21ac06dc70 0x7f21ac150dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:20.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.196+0000 7f21b099e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21ac06e0e0 0x7f21ac0c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:20.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.196+0000 7f21b099e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21ac159530 0x7f21ac0c8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:20.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.196+0000 7f21b099e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac0ca690 con 0x7f21ac06dc70 2023-10-06T01:39:20.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.196+0000 7f21b099e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac0b3480 con 0x7f21ac06e0e0 2023-10-06T01:39:20.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.196+0000 7f21b099e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac15db70 con 0x7f21ac159530 2023-10-06T01:39:20.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.196+0000 7f21aa59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21ac06dc70 0x7f21ac150dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:20.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.196+0000 7f21aa59c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21ac06dc70 0x7f21ac150dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52222/0 (socket says 172.21.15.69:52222) 2023-10-06T01:39:20.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.196+0000 7f21aa59c700 1 -- 172.21.15.69:0/393017101 learned_addr learned my addr 172.21.15.69:0/393017101 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:20.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.196+0000 7f21a9d9b700 1 --2- 172.21.15.69:0/393017101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21ac06e0e0 0x7f21ac0c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:20.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.197+0000 7f21aad9d700 1 --2- 172.21.15.69:0/393017101 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21ac159530 0x7f21ac0c8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:20.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.197+0000 7f21aa59c700 1 -- 172.21.15.69:0/393017101 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21ac159530 msgr2=0x7f21ac0c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:20.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.197+0000 7f21aa59c700 1 --2- 172.21.15.69:0/393017101 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21ac159530 0x7f21ac0c8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:20.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.197+0000 7f21aa59c700 1 -- 172.21.15.69:0/393017101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21ac06e0e0 msgr2=0x7f21ac0c8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:20.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.197+0000 7f21aa59c700 1 --2- 172.21.15.69:0/393017101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21ac06e0e0 0x7f21ac0c8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:20.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.197+0000 7f21aa59c700 1 -- 172.21.15.69:0/393017101 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a4009ae0 con 0x7f21ac06dc70 2023-10-06T01:39:20.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.197+0000 7f21aa59c700 1 --2- 172.21.15.69:0/393017101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21ac06dc70 0x7f21ac150dd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f21a40072f0 tx=0x7f21a4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:20.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.197+0000 7f219a7fc700 1 -- 172.21.15.69:0/393017101 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a40078f0 con 0x7f21ac06dc70 2023-10-06T01:39:20.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.197+0000 7f219a7fc700 1 -- 172.21.15.69:0/393017101 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a4007a50 con 0x7f21ac06dc70 2023-10-06T01:39:20.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.197+0000 7f219a7fc700 1 -- 172.21.15.69:0/393017101 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a4007e10 con 0x7f21ac06dc70 2023-10-06T01:39:20.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.197+0000 7f21b099e700 1 -- 172.21.15.69:0/393017101 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21ac15d540 con 0x7f21ac06dc70 2023-10-06T01:39:20.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.197+0000 7f21b099e700 1 -- 172.21.15.69:0/393017101 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21ac15d800 con 0x7f21ac06dc70 2023-10-06T01:39:20.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.198+0000 7f21b099e700 1 -- 172.21.15.69:0/393017101 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21ac04c3c0 con 0x7f21ac06dc70 2023-10-06T01:39:20.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.198+0000 7f219a7fc700 1 -- 172.21.15.69:0/393017101 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21a4003040 con 0x7f21ac06dc70 2023-10-06T01:39:20.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.199+0000 7f219a7fc700 1 --2- 172.21.15.69:0/393017101 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f218c066f30 0x7f218c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:20.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.199+0000 7f219a7fc700 1 -- 172.21.15.69:0/393017101 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f21a4085b70 con 0x7f21ac06dc70 2023-10-06T01:39:20.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.199+0000 7f21a9d9b700 1 --2- 172.21.15.69:0/393017101 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f218c066f30 0x7f218c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:20.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.199+0000 7f21a9d9b700 1 --2- 172.21.15.69:0/393017101 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f218c066f30 0x7f218c0693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f21ac15cca0 tx=0x7f21a00091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:20.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.203+0000 7f219a7fc700 1 -- 172.21.15.69:0/393017101 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21a4052c80 con 0x7f21ac06dc70 2023-10-06T01:39:20.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.385+0000 7f21b099e700 1 -- 172.21.15.69:0/393017101 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f21ac15a990 con 0x7f21ac06dc70 2023-10-06T01:39:20.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.385+0000 7f219a7fc700 1 -- 172.21.15.69:0/393017101 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f21a40562a0 con 0x7f21ac06dc70 2023-10-06T01:39:20.387 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-10-06T01:39:20.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.387+0000 7f21b099e700 1 -- 172.21.15.69:0/393017101 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f218c066f30 msgr2=0x7f218c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:20.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.387+0000 7f21b099e700 1 --2- 172.21.15.69:0/393017101 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f218c066f30 0x7f218c0693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f21ac15cca0 tx=0x7f21a00091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:20.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.387+0000 7f21b099e700 1 -- 172.21.15.69:0/393017101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21ac06dc70 msgr2=0x7f21ac150dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:20.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.387+0000 7f21b099e700 1 --2- 172.21.15.69:0/393017101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21ac06dc70 0x7f21ac150dd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f21a40072f0 tx=0x7f21a4018000 comp rx=0 tx=0).stop 2023-10-06T01:39:20.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.387+0000 7f21b099e700 1 -- 172.21.15.69:0/393017101 shutdown_connections 2023-10-06T01:39:20.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.387+0000 7f21b099e700 1 --2- 172.21.15.69:0/393017101 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f218c066f30 0x7f218c0693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:20.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.387+0000 7f21b099e700 1 --2- 172.21.15.69:0/393017101 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21ac159530 0x7f21ac0c8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:20.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.387+0000 7f21b099e700 1 --2- 172.21.15.69:0/393017101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21ac06dc70 0x7f21ac150dd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:20.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.387+0000 7f21b099e700 1 --2- 172.21.15.69:0/393017101 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21ac06e0e0 0x7f21ac0c8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:20.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.387+0000 7f21b099e700 1 -- 172.21.15.69:0/393017101 >> 172.21.15.69:0/393017101 conn(0x7f21ac0703a0 msgr2=0x7f21ac153ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:20.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.387+0000 7f21b099e700 1 -- 172.21.15.69:0/393017101 shutdown_connections 2023-10-06T01:39:20.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.387+0000 7f21b099e700 1 -- 172.21.15.69:0/393017101 wait complete. 2023-10-06T01:39:20.400 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T01:39:20.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.516+0000 7f7832e57700 1 Processor -- start 2023-10-06T01:39:20.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.516+0000 7f7832e57700 1 -- start start 2023-10-06T01:39:20.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.517+0000 7f7832e57700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f782c159530 0x7f782c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:20.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.517+0000 7f7832e57700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f782c06dc70 0x7f782c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:20.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.517+0000 7f7832e57700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f782c0ccfd0 con 0x7f782c06e0e0 2023-10-06T01:39:20.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.517+0000 7f7832e57700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782c0cf0e0 con 0x7f782c159530 2023-10-06T01:39:20.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.517+0000 7f7832e57700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782c15a3d0 con 0x7f782c06dc70 2023-10-06T01:39:20.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.517+0000 7f7830bf3700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f782c159530 0x7f782c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:20.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.517+0000 7f78313f4700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f782c06e0e0 0x7f782c0cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44894/0 (socket says 172.21.15.69:44894) 2023-10-06T01:39:20.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.517+0000 7f78313f4700 1 -- 172.21.15.69:0/2319378991 learned_addr learned my addr 172.21.15.69:0/2319378991 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:20.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.517+0000 7f782bfff700 1 --2- 172.21.15.69:0/2319378991 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f782c06dc70 0x7f782c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:20.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.517+0000 7f7830bf3700 1 -- 172.21.15.69:0/2319378991 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f782c06dc70 msgr2=0x7f782c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:20.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.517+0000 7f7830bf3700 1 --2- 172.21.15.69:0/2319378991 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f782c06dc70 0x7f782c159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:20.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.517+0000 7f7830bf3700 1 -- 172.21.15.69:0/2319378991 >> v1:172.21.15.69:6789/0 conn(0x7f782c06e0e0 legacy=0x7f782c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:20.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.517+0000 7f7830bf3700 1 -- 172.21.15.69:0/2319378991 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f782c15a6b0 con 0x7f782c159530 2023-10-06T01:39:20.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.517+0000 7f782b7fe700 1 -- 172.21.15.69:0/2319378991 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213862174 0 0) 0x7f782c0ccfd0 con 0x7f782c06e0e0 2023-10-06T01:39:20.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.518+0000 7f7830bf3700 1 --2- 172.21.15.69:0/2319378991 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f782c159530 0x7f782c0ceba0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f781c009e60 tx=0x7f781c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ae30f54f67d57fd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:20.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.518+0000 7f782b7fe700 1 -- 172.21.15.69:0/2319378991 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c00e070 con 0x7f782c159530 2023-10-06T01:39:20.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.518+0000 7f782b7fe700 1 -- 172.21.15.69:0/2319378991 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781c00bb60 con 0x7f782c159530 2023-10-06T01:39:20.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.518+0000 7f782b7fe700 1 -- 172.21.15.69:0/2319378991 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c012430 con 0x7f782c159530 2023-10-06T01:39:20.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.518+0000 7f7832e57700 1 -- 172.21.15.69:0/2319378991 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f782c159530 msgr2=0x7f782c0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:20.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.518+0000 7f7832e57700 1 --2- 172.21.15.69:0/2319378991 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f782c159530 0x7f782c0ceba0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f781c009e60 tx=0x7f781c009780 comp rx=0 tx=0).stop 2023-10-06T01:39:20.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.518+0000 7f7832e57700 1 -- 172.21.15.69:0/2319378991 shutdown_connections 2023-10-06T01:39:20.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.518+0000 7f7832e57700 1 --2- 172.21.15.69:0/2319378991 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f782c159530 0x7f782c0ceba0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:20.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.518+0000 7f7832e57700 1 --2- 172.21.15.69:0/2319378991 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f782c06dc70 0x7f782c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:20.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.518+0000 7f7832e57700 1 -- 172.21.15.69:0/2319378991 >> 172.21.15.69:0/2319378991 conn(0x7f782c0703a0 msgr2=0x7f782c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:20.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.518+0000 7f7832e57700 1 -- 172.21.15.69:0/2319378991 shutdown_connections 2023-10-06T01:39:20.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.518+0000 7f7832e57700 1 -- 172.21.15.69:0/2319378991 wait complete. 2023-10-06T01:39:20.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.519+0000 7f7832e57700 1 Processor -- start 2023-10-06T01:39:20.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.520+0000 7f7832e57700 1 -- start start 2023-10-06T01:39:20.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.520+0000 7f7832e57700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f782c06dc70 0x7f782c0b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:20.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.520+0000 7f7832e57700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f782c06e0e0 0x7f782c0b4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:20.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.520+0000 7f7832e57700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f782c159530 0x7f782c0b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:20.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.520+0000 7f7832e57700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c0b61c0 con 0x7f782c06dc70 2023-10-06T01:39:20.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.520+0000 7f7832e57700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782c0b5540 con 0x7f782c159530 2023-10-06T01:39:20.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.520+0000 7f7832e57700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f782c0b5820 con 0x7f782c06e0e0 2023-10-06T01:39:20.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.520+0000 7f7830bf3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f782c06dc70 0x7f782c0b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:20.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.520+0000 7f7830bf3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f782c06dc70 0x7f782c0b1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52240/0 (socket says 172.21.15.69:52240) 2023-10-06T01:39:20.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.520+0000 7f7830bf3700 1 -- 172.21.15.69:0/3903102719 learned_addr learned my addr 172.21.15.69:0/3903102719 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:20.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.521+0000 7f782bfff700 1 --2- 172.21.15.69:0/3903102719 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f782c06e0e0 0x7f782c0b4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:20.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.521+0000 7f78313f4700 1 --2- 172.21.15.69:0/3903102719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f782c159530 0x7f782c0b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:20.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.521+0000 7f7830bf3700 1 -- 172.21.15.69:0/3903102719 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f782c06e0e0 msgr2=0x7f782c0b4960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:20.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.521+0000 7f7830bf3700 1 --2- 172.21.15.69:0/3903102719 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f782c06e0e0 0x7f782c0b4960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:20.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.521+0000 7f7830bf3700 1 -- 172.21.15.69:0/3903102719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f782c159530 msgr2=0x7f782c0b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:20.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.521+0000 7f7830bf3700 1 --2- 172.21.15.69:0/3903102719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f782c159530 0x7f782c0b4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:20.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.521+0000 7f7830bf3700 1 -- 172.21.15.69:0/3903102719 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c009a20 con 0x7f782c06dc70 2023-10-06T01:39:20.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.521+0000 7f7830bf3700 1 --2- 172.21.15.69:0/3903102719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f782c06dc70 0x7f782c0b1d20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f782c089650 tx=0x7f781c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:20.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.521+0000 7f7828ff9700 1 -- 172.21.15.69:0/3903102719 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c012de0 con 0x7f782c06dc70 2023-10-06T01:39:20.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.521+0000 7f7828ff9700 1 -- 172.21.15.69:0/3903102719 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f781c027470 con 0x7f782c06dc70 2023-10-06T01:39:20.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.521+0000 7f7832e57700 1 -- 172.21.15.69:0/3903102719 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f782c0b5b00 con 0x7f782c06dc70 2023-10-06T01:39:20.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.521+0000 7f7828ff9700 1 -- 172.21.15.69:0/3903102719 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781c027830 con 0x7f782c06dc70 2023-10-06T01:39:20.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.521+0000 7f7832e57700 1 -- 172.21.15.69:0/3903102719 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f782c0b2260 con 0x7f782c06dc70 2023-10-06T01:39:20.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.522+0000 7f7832e57700 1 -- 172.21.15.69:0/3903102719 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f782c04c3c0 con 0x7f782c06dc70 2023-10-06T01:39:20.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.522+0000 7f7828ff9700 1 -- 172.21.15.69:0/3903102719 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f781c024070 con 0x7f782c06dc70 2023-10-06T01:39:20.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.523+0000 7f7828ff9700 1 --2- 172.21.15.69:0/3903102719 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7818066f30 0x7f78180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:20.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.523+0000 7f7828ff9700 1 -- 172.21.15.69:0/3903102719 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f781c086d00 con 0x7f782c06dc70 2023-10-06T01:39:20.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.523+0000 7f782bfff700 1 --2- 172.21.15.69:0/3903102719 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7818066f30 0x7f78180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:20.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.523+0000 7f782bfff700 1 --2- 172.21.15.69:0/3903102719 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7818066f30 0x7f78180693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f782c0b66b0 tx=0x7f7820008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:20.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.527+0000 7f7828ff9700 1 -- 172.21.15.69:0/3903102719 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f781c053e10 con 0x7f782c06dc70 2023-10-06T01:39:20.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.714+0000 7f7832e57700 1 -- 172.21.15.69:0/3903102719 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f782c15a990 con 0x7f782c06dc70 2023-10-06T01:39:20.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.714+0000 7f7828ff9700 1 -- 172.21.15.69:0/3903102719 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f781c02c0a0 con 0x7f782c06dc70 2023-10-06T01:39:20.716 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-10-06T01:39:20.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.716+0000 7f7832e57700 1 -- 172.21.15.69:0/3903102719 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7818066f30 msgr2=0x7f78180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:20.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.716+0000 7f7832e57700 1 --2- 172.21.15.69:0/3903102719 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7818066f30 0x7f78180693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f782c0b66b0 tx=0x7f7820008040 comp rx=0 tx=0).stop 2023-10-06T01:39:20.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.716+0000 7f7832e57700 1 -- 172.21.15.69:0/3903102719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f782c06dc70 msgr2=0x7f782c0b1d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:20.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.716+0000 7f7832e57700 1 --2- 172.21.15.69:0/3903102719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f782c06dc70 0x7f782c0b1d20 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f782c089650 tx=0x7f781c019000 comp rx=0 tx=0).stop 2023-10-06T01:39:20.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.716+0000 7f7832e57700 1 -- 172.21.15.69:0/3903102719 shutdown_connections 2023-10-06T01:39:20.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.716+0000 7f7832e57700 1 --2- 172.21.15.69:0/3903102719 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7818066f30 0x7f78180693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:20.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.716+0000 7f7832e57700 1 --2- 172.21.15.69:0/3903102719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f782c159530 0x7f782c0b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:20.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.716+0000 7f7832e57700 1 --2- 172.21.15.69:0/3903102719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f782c06dc70 0x7f782c0b1d20 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:20.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.716+0000 7f7832e57700 1 --2- 172.21.15.69:0/3903102719 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f782c06e0e0 0x7f782c0b4960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:20.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.716+0000 7f7832e57700 1 -- 172.21.15.69:0/3903102719 >> 172.21.15.69:0/3903102719 conn(0x7f782c0703a0 msgr2=0x7f782c0cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:20.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.717+0000 7f7832e57700 1 -- 172.21.15.69:0/3903102719 shutdown_connections 2023-10-06T01:39:20.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.717+0000 7f7832e57700 1 -- 172.21.15.69:0/3903102719 wait complete. 2023-10-06T01:39:20.730 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:39:20.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.842+0000 7ff964c70700 1 Processor -- start 2023-10-06T01:39:20.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.842+0000 7ff964c70700 1 -- start start 2023-10-06T01:39:20.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.843+0000 7ff964c70700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff96015a5d0 0x7ff960156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:20.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.843+0000 7ff964c70700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96015ae40 con 0x7ff9600cb5a0 2023-10-06T01:39:20.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.843+0000 7ff964c70700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff96015ab60 con 0x7ff9600cb970 2023-10-06T01:39:20.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.843+0000 7ff964c70700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9600ce0f0 con 0x7ff96015a5d0 2023-10-06T01:39:20.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.843+0000 7ff95e59c700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7ff9600cb5a0 0x7ff9600cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44910/0 (socket says 172.21.15.69:44910) 2023-10-06T01:39:20.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.843+0000 7ff95e59c700 1 -- 172.21.15.69:0/429790420 learned_addr learned my addr 172.21.15.69:0/429790420 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:20.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.843+0000 7ff95ed9d700 1 --2- 172.21.15.69:0/429790420 >> v2:172.21.15.88:3300/0 conn(0x7ff96015a5d0 0x7ff960156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:20.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.843+0000 7ff95d59a700 1 -- 172.21.15.69:0/429790420 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2304031427 0 0) 0x7ff96015ae40 con 0x7ff9600cb5a0 2023-10-06T01:39:20.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.843+0000 7ff95d59a700 1 -- 172.21.15.69:0/429790420 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff948003570 con 0x7ff9600cb5a0 2023-10-06T01:39:20.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.844+0000 7ff95ed9d700 1 -- 172.21.15.69:0/429790420 >> v1:172.21.15.88:6789/0 conn(0x7ff9600cb970 legacy=0x7ff960159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:20.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.844+0000 7ff95d59a700 1 -- 172.21.15.69:0/429790420 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2282313764 0 0) 0x7ff948003570 con 0x7ff9600cb5a0 2023-10-06T01:39:20.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.844+0000 7ff95ed9d700 1 -- 172.21.15.69:0/429790420 >> v1:172.21.15.69:6789/0 conn(0x7ff9600cb5a0 legacy=0x7ff9600cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:20.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.844+0000 7ff95ed9d700 1 -- 172.21.15.69:0/429790420 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9600ccf00 con 0x7ff96015a5d0 2023-10-06T01:39:20.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.844+0000 7ff95ed9d700 1 --2- 172.21.15.69:0/429790420 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff96015a5d0 0x7ff960156e90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff9580098e0 tx=0x7ff9580091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cc68fa3ece6d093 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:20.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.844+0000 7ff95d59a700 1 -- 172.21.15.69:0/429790420 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9500017f0 con 0x7ff96015a5d0 2023-10-06T01:39:20.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.844+0000 7ff95d59a700 1 -- 172.21.15.69:0/429790420 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff958011420 con 0x7ff96015a5d0 2023-10-06T01:39:20.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.844+0000 7ff95d59a700 1 -- 172.21.15.69:0/429790420 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9580117c0 con 0x7ff96015a5d0 2023-10-06T01:39:20.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.844+0000 7ff964c70700 1 -- 172.21.15.69:0/429790420 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff96015a5d0 msgr2=0x7ff960156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:20.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.844+0000 7ff964c70700 1 --2- 172.21.15.69:0/429790420 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff96015a5d0 0x7ff960156e90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff9580098e0 tx=0x7ff9580091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:20.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.845+0000 7ff964c70700 1 -- 172.21.15.69:0/429790420 shutdown_connections 2023-10-06T01:39:20.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.845+0000 7ff964c70700 1 --2- 172.21.15.69:0/429790420 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff96015a5d0 0x7ff960156e90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:20.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.845+0000 7ff964c70700 1 -- 172.21.15.69:0/429790420 >> 172.21.15.69:0/429790420 conn(0x7ff960070e30 msgr2=0x7ff9600d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:20.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.845+0000 7ff964c70700 1 -- 172.21.15.69:0/429790420 shutdown_connections 2023-10-06T01:39:20.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.845+0000 7ff964c70700 1 -- 172.21.15.69:0/429790420 wait complete. 2023-10-06T01:39:20.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.846+0000 7ff964c70700 1 Processor -- start 2023-10-06T01:39:20.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.846+0000 7ff964c70700 1 -- start start 2023-10-06T01:39:20.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.846+0000 7ff964c70700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9600cb5a0 0x7ff96015d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:20.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.846+0000 7ff964c70700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9600cb970 0x7ff960150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:20.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.846+0000 7ff964c70700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff96015a5d0 0x7ff96015c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:20.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.846+0000 7ff964c70700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff960152360 con 0x7ff9600cb970 2023-10-06T01:39:20.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.846+0000 7ff964c70700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff96015df10 con 0x7ff9600cb5a0 2023-10-06T01:39:20.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.846+0000 7ff964c70700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff960151750 con 0x7ff96015a5d0 2023-10-06T01:39:20.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.846+0000 7ff95dd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9600cb970 0x7ff960150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:20.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.846+0000 7ff95dd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9600cb970 0x7ff960150dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52252/0 (socket says 172.21.15.69:52252) 2023-10-06T01:39:20.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.846+0000 7ff95dd9b700 1 -- 172.21.15.69:0/2056364776 learned_addr learned my addr 172.21.15.69:0/2056364776 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:20.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.847+0000 7ff95ed9d700 1 --2- 172.21.15.69:0/2056364776 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff96015a5d0 0x7ff96015c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:20.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.847+0000 7ff95e59c700 1 --2- 172.21.15.69:0/2056364776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9600cb5a0 0x7ff96015d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:20.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.847+0000 7ff95dd9b700 1 -- 172.21.15.69:0/2056364776 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff96015a5d0 msgr2=0x7ff96015c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:20.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.847+0000 7ff95dd9b700 1 --2- 172.21.15.69:0/2056364776 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff96015a5d0 0x7ff96015c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:20.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.847+0000 7ff95dd9b700 1 -- 172.21.15.69:0/2056364776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9600cb5a0 msgr2=0x7ff96015d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:20.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.847+0000 7ff95dd9b700 1 --2- 172.21.15.69:0/2056364776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9600cb5a0 0x7ff96015d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:20.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.847+0000 7ff95dd9b700 1 -- 172.21.15.69:0/2056364776 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff958009420 con 0x7ff9600cb970 2023-10-06T01:39:20.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.847+0000 7ff95e59c700 1 --2- 172.21.15.69:0/2056364776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9600cb5a0 0x7ff96015d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:20.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.847+0000 7ff95dd9b700 1 --2- 172.21.15.69:0/2056364776 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9600cb970 0x7ff960150dc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff95400c810 tx=0x7ff954007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:20.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.847+0000 7ff94e7fc700 1 -- 172.21.15.69:0/2056364776 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff954012630 con 0x7ff9600cb970 2023-10-06T01:39:20.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.847+0000 7ff94e7fc700 1 -- 172.21.15.69:0/2056364776 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9540127b0 con 0x7ff9600cb970 2023-10-06T01:39:20.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.847+0000 7ff964c70700 1 -- 172.21.15.69:0/2056364776 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff960151a30 con 0x7ff9600cb970 2023-10-06T01:39:20.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.847+0000 7ff94e7fc700 1 -- 172.21.15.69:0/2056364776 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff954012b70 con 0x7ff9600cb970 2023-10-06T01:39:20.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.847+0000 7ff964c70700 1 -- 172.21.15.69:0/2056364776 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff960151ff0 con 0x7ff9600cb970 2023-10-06T01:39:20.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.848+0000 7ff964c70700 1 -- 172.21.15.69:0/2056364776 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff96004c3c0 con 0x7ff9600cb970 2023-10-06T01:39:20.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.848+0000 7ff94e7fc700 1 -- 172.21.15.69:0/2056364776 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff95401b400 con 0x7ff9600cb970 2023-10-06T01:39:20.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.849+0000 7ff94e7fc700 1 --2- 172.21.15.69:0/2056364776 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff940066f30 0x7ff9400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:20.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.849+0000 7ff94e7fc700 1 -- 172.21.15.69:0/2056364776 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff954084330 con 0x7ff9600cb970 2023-10-06T01:39:20.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.849+0000 7ff95e59c700 1 --2- 172.21.15.69:0/2056364776 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff940066f30 0x7ff9400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:20.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.849+0000 7ff95e59c700 1 --2- 172.21.15.69:0/2056364776 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff940066f30 0x7ff9400693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff9600afb70 tx=0x7ff950009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:20.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:20.853+0000 7ff94e7fc700 1 -- 172.21.15.69:0/2056364776 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff954051440 con 0x7ff9600cb970 2023-10-06T01:39:21.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.035+0000 7ff964c70700 1 -- 172.21.15.69:0/2056364776 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9600c7380 con 0x7ff9600cb970 2023-10-06T01:39:21.037 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.036+0000 7ff94e7fc700 1 -- 172.21.15.69:0/2056364776 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16818 (secure 0 0 0) 0x7ff954054a60 con 0x7ff9600cb970 2023-10-06T01:39:21.038 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:21.038 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":24,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:38:50.506861+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:38:43.046056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:38:47.525023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:38:47.992048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:39:21.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.038+0000 7ff964c70700 1 -- 172.21.15.69:0/2056364776 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff940066f30 msgr2=0x7ff9400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:21.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.038+0000 7ff964c70700 1 --2- 172.21.15.69:0/2056364776 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff940066f30 0x7ff9400693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff9600afb70 tx=0x7ff950009040 comp rx=0 tx=0).stop 2023-10-06T01:39:21.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.038+0000 7ff964c70700 1 -- 172.21.15.69:0/2056364776 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9600cb970 msgr2=0x7ff960150dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:21.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.038+0000 7ff964c70700 1 --2- 172.21.15.69:0/2056364776 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9600cb970 0x7ff960150dc0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff95400c810 tx=0x7ff954007f00 comp rx=0 tx=0).stop 2023-10-06T01:39:21.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.038+0000 7ff964c70700 1 -- 172.21.15.69:0/2056364776 shutdown_connections 2023-10-06T01:39:21.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.038+0000 7ff964c70700 1 --2- 172.21.15.69:0/2056364776 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff940066f30 0x7ff9400693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:21.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.038+0000 7ff964c70700 1 --2- 172.21.15.69:0/2056364776 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff96015a5d0 0x7ff96015c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:21.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.038+0000 7ff964c70700 1 --2- 172.21.15.69:0/2056364776 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff9600cb5a0 0x7ff96015d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:21.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.038+0000 7ff964c70700 1 --2- 172.21.15.69:0/2056364776 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff9600cb970 0x7ff960150dc0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:21.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.038+0000 7ff964c70700 1 -- 172.21.15.69:0/2056364776 >> 172.21.15.69:0/2056364776 conn(0x7ff960070e30 msgr2=0x7ff9600b19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:21.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.038+0000 7ff964c70700 1 -- 172.21.15.69:0/2056364776 shutdown_connections 2023-10-06T01:39:21.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.038+0000 7ff964c70700 1 -- 172.21.15.69:0/2056364776 wait complete. 2023-10-06T01:39:21.052 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:38:38.288642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:38:43.046056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T01:38:47.525023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T01:38:47.992048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T01:39:21.052 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:39:21.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.167+0000 7f9300902700 1 Processor -- start 2023-10-06T01:39:21.169 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.167+0000 7f9300902700 1 -- start start 2023-10-06T01:39:21.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.168+0000 7f9300902700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f92fc0af6b0 0x7f92fc0accd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:21.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.168+0000 7f9300902700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92fc0ac840 con 0x7f92fc06d250 2023-10-06T01:39:21.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.168+0000 7f9300902700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92fc0abf50 con 0x7f92fc157420 2023-10-06T01:39:21.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.168+0000 7f9300902700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92fc0aea60 con 0x7f92fc0af6b0 2023-10-06T01:39:21.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.168+0000 7f92f3fff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f92fc06d250 0x7f92fc0aefa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44916/0 (socket says 172.21.15.69:44916) 2023-10-06T01:39:21.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.168+0000 7f92f3fff700 1 -- 172.21.15.69:0/2841733692 learned_addr learned my addr 172.21.15.69:0/2841733692 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:21.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.168+0000 7f92fb59e700 1 --2- 172.21.15.69:0/2841733692 >> v2:172.21.15.69:3300/0 conn(0x7f92fc0af6b0 0x7f92fc0accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:21.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.168+0000 7f92fa59c700 1 -- 172.21.15.69:0/2841733692 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3232000802 0 0) 0x7f92fc0ac840 con 0x7f92fc06d250 2023-10-06T01:39:21.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.168+0000 7f92fa59c700 1 -- 172.21.15.69:0/2841733692 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92e8003570 con 0x7f92fc06d250 2023-10-06T01:39:21.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.168+0000 7f92fb59e700 1 -- 172.21.15.69:0/2841733692 >> v1:172.21.15.88:6789/0 conn(0x7f92fc157420 legacy=0x7f92fc0b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:21.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.168+0000 7f92fb59e700 1 -- 172.21.15.69:0/2841733692 >> v1:172.21.15.69:6789/0 conn(0x7f92fc06d250 legacy=0x7f92fc0aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:21.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.168+0000 7f92fb59e700 1 -- 172.21.15.69:0/2841733692 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92fc0ac1f0 con 0x7f92fc0af6b0 2023-10-06T01:39:21.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.168+0000 7f92fb59e700 1 --2- 172.21.15.69:0/2841733692 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92fc0af6b0 0x7f92fc0accd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f92f4009e60 tx=0x7f92f4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d489670abf75d4ae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:21.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.169+0000 7f92fa59c700 1 -- 172.21.15.69:0/2841733692 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f400e070 con 0x7f92fc0af6b0 2023-10-06T01:39:21.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.169+0000 7f92fa59c700 1 -- 172.21.15.69:0/2841733692 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92f400bb60 con 0x7f92fc0af6b0 2023-10-06T01:39:21.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.169+0000 7f92fa59c700 1 -- 172.21.15.69:0/2841733692 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92f4012430 con 0x7f92fc0af6b0 2023-10-06T01:39:21.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.169+0000 7f9300902700 1 -- 172.21.15.69:0/2841733692 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92fc0af6b0 msgr2=0x7f92fc0accd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:21.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.169+0000 7f9300902700 1 --2- 172.21.15.69:0/2841733692 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92fc0af6b0 0x7f92fc0accd0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f92f4009e60 tx=0x7f92f4009780 comp rx=0 tx=0).stop 2023-10-06T01:39:21.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.169+0000 7f9300902700 1 -- 172.21.15.69:0/2841733692 shutdown_connections 2023-10-06T01:39:21.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.169+0000 7f9300902700 1 --2- 172.21.15.69:0/2841733692 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92fc0af6b0 0x7f92fc0accd0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:21.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.169+0000 7f9300902700 1 -- 172.21.15.69:0/2841733692 >> 172.21.15.69:0/2841733692 conn(0x7f92fc06ce80 msgr2=0x7f92fc0ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:21.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.169+0000 7f9300902700 1 -- 172.21.15.69:0/2841733692 shutdown_connections 2023-10-06T01:39:21.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.169+0000 7f9300902700 1 -- 172.21.15.69:0/2841733692 wait complete. 2023-10-06T01:39:21.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.170+0000 7f9300902700 1 Processor -- start 2023-10-06T01:39:21.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.170+0000 7f9300902700 1 -- start start 2023-10-06T01:39:21.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.171+0000 7f9300902700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92fc06d250 0x7f92fc154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:21.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.171+0000 7f9300902700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92fc0af6b0 0x7f92fc158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:21.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.171+0000 7f9300902700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92fc157420 0x7f92fc14fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:21.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.171+0000 7f9300902700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc1589b0 con 0x7f92fc06d250 2023-10-06T01:39:21.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.171+0000 7f9300902700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc0993f0 con 0x7f92fc157420 2023-10-06T01:39:21.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.171+0000 7f9300902700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92fc158bc0 con 0x7f92fc0af6b0 2023-10-06T01:39:21.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.171+0000 7f92fad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92fc06d250 0x7f92fc154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:21.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.171+0000 7f92fad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92fc06d250 0x7f92fc154c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52270/0 (socket says 172.21.15.69:52270) 2023-10-06T01:39:21.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.171+0000 7f92fad9d700 1 -- 172.21.15.69:0/1389215895 learned_addr learned my addr 172.21.15.69:0/1389215895 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:21.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.171+0000 7f92f3fff700 1 --2- 172.21.15.69:0/1389215895 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92fc0af6b0 0x7f92fc158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:21.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.171+0000 7f92fb59e700 1 --2- 172.21.15.69:0/1389215895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92fc157420 0x7f92fc14fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:21.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.171+0000 7f92fad9d700 1 -- 172.21.15.69:0/1389215895 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92fc0af6b0 msgr2=0x7f92fc158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:21.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.171+0000 7f92fad9d700 1 --2- 172.21.15.69:0/1389215895 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92fc0af6b0 0x7f92fc158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:21.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.171+0000 7f92fad9d700 1 -- 172.21.15.69:0/1389215895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92fc157420 msgr2=0x7f92fc14fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:21.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.171+0000 7f92fad9d700 1 --2- 172.21.15.69:0/1389215895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92fc157420 0x7f92fc14fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:21.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.171+0000 7f92fad9d700 1 -- 172.21.15.69:0/1389215895 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92f4009a20 con 0x7f92fc06d250 2023-10-06T01:39:21.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.171+0000 7f92fb59e700 1 --2- 172.21.15.69:0/1389215895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92fc157420 0x7f92fc14fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:21.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.172+0000 7f92fad9d700 1 --2- 172.21.15.69:0/1389215895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92fc06d250 0x7f92fc154c80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f92ec00c590 tx=0x7f92ec00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:21.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.172+0000 7f92f2ffd700 1 -- 172.21.15.69:0/1389215895 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec011590 con 0x7f92fc06d250 2023-10-06T01:39:21.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.172+0000 7f92f2ffd700 1 -- 172.21.15.69:0/1389215895 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ec011710 con 0x7f92fc06d250 2023-10-06T01:39:21.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.172+0000 7f9300902700 1 -- 172.21.15.69:0/1389215895 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92fc158ea0 con 0x7f92fc06d250 2023-10-06T01:39:21.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.172+0000 7f92f2ffd700 1 -- 172.21.15.69:0/1389215895 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ec011ad0 con 0x7f92fc06d250 2023-10-06T01:39:21.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.172+0000 7f9300902700 1 -- 172.21.15.69:0/1389215895 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92fc159460 con 0x7f92fc06d250 2023-10-06T01:39:21.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.173+0000 7f9300902700 1 -- 172.21.15.69:0/1389215895 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92fc0991c0 con 0x7f92fc06d250 2023-10-06T01:39:21.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.173+0000 7f92f2ffd700 1 -- 172.21.15.69:0/1389215895 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f92ec01b3b0 con 0x7f92fc06d250 2023-10-06T01:39:21.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.173+0000 7f92f2ffd700 1 --2- 172.21.15.69:0/1389215895 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f92dc066f30 0x7f92dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:21.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.173+0000 7f92f2ffd700 1 -- 172.21.15.69:0/1389215895 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f92ec083bd0 con 0x7f92fc06d250 2023-10-06T01:39:21.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.173+0000 7f92f3fff700 1 --2- 172.21.15.69:0/1389215895 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f92dc066f30 0x7f92dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:21.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.174+0000 7f92f3fff700 1 --2- 172.21.15.69:0/1389215895 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f92dc066f30 0x7f92dc0693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f92fc15a6f0 tx=0x7f92e4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:21.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.177+0000 7f92f2ffd700 1 -- 172.21.15.69:0/1389215895 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f92ec050ce0 con 0x7f92fc06d250 2023-10-06T01:39:21.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.359+0000 7f9300902700 1 -- 172.21.15.69:0/1389215895 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f92fc04c3c0 con 0x7f92fc06d250 2023-10-06T01:39:21.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.359+0000 7f92f2ffd700 1 -- 172.21.15.69:0/1389215895 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7f92ec017070 con 0x7f92fc06d250 2023-10-06T01:39:21.361 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-10-06T01:39:21.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.361+0000 7f9300902700 1 -- 172.21.15.69:0/1389215895 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f92dc066f30 msgr2=0x7f92dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:21.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.361+0000 7f9300902700 1 --2- 172.21.15.69:0/1389215895 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f92dc066f30 0x7f92dc0693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f92fc15a6f0 tx=0x7f92e4009040 comp rx=0 tx=0).stop 2023-10-06T01:39:21.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.361+0000 7f9300902700 1 -- 172.21.15.69:0/1389215895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92fc06d250 msgr2=0x7f92fc154c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:21.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.361+0000 7f9300902700 1 --2- 172.21.15.69:0/1389215895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92fc06d250 0x7f92fc154c80 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f92ec00c590 tx=0x7f92ec00c8a0 comp rx=0 tx=0).stop 2023-10-06T01:39:21.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.361+0000 7f9300902700 1 -- 172.21.15.69:0/1389215895 shutdown_connections 2023-10-06T01:39:21.363 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.361+0000 7f9300902700 1 --2- 172.21.15.69:0/1389215895 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f92dc066f30 0x7f92dc0693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:21.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.361+0000 7f9300902700 1 --2- 172.21.15.69:0/1389215895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f92fc157420 0x7f92fc14fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:21.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.361+0000 7f9300902700 1 --2- 172.21.15.69:0/1389215895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92fc06d250 0x7f92fc154c80 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:21.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.361+0000 7f9300902700 1 --2- 172.21.15.69:0/1389215895 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f92fc0af6b0 0x7f92fc158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:21.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.361+0000 7f9300902700 1 -- 172.21.15.69:0/1389215895 >> 172.21.15.69:0/1389215895 conn(0x7f92fc06ce80 msgr2=0x7f92fc0aefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:21.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.361+0000 7f9300902700 1 -- 172.21.15.69:0/1389215895 shutdown_connections 2023-10-06T01:39:21.364 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.361+0000 7f9300902700 1 -- 172.21.15.69:0/1389215895 wait complete. 2023-10-06T01:39:21.374 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:39:21.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.490+0000 7f3a02821700 1 Processor -- start 2023-10-06T01:39:21.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.490+0000 7f3a02821700 1 -- start start 2023-10-06T01:39:21.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.491+0000 7f3a02821700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f39fc157420 0x7f39fc0b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:21.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.491+0000 7f3a02821700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39fc0ac840 con 0x7f39fc0af6b0 2023-10-06T01:39:21.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.491+0000 7f3a02821700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39fc0b18f0 con 0x7f39fc06d250 2023-10-06T01:39:21.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.491+0000 7f3a02821700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39fc0abf50 con 0x7f39fc157420 2023-10-06T01:39:21.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.491+0000 7f3a02020700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f39fc0af6b0 0x7f39fc0accd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44918/0 (socket says 172.21.15.69:44918) 2023-10-06T01:39:21.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.491+0000 7f3a0181f700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f39fc157420 0x7f39fc0b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:21.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.491+0000 7f3a02020700 1 -- 172.21.15.69:0/570205837 learned_addr learned my addr 172.21.15.69:0/570205837 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:21.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.492+0000 7f3a0081d700 1 -- 172.21.15.69:0/570205837 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3949059793 0 0) 0x7f39fc0ac840 con 0x7f39fc0af6b0 2023-10-06T01:39:21.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.492+0000 7f3a0081d700 1 -- 172.21.15.69:0/570205837 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f39e8003570 con 0x7f39fc0af6b0 2023-10-06T01:39:21.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.492+0000 7f3a0181f700 1 -- 172.21.15.69:0/570205837 >> v1:172.21.15.88:6789/0 conn(0x7f39fc06d250 legacy=0x7f39fc0aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:21.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.492+0000 7f3a0181f700 1 -- 172.21.15.69:0/570205837 >> v1:172.21.15.69:6789/0 conn(0x7f39fc0af6b0 legacy=0x7f39fc0accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:21.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.492+0000 7f3a0181f700 1 -- 172.21.15.69:0/570205837 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39fc0aea60 con 0x7f39fc157420 2023-10-06T01:39:21.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.492+0000 7f3a0181f700 1 --2- 172.21.15.69:0/570205837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39fc157420 0x7f39fc0b13b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f39f40098e0 tx=0x7f39f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95819f4e8c34f40 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:21.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.492+0000 7f3a0081d700 1 -- 172.21.15.69:0/570205837 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f400b640 con 0x7f39fc157420 2023-10-06T01:39:21.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.492+0000 7f3a0081d700 1 -- 172.21.15.69:0/570205837 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f400b7a0 con 0x7f39fc157420 2023-10-06T01:39:21.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.492+0000 7f3a0081d700 1 -- 172.21.15.69:0/570205837 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f400bb40 con 0x7f39fc157420 2023-10-06T01:39:21.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.493+0000 7f3a02821700 1 -- 172.21.15.69:0/570205837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39fc157420 msgr2=0x7f39fc0b13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:21.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.493+0000 7f3a02821700 1 --2- 172.21.15.69:0/570205837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39fc157420 0x7f39fc0b13b0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f39f40098e0 tx=0x7f39f40091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:21.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.493+0000 7f3a02821700 1 -- 172.21.15.69:0/570205837 shutdown_connections 2023-10-06T01:39:21.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.493+0000 7f3a02821700 1 --2- 172.21.15.69:0/570205837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39fc157420 0x7f39fc0b13b0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:21.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.493+0000 7f3a02821700 1 -- 172.21.15.69:0/570205837 >> 172.21.15.69:0/570205837 conn(0x7f39fc06ce80 msgr2=0x7f39fc0ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:21.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.493+0000 7f3a02821700 1 -- 172.21.15.69:0/570205837 shutdown_connections 2023-10-06T01:39:21.496 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.493+0000 7f3a02821700 1 -- 172.21.15.69:0/570205837 wait complete. 2023-10-06T01:39:21.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.494+0000 7f3a02821700 1 Processor -- start 2023-10-06T01:39:21.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.494+0000 7f3a02821700 1 -- start start 2023-10-06T01:39:21.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.495+0000 7f3a02821700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39fc06d250 0x7f39fc144ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:21.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.495+0000 7f3a02821700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39fc0af6b0 0x7f39fc1541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:21.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.495+0000 7f3a02821700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f39fc157420 0x7f39fc155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:21.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.495+0000 7f3a02821700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc155610 con 0x7f39fc06d250 2023-10-06T01:39:21.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.495+0000 7f3a02821700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc1453e0 con 0x7f39fc0af6b0 2023-10-06T01:39:21.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.495+0000 7f3a02821700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39fc099580 con 0x7f39fc157420 2023-10-06T01:39:21.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.495+0000 7f3a0181f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39fc06d250 0x7f39fc144ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:21.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.495+0000 7f3a0181f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39fc06d250 0x7f39fc144ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52300/0 (socket says 172.21.15.69:52300) 2023-10-06T01:39:21.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.495+0000 7f3a0181f700 1 -- 172.21.15.69:0/3495717654 learned_addr learned my addr 172.21.15.69:0/3495717654 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:21.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.495+0000 7f3a0101e700 1 --2- 172.21.15.69:0/3495717654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39fc0af6b0 0x7f39fc1541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:21.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.495+0000 7f3a02020700 1 --2- 172.21.15.69:0/3495717654 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f39fc157420 0x7f39fc155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:21.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.495+0000 7f3a0181f700 1 -- 172.21.15.69:0/3495717654 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f39fc157420 msgr2=0x7f39fc155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:21.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.495+0000 7f3a0181f700 1 --2- 172.21.15.69:0/3495717654 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f39fc157420 0x7f39fc155f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:21.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.495+0000 7f3a0181f700 1 -- 172.21.15.69:0/3495717654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39fc0af6b0 msgr2=0x7f39fc1541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:21.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.495+0000 7f3a0181f700 1 --2- 172.21.15.69:0/3495717654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39fc0af6b0 0x7f39fc1541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:21.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.495+0000 7f3a0181f700 1 -- 172.21.15.69:0/3495717654 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39f4009420 con 0x7f39fc06d250 2023-10-06T01:39:21.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.495+0000 7f3a02020700 1 --2- 172.21.15.69:0/3495717654 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f39fc157420 0x7f39fc155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:21.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.495+0000 7f3a0181f700 1 --2- 172.21.15.69:0/3495717654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39fc06d250 0x7f39fc144ea0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f39fc0710e0 tx=0x7f39f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:21.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.495+0000 7f39f1ffb700 1 -- 172.21.15.69:0/3495717654 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f4000d10 con 0x7f39fc06d250 2023-10-06T01:39:21.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.495+0000 7f39f1ffb700 1 -- 172.21.15.69:0/3495717654 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39f400bb20 con 0x7f39fc06d250 2023-10-06T01:39:21.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.495+0000 7f39f1ffb700 1 -- 172.21.15.69:0/3495717654 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39f4011650 con 0x7f39fc06d250 2023-10-06T01:39:21.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.495+0000 7f3a02821700 1 -- 172.21.15.69:0/3495717654 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39fc154a90 con 0x7f39fc06d250 2023-10-06T01:39:21.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.496+0000 7f3a02821700 1 -- 172.21.15.69:0/3495717654 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39fc154e20 con 0x7f39fc06d250 2023-10-06T01:39:21.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.497+0000 7f3a02821700 1 -- 172.21.15.69:0/3495717654 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39fc099740 con 0x7f39fc06d250 2023-10-06T01:39:21.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.497+0000 7f39f1ffb700 1 -- 172.21.15.69:0/3495717654 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f39f4011a00 con 0x7f39fc06d250 2023-10-06T01:39:21.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.497+0000 7f39f1ffb700 1 --2- 172.21.15.69:0/3495717654 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f39e0066f30 0x7f39e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:21.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.497+0000 7f39f1ffb700 1 -- 172.21.15.69:0/3495717654 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f39f4085cd0 con 0x7f39fc06d250 2023-10-06T01:39:21.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.497+0000 7f3a0101e700 1 --2- 172.21.15.69:0/3495717654 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f39e0066f30 0x7f39e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:21.501 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.498+0000 7f3a0101e700 1 --2- 172.21.15.69:0/3495717654 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f39e0066f30 0x7f39e00693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f39fc156c90 tx=0x7f39ec007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:21.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.501+0000 7f39f1ffb700 1 -- 172.21.15.69:0/3495717654 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39f4052de0 con 0x7f39fc06d250 2023-10-06T01:39:21.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.689+0000 7f3a02821700 1 -- 172.21.15.69:0/3495717654 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f39fc04c3c0 con 0x7f39fc06d250 2023-10-06T01:39:21.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.690+0000 7f39f1ffb700 1 -- 172.21.15.69:0/3495717654 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f39f40150a0 con 0x7f39fc06d250 2023-10-06T01:39:21.691 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 8 2023-10-06T01:39:21.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.692+0000 7f3a02821700 1 -- 172.21.15.69:0/3495717654 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f39e0066f30 msgr2=0x7f39e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:21.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.692+0000 7f3a02821700 1 --2- 172.21.15.69:0/3495717654 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f39e0066f30 0x7f39e00693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f39fc156c90 tx=0x7f39ec007ec0 comp rx=0 tx=0).stop 2023-10-06T01:39:21.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.692+0000 7f3a02821700 1 -- 172.21.15.69:0/3495717654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39fc06d250 msgr2=0x7f39fc144ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:21.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.692+0000 7f3a02821700 1 --2- 172.21.15.69:0/3495717654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39fc06d250 0x7f39fc144ea0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f39fc0710e0 tx=0x7f39f4017000 comp rx=0 tx=0).stop 2023-10-06T01:39:21.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.692+0000 7f3a02821700 1 -- 172.21.15.69:0/3495717654 shutdown_connections 2023-10-06T01:39:21.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.692+0000 7f3a02821700 1 --2- 172.21.15.69:0/3495717654 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f39e0066f30 0x7f39e00693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:21.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.692+0000 7f3a02821700 1 --2- 172.21.15.69:0/3495717654 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f39fc157420 0x7f39fc155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:21.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.692+0000 7f3a02821700 1 --2- 172.21.15.69:0/3495717654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f39fc06d250 0x7f39fc144ea0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:21.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.692+0000 7f3a02821700 1 --2- 172.21.15.69:0/3495717654 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f39fc0af6b0 0x7f39fc1541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:21.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.692+0000 7f3a02821700 1 -- 172.21.15.69:0/3495717654 >> 172.21.15.69:0/3495717654 conn(0x7f39fc06ce80 msgr2=0x7f39fc150af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:21.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.692+0000 7f3a02821700 1 -- 172.21.15.69:0/3495717654 shutdown_connections 2023-10-06T01:39:21.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.692+0000 7f3a02821700 1 -- 172.21.15.69:0/3495717654 wait complete. 2023-10-06T01:39:21.705 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T01:39:21.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.820+0000 7fca7cebb700 1 Processor -- start 2023-10-06T01:39:21.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.820+0000 7fca7cebb700 1 -- start start 2023-10-06T01:39:21.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.821+0000 7fca7cebb700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fca78153a00 0x7fca78153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:21.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.821+0000 7fca7cebb700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fca780cea00 0x7fca780cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:21.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.821+0000 7fca7cebb700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca7815ac50 con 0x7fca7815de50 2023-10-06T01:39:21.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.821+0000 7fca7cebb700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca7815d010 con 0x7fca78153a00 2023-10-06T01:39:21.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.821+0000 7fca7cebb700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca780cf3c0 con 0x7fca780cea00 2023-10-06T01:39:21.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.821+0000 7fca777fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fca78153a00 0x7fca78153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:21.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.821+0000 7fca777fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fca78153a00 0x7fca78153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52316/0 (socket says 172.21.15.69:52316) 2023-10-06T01:39:21.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.821+0000 7fca777fe700 1 -- 172.21.15.69:0/3199791683 learned_addr learned my addr 172.21.15.69:0/3199791683 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:21.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.821+0000 7fca77fff700 1 --2- 172.21.15.69:0/3199791683 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fca780cea00 0x7fca780cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:21.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.821+0000 7fca777fe700 1 -- 172.21.15.69:0/3199791683 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fca780cea00 msgr2=0x7fca780cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:21.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.821+0000 7fca777fe700 1 --2- 172.21.15.69:0/3199791683 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fca780cea00 0x7fca780cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:21.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.821+0000 7fca777fe700 1 -- 172.21.15.69:0/3199791683 >> v1:172.21.15.88:6789/0 conn(0x7fca7815de50 legacy=0x7fca7815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:21.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.821+0000 7fca777fe700 1 -- 172.21.15.69:0/3199791683 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca7815af60 con 0x7fca78153a00 2023-10-06T01:39:21.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.822+0000 7fca777fe700 1 --2- 172.21.15.69:0/3199791683 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca78153a00 0x7fca78153dd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fca68009f20 tx=0x7fca68009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0394551df0a13b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:21.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.822+0000 7fca767fc700 1 -- 172.21.15.69:0/3199791683 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6800e070 con 0x7fca78153a00 2023-10-06T01:39:21.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.822+0000 7fca767fc700 1 -- 172.21.15.69:0/3199791683 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6800b9d0 con 0x7fca78153a00 2023-10-06T01:39:21.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.822+0000 7fca767fc700 1 -- 172.21.15.69:0/3199791683 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca680092e0 con 0x7fca78153a00 2023-10-06T01:39:21.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.822+0000 7fca7cebb700 1 -- 172.21.15.69:0/3199791683 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca78153a00 msgr2=0x7fca78153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:21.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.822+0000 7fca7cebb700 1 --2- 172.21.15.69:0/3199791683 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca78153a00 0x7fca78153dd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fca68009f20 tx=0x7fca68009840 comp rx=0 tx=0).stop 2023-10-06T01:39:21.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.822+0000 7fca7cebb700 1 -- 172.21.15.69:0/3199791683 shutdown_connections 2023-10-06T01:39:21.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.822+0000 7fca7cebb700 1 --2- 172.21.15.69:0/3199791683 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fca780cea00 0x7fca780cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:21.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.822+0000 7fca7cebb700 1 --2- 172.21.15.69:0/3199791683 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca78153a00 0x7fca78153dd0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:21.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.822+0000 7fca7cebb700 1 -- 172.21.15.69:0/3199791683 >> 172.21.15.69:0/3199791683 conn(0x7fca780703a0 msgr2=0x7fca780707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:21.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.822+0000 7fca7cebb700 1 -- 172.21.15.69:0/3199791683 shutdown_connections 2023-10-06T01:39:21.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.822+0000 7fca7cebb700 1 -- 172.21.15.69:0/3199791683 wait complete. 2023-10-06T01:39:21.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.823+0000 7fca7cebb700 1 Processor -- start 2023-10-06T01:39:21.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.824+0000 7fca7cebb700 1 -- start start 2023-10-06T01:39:21.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.824+0000 7fca7cebb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca780cea00 0x7fca780c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:21.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.824+0000 7fca7cebb700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fca78153a00 0x7fca78152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:21.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.824+0000 7fca7cebb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca7815de50 0x7fca780c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:21.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.824+0000 7fca7cebb700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7816d180 con 0x7fca780cea00 2023-10-06T01:39:21.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.824+0000 7fca7cebb700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca7816d3d0 con 0x7fca7815de50 2023-10-06T01:39:21.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.824+0000 7fca7cebb700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7816d6b0 con 0x7fca78153a00 2023-10-06T01:39:21.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.824+0000 7fca777fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca780cea00 0x7fca780c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:21.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.824+0000 7fca777fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca780cea00 0x7fca780c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52322/0 (socket says 172.21.15.69:52322) 2023-10-06T01:39:21.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.824+0000 7fca777fe700 1 -- 172.21.15.69:0/2220818945 learned_addr learned my addr 172.21.15.69:0/2220818945 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:21.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.824+0000 7fca77fff700 1 --2- 172.21.15.69:0/2220818945 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca7815de50 0x7fca780c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:21.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.824+0000 7fca76ffd700 1 --2- 172.21.15.69:0/2220818945 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fca78153a00 0x7fca78152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:21.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.825+0000 7fca777fe700 1 -- 172.21.15.69:0/2220818945 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fca78153a00 msgr2=0x7fca78152cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:21.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.825+0000 7fca777fe700 1 --2- 172.21.15.69:0/2220818945 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fca78153a00 0x7fca78152cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:21.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.825+0000 7fca777fe700 1 -- 172.21.15.69:0/2220818945 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca7815de50 msgr2=0x7fca780c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:21.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.825+0000 7fca777fe700 1 --2- 172.21.15.69:0/2220818945 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca7815de50 0x7fca780c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:21.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.825+0000 7fca777fe700 1 -- 172.21.15.69:0/2220818945 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca68009ae0 con 0x7fca780cea00 2023-10-06T01:39:21.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.825+0000 7fca777fe700 1 --2- 172.21.15.69:0/2220818945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca780cea00 0x7fca780c75e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fca6800b610 tx=0x7fca68018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:21.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.825+0000 7fca5f7fe700 1 -- 172.21.15.69:0/2220818945 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca680088f0 con 0x7fca780cea00 2023-10-06T01:39:21.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.825+0000 7fca5f7fe700 1 -- 172.21.15.69:0/2220818945 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca68008a50 con 0x7fca780cea00 2023-10-06T01:39:21.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.825+0000 7fca7cebb700 1 -- 172.21.15.69:0/2220818945 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca7816d990 con 0x7fca780cea00 2023-10-06T01:39:21.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.825+0000 7fca5f7fe700 1 -- 172.21.15.69:0/2220818945 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca68008e10 con 0x7fca780cea00 2023-10-06T01:39:21.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.825+0000 7fca7cebb700 1 -- 172.21.15.69:0/2220818945 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca7816df50 con 0x7fca780cea00 2023-10-06T01:39:21.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.826+0000 7fca7cebb700 1 -- 172.21.15.69:0/2220818945 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca78169bd0 con 0x7fca780cea00 2023-10-06T01:39:21.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.826+0000 7fca5f7fe700 1 -- 172.21.15.69:0/2220818945 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fca68003040 con 0x7fca780cea00 2023-10-06T01:39:21.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.827+0000 7fca5f7fe700 1 --2- 172.21.15.69:0/2220818945 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fca64066f30 0x7fca640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:21.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.827+0000 7fca5f7fe700 1 -- 172.21.15.69:0/2220818945 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fca680863d0 con 0x7fca780cea00 2023-10-06T01:39:21.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.827+0000 7fca76ffd700 1 --2- 172.21.15.69:0/2220818945 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fca64066f30 0x7fca640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:21.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.827+0000 7fca76ffd700 1 --2- 172.21.15.69:0/2220818945 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fca64066f30 0x7fca640693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fca781510f0 tx=0x7fca6c007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:21.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:21.831+0000 7fca5f7fe700 1 -- 172.21.15.69:0/2220818945 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fca680534f0 con 0x7fca780cea00 2023-10-06T01:39:22.012 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.011+0000 7fca7cebb700 1 -- 172.21.15.69:0/2220818945 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fca7804c3c0 con 0x7fca780cea00 2023-10-06T01:39:22.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.012+0000 7fca5f7fe700 1 -- 172.21.15.69:0/2220818945 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7fca68056b10 con 0x7fca780cea00 2023-10-06T01:39:22.013 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-10-06T01:39:22.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.014+0000 7fca7cebb700 1 -- 172.21.15.69:0/2220818945 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fca64066f30 msgr2=0x7fca640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:22.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.014+0000 7fca7cebb700 1 --2- 172.21.15.69:0/2220818945 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fca64066f30 0x7fca640693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fca781510f0 tx=0x7fca6c007ec0 comp rx=0 tx=0).stop 2023-10-06T01:39:22.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.014+0000 7fca7cebb700 1 -- 172.21.15.69:0/2220818945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca780cea00 msgr2=0x7fca780c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:22.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.014+0000 7fca7cebb700 1 --2- 172.21.15.69:0/2220818945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca780cea00 0x7fca780c75e0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fca6800b610 tx=0x7fca68018000 comp rx=0 tx=0).stop 2023-10-06T01:39:22.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.014+0000 7fca7cebb700 1 -- 172.21.15.69:0/2220818945 shutdown_connections 2023-10-06T01:39:22.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.014+0000 7fca7cebb700 1 --2- 172.21.15.69:0/2220818945 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fca64066f30 0x7fca640693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:22.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.014+0000 7fca7cebb700 1 --2- 172.21.15.69:0/2220818945 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fca7815de50 0x7fca780c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:22.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.014+0000 7fca7cebb700 1 --2- 172.21.15.69:0/2220818945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fca780cea00 0x7fca780c75e0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:22.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.014+0000 7fca7cebb700 1 --2- 172.21.15.69:0/2220818945 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fca78153a00 0x7fca78152cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:22.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.014+0000 7fca7cebb700 1 -- 172.21.15.69:0/2220818945 >> 172.21.15.69:0/2220818945 conn(0x7fca780703a0 msgr2=0x7fca78151f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:22.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.014+0000 7fca7cebb700 1 -- 172.21.15.69:0/2220818945 shutdown_connections 2023-10-06T01:39:22.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.014+0000 7fca7cebb700 1 -- 172.21.15.69:0/2220818945 wait complete. 2023-10-06T01:39:22.027 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T01:39:22.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.143+0000 7f4862fb0700 1 Processor -- start 2023-10-06T01:39:22.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.143+0000 7f4862fb0700 1 -- start start 2023-10-06T01:39:22.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.144+0000 7f4862fb0700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f485c159ee0 0x7f485c06a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:22.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.144+0000 7f4862fb0700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f485c06d070 con 0x7f485c159b10 2023-10-06T01:39:22.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.144+0000 7f4862fb0700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f485c06af30 con 0x7f485c06aae0 2023-10-06T01:39:22.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.144+0000 7f4862fb0700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f485c0b0030 con 0x7f485c159ee0 2023-10-06T01:39:22.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.144+0000 7f4860d4c700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f485c159b10 0x7f485c0af920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44922/0 (socket says 172.21.15.69:44922) 2023-10-06T01:39:22.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.144+0000 7f4860d4c700 1 -- 172.21.15.69:0/4133697372 learned_addr learned my addr 172.21.15.69:0/4133697372 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:22.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.144+0000 7f485b7fe700 1 -- 172.21.15.69:0/4133697372 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 801315152 0 0) 0x7f485c06d070 con 0x7f485c159b10 2023-10-06T01:39:22.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.144+0000 7f485bfff700 1 --2- 172.21.15.69:0/4133697372 >> v2:172.21.15.88:3300/0 conn(0x7f485c159ee0 0x7f485c06a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:22.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.145+0000 7f485b7fe700 1 -- 172.21.15.69:0/4133697372 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f484c003570 con 0x7f485c159b10 2023-10-06T01:39:22.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.145+0000 7f485b7fe700 1 -- 172.21.15.69:0/4133697372 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4223565116 0 0) 0x7f484c003570 con 0x7f485c159b10 2023-10-06T01:39:22.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.145+0000 7f485b7fe700 1 -- 172.21.15.69:0/4133697372 >> v2:172.21.15.88:3300/0 conn(0x7f485c159ee0 msgr2=0x7f485c06a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:22.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.145+0000 7f485b7fe700 1 --2- 172.21.15.69:0/4133697372 >> v2:172.21.15.88:3300/0 conn(0x7f485c159ee0 0x7f485c06a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:22.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.145+0000 7f485b7fe700 1 -- 172.21.15.69:0/4133697372 >> v1:172.21.15.88:6789/0 conn(0x7f485c06aae0 legacy=0x7f485c06d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:22.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.145+0000 7f485b7fe700 1 -- 172.21.15.69:0/4133697372 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485c0c9270 con 0x7f485c159b10 2023-10-06T01:39:22.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.145+0000 7f485b7fe700 1 -- 172.21.15.69:0/4133697372 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f48500015f0 con 0x7f485c159b10 2023-10-06T01:39:22.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.145+0000 7f485b7fe700 1 -- 172.21.15.69:0/4133697372 >> v1:172.21.15.69:6789/0 conn(0x7f485c159b10 legacy=0x7f485c0af920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:22.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.145+0000 7f485b7fe700 1 --2- 172.21.15.69:0/4133697372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f484c003a60 0x7f484c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:22.149 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.145+0000 7f485b7fe700 1 --2- 172.21.15.69:0/4133697372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f484c004810 0x7f484c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:22.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.145+0000 7f485b7fe700 1 --2- 172.21.15.69:0/4133697372 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f484c0051c0 0x7f484c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:22.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.145+0000 7f485b7fe700 1 -- 172.21.15.69:0/4133697372 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c0b0030 con 0x7f484c003a60 2023-10-06T01:39:22.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.145+0000 7f485b7fe700 1 -- 172.21.15.69:0/4133697372 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c00c160 con 0x7f484c004810 2023-10-06T01:39:22.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.145+0000 7f485b7fe700 1 -- 172.21.15.69:0/4133697372 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484c00c320 con 0x7f484c0051c0 2023-10-06T01:39:22.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.145+0000 7f4860d4c700 1 --2- 172.21.15.69:0/4133697372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f484c003a60 0x7f484c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:22.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.145+0000 7f485bfff700 1 --2- 172.21.15.69:0/4133697372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f484c004810 0x7f484c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:22.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.145+0000 7f486154d700 1 --2- 172.21.15.69:0/4133697372 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f484c0051c0 0x7f484c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:22.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.145+0000 7f4860d4c700 1 -- 172.21.15.69:0/4133697372 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f484c0051c0 msgr2=0x7f484c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:22.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.145+0000 7f4860d4c700 1 --2- 172.21.15.69:0/4133697372 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f484c0051c0 0x7f484c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:22.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.145+0000 7f4860d4c700 1 -- 172.21.15.69:0/4133697372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f484c004810 msgr2=0x7f484c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:22.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.145+0000 7f4860d4c700 1 --2- 172.21.15.69:0/4133697372 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f484c004810 0x7f484c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:22.150 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.145+0000 7f4860d4c700 1 -- 172.21.15.69:0/4133697372 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484c003570 con 0x7f484c003a60 2023-10-06T01:39:22.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.145+0000 7f486154d700 1 -- 172.21.15.69:0/4133697372 reap_dead start 2023-10-06T01:39:22.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.145+0000 7f4860d4c700 1 --2- 172.21.15.69:0/4133697372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f484c003a60 0x7f484c003e70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f485000c3c0 tx=0x7f4850007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a8d9623a0c335e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:22.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.145+0000 7f485b7fe700 1 -- 172.21.15.69:0/4133697372 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f485000cc90 con 0x7f484c003a60 2023-10-06T01:39:22.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.145+0000 7f485b7fe700 1 -- 172.21.15.69:0/4133697372 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485000ce10 con 0x7f484c003a60 2023-10-06T01:39:22.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.145+0000 7f485b7fe700 1 -- 172.21.15.69:0/4133697372 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4850007320 con 0x7f484c003a60 2023-10-06T01:39:22.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.146+0000 7f4862fb0700 1 -- 172.21.15.69:0/4133697372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f484c003a60 msgr2=0x7f484c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:22.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.146+0000 7f4862fb0700 1 --2- 172.21.15.69:0/4133697372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f484c003a60 0x7f484c003e70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f485000c3c0 tx=0x7f4850007920 comp rx=0 tx=0).stop 2023-10-06T01:39:22.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.146+0000 7f4862fb0700 1 -- 172.21.15.69:0/4133697372 shutdown_connections 2023-10-06T01:39:22.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.146+0000 7f4862fb0700 1 --2- 172.21.15.69:0/4133697372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f484c003a60 0x7f484c003e70 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:22.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.146+0000 7f4862fb0700 1 -- 172.21.15.69:0/4133697372 >> 172.21.15.69:0/4133697372 conn(0x7f485c0ccb60 msgr2=0x7f485c0ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:22.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.146+0000 7f4862fb0700 1 -- 172.21.15.69:0/4133697372 shutdown_connections 2023-10-06T01:39:22.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.146+0000 7f4862fb0700 1 -- 172.21.15.69:0/4133697372 wait complete. 2023-10-06T01:39:22.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.147+0000 7f4862fb0700 1 Processor -- start 2023-10-06T01:39:22.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.147+0000 7f4862fb0700 1 -- start start 2023-10-06T01:39:22.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.148+0000 7f4862fb0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f484c003a60 0x7f485c1697f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:22.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.148+0000 7f4862fb0700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f485c15ac60 0x7f485c15c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:22.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.148+0000 7f4862fb0700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f485c0c59b0 0x7f485c0c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:22.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.148+0000 7f4862fb0700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c0c6350 con 0x7f484c003a60 2023-10-06T01:39:22.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.148+0000 7f4862fb0700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c169d30 con 0x7f485c0c59b0 2023-10-06T01:39:22.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.148+0000 7f4862fb0700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f485c15bdd0 con 0x7f485c15ac60 2023-10-06T01:39:22.154 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.148+0000 7f4860d4c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f484c003a60 0x7f485c1697f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:22.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.148+0000 7f4860d4c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f484c003a60 0x7f485c1697f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52328/0 (socket says 172.21.15.69:52328) 2023-10-06T01:39:22.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.148+0000 7f4860d4c700 1 -- 172.21.15.69:0/1201642215 learned_addr learned my addr 172.21.15.69:0/1201642215 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:22.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.148+0000 7f485bfff700 1 --2- 172.21.15.69:0/1201642215 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f485c15ac60 0x7f485c15c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:22.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.148+0000 7f486154d700 1 --2- 172.21.15.69:0/1201642215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f485c0c59b0 0x7f485c0c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:22.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.148+0000 7f4860d4c700 1 -- 172.21.15.69:0/1201642215 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f485c15ac60 msgr2=0x7f485c15c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:22.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.148+0000 7f4860d4c700 1 --2- 172.21.15.69:0/1201642215 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f485c15ac60 0x7f485c15c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:22.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.148+0000 7f4860d4c700 1 -- 172.21.15.69:0/1201642215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f485c0c59b0 msgr2=0x7f485c0c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:22.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.148+0000 7f4860d4c700 1 --2- 172.21.15.69:0/1201642215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f485c0c59b0 0x7f485c0c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:22.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.148+0000 7f4860d4c700 1 -- 172.21.15.69:0/1201642215 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485c15b1c0 con 0x7f484c003a60 2023-10-06T01:39:22.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.149+0000 7f4860d4c700 1 --2- 172.21.15.69:0/1201642215 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f484c003a60 0x7f485c1697f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f485000c9b0 tx=0x7f4850015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:22.155 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.149+0000 7f4858ff9700 1 -- 172.21.15.69:0/1201642215 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4850020070 con 0x7f484c003a60 2023-10-06T01:39:22.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.149+0000 7f4858ff9700 1 -- 172.21.15.69:0/1201642215 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f485000cc90 con 0x7f484c003a60 2023-10-06T01:39:22.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.149+0000 7f4858ff9700 1 -- 172.21.15.69:0/1201642215 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4850005c30 con 0x7f484c003a60 2023-10-06T01:39:22.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.149+0000 7f4862fb0700 1 -- 172.21.15.69:0/1201642215 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f485c15b4a0 con 0x7f484c003a60 2023-10-06T01:39:22.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.149+0000 7f4862fb0700 1 -- 172.21.15.69:0/1201642215 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f485c15ba60 con 0x7f484c003a60 2023-10-06T01:39:22.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.150+0000 7f4862fb0700 1 -- 172.21.15.69:0/1201642215 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f485c04c3c0 con 0x7f484c003a60 2023-10-06T01:39:22.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.150+0000 7f4858ff9700 1 -- 172.21.15.69:0/1201642215 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4850019420 con 0x7f484c003a60 2023-10-06T01:39:22.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.150+0000 7f4858ff9700 1 --2- 172.21.15.69:0/1201642215 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4840066f30 0x7f48400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:22.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.150+0000 7f4858ff9700 1 -- 172.21.15.69:0/1201642215 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4850086760 con 0x7f484c003a60 2023-10-06T01:39:22.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.150+0000 7f485bfff700 1 --2- 172.21.15.69:0/1201642215 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4840066f30 0x7f48400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:22.156 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.151+0000 7f485bfff700 1 --2- 172.21.15.69:0/1201642215 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4840066f30 0x7f48400693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4848006f00 tx=0x7f48480091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:22.157 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.155+0000 7f4858ff9700 1 -- 172.21.15.69:0/1201642215 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4850053870 con 0x7f484c003a60 2023-10-06T01:39:22.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.337+0000 7f4862fb0700 1 -- 172.21.15.69:0/1201642215 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f485c0ca2f0 con 0x7f484c003a60 2023-10-06T01:39:22.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.337+0000 7f4858ff9700 1 -- 172.21.15.69:0/1201642215 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4850017030 con 0x7f484c003a60 2023-10-06T01:39:22.339 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-10-06T01:39:22.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.339+0000 7f4862fb0700 1 -- 172.21.15.69:0/1201642215 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4840066f30 msgr2=0x7f48400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:22.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.339+0000 7f4862fb0700 1 --2- 172.21.15.69:0/1201642215 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4840066f30 0x7f48400693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4848006f00 tx=0x7f48480091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:22.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.339+0000 7f4862fb0700 1 -- 172.21.15.69:0/1201642215 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f484c003a60 msgr2=0x7f485c1697f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:22.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.339+0000 7f4862fb0700 1 --2- 172.21.15.69:0/1201642215 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f484c003a60 0x7f485c1697f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f485000c9b0 tx=0x7f4850015000 comp rx=0 tx=0).stop 2023-10-06T01:39:22.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.339+0000 7f4862fb0700 1 -- 172.21.15.69:0/1201642215 shutdown_connections 2023-10-06T01:39:22.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.339+0000 7f4862fb0700 1 --2- 172.21.15.69:0/1201642215 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4840066f30 0x7f48400693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:22.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.339+0000 7f4862fb0700 1 --2- 172.21.15.69:0/1201642215 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f485c0c59b0 0x7f485c0c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:22.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.339+0000 7f4862fb0700 1 --2- 172.21.15.69:0/1201642215 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f484c003a60 0x7f485c1697f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:22.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.339+0000 7f4862fb0700 1 --2- 172.21.15.69:0/1201642215 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f485c15ac60 0x7f485c15c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:22.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.339+0000 7f4862fb0700 1 -- 172.21.15.69:0/1201642215 >> 172.21.15.69:0/1201642215 conn(0x7f485c0ccb60 msgr2=0x7f485c0c9560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:22.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.339+0000 7f4862fb0700 1 -- 172.21.15.69:0/1201642215 shutdown_connections 2023-10-06T01:39:22.342 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.339+0000 7f4862fb0700 1 -- 172.21.15.69:0/1201642215 wait complete. 2023-10-06T01:39:22.470 INFO:tasks.cephfs_test_runner:Starting test: test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) 2023-10-06T01:39:22.471 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread' 2023-10-06T01:39:22.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.586+0000 7f1784f86700 1 Processor -- start 2023-10-06T01:39:22.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.586+0000 7f1784f86700 1 -- start start 2023-10-06T01:39:22.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.587+0000 7f1784f86700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f178006c8f0 0x7f178015d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:22.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.587+0000 7f1784f86700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f17800ccac0 0x7f17800cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:22.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.587+0000 7f1784f86700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17800cb460 con 0x7f17800cbe30 2023-10-06T01:39:22.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.587+0000 7f1784f86700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17800cb180 con 0x7f17800ccac0 2023-10-06T01:39:22.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.587+0000 7f1784f86700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178015db00 con 0x7f178006c8f0 2023-10-06T01:39:22.590 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.587+0000 7f177effd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f17800ccac0 0x7f17800cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:22.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.587+0000 7f177ffff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f17800cbe30 0x7f17800a98f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44932/0 (socket says 172.21.15.69:44932) 2023-10-06T01:39:22.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.587+0000 7f177ffff700 1 -- 172.21.15.69:0/3916916512 learned_addr learned my addr 172.21.15.69:0/3916916512 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:22.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.588+0000 7f177f7fe700 1 --2- 172.21.15.69:0/3916916512 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f178006c8f0 0x7f178015d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:22.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.588+0000 7f177effd700 1 -- 172.21.15.69:0/3916916512 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f178006c8f0 msgr2=0x7f178015d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:22.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.588+0000 7f177effd700 1 --2- 172.21.15.69:0/3916916512 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f178006c8f0 0x7f178015d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:22.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.588+0000 7f177effd700 1 -- 172.21.15.69:0/3916916512 >> v1:172.21.15.69:6789/0 conn(0x7f17800cbe30 legacy=0x7f17800a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:22.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.588+0000 7f177effd700 1 -- 172.21.15.69:0/3916916512 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178015dde0 con 0x7f17800ccac0 2023-10-06T01:39:22.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.588+0000 7f177e7fc700 1 -- 172.21.15.69:0/3916916512 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 390953185 0 0) 0x7f17800cb460 con 0x7f17800cbe30 2023-10-06T01:39:22.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.588+0000 7f177f7fe700 1 --2- 172.21.15.69:0/3916916512 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f178006c8f0 0x7f178015d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:22.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.588+0000 7f177effd700 1 --2- 172.21.15.69:0/3916916512 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17800ccac0 0x7f17800cb8f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f17740098e0 tx=0x7f17740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e01c9ccd6c8ff29 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:22.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.588+0000 7f177e7fc700 1 -- 172.21.15.69:0/3916916512 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1774009e80 con 0x7f17800ccac0 2023-10-06T01:39:22.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.588+0000 7f177e7fc700 1 -- 172.21.15.69:0/3916916512 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f177400b860 con 0x7f17800ccac0 2023-10-06T01:39:22.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.588+0000 7f177e7fc700 1 -- 172.21.15.69:0/3916916512 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f177400bbe0 con 0x7f17800ccac0 2023-10-06T01:39:22.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.588+0000 7f1784f86700 1 -- 172.21.15.69:0/3916916512 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17800ccac0 msgr2=0x7f17800cb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:22.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.588+0000 7f1784f86700 1 --2- 172.21.15.69:0/3916916512 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17800ccac0 0x7f17800cb8f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f17740098e0 tx=0x7f17740091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:22.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.588+0000 7f1784f86700 1 -- 172.21.15.69:0/3916916512 shutdown_connections 2023-10-06T01:39:22.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.588+0000 7f1784f86700 1 --2- 172.21.15.69:0/3916916512 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f178006c8f0 0x7f178015d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:22.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.588+0000 7f1784f86700 1 --2- 172.21.15.69:0/3916916512 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17800ccac0 0x7f17800cb8f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:22.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.588+0000 7f1784f86700 1 -- 172.21.15.69:0/3916916512 >> 172.21.15.69:0/3916916512 conn(0x7f178006e280 msgr2=0x7f17800cd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:22.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.588+0000 7f1784f86700 1 -- 172.21.15.69:0/3916916512 shutdown_connections 2023-10-06T01:39:22.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.588+0000 7f1784f86700 1 -- 172.21.15.69:0/3916916512 wait complete. 2023-10-06T01:39:22.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.590+0000 7f1784f86700 1 Processor -- start 2023-10-06T01:39:22.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.590+0000 7f1784f86700 1 -- start start 2023-10-06T01:39:22.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.590+0000 7f1784f86700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f178006c8f0 0x7f178015b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:22.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.590+0000 7f1784f86700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f17800cbe30 0x7f178014a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:22.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.590+0000 7f1784f86700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17800ccac0 0x7f178016cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:22.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.590+0000 7f1784f86700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17800c64c0 con 0x7f17800ccac0 2023-10-06T01:39:22.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.590+0000 7f1784f86700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17800c5f10 con 0x7f178006c8f0 2023-10-06T01:39:22.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.590+0000 7f1784f86700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17800c6190 con 0x7f17800cbe30 2023-10-06T01:39:22.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.590+0000 7f177ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17800ccac0 0x7f178016cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:22.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.591+0000 7f177ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17800ccac0 0x7f178016cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52354/0 (socket says 172.21.15.69:52354) 2023-10-06T01:39:22.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.591+0000 7f177ffff700 1 -- 172.21.15.69:0/4232949213 learned_addr learned my addr 172.21.15.69:0/4232949213 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:22.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.591+0000 7f177effd700 1 --2- 172.21.15.69:0/4232949213 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f17800cbe30 0x7f178014a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:22.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.591+0000 7f177ffff700 1 -- 172.21.15.69:0/4232949213 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f17800cbe30 msgr2=0x7f178014a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:22.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.591+0000 7f177ffff700 1 --2- 172.21.15.69:0/4232949213 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f17800cbe30 0x7f178014a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:22.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.591+0000 7f177ffff700 1 -- 172.21.15.69:0/4232949213 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f178006c8f0 msgr2=0x7f178015b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:22.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.591+0000 7f177ffff700 1 --2- 172.21.15.69:0/4232949213 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f178006c8f0 0x7f178015b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:22.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.591+0000 7f177ffff700 1 -- 172.21.15.69:0/4232949213 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1774009420 con 0x7f17800ccac0 2023-10-06T01:39:22.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.591+0000 7f177effd700 1 --2- 172.21.15.69:0/4232949213 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f17800cbe30 0x7f178014a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:22.596 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.591+0000 7f177ffff700 1 --2- 172.21.15.69:0/4232949213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17800ccac0 0x7f178016cc10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f177800c5d0 tx=0x7f1778007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:22.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.591+0000 7f17677fe700 1 -- 172.21.15.69:0/4232949213 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1778005b30 con 0x7f17800ccac0 2023-10-06T01:39:22.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.591+0000 7f17677fe700 1 -- 172.21.15.69:0/4232949213 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1778005c90 con 0x7f17800ccac0 2023-10-06T01:39:22.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.591+0000 7f1784f86700 1 -- 172.21.15.69:0/4232949213 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17800c4a70 con 0x7f17800ccac0 2023-10-06T01:39:22.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.591+0000 7f17677fe700 1 -- 172.21.15.69:0/4232949213 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1778007320 con 0x7f17800ccac0 2023-10-06T01:39:22.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.591+0000 7f1784f86700 1 -- 172.21.15.69:0/4232949213 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17800c4530 con 0x7f17800ccac0 2023-10-06T01:39:22.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.592+0000 7f1784f86700 1 -- 172.21.15.69:0/4232949213 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f178004c3c0 con 0x7f17800ccac0 2023-10-06T01:39:22.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.592+0000 7f17677fe700 1 -- 172.21.15.69:0/4232949213 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1778007690 con 0x7f17800ccac0 2023-10-06T01:39:22.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.593+0000 7f17677fe700 1 --2- 172.21.15.69:0/4232949213 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f176c066f30 0x7f176c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:22.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.593+0000 7f17677fe700 1 -- 172.21.15.69:0/4232949213 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1778083d60 con 0x7f17800ccac0 2023-10-06T01:39:22.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.593+0000 7f177f7fe700 1 --2- 172.21.15.69:0/4232949213 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f176c066f30 0x7f176c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:22.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.593+0000 7f177f7fe700 1 --2- 172.21.15.69:0/4232949213 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f176c066f30 0x7f176c0693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f177000c3d0 tx=0x7f17700074d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:22.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.597+0000 7f17677fe700 1 -- 172.21.15.69:0/4232949213 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1778050d40 con 0x7f17800ccac0 2023-10-06T01:39:22.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:22.857+0000 7f1784f86700 1 -- 172.21.15.69:0/4232949213 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]} v 0) v1 -- 0x7f178015e0c0 con 0x7f17800ccac0 2023-10-06T01:39:23.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.540+0000 7f17677fe700 1 -- 172.21.15.69:0/4232949213 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]}]=0 v54) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1778017070 con 0x7f17800ccac0 2023-10-06T01:39:23.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.543+0000 7f1784f86700 1 -- 172.21.15.69:0/4232949213 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f176c066f30 msgr2=0x7f176c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:23.544 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.543+0000 7f1784f86700 1 --2- 172.21.15.69:0/4232949213 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f176c066f30 0x7f176c0693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f177000c3d0 tx=0x7f17700074d0 comp rx=0 tx=0).stop 2023-10-06T01:39:23.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.543+0000 7f1784f86700 1 -- 172.21.15.69:0/4232949213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17800ccac0 msgr2=0x7f178016cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:23.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.543+0000 7f1784f86700 1 --2- 172.21.15.69:0/4232949213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17800ccac0 0x7f178016cc10 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f177800c5d0 tx=0x7f1778007d30 comp rx=0 tx=0).stop 2023-10-06T01:39:23.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.543+0000 7f1784f86700 1 -- 172.21.15.69:0/4232949213 shutdown_connections 2023-10-06T01:39:23.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.543+0000 7f1784f86700 1 --2- 172.21.15.69:0/4232949213 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f176c066f30 0x7f176c0693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:23.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.543+0000 7f1784f86700 1 --2- 172.21.15.69:0/4232949213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17800ccac0 0x7f178016cc10 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:23.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.543+0000 7f1784f86700 1 --2- 172.21.15.69:0/4232949213 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f178006c8f0 0x7f178015b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:23.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.543+0000 7f1784f86700 1 --2- 172.21.15.69:0/4232949213 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f17800cbe30 0x7f178014a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:23.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.543+0000 7f1784f86700 1 -- 172.21.15.69:0/4232949213 >> 172.21.15.69:0/4232949213 conn(0x7f178006e280 msgr2=0x7f1780067e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:23.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.543+0000 7f1784f86700 1 -- 172.21.15.69:0/4232949213 shutdown_connections 2023-10-06T01:39:23.545 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.543+0000 7f1784f86700 1 -- 172.21.15.69:0/4232949213 wait complete. 2023-10-06T01:39:23.559 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T01:39:23.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.679+0000 7feccd66b700 1 Processor -- start 2023-10-06T01:39:23.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.679+0000 7feccd66b700 1 -- start start 2023-10-06T01:39:23.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.680+0000 7feccd66b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fecc8155b60 0x7fecc80b0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:23.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.680+0000 7feccd66b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fecc8155f30 0x7fecc8156380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:23.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.680+0000 7feccd66b700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecc81575a0 con 0x7fecc80ccb10 2023-10-06T01:39:23.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.680+0000 7feccd66b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecc8156990 con 0x7fecc8155b60 2023-10-06T01:39:23.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.680+0000 7feccd66b700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc8156c70 con 0x7fecc8155f30 2023-10-06T01:39:23.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.680+0000 7fecbe7fc700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fecc8155f30 0x7fecc8156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:23.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.680+0000 7fecc6ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fecc8155b60 0x7fecc80b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:23.684 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.680+0000 7fecc77fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fecc80ccb10 0x7fecc81599d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.69:48754/0 (socket says 172.21.15.69:48754) 2023-10-06T01:39:23.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.680+0000 7fecbe7fc700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fecc8155f30 0x7fecc8156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.69:56322/0 (socket says 172.21.15.69:56322) 2023-10-06T01:39:23.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.680+0000 7fecc77fe700 1 -- 172.21.15.69:0/2226082128 learned_addr learned my addr 172.21.15.69:0/2226082128 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:23.685 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.681+0000 7fecbe7fc700 1 -- 172.21.15.69:0/2226082128 >> v2:172.21.15.88:3300/0 conn(0x7fecc8155b60 msgr2=0x7fecc80b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:23.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.681+0000 7fecbe7fc700 1 --2- 172.21.15.69:0/2226082128 >> v2:172.21.15.88:3300/0 conn(0x7fecc8155b60 0x7fecc80b0730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:23.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.681+0000 7fecbe7fc700 1 -- 172.21.15.69:0/2226082128 >> v1:172.21.15.88:6789/0 conn(0x7fecc80ccb10 legacy=0x7fecc81599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:23.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.681+0000 7fecbe7fc700 1 -- 172.21.15.69:0/2226082128 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecc8156f50 con 0x7fecc8155f30 2023-10-06T01:39:23.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.681+0000 7fecc6ffd700 1 --2- 172.21.15.69:0/2226082128 >> v2:172.21.15.88:3300/0 conn(0x7fecc8155b60 0x7fecc80b0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:23.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.681+0000 7fecbe7fc700 1 --2- 172.21.15.69:0/2226082128 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fecc8155f30 0x7fecc8156380 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fecb00098e0 tx=0x7fecb00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3917c0d2a88a73db server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:23.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.681+0000 7fecc67fc700 1 -- 172.21.15.69:0/2226082128 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb000b640 con 0x7fecc8155f30 2023-10-06T01:39:23.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.681+0000 7fecc67fc700 1 -- 172.21.15.69:0/2226082128 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecb000b7a0 con 0x7fecc8155f30 2023-10-06T01:39:23.686 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.681+0000 7fecc67fc700 1 -- 172.21.15.69:0/2226082128 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecb000bb40 con 0x7fecc8155f30 2023-10-06T01:39:23.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.682+0000 7feccd66b700 1 -- 172.21.15.69:0/2226082128 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fecc8155f30 msgr2=0x7fecc8156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:23.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.682+0000 7feccd66b700 1 --2- 172.21.15.69:0/2226082128 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fecc8155f30 0x7fecc8156380 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fecb00098e0 tx=0x7fecb00091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:23.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.682+0000 7feccd66b700 1 -- 172.21.15.69:0/2226082128 shutdown_connections 2023-10-06T01:39:23.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.682+0000 7feccd66b700 1 --2- 172.21.15.69:0/2226082128 >> v2:172.21.15.88:3300/0 conn(0x7fecc8155b60 0x7fecc80b0730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:23.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.682+0000 7feccd66b700 1 --2- 172.21.15.69:0/2226082128 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fecc8155f30 0x7fecc8156380 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:23.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.682+0000 7feccd66b700 1 -- 172.21.15.69:0/2226082128 >> 172.21.15.69:0/2226082128 conn(0x7fecc806d170 msgr2=0x7fecc80cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:23.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.682+0000 7feccd66b700 1 -- 172.21.15.69:0/2226082128 shutdown_connections 2023-10-06T01:39:23.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.682+0000 7feccd66b700 1 -- 172.21.15.69:0/2226082128 wait complete. 2023-10-06T01:39:23.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.683+0000 7feccd66b700 1 Processor -- start 2023-10-06T01:39:23.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.683+0000 7feccd66b700 1 -- start start 2023-10-06T01:39:23.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.684+0000 7feccd66b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecc80ccb10 0x7fecc8145e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:23.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.684+0000 7feccd66b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fecc8155b60 0x7fecc80cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:23.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.684+0000 7feccd66b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecc8155f30 0x7fecc80cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:23.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.684+0000 7feccd66b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc80c5ee0 con 0x7fecc8155f30 2023-10-06T01:39:23.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.684+0000 7feccd66b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecc80ca7d0 con 0x7fecc80ccb10 2023-10-06T01:39:23.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.684+0000 7feccd66b700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecc80c55b0 con 0x7fecc8155b60 2023-10-06T01:39:23.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.684+0000 7fecc77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecc8155f30 0x7fecc80cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:23.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.684+0000 7fecc77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecc8155f30 0x7fecc80cb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52364/0 (socket says 172.21.15.69:52364) 2023-10-06T01:39:23.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.684+0000 7fecc77fe700 1 -- 172.21.15.69:0/485256930 learned_addr learned my addr 172.21.15.69:0/485256930 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:23.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.684+0000 7fecc6ffd700 1 --2- 172.21.15.69:0/485256930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecc80ccb10 0x7fecc8145e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:23.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.684+0000 7fecbe7fc700 1 --2- 172.21.15.69:0/485256930 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fecc8155b60 0x7fecc80cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:23.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.684+0000 7fecc77fe700 1 -- 172.21.15.69:0/485256930 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fecc8155b60 msgr2=0x7fecc80cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:23.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.684+0000 7fecc77fe700 1 --2- 172.21.15.69:0/485256930 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fecc8155b60 0x7fecc80cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:23.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.684+0000 7fecc77fe700 1 -- 172.21.15.69:0/485256930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecc80ccb10 msgr2=0x7fecc8145e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:23.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.684+0000 7fecc77fe700 1 --2- 172.21.15.69:0/485256930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecc80ccb10 0x7fecc8145e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:23.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.684+0000 7fecc77fe700 1 -- 172.21.15.69:0/485256930 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb8009a20 con 0x7fecc8155f30 2023-10-06T01:39:23.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.684+0000 7fecc77fe700 1 --2- 172.21.15.69:0/485256930 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecc8155f30 0x7fecc80cb2a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fecc000c590 tx=0x7fecc0007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:23.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.684+0000 7fecbf7fe700 1 -- 172.21.15.69:0/485256930 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc0005b30 con 0x7fecc8155f30 2023-10-06T01:39:23.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.684+0000 7fecbf7fe700 1 -- 172.21.15.69:0/485256930 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc0005cb0 con 0x7fecc8155f30 2023-10-06T01:39:23.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.684+0000 7feccd66b700 1 -- 172.21.15.69:0/485256930 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb0009420 con 0x7fecc8155f30 2023-10-06T01:39:23.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.684+0000 7fecbf7fe700 1 -- 172.21.15.69:0/485256930 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc0007320 con 0x7fecc8155f30 2023-10-06T01:39:23.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.684+0000 7feccd66b700 1 -- 172.21.15.69:0/485256930 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecc80c5b70 con 0x7fecc8155f30 2023-10-06T01:39:23.692 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.685+0000 7feccd66b700 1 -- 172.21.15.69:0/485256930 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecc804c3c0 con 0x7fecc8155f30 2023-10-06T01:39:23.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.686+0000 7fecbf7fe700 1 -- 172.21.15.69:0/485256930 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fecc001b3b0 con 0x7fecc8155f30 2023-10-06T01:39:23.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.686+0000 7fecbf7fe700 1 --2- 172.21.15.69:0/485256930 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7feca8066f30 0x7feca80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:23.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.686+0000 7fecbf7fe700 1 -- 172.21.15.69:0/485256930 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fecc0083ae0 con 0x7fecc8155f30 2023-10-06T01:39:23.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.686+0000 7fecc6ffd700 1 --2- 172.21.15.69:0/485256930 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7feca8066f30 0x7feca80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:23.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.687+0000 7fecc6ffd700 1 --2- 172.21.15.69:0/485256930 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7feca8066f30 0x7feca80693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fecb8009fd0 tx=0x7fecb800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:23.693 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.690+0000 7fecbf7fe700 1 -- 172.21.15.69:0/485256930 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fecc0050b50 con 0x7fecc8155f30 2023-10-06T01:39:23.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.875+0000 7feccd66b700 1 -- 172.21.15.69:0/485256930 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fecc80c6020 con 0x7fecc8155f30 2023-10-06T01:39:23.880 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.879+0000 7fecbf7fe700 1 -- 172.21.15.69:0/485256930 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fecc0017020 con 0x7fecc8155f30 2023-10-06T01:39:23.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.881+0000 7feccd66b700 1 -- 172.21.15.69:0/485256930 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7feca8066f30 msgr2=0x7feca80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:23.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.881+0000 7feccd66b700 1 --2- 172.21.15.69:0/485256930 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7feca8066f30 0x7feca80693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fecb8009fd0 tx=0x7fecb800b040 comp rx=0 tx=0).stop 2023-10-06T01:39:23.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.881+0000 7feccd66b700 1 -- 172.21.15.69:0/485256930 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecc8155f30 msgr2=0x7fecc80cb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:23.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.881+0000 7feccd66b700 1 --2- 172.21.15.69:0/485256930 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecc8155f30 0x7fecc80cb2a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fecc000c590 tx=0x7fecc0007ef0 comp rx=0 tx=0).stop 2023-10-06T01:39:23.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.881+0000 7feccd66b700 1 -- 172.21.15.69:0/485256930 shutdown_connections 2023-10-06T01:39:23.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.881+0000 7feccd66b700 1 --2- 172.21.15.69:0/485256930 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7feca8066f30 0x7feca80693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:23.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.881+0000 7feccd66b700 1 --2- 172.21.15.69:0/485256930 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fecc8155f30 0x7fecc80cb2a0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:23.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.881+0000 7feccd66b700 1 --2- 172.21.15.69:0/485256930 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fecc80ccb10 0x7fecc8145e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:23.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.881+0000 7feccd66b700 1 --2- 172.21.15.69:0/485256930 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fecc8155b60 0x7fecc80cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:23.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.881+0000 7feccd66b700 1 -- 172.21.15.69:0/485256930 >> 172.21.15.69:0/485256930 conn(0x7fecc806d170 msgr2=0x7fecc8157b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:23.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.881+0000 7feccd66b700 1 -- 172.21.15.69:0/485256930 shutdown_connections 2023-10-06T01:39:23.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:23.881+0000 7feccd66b700 1 -- 172.21.15.69:0/485256930 wait complete. 2023-10-06T01:39:23.895 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T01:39:23.895 DEBUG:teuthology.orchestra.run.smithi069:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T01:39:23.931 DEBUG:teuthology.orchestra.run.smithi088:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T01:39:23.974 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T01:39:23.974 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T01:39:23.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:39:23.975 DEBUG:teuthology.orchestra.run.smithi069:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-06T01:39:24.005 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi069.front.sepia.ceph.com 2023-10-06T01:39:24.006 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:24.006 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T01:39:24.061 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T01:39:24.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:39:24.061 DEBUG:teuthology.orchestra.run.smithi088:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-06T01:39:24.109 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2023-10-06T01:39:24.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:24.110 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T01:39:24.126 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-06T01:39:24.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:39:24.127 DEBUG:teuthology.orchestra.run.smithi069:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-06T01:39:24.160 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi069.front.sepia.ceph.com 2023-10-06T01:39:24.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:24.161 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-06T01:39:24.216 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-06T01:39:24.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:39:24.216 DEBUG:teuthology.orchestra.run.smithi088:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-06T01:39:24.260 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2023-10-06T01:39:24.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:24.260 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-06T01:39:24.316 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-06T01:39:24.317 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:39:24.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.429+0000 7fda46304700 1 Processor -- start 2023-10-06T01:39:24.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.429+0000 7fda46304700 1 -- start start 2023-10-06T01:39:24.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.430+0000 7fda46304700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fda400cb5a0 0x7fda400cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:24.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.430+0000 7fda46304700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda400cd9e0 0x7fda40159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:24.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.430+0000 7fda46304700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda4015ae40 con 0x7fda400cde50 2023-10-06T01:39:24.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.430+0000 7fda46304700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda400d13f0 con 0x7fda400cb5a0 2023-10-06T01:39:24.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.430+0000 7fda46304700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4015ab60 con 0x7fda400cd9e0 2023-10-06T01:39:24.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.431+0000 7fda3f7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda400cd9e0 0x7fda40159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:24.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.431+0000 7fda3ffff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fda400cb5a0 0x7fda400cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:24.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.431+0000 7fda3f7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda400cd9e0 0x7fda40159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.69:56334/0 (socket says 172.21.15.69:56334) 2023-10-06T01:39:24.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.431+0000 7fda3f7fe700 1 -- 172.21.15.69:0/2664566490 learned_addr learned my addr 172.21.15.69:0/2664566490 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:24.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.431+0000 7fda448a1700 1 --1- 172.21.15.69:0/2664566490 >> v1:172.21.15.88:6789/0 conn(0x7fda400cde50 0x7fda40156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.69:48766/0 (socket says 172.21.15.69:48766) 2023-10-06T01:39:24.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.431+0000 7fda3f7fe700 1 -- 172.21.15.69:0/2664566490 >> v2:172.21.15.88:3300/0 conn(0x7fda400cb5a0 msgr2=0x7fda400cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:24.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.431+0000 7fda3f7fe700 1 --2- 172.21.15.69:0/2664566490 >> v2:172.21.15.88:3300/0 conn(0x7fda400cb5a0 0x7fda400cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:24.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.431+0000 7fda3f7fe700 1 -- 172.21.15.69:0/2664566490 >> v1:172.21.15.88:6789/0 conn(0x7fda400cde50 legacy=0x7fda40156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:24.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.431+0000 7fda3f7fe700 1 -- 172.21.15.69:0/2664566490 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda400ccf00 con 0x7fda400cd9e0 2023-10-06T01:39:24.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.431+0000 7fda3effd700 1 -- 172.21.15.69:0/2664566490 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1761289958 0 0) 0x7fda4015ae40 con 0x7fda400cde50 2023-10-06T01:39:24.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.431+0000 7fda3ffff700 1 --2- 172.21.15.69:0/2664566490 >> v2:172.21.15.88:3300/0 conn(0x7fda400cb5a0 0x7fda400cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:24.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.431+0000 7fda3f7fe700 1 --2- 172.21.15.69:0/2664566490 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda400cd9e0 0x7fda40159ec0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fda340099b0 tx=0x7fda34009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b10fccde446ca8d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:24.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.431+0000 7fda3effd700 1 -- 172.21.15.69:0/2664566490 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda34009ea0 con 0x7fda400cd9e0 2023-10-06T01:39:24.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.431+0000 7fda3effd700 1 -- 172.21.15.69:0/2664566490 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3400b860 con 0x7fda400cd9e0 2023-10-06T01:39:24.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.431+0000 7fda3effd700 1 -- 172.21.15.69:0/2664566490 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3400bc00 con 0x7fda400cd9e0 2023-10-06T01:39:24.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.432+0000 7fda46304700 1 -- 172.21.15.69:0/2664566490 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda400cd9e0 msgr2=0x7fda40159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:24.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.432+0000 7fda46304700 1 --2- 172.21.15.69:0/2664566490 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda400cd9e0 0x7fda40159ec0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fda340099b0 tx=0x7fda34009250 comp rx=0 tx=0).stop 2023-10-06T01:39:24.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.432+0000 7fda46304700 1 -- 172.21.15.69:0/2664566490 shutdown_connections 2023-10-06T01:39:24.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.432+0000 7fda46304700 1 --2- 172.21.15.69:0/2664566490 >> v2:172.21.15.88:3300/0 conn(0x7fda400cb5a0 0x7fda400cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:24.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.432+0000 7fda46304700 1 --2- 172.21.15.69:0/2664566490 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda400cd9e0 0x7fda40159ec0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:24.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.432+0000 7fda46304700 1 -- 172.21.15.69:0/2664566490 >> 172.21.15.69:0/2664566490 conn(0x7fda40070e30 msgr2=0x7fda400d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:24.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.432+0000 7fda46304700 1 -- 172.21.15.69:0/2664566490 shutdown_connections 2023-10-06T01:39:24.436 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.432+0000 7fda46304700 1 -- 172.21.15.69:0/2664566490 wait complete. 2023-10-06T01:39:24.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.433+0000 7fda46304700 1 Processor -- start 2023-10-06T01:39:24.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.433+0000 7fda46304700 1 -- start start 2023-10-06T01:39:24.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.434+0000 7fda46304700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda400cb5a0 0x7fda400ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:24.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.434+0000 7fda46304700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda400cd9e0 0x7fda401558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:24.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.434+0000 7fda46304700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda40151b90 0x7fda4015c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:24.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.434+0000 7fda46304700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda400c7df0 con 0x7fda40151b90 2023-10-06T01:39:24.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.434+0000 7fda46304700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda400c8090 con 0x7fda400cb5a0 2023-10-06T01:39:24.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.434+0000 7fda46304700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda40152bf0 con 0x7fda400cd9e0 2023-10-06T01:39:24.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.434+0000 7fda3f7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda400cd9e0 0x7fda401558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:24.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.434+0000 7fda448a1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda40151b90 0x7fda4015c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:24.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.434+0000 7fda3ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda400cb5a0 0x7fda400ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:24.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.434+0000 7fda3f7fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda400cd9e0 0x7fda401558a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.69:56350/0 (socket says 172.21.15.69:56350) 2023-10-06T01:39:24.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.434+0000 7fda3ffff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda400cb5a0 0x7fda400ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.69:56284/0 (socket says 172.21.15.69:56284) 2023-10-06T01:39:24.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.434+0000 7fda3f7fe700 1 -- 172.21.15.69:0/1450256133 learned_addr learned my addr 172.21.15.69:0/1450256133 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:24.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.434+0000 7fda3ffff700 1 -- 172.21.15.69:0/1450256133 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda400cd9e0 msgr2=0x7fda401558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:24.439 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.434+0000 7fda3ffff700 1 --2- 172.21.15.69:0/1450256133 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda400cd9e0 0x7fda401558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:24.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.434+0000 7fda3ffff700 1 -- 172.21.15.69:0/1450256133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda40151b90 msgr2=0x7fda4015c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:24.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.434+0000 7fda3ffff700 1 --2- 172.21.15.69:0/1450256133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda40151b90 0x7fda4015c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:24.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.434+0000 7fda3ffff700 1 -- 172.21.15.69:0/1450256133 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda30009420 con 0x7fda400cb5a0 2023-10-06T01:39:24.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.434+0000 7fda448a1700 1 --2- 172.21.15.69:0/1450256133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda40151b90 0x7fda4015c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:24.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.435+0000 7fda3ffff700 1 --2- 172.21.15.69:0/1450256133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda400cb5a0 0x7fda400ca360 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fda3000ea30 tx=0x7fda300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:24.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.435+0000 7fda27fff700 1 -- 172.21.15.69:0/1450256133 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3000ee70 con 0x7fda400cb5a0 2023-10-06T01:39:24.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.435+0000 7fda27fff700 1 -- 172.21.15.69:0/1450256133 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3000c850 con 0x7fda400cb5a0 2023-10-06T01:39:24.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.435+0000 7fda46304700 1 -- 172.21.15.69:0/1450256133 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda340094f0 con 0x7fda400cb5a0 2023-10-06T01:39:24.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.435+0000 7fda27fff700 1 -- 172.21.15.69:0/1450256133 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3000cbf0 con 0x7fda400cb5a0 2023-10-06T01:39:24.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.435+0000 7fda46304700 1 -- 172.21.15.69:0/1450256133 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda40152630 con 0x7fda400cb5a0 2023-10-06T01:39:24.440 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.436+0000 7fda46304700 1 -- 172.21.15.69:0/1450256133 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda400c8370 con 0x7fda400cb5a0 2023-10-06T01:39:24.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.436+0000 7fda27fff700 1 -- 172.21.15.69:0/1450256133 <== mon.1 v2:172.21.15.88:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda30013470 con 0x7fda400cb5a0 2023-10-06T01:39:24.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.436+0000 7fda27fff700 1 --2- 172.21.15.69:0/1450256133 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fda2c066f30 0x7fda2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:24.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.437+0000 7fda27fff700 1 -- 172.21.15.69:0/1450256133 <== mon.1 v2:172.21.15.88:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fda30084bb0 con 0x7fda400cb5a0 2023-10-06T01:39:24.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.437+0000 7fda3f7fe700 1 --2- 172.21.15.69:0/1450256133 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fda2c066f30 0x7fda2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:24.441 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.437+0000 7fda3f7fe700 1 --2- 172.21.15.69:0/1450256133 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fda2c066f30 0x7fda2c0693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fda400d1690 tx=0x7fda34017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:24.442 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.441+0000 7fda27fff700 1 -- 172.21.15.69:0/1450256133 <== mon.1 v2:172.21.15.88:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda30051cc0 con 0x7fda400cb5a0 2023-10-06T01:39:24.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.669+0000 7fda46304700 1 -- 172.21.15.69:0/1450256133 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda4004c3c0 con 0x7fda400cb5a0 2023-10-06T01:39:24.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.670+0000 7fda27fff700 1 -- 172.21.15.69:0/1450256133 <== mon.1 v2:172.21.15.88:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4591 (secure 0 0 0) 0x7fda300552e0 con 0x7fda400cb5a0 2023-10-06T01:39:24.671 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:24.671 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6836/2049506781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2049506781},{"type":"v1","addr":"172.21.15.69:6836","nonce":2049506781}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3367080201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6835","nonce":3367080201},{"type":"v1","addr":"172.21.15.69:6837","nonce":3367080201}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2692995813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":2692995813},{"type":"v1","addr":"172.21.15.88:6835","nonce":2692995813}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:38:49.072564+0000","modified":"2023-10-06T01:38:52.659297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6834/2097597935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":2097597935},{"type":"v1","addr":"172.21.15.88:6834","nonce":2097597935}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T01:39:24.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.672+0000 7fda46304700 1 -- 172.21.15.69:0/1450256133 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fda2c066f30 msgr2=0x7fda2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:24.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.672+0000 7fda46304700 1 --2- 172.21.15.69:0/1450256133 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fda2c066f30 0x7fda2c0693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fda400d1690 tx=0x7fda34017000 comp rx=0 tx=0).stop 2023-10-06T01:39:24.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.672+0000 7fda46304700 1 -- 172.21.15.69:0/1450256133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda400cb5a0 msgr2=0x7fda400ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:24.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.672+0000 7fda46304700 1 --2- 172.21.15.69:0/1450256133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda400cb5a0 0x7fda400ca360 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fda3000ea30 tx=0x7fda300091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:24.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.672+0000 7fda46304700 1 -- 172.21.15.69:0/1450256133 shutdown_connections 2023-10-06T01:39:24.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.672+0000 7fda46304700 1 --2- 172.21.15.69:0/1450256133 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fda2c066f30 0x7fda2c0693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:24.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.672+0000 7fda46304700 1 --2- 172.21.15.69:0/1450256133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda40151b90 0x7fda4015c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:24.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.672+0000 7fda46304700 1 --2- 172.21.15.69:0/1450256133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda400cb5a0 0x7fda400ca360 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:24.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.672+0000 7fda46304700 1 --2- 172.21.15.69:0/1450256133 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda400cd9e0 0x7fda401558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:24.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.672+0000 7fda46304700 1 -- 172.21.15.69:0/1450256133 >> 172.21.15.69:0/1450256133 conn(0x7fda40070e30 msgr2=0x7fda400c6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:24.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.672+0000 7fda46304700 1 -- 172.21.15.69:0/1450256133 shutdown_connections 2023-10-06T01:39:24.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.672+0000 7fda46304700 1 -- 172.21.15.69:0/1450256133 wait complete. 2023-10-06T01:39:24.675 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 8 2023-10-06T01:39:24.685 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:39:24.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.798+0000 7f854073f700 1 Processor -- start 2023-10-06T01:39:24.799 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.798+0000 7f854073f700 1 -- start start 2023-10-06T01:39:24.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.799+0000 7f854073f700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f85380cb970 0x7f8538159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:24.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.799+0000 7f854073f700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853815ae40 con 0x7f85380cb5a0 2023-10-06T01:39:24.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.799+0000 7f854073f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f853815ab60 con 0x7f853815a400 2023-10-06T01:39:24.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.799+0000 7f854073f700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85380ce0f0 con 0x7f85380cb970 2023-10-06T01:39:24.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.799+0000 7f853e4db700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f85380cb5a0 0x7f85380cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44936/0 (socket says 172.21.15.69:44936) 2023-10-06T01:39:24.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.799+0000 7f853e4db700 1 -- 172.21.15.69:0/1271756244 learned_addr learned my addr 172.21.15.69:0/1271756244 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:24.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.799+0000 7f853d4d9700 1 -- 172.21.15.69:0/1271756244 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 683853869 0 0) 0x7f853815ae40 con 0x7f85380cb5a0 2023-10-06T01:39:24.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.799+0000 7f853d4d9700 1 -- 172.21.15.69:0/1271756244 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8524003570 con 0x7f85380cb5a0 2023-10-06T01:39:24.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.799+0000 7f853dcda700 1 --2- 172.21.15.69:0/1271756244 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f85380cb970 0x7f8538159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:24.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.799+0000 7f853d4d9700 1 -- 172.21.15.69:0/1271756244 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3320593806 0 0) 0x7f8524003570 con 0x7f85380cb5a0 2023-10-06T01:39:24.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.799+0000 7f853d4d9700 1 -- 172.21.15.69:0/1271756244 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f85380cb970 msgr2=0x7f8538159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:24.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.799+0000 7f853d4d9700 1 --2- 172.21.15.69:0/1271756244 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f85380cb970 0x7f8538159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:24.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.799+0000 7f853d4d9700 1 -- 172.21.15.69:0/1271756244 >> v1:172.21.15.88:6789/0 conn(0x7f853815a400 legacy=0x7f8538156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:24.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.799+0000 7f853d4d9700 1 -- 172.21.15.69:0/1271756244 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85380ccf00 con 0x7f85380cb5a0 2023-10-06T01:39:24.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.799+0000 7f853d4d9700 1 -- 172.21.15.69:0/1271756244 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f8534001470 con 0x7f85380cb5a0 2023-10-06T01:39:24.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.799+0000 7f853d4d9700 1 -- 172.21.15.69:0/1271756244 >> v1:172.21.15.69:6789/0 conn(0x7f85380cb5a0 legacy=0x7f85380cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:24.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.799+0000 7f853d4d9700 1 --2- 172.21.15.69:0/1271756244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8524003a90 0x7f8524003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:24.810 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.799+0000 7f853d4d9700 1 --2- 172.21.15.69:0/1271756244 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f85380cb970 0x7f8524004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:24.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.799+0000 7f853d4d9700 1 --2- 172.21.15.69:0/1271756244 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8524004d50 0x7f85240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:24.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.799+0000 7f853d4d9700 1 -- 172.21.15.69:0/1271756244 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85380ce0f0 con 0x7f8524004d50 2023-10-06T01:39:24.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.799+0000 7f853d4d9700 1 -- 172.21.15.69:0/1271756244 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f852400bba0 con 0x7f8524003a90 2023-10-06T01:39:24.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.799+0000 7f853d4d9700 1 -- 172.21.15.69:0/1271756244 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f852400bd60 con 0x7f85380cb970 2023-10-06T01:39:24.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.799+0000 7f853ecdc700 1 --2- 172.21.15.69:0/1271756244 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8524004d50 0x7f85240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:24.811 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.800+0000 7f853e4db700 1 --2- 172.21.15.69:0/1271756244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8524003a90 0x7f8524003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:24.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.800+0000 7f853dcda700 1 --2- 172.21.15.69:0/1271756244 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f85380cb970 0x7f8524004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:24.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.800+0000 7f853ecdc700 1 -- 172.21.15.69:0/1271756244 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f85380cb970 msgr2=0x7f8524004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:24.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.800+0000 7f853ecdc700 1 --2- 172.21.15.69:0/1271756244 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f85380cb970 0x7f8524004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:24.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.800+0000 7f853ecdc700 1 -- 172.21.15.69:0/1271756244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8524003a90 msgr2=0x7f8524003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:24.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.800+0000 7f853ecdc700 1 --2- 172.21.15.69:0/1271756244 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8524003a90 0x7f8524003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:24.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.800+0000 7f853ecdc700 1 -- 172.21.15.69:0/1271756244 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8524003570 con 0x7f8524004d50 2023-10-06T01:39:24.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.800+0000 7f853ecdc700 1 --2- 172.21.15.69:0/1271756244 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8524004d50 0x7f85240051c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8530001fc0 tx=0x7f8530001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd94c1552bf216fe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:24.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.800+0000 7f853d4d9700 1 -- 172.21.15.69:0/1271756244 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8530001950 con 0x7f8524004d50 2023-10-06T01:39:24.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.800+0000 7f853d4d9700 1 -- 172.21.15.69:0/1271756244 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f853000c8b0 con 0x7f8524004d50 2023-10-06T01:39:24.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.800+0000 7f853d4d9700 1 -- 172.21.15.69:0/1271756244 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f853000cc50 con 0x7f8524004d50 2023-10-06T01:39:24.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.800+0000 7f854073f700 1 -- 172.21.15.69:0/1271756244 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8524004d50 msgr2=0x7f85240051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:24.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.800+0000 7f854073f700 1 --2- 172.21.15.69:0/1271756244 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8524004d50 0x7f85240051c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f8530001fc0 tx=0x7f8530001640 comp rx=0 tx=0).stop 2023-10-06T01:39:24.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.801+0000 7f853ecdc700 1 -- 172.21.15.69:0/1271756244 reap_dead start 2023-10-06T01:39:24.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.801+0000 7f854073f700 1 -- 172.21.15.69:0/1271756244 shutdown_connections 2023-10-06T01:39:24.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.801+0000 7f854073f700 1 -- 172.21.15.69:0/1271756244 >> 172.21.15.69:0/1271756244 conn(0x7f8538070e30 msgr2=0x7f85380d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:24.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.801+0000 7f854073f700 1 -- 172.21.15.69:0/1271756244 shutdown_connections 2023-10-06T01:39:24.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.801+0000 7f854073f700 1 -- 172.21.15.69:0/1271756244 wait complete. 2023-10-06T01:39:24.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.802+0000 7f854073f700 1 Processor -- start 2023-10-06T01:39:24.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.802+0000 7f854073f700 1 -- start start 2023-10-06T01:39:24.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.802+0000 7f854073f700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8524004d50 0x7f853814fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:24.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.802+0000 7f854073f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8538153040 0x7f85381539d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:24.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.802+0000 7f854073f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8538160390 0x7f85380b4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:24.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.802+0000 7f854073f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85380cbde0 con 0x7f8538153040 2023-10-06T01:39:24.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.802+0000 7f854073f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85381500e0 con 0x7f8538160390 2023-10-06T01:39:24.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.802+0000 7f854073f700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f853815f660 con 0x7f8524004d50 2023-10-06T01:39:24.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.802+0000 7f853dcda700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8538153040 0x7f85381539d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:24.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.803+0000 7f853dcda700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8538153040 0x7f85381539d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52386/0 (socket says 172.21.15.69:52386) 2023-10-06T01:39:24.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.803+0000 7f853dcda700 1 -- 172.21.15.69:0/358813297 learned_addr learned my addr 172.21.15.69:0/358813297 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:24.816 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.803+0000 7f853ecdc700 1 --2- 172.21.15.69:0/358813297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8538160390 0x7f85380b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:24.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.803+0000 7f853e4db700 1 --2- 172.21.15.69:0/358813297 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8524004d50 0x7f853814fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:24.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.803+0000 7f853dcda700 1 -- 172.21.15.69:0/358813297 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8524004d50 msgr2=0x7f853814fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:24.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.803+0000 7f853dcda700 1 --2- 172.21.15.69:0/358813297 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8524004d50 0x7f853814fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:24.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.803+0000 7f853dcda700 1 -- 172.21.15.69:0/358813297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8538160390 msgr2=0x7f85380b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:24.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.803+0000 7f853dcda700 1 --2- 172.21.15.69:0/358813297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8538160390 0x7f85380b4990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:24.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.803+0000 7f853dcda700 1 -- 172.21.15.69:0/358813297 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f853815ff00 con 0x7f8538153040 2023-10-06T01:39:24.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.803+0000 7f853e4db700 1 --2- 172.21.15.69:0/358813297 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8524004d50 0x7f853814fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:24.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.803+0000 7f853dcda700 1 --2- 172.21.15.69:0/358813297 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8538153040 0x7f85381539d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8528011b10 tx=0x7f85280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:24.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.803+0000 7f852e7fc700 1 -- 172.21.15.69:0/358813297 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852800f8e0 con 0x7f8538153040 2023-10-06T01:39:24.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.803+0000 7f852e7fc700 1 -- 172.21.15.69:0/358813297 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f852800fa40 con 0x7f8538153040 2023-10-06T01:39:24.818 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.803+0000 7f854073f700 1 -- 172.21.15.69:0/358813297 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8538153520 con 0x7f8538153040 2023-10-06T01:39:24.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.803+0000 7f852e7fc700 1 -- 172.21.15.69:0/358813297 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f852800fdc0 con 0x7f8538153040 2023-10-06T01:39:24.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.803+0000 7f854073f700 1 -- 172.21.15.69:0/358813297 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f853815fb90 con 0x7f8538153040 2023-10-06T01:39:24.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.804+0000 7f854073f700 1 -- 172.21.15.69:0/358813297 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8538160090 con 0x7f8538153040 2023-10-06T01:39:24.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.804+0000 7f852e7fc700 1 -- 172.21.15.69:0/358813297 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8528014650 con 0x7f8538153040 2023-10-06T01:39:24.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.805+0000 7f852e7fc700 1 --2- 172.21.15.69:0/358813297 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f851c066f30 0x7f851c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:24.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.805+0000 7f852e7fc700 1 -- 172.21.15.69:0/358813297 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8528018030 con 0x7f8538153040 2023-10-06T01:39:24.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.805+0000 7f853e4db700 1 --2- 172.21.15.69:0/358813297 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f851c066f30 0x7f851c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:24.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.805+0000 7f853e4db700 1 --2- 172.21.15.69:0/358813297 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f851c066f30 0x7f851c0693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8534001200 tx=0x7f8534009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:24.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.809+0000 7f852e7fc700 1 -- 172.21.15.69:0/358813297 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8528052080 con 0x7f8538153040 2023-10-06T01:39:24.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.993+0000 7f854073f700 1 -- 172.21.15.69:0/358813297 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f853804c3c0 con 0x7f8538153040 2023-10-06T01:39:24.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.994+0000 7f852e7fc700 1 -- 172.21.15.69:0/358813297 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f8528022090 con 0x7f8538153040 2023-10-06T01:39:24.995 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:24.995 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":24,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:38:50.506861+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:38:43.046056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:38:47.525023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:38:47.992048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:39:24.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.996+0000 7f854073f700 1 -- 172.21.15.69:0/358813297 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f851c066f30 msgr2=0x7f851c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:24.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.996+0000 7f854073f700 1 --2- 172.21.15.69:0/358813297 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f851c066f30 0x7f851c0693e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8534001200 tx=0x7f8534009040 comp rx=0 tx=0).stop 2023-10-06T01:39:24.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.996+0000 7f854073f700 1 -- 172.21.15.69:0/358813297 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8538153040 msgr2=0x7f85381539d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:24.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.996+0000 7f854073f700 1 --2- 172.21.15.69:0/358813297 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8538153040 0x7f85381539d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f8528011b10 tx=0x7f85280091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:24.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.996+0000 7f854073f700 1 -- 172.21.15.69:0/358813297 shutdown_connections 2023-10-06T01:39:24.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.996+0000 7f854073f700 1 --2- 172.21.15.69:0/358813297 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f851c066f30 0x7f851c0693e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:24.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.996+0000 7f854073f700 1 --2- 172.21.15.69:0/358813297 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8538160390 0x7f85380b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:24.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.996+0000 7f854073f700 1 --2- 172.21.15.69:0/358813297 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8524004d50 0x7f853814fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:24.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.996+0000 7f854073f700 1 --2- 172.21.15.69:0/358813297 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8538153040 0x7f85381539d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:24.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.996+0000 7f854073f700 1 -- 172.21.15.69:0/358813297 >> 172.21.15.69:0/358813297 conn(0x7f8538070e30 msgr2=0x7f85380d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:24.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.996+0000 7f854073f700 1 -- 172.21.15.69:0/358813297 shutdown_connections 2023-10-06T01:39:24.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:24.996+0000 7f854073f700 1 -- 172.21.15.69:0/358813297 wait complete. 2023-10-06T01:39:25.009 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:38:38.288642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:38:43.046056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T01:38:47.525023+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T01:38:47.992048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T01:39:25.010 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:39:25.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.126+0000 7fe3e4dde700 1 Processor -- start 2023-10-06T01:39:25.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.126+0000 7fe3e4dde700 1 -- start start 2023-10-06T01:39:25.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.127+0000 7fe3e4dde700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe3e00c7f90 0x7fe3e006c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:25.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.127+0000 7fe3e4dde700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3e00ca480 con 0x7fe3e0142fd0 2023-10-06T01:39:25.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.127+0000 7fe3e4dde700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3e015e240 con 0x7fe3e0142c00 2023-10-06T01:39:25.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.127+0000 7fe3e4dde700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3e006b350 con 0x7fe3e00c7f90 2023-10-06T01:39:25.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.127+0000 7fe3deffd700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fe3e0142fd0 0x7fe3e00c7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44944/0 (socket says 172.21.15.69:44944) 2023-10-06T01:39:25.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.127+0000 7fe3deffd700 1 -- 172.21.15.69:0/8819982 learned_addr learned my addr 172.21.15.69:0/8819982 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:25.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.127+0000 7fe3de7fc700 1 -- 172.21.15.69:0/8819982 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3115796355 0 0) 0x7fe3e00ca480 con 0x7fe3e0142fd0 2023-10-06T01:39:25.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.127+0000 7fe3dffff700 1 --2- 172.21.15.69:0/8819982 >> v2:172.21.15.88:3300/0 conn(0x7fe3e00c7f90 0x7fe3e006c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:25.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.127+0000 7fe3de7fc700 1 -- 172.21.15.69:0/8819982 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe3c8003570 con 0x7fe3e0142fd0 2023-10-06T01:39:25.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.127+0000 7fe3de7fc700 1 -- 172.21.15.69:0/8819982 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 238557917 0 0) 0x7fe3c8003570 con 0x7fe3e0142fd0 2023-10-06T01:39:25.132 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.127+0000 7fe3de7fc700 1 -- 172.21.15.69:0/8819982 >> v2:172.21.15.88:3300/0 conn(0x7fe3e00c7f90 msgr2=0x7fe3e006c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:25.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.127+0000 7fe3de7fc700 1 --2- 172.21.15.69:0/8819982 >> v2:172.21.15.88:3300/0 conn(0x7fe3e00c7f90 0x7fe3e006c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.127+0000 7fe3de7fc700 1 -- 172.21.15.69:0/8819982 >> v1:172.21.15.88:6789/0 conn(0x7fe3e0142c00 legacy=0x7fe3e006b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:25.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.127+0000 7fe3de7fc700 1 -- 172.21.15.69:0/8819982 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e015df60 con 0x7fe3e0142fd0 2023-10-06T01:39:25.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.127+0000 7fe3de7fc700 1 -- 172.21.15.69:0/8819982 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7fe3d4001470 con 0x7fe3e0142fd0 2023-10-06T01:39:25.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.127+0000 7fe3de7fc700 1 -- 172.21.15.69:0/8819982 >> v1:172.21.15.69:6789/0 conn(0x7fe3e0142fd0 legacy=0x7fe3e00c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:25.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.127+0000 7fe3de7fc700 1 --2- 172.21.15.69:0/8819982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3c8003a60 0x7fe3c8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:25.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.128+0000 7fe3de7fc700 1 --2- 172.21.15.69:0/8819982 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe3c8004810 0x7fe3c8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:25.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.128+0000 7fe3de7fc700 1 --2- 172.21.15.69:0/8819982 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3c80051c0 0x7fe3c800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:25.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.128+0000 7fe3de7fc700 1 -- 172.21.15.69:0/8819982 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e006b350 con 0x7fe3c8003a60 2023-10-06T01:39:25.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.128+0000 7fe3de7fc700 1 -- 172.21.15.69:0/8819982 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c800c160 con 0x7fe3c80051c0 2023-10-06T01:39:25.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.128+0000 7fe3de7fc700 1 -- 172.21.15.69:0/8819982 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3c800c320 con 0x7fe3c8004810 2023-10-06T01:39:25.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.128+0000 7fe3df7fe700 1 --2- 172.21.15.69:0/8819982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3c8003a60 0x7fe3c8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:25.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.128+0000 7fe3dffff700 1 --2- 172.21.15.69:0/8819982 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3c80051c0 0x7fe3c800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:25.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.128+0000 7fe3deffd700 1 --2- 172.21.15.69:0/8819982 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe3c8004810 0x7fe3c8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:25.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.128+0000 7fe3df7fe700 1 -- 172.21.15.69:0/8819982 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe3c8004810 msgr2=0x7fe3c8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:25.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.128+0000 7fe3df7fe700 1 --2- 172.21.15.69:0/8819982 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe3c8004810 0x7fe3c8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.128+0000 7fe3df7fe700 1 -- 172.21.15.69:0/8819982 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3c80051c0 msgr2=0x7fe3c800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:25.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.128+0000 7fe3df7fe700 1 --2- 172.21.15.69:0/8819982 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3c80051c0 0x7fe3c800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.128+0000 7fe3df7fe700 1 -- 172.21.15.69:0/8819982 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3c8003570 con 0x7fe3c8003a60 2023-10-06T01:39:25.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.128+0000 7fe3dffff700 1 --2- 172.21.15.69:0/8819982 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3c80051c0 0x7fe3c800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:25.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.128+0000 7fe3dffff700 1 -- 172.21.15.69:0/8819982 reap_dead start 2023-10-06T01:39:25.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.128+0000 7fe3df7fe700 1 --2- 172.21.15.69:0/8819982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3c8003a60 0x7fe3c8003e70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0001ff0 tx=0x7fe3d0001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c9aaacd6a1ded7d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:25.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.128+0000 7fe3de7fc700 1 -- 172.21.15.69:0/8819982 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d0001980 con 0x7fe3c8003a60 2023-10-06T01:39:25.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.128+0000 7fe3de7fc700 1 -- 172.21.15.69:0/8819982 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d000c8b0 con 0x7fe3c8003a60 2023-10-06T01:39:25.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.128+0000 7fe3de7fc700 1 -- 172.21.15.69:0/8819982 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d000cc50 con 0x7fe3c8003a60 2023-10-06T01:39:25.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.129+0000 7fe3e4dde700 1 -- 172.21.15.69:0/8819982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3c8003a60 msgr2=0x7fe3c8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:25.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.129+0000 7fe3e4dde700 1 --2- 172.21.15.69:0/8819982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3c8003a60 0x7fe3c8003e70 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0001ff0 tx=0x7fe3d0001670 comp rx=0 tx=0).stop 2023-10-06T01:39:25.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.129+0000 7fe3e4dde700 1 -- 172.21.15.69:0/8819982 shutdown_connections 2023-10-06T01:39:25.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.129+0000 7fe3e4dde700 1 --2- 172.21.15.69:0/8819982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3c8003a60 0x7fe3c8003e70 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.129+0000 7fe3e4dde700 1 -- 172.21.15.69:0/8819982 >> 172.21.15.69:0/8819982 conn(0x7fe3e00675a0 msgr2=0x7fe3e00679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:25.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.129+0000 7fe3e4dde700 1 -- 172.21.15.69:0/8819982 shutdown_connections 2023-10-06T01:39:25.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.129+0000 7fe3e4dde700 1 -- 172.21.15.69:0/8819982 wait complete. 2023-10-06T01:39:25.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.130+0000 7fe3e4dde700 1 Processor -- start 2023-10-06T01:39:25.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.130+0000 7fe3e4dde700 1 -- start start 2023-10-06T01:39:25.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.131+0000 7fe3e4dde700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3c8003a60 0x7fe3e015c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:25.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.131+0000 7fe3e4dde700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe3e0169980 0x7fe3e01409a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:25.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.131+0000 7fe3e4dde700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3e0169df0 0x7fe3e0140ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:25.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.131+0000 7fe3e4dde700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e015a0c0 con 0x7fe3e0169df0 2023-10-06T01:39:25.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.131+0000 7fe3e4dde700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e015a3a0 con 0x7fe3c8003a60 2023-10-06T01:39:25.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.131+0000 7fe3e4dde700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e015a680 con 0x7fe3e0169980 2023-10-06T01:39:25.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.131+0000 7fe3dffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3e0169df0 0x7fe3e0140ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:25.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.131+0000 7fe3dffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3e0169df0 0x7fe3e0140ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52404/0 (socket says 172.21.15.69:52404) 2023-10-06T01:39:25.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.131+0000 7fe3dffff700 1 -- 172.21.15.69:0/3308019237 learned_addr learned my addr 172.21.15.69:0/3308019237 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:25.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.131+0000 7fe3df7fe700 1 --2- 172.21.15.69:0/3308019237 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3c8003a60 0x7fe3e015c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:25.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.131+0000 7fe3deffd700 1 --2- 172.21.15.69:0/3308019237 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe3e0169980 0x7fe3e01409a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:25.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.131+0000 7fe3dffff700 1 -- 172.21.15.69:0/3308019237 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe3e0169980 msgr2=0x7fe3e01409a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:25.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.131+0000 7fe3dffff700 1 --2- 172.21.15.69:0/3308019237 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe3e0169980 0x7fe3e01409a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.131+0000 7fe3dffff700 1 -- 172.21.15.69:0/3308019237 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3c8003a60 msgr2=0x7fe3e015c780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:25.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.131+0000 7fe3dffff700 1 --2- 172.21.15.69:0/3308019237 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3c8003a60 0x7fe3e015c780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.131+0000 7fe3dffff700 1 -- 172.21.15.69:0/3308019237 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e015a960 con 0x7fe3e0169df0 2023-10-06T01:39:25.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.131+0000 7fe3dffff700 1 --2- 172.21.15.69:0/3308019237 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3e0169df0 0x7fe3e0140ee0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe3e00ca8c0 tx=0x7fe3d8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:25.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.131+0000 7fe3c77fe700 1 -- 172.21.15.69:0/3308019237 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d8011ed0 con 0x7fe3e0169df0 2023-10-06T01:39:25.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.131+0000 7fe3c77fe700 1 -- 172.21.15.69:0/3308019237 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3d8015670 con 0x7fe3e0169df0 2023-10-06T01:39:25.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.131+0000 7fe3e4dde700 1 -- 172.21.15.69:0/3308019237 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e015ac40 con 0x7fe3e0169df0 2023-10-06T01:39:25.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.131+0000 7fe3c77fe700 1 -- 172.21.15.69:0/3308019237 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3d8015a10 con 0x7fe3e0169df0 2023-10-06T01:39:25.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.132+0000 7fe3e4dde700 1 -- 172.21.15.69:0/3308019237 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e015ce80 con 0x7fe3e0169df0 2023-10-06T01:39:25.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.132+0000 7fe3e4dde700 1 -- 172.21.15.69:0/3308019237 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3e015ae30 con 0x7fe3e0169df0 2023-10-06T01:39:25.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.133+0000 7fe3c77fe700 1 -- 172.21.15.69:0/3308019237 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe3d801f410 con 0x7fe3e0169df0 2023-10-06T01:39:25.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.133+0000 7fe3c77fe700 1 --2- 172.21.15.69:0/3308019237 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe3cc066f30 0x7fe3cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:25.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.133+0000 7fe3c77fe700 1 -- 172.21.15.69:0/3308019237 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe3d8084370 con 0x7fe3e0169df0 2023-10-06T01:39:25.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.133+0000 7fe3df7fe700 1 --2- 172.21.15.69:0/3308019237 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe3cc066f30 0x7fe3cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:25.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.134+0000 7fe3df7fe700 1 --2- 172.21.15.69:0/3308019237 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe3cc066f30 0x7fe3cc0693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0004290 tx=0x7fe3d0015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:25.148 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.137+0000 7fe3c77fe700 1 -- 172.21.15.69:0/3308019237 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe3d8051480 con 0x7fe3e0169df0 2023-10-06T01:39:25.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.320+0000 7fe3e4dde700 1 -- 172.21.15.69:0/3308019237 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe3e004c3c0 con 0x7fe3e0169df0 2023-10-06T01:39:25.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.321+0000 7fe3c77fe700 1 -- 172.21.15.69:0/3308019237 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe3d8054aa0 con 0x7fe3e0169df0 2023-10-06T01:39:25.322 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-10-06T01:39:25.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.323+0000 7fe3e4dde700 1 -- 172.21.15.69:0/3308019237 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe3cc066f30 msgr2=0x7fe3cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:25.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.323+0000 7fe3e4dde700 1 --2- 172.21.15.69:0/3308019237 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe3cc066f30 0x7fe3cc0693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe3d0004290 tx=0x7fe3d0015000 comp rx=0 tx=0).stop 2023-10-06T01:39:25.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.323+0000 7fe3e4dde700 1 -- 172.21.15.69:0/3308019237 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3e0169df0 msgr2=0x7fe3e0140ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:25.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.323+0000 7fe3e4dde700 1 --2- 172.21.15.69:0/3308019237 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3e0169df0 0x7fe3e0140ee0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe3e00ca8c0 tx=0x7fe3d8008040 comp rx=0 tx=0).stop 2023-10-06T01:39:25.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.323+0000 7fe3e4dde700 1 -- 172.21.15.69:0/3308019237 shutdown_connections 2023-10-06T01:39:25.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.323+0000 7fe3e4dde700 1 --2- 172.21.15.69:0/3308019237 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe3cc066f30 0x7fe3cc0693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.323+0000 7fe3e4dde700 1 --2- 172.21.15.69:0/3308019237 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3e0169df0 0x7fe3e0140ee0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.323+0000 7fe3e4dde700 1 --2- 172.21.15.69:0/3308019237 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe3c8003a60 0x7fe3e015c780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.323+0000 7fe3e4dde700 1 --2- 172.21.15.69:0/3308019237 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe3e0169980 0x7fe3e01409a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.323+0000 7fe3e4dde700 1 -- 172.21.15.69:0/3308019237 >> 172.21.15.69:0/3308019237 conn(0x7fe3e00675a0 msgr2=0x7fe3e0141be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:25.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.323+0000 7fe3e4dde700 1 -- 172.21.15.69:0/3308019237 shutdown_connections 2023-10-06T01:39:25.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.323+0000 7fe3e4dde700 1 -- 172.21.15.69:0/3308019237 wait complete. 2023-10-06T01:39:25.336 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:39:25.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.452+0000 7f71672e4700 1 Processor -- start 2023-10-06T01:39:25.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.453+0000 7f71672e4700 1 -- start start 2023-10-06T01:39:25.460 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.453+0000 7f71672e4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f7160159530 0x7f71600ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:25.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.453+0000 7f71672e4700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71600ccfd0 con 0x7f716006dc70 2023-10-06T01:39:25.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.453+0000 7f71672e4700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71600cf0e0 con 0x7f716006e0e0 2023-10-06T01:39:25.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.453+0000 7f71672e4700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f716015a3d0 con 0x7f7160159530 2023-10-06T01:39:25.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.453+0000 7f716487f700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f716006dc70 0x7f7160159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44950/0 (socket says 172.21.15.69:44950) 2023-10-06T01:39:25.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.454+0000 7f716487f700 1 -- 172.21.15.69:0/3311270038 learned_addr learned my addr 172.21.15.69:0/3311270038 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:25.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.454+0000 7f7165080700 1 --2- 172.21.15.69:0/3311270038 >> v2:172.21.15.88:3300/0 conn(0x7f7160159530 0x7f71600ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:25.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.454+0000 7f7157fff700 1 -- 172.21.15.69:0/3311270038 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1582985609 0 0) 0x7f71600ccfd0 con 0x7f716006dc70 2023-10-06T01:39:25.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.454+0000 7f7157fff700 1 -- 172.21.15.69:0/3311270038 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f714c003570 con 0x7f716006dc70 2023-10-06T01:39:25.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.454+0000 7f7157fff700 1 -- 172.21.15.69:0/3311270038 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2833405436 0 0) 0x7f71600cf0e0 con 0x7f716006e0e0 2023-10-06T01:39:25.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.454+0000 7f7157fff700 1 -- 172.21.15.69:0/3311270038 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71600ccfd0 con 0x7f716006e0e0 2023-10-06T01:39:25.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.454+0000 7f7157fff700 1 -- 172.21.15.69:0/3311270038 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 296854098 0 0) 0x7f714c003570 con 0x7f716006dc70 2023-10-06T01:39:25.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.454+0000 7f7157fff700 1 -- 172.21.15.69:0/3311270038 >> v2:172.21.15.88:3300/0 conn(0x7f7160159530 msgr2=0x7f71600ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:25.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.454+0000 7f7157fff700 1 --2- 172.21.15.69:0/3311270038 >> v2:172.21.15.88:3300/0 conn(0x7f7160159530 0x7f71600ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.454+0000 7f7157fff700 1 -- 172.21.15.69:0/3311270038 >> v1:172.21.15.88:6789/0 conn(0x7f716006e0e0 legacy=0x7f71600cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:25.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.454+0000 7f7157fff700 1 -- 172.21.15.69:0/3311270038 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f716015a6b0 con 0x7f716006dc70 2023-10-06T01:39:25.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.454+0000 7f7157fff700 1 -- 172.21.15.69:0/3311270038 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f7150001470 con 0x7f716006dc70 2023-10-06T01:39:25.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.454+0000 7f7157fff700 1 -- 172.21.15.69:0/3311270038 >> v1:172.21.15.69:6789/0 conn(0x7f716006dc70 legacy=0x7f7160159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:25.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.454+0000 7f7157fff700 1 --2- 172.21.15.69:0/3311270038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f714c003c40 0x7f714c004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:25.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.454+0000 7f7157fff700 1 --2- 172.21.15.69:0/3311270038 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f714c004810 0x7f714c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:25.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.454+0000 7f7157fff700 1 --2- 172.21.15.69:0/3311270038 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f714c005210 0x7f714c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:25.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.454+0000 7f7157fff700 1 -- 172.21.15.69:0/3311270038 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716015a3d0 con 0x7f714c004810 2023-10-06T01:39:25.462 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.454+0000 7f7157fff700 1 -- 172.21.15.69:0/3311270038 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c00c130 con 0x7f714c003c40 2023-10-06T01:39:25.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.454+0000 7f7157fff700 1 -- 172.21.15.69:0/3311270038 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f714c00c2c0 con 0x7f714c005210 2023-10-06T01:39:25.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.454+0000 7f716487f700 1 --2- 172.21.15.69:0/3311270038 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f714c004810 0x7f714c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:25.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.454+0000 7f7165080700 1 --2- 172.21.15.69:0/3311270038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f714c003c40 0x7f714c004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:25.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.454+0000 7f7165881700 1 --2- 172.21.15.69:0/3311270038 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f714c005210 0x7f714c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:25.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.454+0000 7f716487f700 1 -- 172.21.15.69:0/3311270038 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f714c005210 msgr2=0x7f714c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:25.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.454+0000 7f716487f700 1 --2- 172.21.15.69:0/3311270038 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f714c005210 0x7f714c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.454+0000 7f716487f700 1 -- 172.21.15.69:0/3311270038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f714c003c40 msgr2=0x7f714c004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:25.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.454+0000 7f716487f700 1 --2- 172.21.15.69:0/3311270038 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f714c003c40 0x7f714c004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.455+0000 7f716487f700 1 -- 172.21.15.69:0/3311270038 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c003570 con 0x7f714c004810 2023-10-06T01:39:25.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.455+0000 7f7165881700 1 -- 172.21.15.69:0/3311270038 reap_dead start 2023-10-06T01:39:25.463 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.455+0000 7f716487f700 1 --2- 172.21.15.69:0/3311270038 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f714c004810 0x7f714c004c80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f715000c210 tx=0x7f7150001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f8746a656440ecf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:25.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.455+0000 7f7157fff700 1 -- 172.21.15.69:0/3311270038 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f715000caa0 con 0x7f714c004810 2023-10-06T01:39:25.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.455+0000 7f7157fff700 1 -- 172.21.15.69:0/3311270038 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f715000cc20 con 0x7f714c004810 2023-10-06T01:39:25.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.455+0000 7f7157fff700 1 -- 172.21.15.69:0/3311270038 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7150005920 con 0x7f714c004810 2023-10-06T01:39:25.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.455+0000 7f71672e4700 1 -- 172.21.15.69:0/3311270038 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f714c004810 msgr2=0x7f714c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:25.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.455+0000 7f71672e4700 1 --2- 172.21.15.69:0/3311270038 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f714c004810 0x7f714c004c80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f715000c210 tx=0x7f7150001d40 comp rx=0 tx=0).stop 2023-10-06T01:39:25.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.455+0000 7f71672e4700 1 -- 172.21.15.69:0/3311270038 shutdown_connections 2023-10-06T01:39:25.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.455+0000 7f71672e4700 1 --2- 172.21.15.69:0/3311270038 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f714c004810 0x7f714c004c80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.455+0000 7f71672e4700 1 -- 172.21.15.69:0/3311270038 >> 172.21.15.69:0/3311270038 conn(0x7f71600703a0 msgr2=0x7f71600707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:25.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.455+0000 7f71672e4700 1 -- 172.21.15.69:0/3311270038 shutdown_connections 2023-10-06T01:39:25.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.455+0000 7f71672e4700 1 -- 172.21.15.69:0/3311270038 wait complete. 2023-10-06T01:39:25.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.456+0000 7f71672e4700 1 Processor -- start 2023-10-06T01:39:25.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.456+0000 7f71672e4700 1 -- start start 2023-10-06T01:39:25.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.457+0000 7f71672e4700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f714c004810 0x7f716014e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:25.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.457+0000 7f71672e4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71600b52f0 0x7f71600cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:25.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.457+0000 7f71672e4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71600cb9f0 0x7f7160153030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:25.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.457+0000 7f71672e4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f716014e950 con 0x7f71600cb9f0 2023-10-06T01:39:25.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.457+0000 7f71672e4700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71600cbe90 con 0x7f71600b52f0 2023-10-06T01:39:25.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.457+0000 7f71672e4700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71600b3480 con 0x7f714c004810 2023-10-06T01:39:25.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.457+0000 7f7165881700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71600cb9f0 0x7f7160153030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:25.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.457+0000 7f7165881700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71600cb9f0 0x7f7160153030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52434/0 (socket says 172.21.15.69:52434) 2023-10-06T01:39:25.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.457+0000 7f7165881700 1 -- 172.21.15.69:0/3492004641 learned_addr learned my addr 172.21.15.69:0/3492004641 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:25.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.458+0000 7f7165080700 1 --2- 172.21.15.69:0/3492004641 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f714c004810 0x7f716014e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:25.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.458+0000 7f716487f700 1 --2- 172.21.15.69:0/3492004641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71600b52f0 0x7f71600cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:25.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.458+0000 7f7165881700 1 -- 172.21.15.69:0/3492004641 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f714c004810 msgr2=0x7f716014e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:25.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.458+0000 7f7165881700 1 --2- 172.21.15.69:0/3492004641 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f714c004810 0x7f716014e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.458+0000 7f7165881700 1 -- 172.21.15.69:0/3492004641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71600b52f0 msgr2=0x7f71600cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:25.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.458+0000 7f7165881700 1 --2- 172.21.15.69:0/3492004641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71600b52f0 0x7f71600cb4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.458+0000 7f7165881700 1 -- 172.21.15.69:0/3492004641 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71600b42e0 con 0x7f71600cb9f0 2023-10-06T01:39:25.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.458+0000 7f7165881700 1 --2- 172.21.15.69:0/3492004641 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71600cb9f0 0x7f7160153030 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f716015d390 tx=0x7f7158009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:25.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.458+0000 7f71557fa700 1 -- 172.21.15.69:0/3492004641 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71580032e0 con 0x7f71600cb9f0 2023-10-06T01:39:25.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.458+0000 7f71557fa700 1 -- 172.21.15.69:0/3492004641 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7158003460 con 0x7f71600cb9f0 2023-10-06T01:39:25.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.458+0000 7f71672e4700 1 -- 172.21.15.69:0/3492004641 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71600b36d0 con 0x7f71600cb9f0 2023-10-06T01:39:25.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.458+0000 7f71557fa700 1 -- 172.21.15.69:0/3492004641 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7158001930 con 0x7f71600cb9f0 2023-10-06T01:39:25.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.458+0000 7f71672e4700 1 -- 172.21.15.69:0/3492004641 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71600b3c90 con 0x7f71600cb9f0 2023-10-06T01:39:25.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.459+0000 7f71672e4700 1 -- 172.21.15.69:0/3492004641 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71600b4470 con 0x7f71600cb9f0 2023-10-06T01:39:25.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.459+0000 7f71557fa700 1 -- 172.21.15.69:0/3492004641 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7158001ce0 con 0x7f71600cb9f0 2023-10-06T01:39:25.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.460+0000 7f71557fa700 1 --2- 172.21.15.69:0/3492004641 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7144066f30 0x7f71440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:25.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.460+0000 7f71557fa700 1 -- 172.21.15.69:0/3492004641 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7158084630 con 0x7f71600cb9f0 2023-10-06T01:39:25.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.460+0000 7f7165080700 1 --2- 172.21.15.69:0/3492004641 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7144066f30 0x7f71440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:25.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.460+0000 7f7165080700 1 --2- 172.21.15.69:0/3492004641 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7144066f30 0x7f71440693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f715c0093f0 tx=0x7f715c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:25.468 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.464+0000 7f71557fa700 1 -- 172.21.15.69:0/3492004641 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7158051740 con 0x7f71600cb9f0 2023-10-06T01:39:25.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.648+0000 7f71672e4700 1 -- 172.21.15.69:0/3492004641 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f716004c3c0 con 0x7f71600cb9f0 2023-10-06T01:39:25.650 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.649+0000 7f71557fa700 1 -- 172.21.15.69:0/3492004641 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f7158054d60 con 0x7f71600cb9f0 2023-10-06T01:39:25.651 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 8 2023-10-06T01:39:25.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.651+0000 7f71672e4700 1 -- 172.21.15.69:0/3492004641 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7144066f30 msgr2=0x7f71440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:25.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.651+0000 7f71672e4700 1 --2- 172.21.15.69:0/3492004641 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7144066f30 0x7f71440693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f715c0093f0 tx=0x7f715c008040 comp rx=0 tx=0).stop 2023-10-06T01:39:25.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.651+0000 7f71672e4700 1 -- 172.21.15.69:0/3492004641 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71600cb9f0 msgr2=0x7f7160153030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:25.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.651+0000 7f71672e4700 1 --2- 172.21.15.69:0/3492004641 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71600cb9f0 0x7f7160153030 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f716015d390 tx=0x7f7158009040 comp rx=0 tx=0).stop 2023-10-06T01:39:25.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.651+0000 7f71672e4700 1 -- 172.21.15.69:0/3492004641 shutdown_connections 2023-10-06T01:39:25.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.651+0000 7f71672e4700 1 --2- 172.21.15.69:0/3492004641 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7144066f30 0x7f71440693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.651+0000 7f71672e4700 1 --2- 172.21.15.69:0/3492004641 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71600cb9f0 0x7f7160153030 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.651+0000 7f71672e4700 1 --2- 172.21.15.69:0/3492004641 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f714c004810 0x7f716014e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.651+0000 7f71672e4700 1 --2- 172.21.15.69:0/3492004641 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71600b52f0 0x7f71600cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.651+0000 7f71672e4700 1 -- 172.21.15.69:0/3492004641 >> 172.21.15.69:0/3492004641 conn(0x7f71600703a0 msgr2=0x7f7160154e40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:25.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.651+0000 7f71672e4700 1 -- 172.21.15.69:0/3492004641 shutdown_connections 2023-10-06T01:39:25.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.651+0000 7f71672e4700 1 -- 172.21.15.69:0/3492004641 wait complete. 2023-10-06T01:39:25.664 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T01:39:25.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.779+0000 7f9accc53700 1 Processor -- start 2023-10-06T01:39:25.781 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.779+0000 7f9accc53700 1 -- start start 2023-10-06T01:39:25.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.780+0000 7f9accc53700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ac815abe0 0x7f9ac80ca840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:25.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.780+0000 7f9accc53700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9ac806d280 0x7f9ac80cad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:25.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.780+0000 7f9accc53700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac815a750 con 0x7f9ac8157360 2023-10-06T01:39:25.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.780+0000 7f9accc53700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac815e400 con 0x7f9ac806d280 2023-10-06T01:39:25.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.780+0000 7f9accc53700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac8068540 con 0x7f9ac815abe0 2023-10-06T01:39:25.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.780+0000 7f9ac6d9d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f9ac806d280 0x7f9ac80cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:25.783 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.780+0000 7f9ac659c700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f9ac8157360 0x7f9ac8067e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44952/0 (socket says 172.21.15.69:44952) 2023-10-06T01:39:25.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.780+0000 7f9ac659c700 1 -- 172.21.15.69:0/1517251505 learned_addr learned my addr 172.21.15.69:0/1517251505 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:25.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.781+0000 7f9abffff700 1 --2- 172.21.15.69:0/1517251505 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ac815abe0 0x7f9ac80ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:25.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.781+0000 7f9ac6d9d700 1 -- 172.21.15.69:0/1517251505 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ac815abe0 msgr2=0x7f9ac80ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:25.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.781+0000 7f9ac6d9d700 1 --2- 172.21.15.69:0/1517251505 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ac815abe0 0x7f9ac80ca840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.781+0000 7f9ac6d9d700 1 -- 172.21.15.69:0/1517251505 >> v1:172.21.15.69:6789/0 conn(0x7f9ac8157360 legacy=0x7f9ac8067e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:25.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.781+0000 7f9ac5d9b700 1 -- 172.21.15.69:0/1517251505 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1222027292 0 0) 0x7f9ac815a750 con 0x7f9ac8157360 2023-10-06T01:39:25.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.781+0000 7f9ac6d9d700 1 -- 172.21.15.69:0/1517251505 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac8159e40 con 0x7f9ac806d280 2023-10-06T01:39:25.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.781+0000 7f9ac6d9d700 1 --2- 172.21.15.69:0/1517251505 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ac806d280 0x7f9ac80cad80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0009e90 tx=0x7f9ac0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde303500e53f6bd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:25.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.781+0000 7f9ac5d9b700 1 -- 172.21.15.69:0/1517251505 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac000e070 con 0x7f9ac806d280 2023-10-06T01:39:25.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.781+0000 7f9ac5d9b700 1 -- 172.21.15.69:0/1517251505 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac000bbf0 con 0x7f9ac806d280 2023-10-06T01:39:25.784 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.781+0000 7f9ac5d9b700 1 -- 172.21.15.69:0/1517251505 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac0012430 con 0x7f9ac806d280 2023-10-06T01:39:25.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.782+0000 7f9accc53700 1 -- 172.21.15.69:0/1517251505 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ac806d280 msgr2=0x7f9ac80cad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:25.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.782+0000 7f9accc53700 1 --2- 172.21.15.69:0/1517251505 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ac806d280 0x7f9ac80cad80 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9ac0009e90 tx=0x7f9ac0009780 comp rx=0 tx=0).stop 2023-10-06T01:39:25.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.782+0000 7f9accc53700 1 -- 172.21.15.69:0/1517251505 shutdown_connections 2023-10-06T01:39:25.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.782+0000 7f9accc53700 1 --2- 172.21.15.69:0/1517251505 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ac806d280 0x7f9ac80cad80 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.782+0000 7f9accc53700 1 --2- 172.21.15.69:0/1517251505 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ac815abe0 0x7f9ac80ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.782+0000 7f9accc53700 1 -- 172.21.15.69:0/1517251505 >> 172.21.15.69:0/1517251505 conn(0x7f9ac80ccb50 msgr2=0x7f9ac80ccf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:25.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.782+0000 7f9accc53700 1 -- 172.21.15.69:0/1517251505 shutdown_connections 2023-10-06T01:39:25.785 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.782+0000 7f9accc53700 1 -- 172.21.15.69:0/1517251505 wait complete. 2023-10-06T01:39:25.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.783+0000 7f9accc53700 1 Processor -- start 2023-10-06T01:39:25.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.783+0000 7f9accc53700 1 -- start start 2023-10-06T01:39:25.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.783+0000 7f9accc53700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ac806d280 0x7f9ac8156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:25.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.783+0000 7f9accc53700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ac8157360 0x7f9ac8158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:25.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.783+0000 7f9accc53700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ac815abe0 0x7f9ac80c18f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:25.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.783+0000 7f9accc53700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac8158470 con 0x7f9ac8157360 2023-10-06T01:39:25.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.783+0000 7f9accc53700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac8157860 con 0x7f9ac815abe0 2023-10-06T01:39:25.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.783+0000 7f9accc53700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac8157b40 con 0x7f9ac806d280 2023-10-06T01:39:25.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.784+0000 7f9abffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ac8157360 0x7f9ac8158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:25.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.784+0000 7f9abffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ac8157360 0x7f9ac8158df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52450/0 (socket says 172.21.15.69:52450) 2023-10-06T01:39:25.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.784+0000 7f9abffff700 1 -- 172.21.15.69:0/42108078 learned_addr learned my addr 172.21.15.69:0/42108078 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:25.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.784+0000 7f9ac659c700 1 --2- 172.21.15.69:0/42108078 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ac806d280 0x7f9ac8156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:25.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.784+0000 7f9ac6d9d700 1 --2- 172.21.15.69:0/42108078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ac815abe0 0x7f9ac80c18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:25.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.784+0000 7f9abffff700 1 -- 172.21.15.69:0/42108078 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ac806d280 msgr2=0x7f9ac8156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:25.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.784+0000 7f9abffff700 1 --2- 172.21.15.69:0/42108078 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ac806d280 0x7f9ac8156790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.784+0000 7f9abffff700 1 -- 172.21.15.69:0/42108078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ac815abe0 msgr2=0x7f9ac80c18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:25.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.784+0000 7f9abffff700 1 --2- 172.21.15.69:0/42108078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ac815abe0 0x7f9ac80c18f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.784+0000 7f9abffff700 1 -- 172.21.15.69:0/42108078 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac0009a20 con 0x7f9ac8157360 2023-10-06T01:39:25.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.784+0000 7f9abffff700 1 --2- 172.21.15.69:0/42108078 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ac8157360 0x7f9ac8158df0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000c880 tx=0x7f9ab0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:25.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.784+0000 7f9abe7fc700 1 -- 172.21.15.69:0/42108078 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0011600 con 0x7f9ac8157360 2023-10-06T01:39:25.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.784+0000 7f9abe7fc700 1 -- 172.21.15.69:0/42108078 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab0011780 con 0x7f9ac8157360 2023-10-06T01:39:25.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.784+0000 7f9accc53700 1 -- 172.21.15.69:0/42108078 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac8157e20 con 0x7f9ac8157360 2023-10-06T01:39:25.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.784+0000 7f9abe7fc700 1 -- 172.21.15.69:0/42108078 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab0011b40 con 0x7f9ac8157360 2023-10-06T01:39:25.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.784+0000 7f9accc53700 1 -- 172.21.15.69:0/42108078 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac8159330 con 0x7f9ac8157360 2023-10-06T01:39:25.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.785+0000 7f9accc53700 1 -- 172.21.15.69:0/42108078 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac804c3c0 con 0x7f9ac8157360 2023-10-06T01:39:25.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.785+0000 7f9abe7fc700 1 -- 172.21.15.69:0/42108078 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9ab0018360 con 0x7f9ac8157360 2023-10-06T01:39:25.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.786+0000 7f9abe7fc700 1 --2- 172.21.15.69:0/42108078 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9aa8066f30 0x7f9aa80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:25.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.786+0000 7f9abe7fc700 1 -- 172.21.15.69:0/42108078 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9ab0084410 con 0x7f9ac8157360 2023-10-06T01:39:25.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.786+0000 7f9ac659c700 1 --2- 172.21.15.69:0/42108078 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9aa8066f30 0x7f9aa80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:25.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.786+0000 7f9ac659c700 1 --2- 172.21.15.69:0/42108078 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9aa8066f30 0x7f9aa80693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80011e0 tx=0x7f9ab8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:25.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.790+0000 7f9abe7fc700 1 -- 172.21.15.69:0/42108078 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9ab0054fb0 con 0x7f9ac8157360 2023-10-06T01:39:25.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.971+0000 7f9accc53700 1 -- 172.21.15.69:0/42108078 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9ac81585b0 con 0x7f9ac8157360 2023-10-06T01:39:25.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.972+0000 7f9abe7fc700 1 -- 172.21.15.69:0/42108078 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9ab005a070 con 0x7f9ac8157360 2023-10-06T01:39:25.973 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-10-06T01:39:25.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.974+0000 7f9accc53700 1 -- 172.21.15.69:0/42108078 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9aa8066f30 msgr2=0x7f9aa80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:25.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.974+0000 7f9accc53700 1 --2- 172.21.15.69:0/42108078 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9aa8066f30 0x7f9aa80693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9ab80011e0 tx=0x7f9ab8009040 comp rx=0 tx=0).stop 2023-10-06T01:39:25.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.974+0000 7f9accc53700 1 -- 172.21.15.69:0/42108078 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ac8157360 msgr2=0x7f9ac8158df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:25.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.974+0000 7f9accc53700 1 --2- 172.21.15.69:0/42108078 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ac8157360 0x7f9ac8158df0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9ab000c880 tx=0x7f9ab0008040 comp rx=0 tx=0).stop 2023-10-06T01:39:25.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.974+0000 7f9accc53700 1 -- 172.21.15.69:0/42108078 shutdown_connections 2023-10-06T01:39:25.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.974+0000 7f9accc53700 1 --2- 172.21.15.69:0/42108078 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9aa8066f30 0x7f9aa80693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.974+0000 7f9accc53700 1 --2- 172.21.15.69:0/42108078 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9ac815abe0 0x7f9ac80c18f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.974+0000 7f9accc53700 1 --2- 172.21.15.69:0/42108078 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9ac806d280 0x7f9ac8156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.974+0000 7f9accc53700 1 --2- 172.21.15.69:0/42108078 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ac8157360 0x7f9ac8158df0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:25.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.974+0000 7f9accc53700 1 -- 172.21.15.69:0/42108078 >> 172.21.15.69:0/42108078 conn(0x7f9ac80ccb50 msgr2=0x7f9ac8067e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:25.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.974+0000 7f9accc53700 1 -- 172.21.15.69:0/42108078 shutdown_connections 2023-10-06T01:39:25.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:25.974+0000 7f9accc53700 1 -- 172.21.15.69:0/42108078 wait complete. 2023-10-06T01:39:25.987 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T01:39:26.104 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.103+0000 7f12f1905700 1 Processor -- start 2023-10-06T01:39:26.105 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.103+0000 7f12f1905700 1 -- start start 2023-10-06T01:39:26.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.104+0000 7f12f1905700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f12ec157930 0x7f12ec0ab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:26.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.104+0000 7f12f1905700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ec0c32a0 con 0x7f12ec0cd2b0 2023-10-06T01:39:26.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.104+0000 7f12f1905700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12ec0c4100 con 0x7f12ec0ca2c0 2023-10-06T01:39:26.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.104+0000 7f12f1905700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12ec0c9730 con 0x7f12ec157930 2023-10-06T01:39:26.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.104+0000 7f12eaffd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f12ec157930 0x7f12ec0ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:26.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.104+0000 7f12eb7fe700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f12ec0cd2b0 0x7f12ec0c4590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44958/0 (socket says 172.21.15.69:44958) 2023-10-06T01:39:26.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.104+0000 7f12eb7fe700 1 -- 172.21.15.69:0/865670141 learned_addr learned my addr 172.21.15.69:0/865670141 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:26.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.104+0000 7f12eaffd700 1 -- 172.21.15.69:0/865670141 >> v1:172.21.15.88:6789/0 conn(0x7f12ec0ca2c0 legacy=0x7f12ec0ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:26.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.105+0000 7f12eaffd700 1 -- 172.21.15.69:0/865670141 >> v1:172.21.15.69:6789/0 conn(0x7f12ec0cd2b0 legacy=0x7f12ec0c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:26.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.105+0000 7f12eaffd700 1 -- 172.21.15.69:0/865670141 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12ec0c34f0 con 0x7f12ec157930 2023-10-06T01:39:26.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.105+0000 7f12eaffd700 1 --2- 172.21.15.69:0/865670141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12ec157930 0x7f12ec0ab070 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0098e0 tx=0x7f12dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb083b7746eb040 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:26.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.105+0000 7f12ea7fc700 1 -- 172.21.15.69:0/865670141 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc009e80 con 0x7f12ec157930 2023-10-06T01:39:26.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.105+0000 7f12ea7fc700 1 -- 172.21.15.69:0/865670141 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12dc00b820 con 0x7f12ec157930 2023-10-06T01:39:26.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.105+0000 7f12ea7fc700 1 -- 172.21.15.69:0/865670141 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12dc00bba0 con 0x7f12ec157930 2023-10-06T01:39:26.108 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.105+0000 7f12f1905700 1 -- 172.21.15.69:0/865670141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12ec157930 msgr2=0x7f12ec0ab070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:26.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.105+0000 7f12f1905700 1 --2- 172.21.15.69:0/865670141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12ec157930 0x7f12ec0ab070 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0098e0 tx=0x7f12dc0091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:26.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.105+0000 7f12f1905700 1 -- 172.21.15.69:0/865670141 shutdown_connections 2023-10-06T01:39:26.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.105+0000 7f12f1905700 1 --2- 172.21.15.69:0/865670141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12ec157930 0x7f12ec0ab070 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:26.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.105+0000 7f12f1905700 1 -- 172.21.15.69:0/865670141 >> 172.21.15.69:0/865670141 conn(0x7f12ec088000 msgr2=0x7f12ec0883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:26.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.105+0000 7f12f1905700 1 -- 172.21.15.69:0/865670141 shutdown_connections 2023-10-06T01:39:26.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.105+0000 7f12f1905700 1 -- 172.21.15.69:0/865670141 wait complete. 2023-10-06T01:39:26.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.107+0000 7f12f1905700 1 Processor -- start 2023-10-06T01:39:26.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.107+0000 7f12f1905700 1 -- start start 2023-10-06T01:39:26.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.107+0000 7f12f1905700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12ec0ca2c0 0x7f12ec0b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:26.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.107+0000 7f12f1905700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12ec0cd2b0 0x7f12ec0b3960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:26.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.107+0000 7f12f1905700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f12ec157930 0x7f12ec153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:26.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.107+0000 7f12f1905700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec0b2490 con 0x7f12ec0cd2b0 2023-10-06T01:39:26.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.107+0000 7f12f1905700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec0b3ea0 con 0x7f12ec0ca2c0 2023-10-06T01:39:26.112 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.107+0000 7f12f1905700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12ec0b1880 con 0x7f12ec157930 2023-10-06T01:39:26.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.107+0000 7f12e27fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12ec0cd2b0 0x7f12ec0b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:26.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.107+0000 7f12e27fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12ec0cd2b0 0x7f12ec0b3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52468/0 (socket says 172.21.15.69:52468) 2023-10-06T01:39:26.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.107+0000 7f12e27fc700 1 -- 172.21.15.69:0/2730080737 learned_addr learned my addr 172.21.15.69:0/2730080737 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:26.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.108+0000 7f12eaffd700 1 --2- 172.21.15.69:0/2730080737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12ec0ca2c0 0x7f12ec0b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:26.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.108+0000 7f12eb7fe700 1 --2- 172.21.15.69:0/2730080737 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f12ec157930 0x7f12ec153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:26.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.108+0000 7f12e27fc700 1 -- 172.21.15.69:0/2730080737 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f12ec157930 msgr2=0x7f12ec153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:26.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.108+0000 7f12e27fc700 1 --2- 172.21.15.69:0/2730080737 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f12ec157930 0x7f12ec153300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:26.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.108+0000 7f12e27fc700 1 -- 172.21.15.69:0/2730080737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12ec0ca2c0 msgr2=0x7f12ec0b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:26.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.108+0000 7f12e27fc700 1 --2- 172.21.15.69:0/2730080737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12ec0ca2c0 0x7f12ec0b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:26.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.108+0000 7f12e27fc700 1 -- 172.21.15.69:0/2730080737 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12dc009420 con 0x7f12ec0cd2b0 2023-10-06T01:39:26.113 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.108+0000 7f12e27fc700 1 --2- 172.21.15.69:0/2730080737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12ec0cd2b0 0x7f12ec0b3960 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f12d400c600 tx=0x7f12d4007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:26.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.108+0000 7f12e37fe700 1 -- 172.21.15.69:0/2730080737 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d4011590 con 0x7f12ec0cd2b0 2023-10-06T01:39:26.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.108+0000 7f12e37fe700 1 -- 172.21.15.69:0/2730080737 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d4011710 con 0x7f12ec0cd2b0 2023-10-06T01:39:26.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.108+0000 7f12e37fe700 1 -- 172.21.15.69:0/2730080737 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d4011ad0 con 0x7f12ec0cd2b0 2023-10-06T01:39:26.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.108+0000 7f12f1905700 1 -- 172.21.15.69:0/2730080737 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12ec0b1b60 con 0x7f12ec0cd2b0 2023-10-06T01:39:26.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.108+0000 7f12f1905700 1 -- 172.21.15.69:0/2730080737 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12ec0b2120 con 0x7f12ec0cd2b0 2023-10-06T01:39:26.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.109+0000 7f12f1905700 1 -- 172.21.15.69:0/2730080737 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12ec04c3c0 con 0x7f12ec0cd2b0 2023-10-06T01:39:26.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.109+0000 7f12e37fe700 1 -- 172.21.15.69:0/2730080737 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f12d401c460 con 0x7f12ec0cd2b0 2023-10-06T01:39:26.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.110+0000 7f12e37fe700 1 --2- 172.21.15.69:0/2730080737 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f12cc066f30 0x7f12cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:26.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.110+0000 7f12e37fe700 1 -- 172.21.15.69:0/2730080737 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f12d4084440 con 0x7f12ec0cd2b0 2023-10-06T01:39:26.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.110+0000 7f12eaffd700 1 --2- 172.21.15.69:0/2730080737 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f12cc066f30 0x7f12cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:26.114 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.110+0000 7f12eaffd700 1 --2- 172.21.15.69:0/2730080737 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f12cc066f30 0x7f12cc0693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0030c0 tx=0x7f12dc016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:26.115 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.114+0000 7f12e37fe700 1 -- 172.21.15.69:0/2730080737 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12d4051550 con 0x7f12ec0cd2b0 2023-10-06T01:39:26.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.297+0000 7f12f1905700 1 -- 172.21.15.69:0/2730080737 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f12ec0ccf80 con 0x7f12ec0cd2b0 2023-10-06T01:39:26.299 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.298+0000 7f12e37fe700 1 -- 172.21.15.69:0/2730080737 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+11 (secure 0 0 0) 0x7f12d4054b70 con 0x7f12ec0cd2b0 2023-10-06T01:39:26.299 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-10-06T01:39:26.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.300+0000 7f12f1905700 1 -- 172.21.15.69:0/2730080737 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f12cc066f30 msgr2=0x7f12cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:26.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.300+0000 7f12f1905700 1 --2- 172.21.15.69:0/2730080737 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f12cc066f30 0x7f12cc0693e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f12dc0030c0 tx=0x7f12dc016000 comp rx=0 tx=0).stop 2023-10-06T01:39:26.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.300+0000 7f12f1905700 1 -- 172.21.15.69:0/2730080737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12ec0cd2b0 msgr2=0x7f12ec0b3960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:26.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.300+0000 7f12f1905700 1 --2- 172.21.15.69:0/2730080737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12ec0cd2b0 0x7f12ec0b3960 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f12d400c600 tx=0x7f12d4007f60 comp rx=0 tx=0).stop 2023-10-06T01:39:26.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.300+0000 7f12f1905700 1 -- 172.21.15.69:0/2730080737 shutdown_connections 2023-10-06T01:39:26.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.300+0000 7f12f1905700 1 --2- 172.21.15.69:0/2730080737 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f12cc066f30 0x7f12cc0693e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:26.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.300+0000 7f12f1905700 1 --2- 172.21.15.69:0/2730080737 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f12ec157930 0x7f12ec153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:26.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.300+0000 7f12f1905700 1 --2- 172.21.15.69:0/2730080737 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12ec0ca2c0 0x7f12ec0b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:26.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.300+0000 7f12f1905700 1 --2- 172.21.15.69:0/2730080737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12ec0cd2b0 0x7f12ec0b3960 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:26.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.300+0000 7f12f1905700 1 -- 172.21.15.69:0/2730080737 >> 172.21.15.69:0/2730080737 conn(0x7f12ec088000 msgr2=0x7f12ec0caff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:26.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.300+0000 7f12f1905700 1 -- 172.21.15.69:0/2730080737 shutdown_connections 2023-10-06T01:39:26.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.300+0000 7f12f1905700 1 -- 172.21.15.69:0/2730080737 wait complete. 2023-10-06T01:39:26.313 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:39:26.425 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.424+0000 7ff51676a700 1 Processor -- start 2023-10-06T01:39:26.426 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.424+0000 7ff51676a700 1 -- start start 2023-10-06T01:39:26.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.425+0000 7ff51676a700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff510153c30 0x7ff51015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:26.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.425+0000 7ff51676a700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff5100cf110 0x7ff51015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:26.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.425+0000 7ff51676a700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff51015afd0 con 0x7ff51015de50 2023-10-06T01:39:26.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.425+0000 7ff51676a700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff51015b2b0 con 0x7ff5100cf110 2023-10-06T01:39:26.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.425+0000 7ff51676a700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff51015b590 con 0x7ff510153c30 2023-10-06T01:39:26.428 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.425+0000 7ff515f69700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff5100cf110 0x7ff51015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:26.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.425+0000 7ff514f67700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7ff51015de50 0x7ff5100cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44960/0 (socket says 172.21.15.69:44960) 2023-10-06T01:39:26.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.425+0000 7ff514f67700 1 -- 172.21.15.69:0/2667482226 learned_addr learned my addr 172.21.15.69:0/2667482226 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:26.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.425+0000 7ff515768700 1 --2- 172.21.15.69:0/2667482226 >> v2:172.21.15.88:3300/0 conn(0x7ff510153c30 0x7ff51015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:26.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.425+0000 7ff515f69700 1 -- 172.21.15.69:0/2667482226 >> v2:172.21.15.88:3300/0 conn(0x7ff510153c30 msgr2=0x7ff51015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:26.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.425+0000 7ff515f69700 1 --2- 172.21.15.69:0/2667482226 >> v2:172.21.15.88:3300/0 conn(0x7ff510153c30 0x7ff51015a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:26.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.425+0000 7ff515f69700 1 -- 172.21.15.69:0/2667482226 >> v1:172.21.15.69:6789/0 conn(0x7ff51015de50 legacy=0x7ff5100cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:26.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.425+0000 7ff515f69700 1 -- 172.21.15.69:0/2667482226 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51015b870 con 0x7ff5100cf110 2023-10-06T01:39:26.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.425+0000 7ff507fff700 1 -- 172.21.15.69:0/2667482226 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 752897342 0 0) 0x7ff51015afd0 con 0x7ff51015de50 2023-10-06T01:39:26.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.426+0000 7ff515f69700 1 --2- 172.21.15.69:0/2667482226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5100cf110 0x7ff51015c070 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff51006ead0 tx=0x7ff508009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=954e3c9eb1a547a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:26.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.426+0000 7ff507fff700 1 -- 172.21.15.69:0/2667482226 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50800e070 con 0x7ff5100cf110 2023-10-06T01:39:26.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.426+0000 7ff507fff700 1 -- 172.21.15.69:0/2667482226 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50800bb60 con 0x7ff5100cf110 2023-10-06T01:39:26.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.426+0000 7ff507fff700 1 -- 172.21.15.69:0/2667482226 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff508012430 con 0x7ff5100cf110 2023-10-06T01:39:26.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.426+0000 7ff51676a700 1 -- 172.21.15.69:0/2667482226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5100cf110 msgr2=0x7ff51015c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:26.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.426+0000 7ff51676a700 1 --2- 172.21.15.69:0/2667482226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5100cf110 0x7ff51015c070 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff51006ead0 tx=0x7ff508009780 comp rx=0 tx=0).stop 2023-10-06T01:39:26.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.426+0000 7ff51676a700 1 -- 172.21.15.69:0/2667482226 shutdown_connections 2023-10-06T01:39:26.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.426+0000 7ff51676a700 1 --2- 172.21.15.69:0/2667482226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5100cf110 0x7ff51015c070 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:26.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.426+0000 7ff51676a700 1 --2- 172.21.15.69:0/2667482226 >> v2:172.21.15.88:3300/0 conn(0x7ff510153c30 0x7ff51015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:26.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.426+0000 7ff51676a700 1 -- 172.21.15.69:0/2667482226 >> 172.21.15.69:0/2667482226 conn(0x7ff5100703a0 msgr2=0x7ff5100707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:26.430 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.426+0000 7ff51676a700 1 -- 172.21.15.69:0/2667482226 shutdown_connections 2023-10-06T01:39:26.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.426+0000 7ff51676a700 1 -- 172.21.15.69:0/2667482226 wait complete. 2023-10-06T01:39:26.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.427+0000 7ff51676a700 1 Processor -- start 2023-10-06T01:39:26.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.427+0000 7ff51676a700 1 -- start start 2023-10-06T01:39:26.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.428+0000 7ff51676a700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5100cf110 0x7ff5100c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:26.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.428+0000 7ff51676a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff510153c30 0x7ff5100cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:26.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.428+0000 7ff51676a700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff51015de50 0x7ff510152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:26.433 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.428+0000 7ff51676a700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5100c9b50 con 0x7ff510153c30 2023-10-06T01:39:26.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.428+0000 7ff51676a700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5100c8f40 con 0x7ff5100cf110 2023-10-06T01:39:26.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.428+0000 7ff51676a700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5100c9220 con 0x7ff51015de50 2023-10-06T01:39:26.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.428+0000 7ff514f67700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff510153c30 0x7ff5100cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:26.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.428+0000 7ff514f67700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff510153c30 0x7ff5100cc330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52484/0 (socket says 172.21.15.69:52484) 2023-10-06T01:39:26.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.428+0000 7ff514f67700 1 -- 172.21.15.69:0/3204420575 learned_addr learned my addr 172.21.15.69:0/3204420575 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:26.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.429+0000 7ff515768700 1 --2- 172.21.15.69:0/3204420575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5100cf110 0x7ff5100c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:26.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.429+0000 7ff515f69700 1 --2- 172.21.15.69:0/3204420575 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff51015de50 0x7ff510152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:26.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.429+0000 7ff514f67700 1 -- 172.21.15.69:0/3204420575 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff51015de50 msgr2=0x7ff510152c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:26.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.429+0000 7ff514f67700 1 --2- 172.21.15.69:0/3204420575 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff51015de50 0x7ff510152c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:26.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.429+0000 7ff514f67700 1 -- 172.21.15.69:0/3204420575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5100cf110 msgr2=0x7ff5100c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:26.434 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.429+0000 7ff514f67700 1 --2- 172.21.15.69:0/3204420575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5100cf110 0x7ff5100c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:26.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.429+0000 7ff514f67700 1 -- 172.21.15.69:0/3204420575 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff508009a20 con 0x7ff510153c30 2023-10-06T01:39:26.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.429+0000 7ff515768700 1 --2- 172.21.15.69:0/3204420575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5100cf110 0x7ff5100c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:26.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.429+0000 7ff514f67700 1 --2- 172.21.15.69:0/3204420575 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff510153c30 0x7ff5100cc330 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff50000c5b0 tx=0x7ff500001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:26.435 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.429+0000 7ff5057fa700 1 -- 172.21.15.69:0/3204420575 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500005b30 con 0x7ff510153c30 2023-10-06T01:39:26.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.429+0000 7ff5057fa700 1 -- 172.21.15.69:0/3204420575 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff500005c90 con 0x7ff510153c30 2023-10-06T01:39:26.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.429+0000 7ff51676a700 1 -- 172.21.15.69:0/3204420575 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5100c9500 con 0x7ff510153c30 2023-10-06T01:39:26.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.429+0000 7ff5057fa700 1 -- 172.21.15.69:0/3204420575 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500007320 con 0x7ff510153c30 2023-10-06T01:39:26.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.429+0000 7ff51676a700 1 -- 172.21.15.69:0/3204420575 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5100cc870 con 0x7ff510153c30 2023-10-06T01:39:26.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.430+0000 7ff51676a700 1 -- 172.21.15.69:0/3204420575 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5100c99a0 con 0x7ff510153c30 2023-10-06T01:39:26.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.430+0000 7ff5057fa700 1 -- 172.21.15.69:0/3204420575 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff50001b400 con 0x7ff510153c30 2023-10-06T01:39:26.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.431+0000 7ff5057fa700 1 --2- 172.21.15.69:0/3204420575 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff4f4066f60 0x7ff4f4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:26.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.431+0000 7ff5057fa700 1 -- 172.21.15.69:0/3204420575 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff500084110 con 0x7ff510153c30 2023-10-06T01:39:26.437 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.431+0000 7ff515768700 1 --2- 172.21.15.69:0/3204420575 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff4f4066f60 0x7ff4f4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:26.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.431+0000 7ff515768700 1 --2- 172.21.15.69:0/3204420575 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff4f4066f60 0x7ff4f4069410 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff50c006f00 tx=0x7ff50c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:26.438 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.435+0000 7ff5057fa700 1 -- 172.21.15.69:0/3204420575 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5000512a0 con 0x7ff510153c30 2023-10-06T01:39:26.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.663+0000 7ff51676a700 1 -- 172.21.15.69:0/3204420575 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff51004c3c0 con 0x7ff510153c30 2023-10-06T01:39:26.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.664+0000 7ff5057fa700 1 -- 172.21.15.69:0/3204420575 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4591 (secure 0 0 0) 0x7ff5000548c0 con 0x7ff510153c30 2023-10-06T01:39:26.665 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:26.666 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6836/2049506781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2049506781},{"type":"v1","addr":"172.21.15.69:6836","nonce":2049506781}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3367080201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6835","nonce":3367080201},{"type":"v1","addr":"172.21.15.69:6837","nonce":3367080201}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2692995813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":2692995813},{"type":"v1","addr":"172.21.15.88:6835","nonce":2692995813}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:38:49.072564+0000","modified":"2023-10-06T01:38:52.659297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6834/2097597935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":2097597935},{"type":"v1","addr":"172.21.15.88:6834","nonce":2097597935}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T01:39:26.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.666+0000 7ff51676a700 1 -- 172.21.15.69:0/3204420575 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff4f4066f60 msgr2=0x7ff4f4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:26.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.666+0000 7ff51676a700 1 --2- 172.21.15.69:0/3204420575 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff4f4066f60 0x7ff4f4069410 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff50c006f00 tx=0x7ff50c008040 comp rx=0 tx=0).stop 2023-10-06T01:39:26.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.666+0000 7ff51676a700 1 -- 172.21.15.69:0/3204420575 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff510153c30 msgr2=0x7ff5100cc330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:26.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.666+0000 7ff51676a700 1 --2- 172.21.15.69:0/3204420575 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff510153c30 0x7ff5100cc330 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff50000c5b0 tx=0x7ff500001070 comp rx=0 tx=0).stop 2023-10-06T01:39:26.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.666+0000 7ff51676a700 1 -- 172.21.15.69:0/3204420575 shutdown_connections 2023-10-06T01:39:26.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.666+0000 7ff51676a700 1 --2- 172.21.15.69:0/3204420575 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff4f4066f60 0x7ff4f4069410 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:26.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.666+0000 7ff51676a700 1 --2- 172.21.15.69:0/3204420575 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff51015de50 0x7ff510152c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:26.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.666+0000 7ff51676a700 1 --2- 172.21.15.69:0/3204420575 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff5100cf110 0x7ff5100c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:26.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.666+0000 7ff51676a700 1 --2- 172.21.15.69:0/3204420575 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff510153c30 0x7ff5100cc330 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:26.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.666+0000 7ff51676a700 1 -- 172.21.15.69:0/3204420575 >> 172.21.15.69:0/3204420575 conn(0x7ff5100703a0 msgr2=0x7ff5100b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:26.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.666+0000 7ff51676a700 1 -- 172.21.15.69:0/3204420575 shutdown_connections 2023-10-06T01:39:26.668 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.666+0000 7ff51676a700 1 -- 172.21.15.69:0/3204420575 wait complete. 2023-10-06T01:39:26.669 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 8 2023-10-06T01:39:26.679 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:39:26.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.792+0000 7f0ec60d9700 1 Processor -- start 2023-10-06T01:39:26.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.792+0000 7f0ec60d9700 1 -- start start 2023-10-06T01:39:26.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.793+0000 7f0ec60d9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0ec00d0780 0x7f0ec00d0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:26.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.793+0000 7f0ec60d9700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f0ec01599e0 0x7f0ec00cfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:26.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.793+0000 7f0ec60d9700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ec00ced70 con 0x7f0ec00ce7b0 2023-10-06T01:39:26.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.793+0000 7f0ec60d9700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec00cf050 con 0x7f0ec01599e0 2023-10-06T01:39:26.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.793+0000 7f0ec60d9700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ec00cf330 con 0x7f0ec00d0780 2023-10-06T01:39:26.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.793+0000 7f0ebffff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f0ec01599e0 0x7f0ec00cfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:26.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.793+0000 7f0ebffff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f0ec01599e0 0x7f0ec00cfe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52492/0 (socket says 172.21.15.69:52492) 2023-10-06T01:39:26.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.793+0000 7f0ebffff700 1 -- 172.21.15.69:0/4062519816 learned_addr learned my addr 172.21.15.69:0/4062519816 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:26.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.793+0000 7f0ebf7fe700 1 --2- 172.21.15.69:0/4062519816 >> v2:172.21.15.88:3300/0 conn(0x7f0ec00d0780 0x7f0ec00d0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:26.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.793+0000 7f0ebffff700 1 -- 172.21.15.69:0/4062519816 >> v2:172.21.15.88:3300/0 conn(0x7f0ec00d0780 msgr2=0x7f0ec00d0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:26.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.793+0000 7f0ebffff700 1 --2- 172.21.15.69:0/4062519816 >> v2:172.21.15.88:3300/0 conn(0x7f0ec00d0780 0x7f0ec00d0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:26.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.793+0000 7f0ebffff700 1 -- 172.21.15.69:0/4062519816 >> v1:172.21.15.88:6789/0 conn(0x7f0ec00ce7b0 legacy=0x7f0ec01592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:26.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.793+0000 7f0ebffff700 1 -- 172.21.15.69:0/4062519816 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec00cf610 con 0x7f0ec01599e0 2023-10-06T01:39:26.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.793+0000 7f0ebffff700 1 --2- 172.21.15.69:0/4062519816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ec01599e0 0x7f0ec00cfe10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0089610 tx=0x7f0eb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8da2518d00df327 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:26.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.794+0000 7f0ebe7fc700 1 -- 172.21.15.69:0/4062519816 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb800b820 con 0x7f0ec01599e0 2023-10-06T01:39:26.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.794+0000 7f0ebe7fc700 1 -- 172.21.15.69:0/4062519816 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb800b980 con 0x7f0ec01599e0 2023-10-06T01:39:26.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.794+0000 7f0ebe7fc700 1 -- 172.21.15.69:0/4062519816 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb800bd20 con 0x7f0ec01599e0 2023-10-06T01:39:26.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.794+0000 7f0ec60d9700 1 -- 172.21.15.69:0/4062519816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ec01599e0 msgr2=0x7f0ec00cfe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:26.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.794+0000 7f0ec60d9700 1 --2- 172.21.15.69:0/4062519816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ec01599e0 0x7f0ec00cfe10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0ec0089610 tx=0x7f0eb8009250 comp rx=0 tx=0).stop 2023-10-06T01:39:26.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.794+0000 7f0ec60d9700 1 -- 172.21.15.69:0/4062519816 shutdown_connections 2023-10-06T01:39:26.797 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.794+0000 7f0ec60d9700 1 --2- 172.21.15.69:0/4062519816 >> v2:172.21.15.88:3300/0 conn(0x7f0ec00d0780 0x7f0ec00d0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:26.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.794+0000 7f0ec60d9700 1 --2- 172.21.15.69:0/4062519816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ec01599e0 0x7f0ec00cfe10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:26.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.794+0000 7f0ec60d9700 1 -- 172.21.15.69:0/4062519816 >> 172.21.15.69:0/4062519816 conn(0x7f0ec00703a0 msgr2=0x7f0ec00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:26.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.794+0000 7f0ec60d9700 1 -- 172.21.15.69:0/4062519816 shutdown_connections 2023-10-06T01:39:26.798 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.794+0000 7f0ec60d9700 1 -- 172.21.15.69:0/4062519816 wait complete. 2023-10-06T01:39:26.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.795+0000 7f0ec60d9700 1 Processor -- start 2023-10-06T01:39:26.800 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.795+0000 7f0ec60d9700 1 -- start start 2023-10-06T01:39:26.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.796+0000 7f0ec60d9700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0ec00ce7b0 0x7f0ec00ca200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:26.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.796+0000 7f0ec60d9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ec00d0780 0x7f0ec00b5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:26.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.796+0000 7f0ec60d9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ec01599e0 0x7f0ec01537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:26.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.796+0000 7f0ec60d9700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec015b200 con 0x7f0ec01599e0 2023-10-06T01:39:26.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.796+0000 7f0ec60d9700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec00b6200 con 0x7f0ec00d0780 2023-10-06T01:39:26.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.796+0000 7f0ec60d9700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ec015a910 con 0x7f0ec00ce7b0 2023-10-06T01:39:26.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.796+0000 7f0ebffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ec01599e0 0x7f0ec01537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:26.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.796+0000 7f0ebffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ec01599e0 0x7f0ec01537d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52500/0 (socket says 172.21.15.69:52500) 2023-10-06T01:39:26.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.796+0000 7f0ebffff700 1 -- 172.21.15.69:0/2535595284 learned_addr learned my addr 172.21.15.69:0/2535595284 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:26.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.796+0000 7f0ebeffd700 1 --2- 172.21.15.69:0/2535595284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ec00d0780 0x7f0ec00b5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:26.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.796+0000 7f0ebf7fe700 1 --2- 172.21.15.69:0/2535595284 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0ec00ce7b0 0x7f0ec00ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:26.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.797+0000 7f0ebffff700 1 -- 172.21.15.69:0/2535595284 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0ec00ce7b0 msgr2=0x7f0ec00ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:26.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.797+0000 7f0ebffff700 1 --2- 172.21.15.69:0/2535595284 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0ec00ce7b0 0x7f0ec00ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:26.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.797+0000 7f0ebffff700 1 -- 172.21.15.69:0/2535595284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ec00d0780 msgr2=0x7f0ec00b5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:26.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.797+0000 7f0ebffff700 1 --2- 172.21.15.69:0/2535595284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ec00d0780 0x7f0ec00b5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:26.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.797+0000 7f0ebffff700 1 -- 172.21.15.69:0/2535595284 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eb80094f0 con 0x7f0ec01599e0 2023-10-06T01:39:26.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.797+0000 7f0ebffff700 1 --2- 172.21.15.69:0/2535595284 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ec01599e0 0x7f0ec01537d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009290 tx=0x7f0eb8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:26.802 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.797+0000 7f0ea77fe700 1 -- 172.21.15.69:0/2535595284 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb801b450 con 0x7f0ec01599e0 2023-10-06T01:39:26.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.797+0000 7f0ea77fe700 1 -- 172.21.15.69:0/2535595284 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0eb8020070 con 0x7f0ec01599e0 2023-10-06T01:39:26.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.797+0000 7f0ea77fe700 1 -- 172.21.15.69:0/2535595284 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0eb801b820 con 0x7f0ec01599e0 2023-10-06T01:39:26.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.797+0000 7f0ec60d9700 1 -- 172.21.15.69:0/2535595284 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec015b690 con 0x7f0ec01599e0 2023-10-06T01:39:26.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.797+0000 7f0ec60d9700 1 -- 172.21.15.69:0/2535595284 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ec015ae90 con 0x7f0ec01599e0 2023-10-06T01:39:26.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.798+0000 7f0ec60d9700 1 -- 172.21.15.69:0/2535595284 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ec015b370 con 0x7f0ec01599e0 2023-10-06T01:39:26.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.798+0000 7f0ea77fe700 1 -- 172.21.15.69:0/2535595284 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0eb8022030 con 0x7f0ec01599e0 2023-10-06T01:39:26.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.799+0000 7f0ea77fe700 1 --2- 172.21.15.69:0/2535595284 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0eac066f30 0x7f0eac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:26.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.799+0000 7f0ea77fe700 1 -- 172.21.15.69:0/2535595284 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0eb80861c0 con 0x7f0ec01599e0 2023-10-06T01:39:26.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.799+0000 7f0ebf7fe700 1 --2- 172.21.15.69:0/2535595284 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0eac066f30 0x7f0eac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:26.803 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.799+0000 7f0ebf7fe700 1 --2- 172.21.15.69:0/2535595284 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0eac066f30 0x7f0eac0693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000f610 tx=0x7f0eb00077f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:26.804 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.803+0000 7f0ea77fe700 1 -- 172.21.15.69:0/2535595284 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0eb80532d0 con 0x7f0ec01599e0 2023-10-06T01:39:26.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.987+0000 7f0ec60d9700 1 -- 172.21.15.69:0/2535595284 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ec004c3c0 con 0x7f0ec01599e0 2023-10-06T01:39:26.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.988+0000 7f0ea77fe700 1 -- 172.21.15.69:0/2535595284 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f0eb80568f0 con 0x7f0ec01599e0 2023-10-06T01:39:26.989 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:26.989 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":24,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:38:50.506861+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:38:43.046056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:38:47.525023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:38:47.992048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:39:26.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.989+0000 7f0ec60d9700 1 -- 172.21.15.69:0/2535595284 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0eac066f30 msgr2=0x7f0eac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:26.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.989+0000 7f0ec60d9700 1 --2- 172.21.15.69:0/2535595284 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0eac066f30 0x7f0eac0693e0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0eb000f610 tx=0x7f0eb00077f0 comp rx=0 tx=0).stop 2023-10-06T01:39:26.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.989+0000 7f0ec60d9700 1 -- 172.21.15.69:0/2535595284 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ec01599e0 msgr2=0x7f0ec01537d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:26.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.989+0000 7f0ec60d9700 1 --2- 172.21.15.69:0/2535595284 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ec01599e0 0x7f0ec01537d0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f0eb8009290 tx=0x7f0eb8016000 comp rx=0 tx=0).stop 2023-10-06T01:39:26.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.990+0000 7f0ec60d9700 1 -- 172.21.15.69:0/2535595284 shutdown_connections 2023-10-06T01:39:26.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.990+0000 7f0ec60d9700 1 --2- 172.21.15.69:0/2535595284 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0eac066f30 0x7f0eac0693e0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:26.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.990+0000 7f0ec60d9700 1 --2- 172.21.15.69:0/2535595284 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ec01599e0 0x7f0ec01537d0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:26.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.990+0000 7f0ec60d9700 1 --2- 172.21.15.69:0/2535595284 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0ec00ce7b0 0x7f0ec00ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:26.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.990+0000 7f0ec60d9700 1 --2- 172.21.15.69:0/2535595284 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0ec00d0780 0x7f0ec00b5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:26.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.990+0000 7f0ec60d9700 1 -- 172.21.15.69:0/2535595284 >> 172.21.15.69:0/2535595284 conn(0x7f0ec00703a0 msgr2=0x7f0ec01558e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:26.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.990+0000 7f0ec60d9700 1 -- 172.21.15.69:0/2535595284 shutdown_connections 2023-10-06T01:39:26.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:26.990+0000 7f0ec60d9700 1 -- 172.21.15.69:0/2535595284 wait complete. 2023-10-06T01:39:27.003 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T01:39:27.003 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:39:27.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.115+0000 7fda3ff22700 1 Processor -- start 2023-10-06T01:39:27.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.115+0000 7fda3ff22700 1 -- start start 2023-10-06T01:39:27.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.116+0000 7fda3ff22700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fda3815d440 0x7fda380aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:27.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.116+0000 7fda3ff22700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fda3806c6a0 0x7fda3806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:27.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.116+0000 7fda3ff22700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda3815a750 con 0x7fda3815d810 2023-10-06T01:39:27.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.116+0000 7fda3ff22700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda3806d080 con 0x7fda3806c6a0 2023-10-06T01:39:27.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.116+0000 7fda3ff22700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda3815e3a0 con 0x7fda3815d440 2023-10-06T01:39:27.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.116+0000 7fda3d4bd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fda3806c6a0 0x7fda3806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:27.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.116+0000 7fda3e4bf700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fda3815d810 0x7fda3815dc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:44962/0 (socket says 172.21.15.69:44962) 2023-10-06T01:39:27.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.116+0000 7fda3e4bf700 1 -- 172.21.15.69:0/2459202849 learned_addr learned my addr 172.21.15.69:0/2459202849 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:27.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.116+0000 7fda3dcbe700 1 --2- 172.21.15.69:0/2459202849 >> v2:172.21.15.88:3300/0 conn(0x7fda3815d440 0x7fda380aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:27.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.116+0000 7fda3ccbc700 1 -- 172.21.15.69:0/2459202849 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2943227577 0 0) 0x7fda3815a750 con 0x7fda3815d810 2023-10-06T01:39:27.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.116+0000 7fda3ccbc700 1 -- 172.21.15.69:0/2459202849 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda24003570 con 0x7fda3815d810 2023-10-06T01:39:27.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.116+0000 7fda3d4bd700 1 -- 172.21.15.69:0/2459202849 >> v2:172.21.15.88:3300/0 conn(0x7fda3815d440 msgr2=0x7fda380aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:27.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.116+0000 7fda3d4bd700 1 --2- 172.21.15.69:0/2459202849 >> v2:172.21.15.88:3300/0 conn(0x7fda3815d440 0x7fda380aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:27.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.116+0000 7fda3d4bd700 1 -- 172.21.15.69:0/2459202849 >> v1:172.21.15.69:6789/0 conn(0x7fda3815d810 legacy=0x7fda3815dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:27.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.116+0000 7fda3d4bd700 1 -- 172.21.15.69:0/2459202849 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda38159e40 con 0x7fda3806c6a0 2023-10-06T01:39:27.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.117+0000 7fda3d4bd700 1 --2- 172.21.15.69:0/2459202849 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda3806c6a0 0x7fda3806cb40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fda380af670 tx=0x7fda280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7afd8a544b150054 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:27.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.117+0000 7fda3ccbc700 1 -- 172.21.15.69:0/2459202849 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda28011630 con 0x7fda3806c6a0 2023-10-06T01:39:27.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.117+0000 7fda3ccbc700 1 -- 172.21.15.69:0/2459202849 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda280117b0 con 0x7fda3806c6a0 2023-10-06T01:39:27.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.117+0000 7fda3ccbc700 1 -- 172.21.15.69:0/2459202849 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda28011b70 con 0x7fda3806c6a0 2023-10-06T01:39:27.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.117+0000 7fda3ff22700 1 -- 172.21.15.69:0/2459202849 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda3806c6a0 msgr2=0x7fda3806cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:27.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.117+0000 7fda3ff22700 1 --2- 172.21.15.69:0/2459202849 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda3806c6a0 0x7fda3806cb40 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fda380af670 tx=0x7fda280091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:27.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.117+0000 7fda3ff22700 1 -- 172.21.15.69:0/2459202849 shutdown_connections 2023-10-06T01:39:27.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.117+0000 7fda3ff22700 1 --2- 172.21.15.69:0/2459202849 >> v2:172.21.15.88:3300/0 conn(0x7fda3815d440 0x7fda380aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:27.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.117+0000 7fda3ff22700 1 --2- 172.21.15.69:0/2459202849 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda3806c6a0 0x7fda3806cb40 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:27.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.117+0000 7fda3ff22700 1 -- 172.21.15.69:0/2459202849 >> 172.21.15.69:0/2459202849 conn(0x7fda3806f190 msgr2=0x7fda380ae580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:27.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.117+0000 7fda3ff22700 1 -- 172.21.15.69:0/2459202849 shutdown_connections 2023-10-06T01:39:27.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.117+0000 7fda3ff22700 1 -- 172.21.15.69:0/2459202849 wait complete. 2023-10-06T01:39:27.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.118+0000 7fda3ff22700 1 Processor -- start 2023-10-06T01:39:27.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.118+0000 7fda3ff22700 1 -- start start 2023-10-06T01:39:27.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.119+0000 7fda3ff22700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda3806c6a0 0x7fda3814a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:27.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.119+0000 7fda3ff22700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda3815d440 0x7fda380ad040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:27.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.119+0000 7fda3ff22700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda3815d810 0x7fda381516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:27.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.119+0000 7fda3ff22700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda380b2850 con 0x7fda3815d810 2023-10-06T01:39:27.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.119+0000 7fda3ff22700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda3814a790 con 0x7fda3806c6a0 2023-10-06T01:39:27.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.119+0000 7fda3ff22700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda380ae550 con 0x7fda3815d440 2023-10-06T01:39:27.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.119+0000 7fda3e4bf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda3815d810 0x7fda381516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:27.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.119+0000 7fda3e4bf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda3815d810 0x7fda381516d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52520/0 (socket says 172.21.15.69:52520) 2023-10-06T01:39:27.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.119+0000 7fda3e4bf700 1 -- 172.21.15.69:0/1562313289 learned_addr learned my addr 172.21.15.69:0/1562313289 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:27.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.119+0000 7fda3dcbe700 1 --2- 172.21.15.69:0/1562313289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda3806c6a0 0x7fda3814a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:27.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.120+0000 7fda3e4bf700 1 -- 172.21.15.69:0/1562313289 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda3815d440 msgr2=0x7fda380ad040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:27.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.120+0000 7fda3e4bf700 1 --2- 172.21.15.69:0/1562313289 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda3815d440 0x7fda380ad040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:27.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.120+0000 7fda3e4bf700 1 -- 172.21.15.69:0/1562313289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda3806c6a0 msgr2=0x7fda3814a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:27.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.120+0000 7fda3e4bf700 1 --2- 172.21.15.69:0/1562313289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda3806c6a0 0x7fda3814a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:27.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.120+0000 7fda3e4bf700 1 -- 172.21.15.69:0/1562313289 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda28009420 con 0x7fda3815d810 2023-10-06T01:39:27.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.120+0000 7fda3dcbe700 1 --2- 172.21.15.69:0/1562313289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda3806c6a0 0x7fda3814a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:27.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.120+0000 7fda3e4bf700 1 --2- 172.21.15.69:0/1562313289 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda3815d810 0x7fda381516d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fda3000cca0 tx=0x7fda30001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:27.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.120+0000 7fda2dffb700 1 -- 172.21.15.69:0/1562313289 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda3000ab30 con 0x7fda3815d810 2023-10-06T01:39:27.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.120+0000 7fda2dffb700 1 -- 172.21.15.69:0/1562313289 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda3000ac90 con 0x7fda3815d810 2023-10-06T01:39:27.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.120+0000 7fda2dffb700 1 -- 172.21.15.69:0/1562313289 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda30007300 con 0x7fda3815d810 2023-10-06T01:39:27.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.120+0000 7fda3ff22700 1 -- 172.21.15.69:0/1562313289 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda380ad940 con 0x7fda3815d810 2023-10-06T01:39:27.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.120+0000 7fda3ff22700 1 -- 172.21.15.69:0/1562313289 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda380adf00 con 0x7fda3815d810 2023-10-06T01:39:27.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.121+0000 7fda3ff22700 1 -- 172.21.15.69:0/1562313289 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda380ae700 con 0x7fda3815d810 2023-10-06T01:39:27.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.121+0000 7fda2dffb700 1 -- 172.21.15.69:0/1562313289 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fda30007730 con 0x7fda3815d810 2023-10-06T01:39:27.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.122+0000 7fda2dffb700 1 --2- 172.21.15.69:0/1562313289 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fda1c066f30 0x7fda1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:27.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.122+0000 7fda3dcbe700 1 --2- 172.21.15.69:0/1562313289 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fda1c066f30 0x7fda1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:27.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.122+0000 7fda2dffb700 1 -- 172.21.15.69:0/1562313289 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fda30084b40 con 0x7fda3815d810 2023-10-06T01:39:27.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.122+0000 7fda3dcbe700 1 --2- 172.21.15.69:0/1562313289 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fda1c066f30 0x7fda1c0693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fda34006f00 tx=0x7fda34008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:27.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.126+0000 7fda2dffb700 1 -- 172.21.15.69:0/1562313289 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fda30051c40 con 0x7fda3815d810 2023-10-06T01:39:27.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.352+0000 7fda3ff22700 1 -- 172.21.15.69:0/1562313289 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fda3804c3c0 con 0x7fda3815d810 2023-10-06T01:39:27.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.352+0000 7fda2dffb700 1 -- 172.21.15.69:0/1562313289 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4591 (secure 0 0 0) 0x7fda30055260 con 0x7fda3815d810 2023-10-06T01:39:27.354 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:27.354 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6836/2049506781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2049506781},{"type":"v1","addr":"172.21.15.69:6836","nonce":2049506781}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3367080201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6835","nonce":3367080201},{"type":"v1","addr":"172.21.15.69:6837","nonce":3367080201}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2692995813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":2692995813},{"type":"v1","addr":"172.21.15.88:6835","nonce":2692995813}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:38:49.072564+0000","modified":"2023-10-06T01:38:52.659297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6834/2097597935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":2097597935},{"type":"v1","addr":"172.21.15.88:6834","nonce":2097597935}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T01:39:27.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.355+0000 7fda3ff22700 1 -- 172.21.15.69:0/1562313289 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fda1c066f30 msgr2=0x7fda1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:27.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.355+0000 7fda3ff22700 1 --2- 172.21.15.69:0/1562313289 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fda1c066f30 0x7fda1c0693e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fda34006f00 tx=0x7fda34008040 comp rx=0 tx=0).stop 2023-10-06T01:39:27.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.355+0000 7fda3ff22700 1 -- 172.21.15.69:0/1562313289 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda3815d810 msgr2=0x7fda381516d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:27.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.355+0000 7fda3ff22700 1 --2- 172.21.15.69:0/1562313289 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda3815d810 0x7fda381516d0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fda3000cca0 tx=0x7fda30001ae0 comp rx=0 tx=0).stop 2023-10-06T01:39:27.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.355+0000 7fda3ff22700 1 -- 172.21.15.69:0/1562313289 shutdown_connections 2023-10-06T01:39:27.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.355+0000 7fda3ff22700 1 --2- 172.21.15.69:0/1562313289 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fda1c066f30 0x7fda1c0693e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:27.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.355+0000 7fda3ff22700 1 --2- 172.21.15.69:0/1562313289 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fda3815d810 0x7fda381516d0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:27.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.355+0000 7fda3ff22700 1 --2- 172.21.15.69:0/1562313289 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fda3806c6a0 0x7fda3814a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:27.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.355+0000 7fda3ff22700 1 --2- 172.21.15.69:0/1562313289 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fda3815d440 0x7fda380ad040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:27.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.355+0000 7fda3ff22700 1 -- 172.21.15.69:0/1562313289 >> 172.21.15.69:0/1562313289 conn(0x7fda3806f190 msgr2=0x7fda3814e840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:27.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.355+0000 7fda3ff22700 1 -- 172.21.15.69:0/1562313289 shutdown_connections 2023-10-06T01:39:27.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.355+0000 7fda3ff22700 1 -- 172.21.15.69:0/1562313289 wait complete. 2023-10-06T01:39:27.359 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 8 2023-10-06T01:39:27.368 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:39:27.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.480+0000 7f246a458700 1 Processor -- start 2023-10-06T01:39:27.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.480+0000 7f246a458700 1 -- start start 2023-10-06T01:39:27.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.481+0000 7f246a458700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f24640b07d0 0x7f24640ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:27.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.481+0000 7f246a458700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f24640cf200 0x7f24640cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:27.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.481+0000 7f246a458700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f246415a280 con 0x7f24640b0ba0 2023-10-06T01:39:27.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.481+0000 7f246a458700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f246406e180 con 0x7f24640b07d0 2023-10-06T01:39:27.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.481+0000 7f246a458700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24640cd540 con 0x7f24640cf200 2023-10-06T01:39:27.484 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.481+0000 7f2463fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f24640b07d0 0x7f24640ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:27.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.481+0000 7f2463fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f24640b07d0 0x7f24640ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44166/0 (socket says 172.21.15.69:44166) 2023-10-06T01:39:27.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.481+0000 7f2463fff700 1 -- 172.21.15.69:0/2463381798 learned_addr learned my addr 172.21.15.69:0/2463381798 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:27.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.482+0000 7f24637fe700 1 --2- 172.21.15.69:0/2463381798 >> v2:172.21.15.88:3300/0 conn(0x7f24640cf200 0x7f24640cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:27.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.482+0000 7f2463fff700 1 -- 172.21.15.69:0/2463381798 >> v2:172.21.15.88:3300/0 conn(0x7f24640cf200 msgr2=0x7f24640cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:27.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.482+0000 7f2463fff700 1 --2- 172.21.15.69:0/2463381798 >> v2:172.21.15.88:3300/0 conn(0x7f24640cf200 0x7f24640cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:27.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.482+0000 7f2463fff700 1 -- 172.21.15.69:0/2463381798 >> v1:172.21.15.88:6789/0 conn(0x7f24640b0ba0 legacy=0x7f246406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:27.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.482+0000 7f2463fff700 1 -- 172.21.15.69:0/2463381798 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f246406d850 con 0x7f24640b07d0 2023-10-06T01:39:27.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.482+0000 7f2463fff700 1 --2- 172.21.15.69:0/2463381798 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24640b07d0 0x7f24640ccac0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f24640cab40 tx=0x7f2454009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320247a19f510fc7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:27.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.482+0000 7f2462ffd700 1 -- 172.21.15.69:0/2463381798 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2454005c10 con 0x7f24640b07d0 2023-10-06T01:39:27.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.482+0000 7f2462ffd700 1 -- 172.21.15.69:0/2463381798 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2454005d70 con 0x7f24640b07d0 2023-10-06T01:39:27.485 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.482+0000 7f2462ffd700 1 -- 172.21.15.69:0/2463381798 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f245400b8d0 con 0x7f24640b07d0 2023-10-06T01:39:27.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.483+0000 7f246a458700 1 -- 172.21.15.69:0/2463381798 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24640b07d0 msgr2=0x7f24640ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:27.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.483+0000 7f246a458700 1 --2- 172.21.15.69:0/2463381798 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24640b07d0 0x7f24640ccac0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f24640cab40 tx=0x7f2454009220 comp rx=0 tx=0).stop 2023-10-06T01:39:27.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.483+0000 7f246a458700 1 -- 172.21.15.69:0/2463381798 shutdown_connections 2023-10-06T01:39:27.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.483+0000 7f246a458700 1 --2- 172.21.15.69:0/2463381798 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24640b07d0 0x7f24640ccac0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:27.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.483+0000 7f246a458700 1 --2- 172.21.15.69:0/2463381798 >> v2:172.21.15.88:3300/0 conn(0x7f24640cf200 0x7f24640cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:27.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.483+0000 7f246a458700 1 -- 172.21.15.69:0/2463381798 >> 172.21.15.69:0/2463381798 conn(0x7f246406ce80 msgr2=0x7f24640ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:27.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.483+0000 7f246a458700 1 -- 172.21.15.69:0/2463381798 shutdown_connections 2023-10-06T01:39:27.486 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.483+0000 7f246a458700 1 -- 172.21.15.69:0/2463381798 wait complete. 2023-10-06T01:39:27.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.484+0000 7f246a458700 1 Processor -- start 2023-10-06T01:39:27.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.484+0000 7f246a458700 1 -- start start 2023-10-06T01:39:27.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.485+0000 7f246a458700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24640b07d0 0x7f24640c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:27.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.485+0000 7f246a458700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24640b0ba0 0x7f2464152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:27.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.485+0000 7f246a458700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f24640cf200 0x7f2464153050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:27.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.485+0000 7f246a458700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2464151af0 con 0x7f24640b0ba0 2023-10-06T01:39:27.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.485+0000 7f246a458700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24641538c0 con 0x7f24640b07d0 2023-10-06T01:39:27.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.485+0000 7f246a458700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2464153c10 con 0x7f24640cf200 2023-10-06T01:39:27.489 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.485+0000 7f24637fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24640b0ba0 0x7f2464152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:27.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.485+0000 7f24637fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24640b0ba0 0x7f2464152b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44172/0 (socket says 172.21.15.69:44172) 2023-10-06T01:39:27.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.485+0000 7f24637fe700 1 -- 172.21.15.69:0/1630305181 learned_addr learned my addr 172.21.15.69:0/1630305181 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:27.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.485+0000 7f2463fff700 1 --2- 172.21.15.69:0/1630305181 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24640b07d0 0x7f24640c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:27.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.485+0000 7f24689f5700 1 --2- 172.21.15.69:0/1630305181 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f24640cf200 0x7f2464153050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:27.490 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.485+0000 7f24637fe700 1 -- 172.21.15.69:0/1630305181 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f24640cf200 msgr2=0x7f2464153050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:27.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.485+0000 7f24637fe700 1 --2- 172.21.15.69:0/1630305181 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f24640cf200 0x7f2464153050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:27.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.485+0000 7f24637fe700 1 -- 172.21.15.69:0/1630305181 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24640b07d0 msgr2=0x7f24640c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:27.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.485+0000 7f24637fe700 1 --2- 172.21.15.69:0/1630305181 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24640b07d0 0x7f24640c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:27.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.485+0000 7f24637fe700 1 -- 172.21.15.69:0/1630305181 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2454009480 con 0x7f24640b0ba0 2023-10-06T01:39:27.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.485+0000 7f2463fff700 1 --2- 172.21.15.69:0/1630305181 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24640b07d0 0x7f24640c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:27.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.485+0000 7f24637fe700 1 --2- 172.21.15.69:0/1630305181 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24640b0ba0 0x7f2464152b10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f245800d860 tx=0x7f2458008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:27.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.485+0000 7f244bfff700 1 -- 172.21.15.69:0/1630305181 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24580125f0 con 0x7f24640b0ba0 2023-10-06T01:39:27.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.485+0000 7f244bfff700 1 -- 172.21.15.69:0/1630305181 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2458012750 con 0x7f24640b0ba0 2023-10-06T01:39:27.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.485+0000 7f246a458700 1 -- 172.21.15.69:0/1630305181 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2464153ef0 con 0x7f24640b0ba0 2023-10-06T01:39:27.491 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.485+0000 7f244bfff700 1 -- 172.21.15.69:0/1630305181 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2458012b10 con 0x7f24640b0ba0 2023-10-06T01:39:27.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.485+0000 7f246a458700 1 -- 172.21.15.69:0/1630305181 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24641544b0 con 0x7f24640b0ba0 2023-10-06T01:39:27.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.486+0000 7f246a458700 1 -- 172.21.15.69:0/1630305181 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24641546d0 con 0x7f24640b0ba0 2023-10-06T01:39:27.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.487+0000 7f244bfff700 1 -- 172.21.15.69:0/1630305181 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f245801e460 con 0x7f24640b0ba0 2023-10-06T01:39:27.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.487+0000 7f244bfff700 1 --2- 172.21.15.69:0/1630305181 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2450066f30 0x7f24500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:27.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.487+0000 7f244bfff700 1 -- 172.21.15.69:0/1630305181 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2458084d50 con 0x7f24640b0ba0 2023-10-06T01:39:27.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.487+0000 7f2463fff700 1 --2- 172.21.15.69:0/1630305181 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2450066f30 0x7f24500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:27.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.488+0000 7f2463fff700 1 --2- 172.21.15.69:0/1630305181 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2450066f30 0x7f24500693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f24540030c0 tx=0x7f2454015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:27.492 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.491+0000 7f244bfff700 1 -- 172.21.15.69:0/1630305181 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2458088030 con 0x7f24640b0ba0 2023-10-06T01:39:27.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.717+0000 7f246a458700 1 -- 172.21.15.69:0/1630305181 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f246404c3c0 con 0x7f24640b0ba0 2023-10-06T01:39:27.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.718+0000 7f244bfff700 1 -- 172.21.15.69:0/1630305181 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4591 (secure 0 0 0) 0x7f24580558f0 con 0x7f24640b0ba0 2023-10-06T01:39:27.719 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:27.720 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6836/2049506781","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2049506781},{"type":"v1","addr":"172.21.15.69:6836","nonce":2049506781}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/3367080201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6835","nonce":3367080201},{"type":"v1","addr":"172.21.15.69:6837","nonce":3367080201}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4297,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2692995813","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":2692995813},{"type":"v1","addr":"172.21.15.88:6835","nonce":2692995813}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:38:49.072564+0000","modified":"2023-10-06T01:38:52.659297+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4302},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4302":{"gid":4302,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6834/2097597935","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":2097597935},{"type":"v1","addr":"172.21.15.88:6834","nonce":2097597935}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-06T01:39:27.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.720+0000 7f246a458700 1 -- 172.21.15.69:0/1630305181 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2450066f30 msgr2=0x7f24500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:27.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.720+0000 7f246a458700 1 --2- 172.21.15.69:0/1630305181 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2450066f30 0x7f24500693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f24540030c0 tx=0x7f2454015000 comp rx=0 tx=0).stop 2023-10-06T01:39:27.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.720+0000 7f246a458700 1 -- 172.21.15.69:0/1630305181 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24640b0ba0 msgr2=0x7f2464152b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:27.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.720+0000 7f246a458700 1 --2- 172.21.15.69:0/1630305181 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24640b0ba0 0x7f2464152b10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f245800d860 tx=0x7f2458008040 comp rx=0 tx=0).stop 2023-10-06T01:39:27.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.720+0000 7f246a458700 1 -- 172.21.15.69:0/1630305181 shutdown_connections 2023-10-06T01:39:27.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.720+0000 7f246a458700 1 --2- 172.21.15.69:0/1630305181 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2450066f30 0x7f24500693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:27.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.720+0000 7f246a458700 1 --2- 172.21.15.69:0/1630305181 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f24640cf200 0x7f2464153050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:27.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.720+0000 7f246a458700 1 --2- 172.21.15.69:0/1630305181 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f24640b07d0 0x7f24640c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:27.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.720+0000 7f246a458700 1 --2- 172.21.15.69:0/1630305181 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f24640b0ba0 0x7f2464152b10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:27.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.720+0000 7f246a458700 1 -- 172.21.15.69:0/1630305181 >> 172.21.15.69:0/1630305181 conn(0x7f246406ce80 msgr2=0x7f24640c3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:27.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.720+0000 7f246a458700 1 -- 172.21.15.69:0/1630305181 shutdown_connections 2023-10-06T01:39:27.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.720+0000 7f246a458700 1 -- 172.21.15.69:0/1630305181 wait complete. 2023-10-06T01:39:27.723 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 8 2023-10-06T01:39:27.734 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:39:27.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.847+0000 7f21fcf84700 1 Processor -- start 2023-10-06T01:39:27.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.847+0000 7f21fcf84700 1 -- start start 2023-10-06T01:39:27.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.848+0000 7f21fcf84700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f21f80c95c0 0x7f21f80aaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:27.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.848+0000 7f21fcf84700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21f80caa00 0x7f21f80c9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:27.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.848+0000 7f21fcf84700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f80c3d00 con 0x7f21f8157290 2023-10-06T01:39:27.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.848+0000 7f21fcf84700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f80c3110 con 0x7f21f80c95c0 2023-10-06T01:39:27.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.848+0000 7f21fcf84700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80c33d0 con 0x7f21f80caa00 2023-10-06T01:39:27.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.848+0000 7f21f77fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f21f80c95c0 0x7f21f80aaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:27.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.848+0000 7f21f7fff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f21f8157290 0x7f21f8157730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38650/0 (socket says 172.21.15.69:38650) 2023-10-06T01:39:27.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.848+0000 7f21f7fff700 1 -- 172.21.15.69:0/1908216364 learned_addr learned my addr 172.21.15.69:0/1908216364 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:27.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.848+0000 7f21f6ffd700 1 --2- 172.21.15.69:0/1908216364 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21f80caa00 0x7f21f80c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:27.851 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.848+0000 7f21f77fe700 1 -- 172.21.15.69:0/1908216364 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21f80caa00 msgr2=0x7f21f80c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:27.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.848+0000 7f21f77fe700 1 --2- 172.21.15.69:0/1908216364 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21f80caa00 0x7f21f80c9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:27.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.848+0000 7f21f77fe700 1 -- 172.21.15.69:0/1908216364 >> v1:172.21.15.69:6789/0 conn(0x7f21f8157290 legacy=0x7f21f8157730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:27.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.848+0000 7f21f77fe700 1 -- 172.21.15.69:0/1908216364 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f80c36b0 con 0x7f21f80c95c0 2023-10-06T01:39:27.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.848+0000 7f21f67fc700 1 -- 172.21.15.69:0/1908216364 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4146500222 0 0) 0x7f21f80c3d00 con 0x7f21f8157290 2023-10-06T01:39:27.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.848+0000 7f21f77fe700 1 --2- 172.21.15.69:0/1908216364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21f80c95c0 0x7f21f80aaec0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f21e8009eb0 tx=0x7f21e8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc4f356f9742ae6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:27.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.849+0000 7f21f67fc700 1 -- 172.21.15.69:0/1908216364 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e800e070 con 0x7f21f80c95c0 2023-10-06T01:39:27.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.849+0000 7f21f67fc700 1 -- 172.21.15.69:0/1908216364 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21e800bc30 con 0x7f21f80c95c0 2023-10-06T01:39:27.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.849+0000 7f21f67fc700 1 -- 172.21.15.69:0/1908216364 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21e8012430 con 0x7f21f80c95c0 2023-10-06T01:39:27.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.849+0000 7f21fcf84700 1 -- 172.21.15.69:0/1908216364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21f80c95c0 msgr2=0x7f21f80aaec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:27.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.849+0000 7f21fcf84700 1 --2- 172.21.15.69:0/1908216364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21f80c95c0 0x7f21f80aaec0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f21e8009eb0 tx=0x7f21e8009780 comp rx=0 tx=0).stop 2023-10-06T01:39:27.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.849+0000 7f21fcf84700 1 -- 172.21.15.69:0/1908216364 shutdown_connections 2023-10-06T01:39:27.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.849+0000 7f21fcf84700 1 --2- 172.21.15.69:0/1908216364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21f80c95c0 0x7f21f80aaec0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:27.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.849+0000 7f21fcf84700 1 --2- 172.21.15.69:0/1908216364 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21f80caa00 0x7f21f80c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:27.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.849+0000 7f21fcf84700 1 -- 172.21.15.69:0/1908216364 >> 172.21.15.69:0/1908216364 conn(0x7f21f8088000 msgr2=0x7f21f80ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:27.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.849+0000 7f21fcf84700 1 -- 172.21.15.69:0/1908216364 shutdown_connections 2023-10-06T01:39:27.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.849+0000 7f21fcf84700 1 -- 172.21.15.69:0/1908216364 wait complete. 2023-10-06T01:39:27.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.850+0000 7f21fcf84700 1 Processor -- start 2023-10-06T01:39:27.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.850+0000 7f21fcf84700 1 -- start start 2023-10-06T01:39:27.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.851+0000 7f21fcf84700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21f80c95c0 0x7f21f8151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:27.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.851+0000 7f21fcf84700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21f8157290 0x7f21f80c6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:27.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.851+0000 7f21fcf84700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21f8152520 0x7f21f80ae0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:27.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.851+0000 7f21fcf84700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80adc30 con 0x7f21f8152520 2023-10-06T01:39:27.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.851+0000 7f21fcf84700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80c7820 con 0x7f21f8157290 2023-10-06T01:39:27.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.851+0000 7f21fcf84700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80c7b00 con 0x7f21f80c95c0 2023-10-06T01:39:27.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.851+0000 7f21f7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21f8152520 0x7f21f80ae0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:27.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.851+0000 7f21f7fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21f8152520 0x7f21f80ae0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44188/0 (socket says 172.21.15.69:44188) 2023-10-06T01:39:27.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.851+0000 7f21f7fff700 1 -- 172.21.15.69:0/2633665915 learned_addr learned my addr 172.21.15.69:0/2633665915 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:27.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.851+0000 7f21f6ffd700 1 --2- 172.21.15.69:0/2633665915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21f8157290 0x7f21f80c6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:27.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.851+0000 7f21f77fe700 1 --2- 172.21.15.69:0/2633665915 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21f80c95c0 0x7f21f8151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:27.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.851+0000 7f21f7fff700 1 -- 172.21.15.69:0/2633665915 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21f80c95c0 msgr2=0x7f21f8151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:27.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.851+0000 7f21f7fff700 1 --2- 172.21.15.69:0/2633665915 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21f80c95c0 0x7f21f8151fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:27.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.851+0000 7f21f7fff700 1 -- 172.21.15.69:0/2633665915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21f8157290 msgr2=0x7f21f80c6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:27.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.851+0000 7f21f7fff700 1 --2- 172.21.15.69:0/2633665915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21f8157290 0x7f21f80c6d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:27.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.851+0000 7f21f7fff700 1 -- 172.21.15.69:0/2633665915 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21e8009a20 con 0x7f21f8152520 2023-10-06T01:39:27.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.851+0000 7f21f6ffd700 1 --2- 172.21.15.69:0/2633665915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21f8157290 0x7f21f80c6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:27.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.852+0000 7f21f7fff700 1 --2- 172.21.15.69:0/2633665915 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21f8152520 0x7f21f80ae0c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f21f000c530 tx=0x7f21f0007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:27.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.852+0000 7f21df7fe700 1 -- 172.21.15.69:0/2633665915 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f0005b30 con 0x7f21f8152520 2023-10-06T01:39:27.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.852+0000 7f21df7fe700 1 -- 172.21.15.69:0/2633665915 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f0005c90 con 0x7f21f8152520 2023-10-06T01:39:27.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.852+0000 7f21fcf84700 1 -- 172.21.15.69:0/2633665915 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f80c7de0 con 0x7f21f8152520 2023-10-06T01:39:27.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.852+0000 7f21df7fe700 1 -- 172.21.15.69:0/2633665915 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f0007320 con 0x7f21f8152520 2023-10-06T01:39:27.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.852+0000 7f21fcf84700 1 -- 172.21.15.69:0/2633665915 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f815c1e0 con 0x7f21f8152520 2023-10-06T01:39:27.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.853+0000 7f21fcf84700 1 -- 172.21.15.69:0/2633665915 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f804c3c0 con 0x7f21f8152520 2023-10-06T01:39:27.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.853+0000 7f21df7fe700 1 -- 172.21.15.69:0/2633665915 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21f001b3b0 con 0x7f21f8152520 2023-10-06T01:39:27.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.853+0000 7f21df7fe700 1 --2- 172.21.15.69:0/2633665915 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f21e4066f30 0x7f21e40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:27.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.853+0000 7f21df7fe700 1 -- 172.21.15.69:0/2633665915 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f21f0083b70 con 0x7f21f8152520 2023-10-06T01:39:27.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.854+0000 7f21f77fe700 1 --2- 172.21.15.69:0/2633665915 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f21e4066f30 0x7f21e40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:27.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.854+0000 7f21f77fe700 1 --2- 172.21.15.69:0/2633665915 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f21e4066f30 0x7f21e40693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f21e8009eb0 tx=0x7f21e8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:27.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:27.858+0000 7f21df7fe700 1 -- 172.21.15.69:0/2633665915 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21f0050c80 con 0x7f21f8152520 2023-10-06T01:39:28.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.043+0000 7f21fcf84700 1 -- 172.21.15.69:0/2633665915 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21f80c3990 con 0x7f21f8152520 2023-10-06T01:39:28.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.044+0000 7f21df7fe700 1 -- 172.21.15.69:0/2633665915 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f21f0017090 con 0x7f21f8152520 2023-10-06T01:39:28.046 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:28.046 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":24,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:38:50.506861+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:38:43.046056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:38:47.525023+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-10-06T01:38:47.992048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:39:28.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.046+0000 7f21fcf84700 1 -- 172.21.15.69:0/2633665915 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f21e4066f30 msgr2=0x7f21e40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:28.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.046+0000 7f21fcf84700 1 --2- 172.21.15.69:0/2633665915 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f21e4066f30 0x7f21e40693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f21e8009eb0 tx=0x7f21e8017000 comp rx=0 tx=0).stop 2023-10-06T01:39:28.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.046+0000 7f21fcf84700 1 -- 172.21.15.69:0/2633665915 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21f8152520 msgr2=0x7f21f80ae0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:28.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.046+0000 7f21fcf84700 1 --2- 172.21.15.69:0/2633665915 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21f8152520 0x7f21f80ae0c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f21f000c530 tx=0x7f21f0007f90 comp rx=0 tx=0).stop 2023-10-06T01:39:28.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.046+0000 7f21fcf84700 1 -- 172.21.15.69:0/2633665915 shutdown_connections 2023-10-06T01:39:28.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.046+0000 7f21fcf84700 1 --2- 172.21.15.69:0/2633665915 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f21e4066f30 0x7f21e40693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:28.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.046+0000 7f21fcf84700 1 --2- 172.21.15.69:0/2633665915 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f21f8152520 0x7f21f80ae0c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:28.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.046+0000 7f21fcf84700 1 --2- 172.21.15.69:0/2633665915 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21f80c95c0 0x7f21f8151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:28.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.046+0000 7f21fcf84700 1 --2- 172.21.15.69:0/2633665915 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f21f8157290 0x7f21f80c6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:28.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.046+0000 7f21fcf84700 1 -- 172.21.15.69:0/2633665915 >> 172.21.15.69:0/2633665915 conn(0x7f21f8088000 msgr2=0x7f21f8155870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:28.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.046+0000 7f21fcf84700 1 -- 172.21.15.69:0/2633665915 shutdown_connections 2023-10-06T01:39:28.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.046+0000 7f21fcf84700 1 -- 172.21.15.69:0/2633665915 wait complete. 2023-10-06T01:39:28.060 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T01:39:28.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.173+0000 7f571da6b700 1 Processor -- start 2023-10-06T01:39:28.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.173+0000 7f571da6b700 1 -- start start 2023-10-06T01:39:28.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.174+0000 7f571da6b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f57180c95c0 0x7f57180aaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:28.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.174+0000 7f571da6b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57181579a0 0x7f57180c9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:28.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.174+0000 7f571da6b700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57180c3d00 con 0x7f57180caa00 2023-10-06T01:39:28.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.174+0000 7f571da6b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57180c3110 con 0x7f57180c95c0 2023-10-06T01:39:28.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.174+0000 7f571da6b700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57180c33d0 con 0x7f57181579a0 2023-10-06T01:39:28.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.174+0000 7f5717fff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f57180caa00 0x7f5718157290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38654/0 (socket says 172.21.15.69:38654) 2023-10-06T01:39:28.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.174+0000 7f5717fff700 1 -- 172.21.15.69:0/2305876781 learned_addr learned my addr 172.21.15.69:0/2305876781 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:28.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.174+0000 7f571ca69700 1 --2- 172.21.15.69:0/2305876781 >> v2:172.21.15.88:3300/0 conn(0x7f57180c95c0 0x7f57180aaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:28.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.174+0000 7f571d26a700 1 --2- 172.21.15.69:0/2305876781 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57181579a0 0x7f57180c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:28.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.174+0000 7f57177fe700 1 -- 172.21.15.69:0/2305876781 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3822892278 0 0) 0x7f57180c3d00 con 0x7f57180caa00 2023-10-06T01:39:28.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.174+0000 7f57177fe700 1 -- 172.21.15.69:0/2305876781 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5704003570 con 0x7f57180caa00 2023-10-06T01:39:28.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.174+0000 7f57177fe700 1 -- 172.21.15.69:0/2305876781 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1949909541 0 0) 0x7f5704003570 con 0x7f57180caa00 2023-10-06T01:39:28.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.174+0000 7f57177fe700 1 -- 172.21.15.69:0/2305876781 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57181579a0 msgr2=0x7f57180c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:28.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.174+0000 7f57177fe700 1 --2- 172.21.15.69:0/2305876781 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57181579a0 0x7f57180c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:28.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.174+0000 7f57177fe700 1 -- 172.21.15.69:0/2305876781 >> v2:172.21.15.88:3300/0 conn(0x7f57180c95c0 msgr2=0x7f57180aaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:28.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.174+0000 7f57177fe700 1 --2- 172.21.15.69:0/2305876781 >> v2:172.21.15.88:3300/0 conn(0x7f57180c95c0 0x7f57180aaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:28.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.174+0000 7f57177fe700 1 -- 172.21.15.69:0/2305876781 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57180c36b0 con 0x7f57180caa00 2023-10-06T01:39:28.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.174+0000 7f57177fe700 1 -- 172.21.15.69:0/2305876781 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f5700001470 con 0x7f57180caa00 2023-10-06T01:39:28.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.174+0000 7f57177fe700 1 -- 172.21.15.69:0/2305876781 >> v1:172.21.15.69:6789/0 conn(0x7f57180caa00 legacy=0x7f5718157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:28.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.174+0000 7f57177fe700 1 --2- 172.21.15.69:0/2305876781 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57181579a0 0x7f5704003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:28.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.174+0000 7f57177fe700 1 --2- 172.21.15.69:0/2305876781 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5704003fe0 0x7f5704004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:28.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.174+0000 7f57177fe700 1 --2- 172.21.15.69:0/2305876781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5704004d50 0x7f57040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:28.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.175+0000 7f57177fe700 1 -- 172.21.15.69:0/2305876781 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57180c3110 con 0x7f5704003fe0 2023-10-06T01:39:28.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.175+0000 7f57177fe700 1 -- 172.21.15.69:0/2305876781 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57180c33d0 con 0x7f5704004d50 2023-10-06T01:39:28.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.175+0000 7f57177fe700 1 -- 172.21.15.69:0/2305876781 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f570400ba90 con 0x7f57181579a0 2023-10-06T01:39:28.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.175+0000 7f5717fff700 1 --2- 172.21.15.69:0/2305876781 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5704003fe0 0x7f5704004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:28.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.175+0000 7f571ca69700 1 --2- 172.21.15.69:0/2305876781 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57181579a0 0x7f5704003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:28.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.175+0000 7f571d26a700 1 --2- 172.21.15.69:0/2305876781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5704004d50 0x7f57040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:28.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.175+0000 7f5717fff700 1 -- 172.21.15.69:0/2305876781 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57181579a0 msgr2=0x7f5704003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:28.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.175+0000 7f5717fff700 1 --2- 172.21.15.69:0/2305876781 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f57181579a0 0x7f5704003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:28.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.175+0000 7f5717fff700 1 -- 172.21.15.69:0/2305876781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5704004d50 msgr2=0x7f57040051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:28.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.175+0000 7f5717fff700 1 --2- 172.21.15.69:0/2305876781 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5704004d50 0x7f57040051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:28.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.175+0000 7f5717fff700 1 -- 172.21.15.69:0/2305876781 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5704003570 con 0x7f5704003fe0 2023-10-06T01:39:28.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.175+0000 7f5717fff700 1 --2- 172.21.15.69:0/2305876781 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5704003fe0 0x7f5704004810 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f570000c3c0 tx=0x7f5700001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdfe0ebd6cfe0b5a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:28.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.175+0000 7f57177fe700 1 -- 172.21.15.69:0/2305876781 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f570000cc30 con 0x7f5704003fe0 2023-10-06T01:39:28.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.175+0000 7f57177fe700 1 -- 172.21.15.69:0/2305876781 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f570000cdb0 con 0x7f5704003fe0 2023-10-06T01:39:28.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.175+0000 7f57177fe700 1 -- 172.21.15.69:0/2305876781 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5700005b70 con 0x7f5704003fe0 2023-10-06T01:39:28.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.176+0000 7f571da6b700 1 -- 172.21.15.69:0/2305876781 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5704003fe0 msgr2=0x7f5704004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:28.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.176+0000 7f571da6b700 1 --2- 172.21.15.69:0/2305876781 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5704003fe0 0x7f5704004810 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f570000c3c0 tx=0x7f5700001e90 comp rx=0 tx=0).stop 2023-10-06T01:39:28.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.176+0000 7f571d26a700 1 -- 172.21.15.69:0/2305876781 reap_dead start 2023-10-06T01:39:28.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.176+0000 7f571da6b700 1 -- 172.21.15.69:0/2305876781 shutdown_connections 2023-10-06T01:39:28.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.176+0000 7f571da6b700 1 -- 172.21.15.69:0/2305876781 >> 172.21.15.69:0/2305876781 conn(0x7f5718088000 msgr2=0x7f57180ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:28.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.176+0000 7f571da6b700 1 -- 172.21.15.69:0/2305876781 shutdown_connections 2023-10-06T01:39:28.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.176+0000 7f571da6b700 1 -- 172.21.15.69:0/2305876781 wait complete. 2023-10-06T01:39:28.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.177+0000 7f571da6b700 1 Processor -- start 2023-10-06T01:39:28.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.177+0000 7f571da6b700 1 -- start start 2023-10-06T01:39:28.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.178+0000 7f571da6b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5704003fe0 0x7f57180ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:28.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.178+0000 7f571da6b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f571816a490 0x7f5718151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:28.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.178+0000 7f571da6b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57180af220 0x7f5718155790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:28.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.178+0000 7f571da6b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57180afe00 con 0x7f57180af220 2023-10-06T01:39:28.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.178+0000 7f571da6b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57180ae420 con 0x7f571816a490 2023-10-06T01:39:28.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.178+0000 7f571da6b700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57180afb20 con 0x7f5704003fe0 2023-10-06T01:39:28.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.178+0000 7f571d26a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57180af220 0x7f5718155790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:28.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.178+0000 7f571d26a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57180af220 0x7f5718155790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44210/0 (socket says 172.21.15.69:44210) 2023-10-06T01:39:28.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.178+0000 7f571d26a700 1 -- 172.21.15.69:0/3780245146 learned_addr learned my addr 172.21.15.69:0/3780245146 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:28.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.178+0000 7f571ca69700 1 --2- 172.21.15.69:0/3780245146 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5704003fe0 0x7f57180ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:28.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.178+0000 7f5717fff700 1 --2- 172.21.15.69:0/3780245146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f571816a490 0x7f5718151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:28.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.178+0000 7f571d26a700 1 -- 172.21.15.69:0/3780245146 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5704003fe0 msgr2=0x7f57180ae8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:28.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.178+0000 7f571d26a700 1 --2- 172.21.15.69:0/3780245146 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5704003fe0 0x7f57180ae8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:28.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.178+0000 7f571d26a700 1 -- 172.21.15.69:0/3780245146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f571816a490 msgr2=0x7f5718151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:28.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.178+0000 7f571d26a700 1 --2- 172.21.15.69:0/3780245146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f571816a490 0x7f5718151e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:28.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.178+0000 7f571d26a700 1 -- 172.21.15.69:0/3780245146 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57180addd0 con 0x7f57180af220 2023-10-06T01:39:28.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.178+0000 7f571d26a700 1 --2- 172.21.15.69:0/3780245146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57180af220 0x7f5718155790 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f571815b380 tx=0x7f57080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:28.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.178+0000 7f5714ff9700 1 -- 172.21.15.69:0/3780245146 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5708013750 con 0x7f57180af220 2023-10-06T01:39:28.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.178+0000 7f5714ff9700 1 -- 172.21.15.69:0/3780245146 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57080138b0 con 0x7f57180af220 2023-10-06T01:39:28.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.178+0000 7f571da6b700 1 -- 172.21.15.69:0/3780245146 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57180ae0b0 con 0x7f57180af220 2023-10-06T01:39:28.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.178+0000 7f5714ff9700 1 -- 172.21.15.69:0/3780245146 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5708013c50 con 0x7f57180af220 2023-10-06T01:39:28.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.179+0000 7f571da6b700 1 -- 172.21.15.69:0/3780245146 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57180af6c0 con 0x7f57180af220 2023-10-06T01:39:28.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.179+0000 7f571da6b700 1 -- 172.21.15.69:0/3780245146 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57180af8e0 con 0x7f57180af220 2023-10-06T01:39:28.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.180+0000 7f5714ff9700 1 -- 172.21.15.69:0/3780245146 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5708014650 con 0x7f57180af220 2023-10-06T01:39:28.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.180+0000 7f5714ff9700 1 --2- 172.21.15.69:0/3780245146 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f56f8066f30 0x7f56f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:28.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.180+0000 7f5714ff9700 1 -- 172.21.15.69:0/3780245146 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5708084a80 con 0x7f57180af220 2023-10-06T01:39:28.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.180+0000 7f571ca69700 1 --2- 172.21.15.69:0/3780245146 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f56f8066f30 0x7f56f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:28.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.181+0000 7f571ca69700 1 --2- 172.21.15.69:0/3780245146 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f56f8066f30 0x7f56f80693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5718156380 tx=0x7f571000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:28.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.184+0000 7f5714ff9700 1 -- 172.21.15.69:0/3780245146 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f57180af8e0 con 0x7f57180af220 2023-10-06T01:39:28.411 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.409+0000 7f571da6b700 1 -- 172.21.15.69:0/3780245146 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f57180adc30 con 0x7f57180af220 2023-10-06T01:39:28.411 INFO:tasks.ceph.mon.a.smithi069.stderr:2023-10-06T01:39:28.410+0000 7fed5f87a700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T01:39:28.417 INFO:tasks.ceph.mds.b.smithi088.stderr: -1776> 2023-10-06T01:38:55.642+0000 7f54e96be700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T01:39:28.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.416+0000 7f5714ff9700 1 -- 172.21.15.69:0/3780245146 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f57180adc30 con 0x7f57180af220 2023-10-06T01:39:28.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.418+0000 7f571da6b700 1 -- 172.21.15.69:0/3780245146 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f56f8066f30 msgr2=0x7f56f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:28.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.418+0000 7f571da6b700 1 --2- 172.21.15.69:0/3780245146 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f56f8066f30 0x7f56f80693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f5718156380 tx=0x7f571000b040 comp rx=0 tx=0).stop 2023-10-06T01:39:28.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.418+0000 7f571da6b700 1 -- 172.21.15.69:0/3780245146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57180af220 msgr2=0x7f5718155790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:28.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.418+0000 7f571da6b700 1 --2- 172.21.15.69:0/3780245146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57180af220 0x7f5718155790 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f571815b380 tx=0x7f57080091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:28.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.418+0000 7f571da6b700 1 -- 172.21.15.69:0/3780245146 shutdown_connections 2023-10-06T01:39:28.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.418+0000 7f571da6b700 1 --2- 172.21.15.69:0/3780245146 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f56f8066f30 0x7f56f80693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:28.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.418+0000 7f571da6b700 1 --2- 172.21.15.69:0/3780245146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57180af220 0x7f5718155790 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:28.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.418+0000 7f571da6b700 1 --2- 172.21.15.69:0/3780245146 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5704003fe0 0x7f57180ae8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:28.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.418+0000 7f571da6b700 1 --2- 172.21.15.69:0/3780245146 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f571816a490 0x7f5718151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:28.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.418+0000 7f571da6b700 1 -- 172.21.15.69:0/3780245146 >> 172.21.15.69:0/3780245146 conn(0x7f5718088000 msgr2=0x7f57180cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:28.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.418+0000 7f571da6b700 1 -- 172.21.15.69:0/3780245146 shutdown_connections 2023-10-06T01:39:28.421 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.418+0000 7f571da6b700 1 -- 172.21.15.69:0/3780245146 wait complete. 2023-10-06T01:39:28.421 INFO:teuthology.orchestra.run.smithi069.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T01:39:28.432 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T01:39:28.442 INFO:tasks.ceph.mds.b.smithi088.stdout:starting mds.b at 2023-10-06T01:39:28.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.546+0000 7f9737348700 1 Processor -- start 2023-10-06T01:39:28.547 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.546+0000 7f9737348700 1 -- start start 2023-10-06T01:39:28.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.547+0000 7f9737348700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f97300cf110 0x7f973015de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:28.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.547+0000 7f9737348700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973015ac50 con 0x7f9730153a00 2023-10-06T01:39:28.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.547+0000 7f9737348700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f973015d010 con 0x7f9730153dd0 2023-10-06T01:39:28.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.547+0000 7f9737348700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973015af60 con 0x7f97300cf110 2023-10-06T01:39:28.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.547+0000 7f9736346700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f9730153a00 0x7f973015a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38668/0 (socket says 172.21.15.69:38668) 2023-10-06T01:39:28.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.547+0000 7f9736346700 1 -- 172.21.15.69:0/3190559205 learned_addr learned my addr 172.21.15.69:0/3190559205 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:28.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.547+0000 7f9736b47700 1 --2- 172.21.15.69:0/3190559205 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f97300cf110 0x7f973015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:28.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.548+0000 7f9736b47700 1 -- 172.21.15.69:0/3190559205 >> v1:172.21.15.88:6789/0 conn(0x7f9730153dd0 legacy=0x7f97300cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:28.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.548+0000 7f9736b47700 1 -- 172.21.15.69:0/3190559205 >> v1:172.21.15.69:6789/0 conn(0x7f9730153a00 legacy=0x7f973015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:28.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.548+0000 7f9736b47700 1 -- 172.21.15.69:0/3190559205 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f973015b240 con 0x7f97300cf110 2023-10-06T01:39:28.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.548+0000 7f9736b47700 1 --2- 172.21.15.69:0/3190559205 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f97300cf110 0x7f973015de50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9728009e90 tx=0x7f9728009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8eacc97aa90e4acd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:28.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.552+0000 7f9735344700 1 -- 172.21.15.69:0/3190559205 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972800e070 con 0x7f97300cf110 2023-10-06T01:39:28.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.553+0000 7f9735344700 1 -- 172.21.15.69:0/3190559205 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972800bc30 con 0x7f97300cf110 2023-10-06T01:39:28.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.553+0000 7f9735344700 1 -- 172.21.15.69:0/3190559205 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9728012430 con 0x7f97300cf110 2023-10-06T01:39:28.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.553+0000 7f9737348700 1 -- 172.21.15.69:0/3190559205 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f97300cf110 msgr2=0x7f973015de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:28.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.553+0000 7f9737348700 1 --2- 172.21.15.69:0/3190559205 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f97300cf110 0x7f973015de50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9728009e90 tx=0x7f9728009780 comp rx=0 tx=0).stop 2023-10-06T01:39:28.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.553+0000 7f9737348700 1 -- 172.21.15.69:0/3190559205 shutdown_connections 2023-10-06T01:39:28.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.553+0000 7f9737348700 1 --2- 172.21.15.69:0/3190559205 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f97300cf110 0x7f973015de50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:28.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.553+0000 7f9737348700 1 -- 172.21.15.69:0/3190559205 >> 172.21.15.69:0/3190559205 conn(0x7f97300703a0 msgr2=0x7f97300707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:28.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.554+0000 7f9737348700 1 -- 172.21.15.69:0/3190559205 shutdown_connections 2023-10-06T01:39:28.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.554+0000 7f9737348700 1 -- 172.21.15.69:0/3190559205 wait complete. 2023-10-06T01:39:28.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.555+0000 7f9737348700 1 Processor -- start 2023-10-06T01:39:28.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.555+0000 7f9737348700 1 -- start start 2023-10-06T01:39:28.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.556+0000 7f9737348700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f97300cf110 0x7f97300c62a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:28.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.556+0000 7f9737348700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9730153a00 0x7f97300c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:28.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.556+0000 7f9737348700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9730153dd0 0x7f97300c8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:28.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.556+0000 7f9737348700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97301697a0 con 0x7f9730153dd0 2023-10-06T01:39:28.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.556+0000 7f9737348700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973016a5a0 con 0x7f9730153a00 2023-10-06T01:39:28.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.556+0000 7f9737348700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9730169990 con 0x7f97300cf110 2023-10-06T01:39:28.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.556+0000 7f9736b47700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9730153dd0 0x7f97300c8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:28.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.556+0000 7f9736b47700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9730153dd0 0x7f97300c8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44220/0 (socket says 172.21.15.69:44220) 2023-10-06T01:39:28.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.556+0000 7f9736b47700 1 -- 172.21.15.69:0/1069188214 learned_addr learned my addr 172.21.15.69:0/1069188214 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:28.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.556+0000 7f9735b45700 1 --2- 172.21.15.69:0/1069188214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9730153a00 0x7f97300c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:28.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.556+0000 7f9736346700 1 --2- 172.21.15.69:0/1069188214 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f97300cf110 0x7f97300c62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:28.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.556+0000 7f9736b47700 1 -- 172.21.15.69:0/1069188214 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f97300cf110 msgr2=0x7f97300c62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:28.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.556+0000 7f9736b47700 1 --2- 172.21.15.69:0/1069188214 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f97300cf110 0x7f97300c62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:28.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.556+0000 7f9736b47700 1 -- 172.21.15.69:0/1069188214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9730153a00 msgr2=0x7f97300c67e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:28.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.556+0000 7f9736b47700 1 --2- 172.21.15.69:0/1069188214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9730153a00 0x7f97300c67e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:28.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.556+0000 7f9736b47700 1 -- 172.21.15.69:0/1069188214 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9728009a20 con 0x7f9730153dd0 2023-10-06T01:39:28.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.556+0000 7f9736b47700 1 --2- 172.21.15.69:0/1069188214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9730153dd0 0x7f97300c8f20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f97280097c0 tx=0x7f9728019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:28.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.556+0000 7f972e7fc700 1 -- 172.21.15.69:0/1069188214 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9728012e10 con 0x7f9730153dd0 2023-10-06T01:39:28.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.556+0000 7f972e7fc700 1 -- 172.21.15.69:0/1069188214 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f972801d630 con 0x7f9730153dd0 2023-10-06T01:39:28.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.556+0000 7f9737348700 1 -- 172.21.15.69:0/1069188214 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9730169c70 con 0x7f9730153dd0 2023-10-06T01:39:28.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.556+0000 7f972e7fc700 1 -- 172.21.15.69:0/1069188214 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f972801d9f0 con 0x7f9730153dd0 2023-10-06T01:39:28.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.556+0000 7f9737348700 1 -- 172.21.15.69:0/1069188214 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f973016a230 con 0x7f9730153dd0 2023-10-06T01:39:28.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.557+0000 7f9737348700 1 -- 172.21.15.69:0/1069188214 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f973016a750 con 0x7f9730153dd0 2023-10-06T01:39:28.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.558+0000 7f972e7fc700 1 -- 172.21.15.69:0/1069188214 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9728024070 con 0x7f9730153dd0 2023-10-06T01:39:28.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.558+0000 7f972e7fc700 1 --2- 172.21.15.69:0/1069188214 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f971c066f30 0x7f971c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:28.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.558+0000 7f972e7fc700 1 -- 172.21.15.69:0/1069188214 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f9728086e60 con 0x7f9730153dd0 2023-10-06T01:39:28.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.558+0000 7f9736346700 1 --2- 172.21.15.69:0/1069188214 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f971c066f30 0x7f971c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:28.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.559+0000 7f9736346700 1 --2- 172.21.15.69:0/1069188214 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f971c066f30 0x7f971c0693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9720007130 tx=0x7f9720007eb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:28.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.562+0000 7f972e7fc700 1 -- 172.21.15.69:0/1069188214 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f973016a750 con 0x7f9730153dd0 2023-10-06T01:39:28.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:28.791+0000 7f9737348700 1 -- 172.21.15.69:0/1069188214 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f973016a710 con 0x7f9730153dd0 2023-10-06T01:39:29.416 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.415+0000 7f972e7fc700 1 -- 172.21.15.69:0/1069188214 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9728053fd0 con 0x7f9730153dd0 2023-10-06T01:39:29.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.417+0000 7f9737348700 1 -- 172.21.15.69:0/1069188214 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f971c066f30 msgr2=0x7f971c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:29.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.417+0000 7f9737348700 1 --2- 172.21.15.69:0/1069188214 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f971c066f30 0x7f971c0693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9720007130 tx=0x7f9720007eb0 comp rx=0 tx=0).stop 2023-10-06T01:39:29.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.417+0000 7f9737348700 1 -- 172.21.15.69:0/1069188214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9730153dd0 msgr2=0x7f97300c8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:29.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.417+0000 7f9737348700 1 --2- 172.21.15.69:0/1069188214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9730153dd0 0x7f97300c8f20 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f97280097c0 tx=0x7f9728019000 comp rx=0 tx=0).stop 2023-10-06T01:39:29.419 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.417+0000 7f9737348700 1 -- 172.21.15.69:0/1069188214 shutdown_connections 2023-10-06T01:39:29.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.417+0000 7f9737348700 1 --2- 172.21.15.69:0/1069188214 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f971c066f30 0x7f971c0693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:29.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.417+0000 7f9737348700 1 --2- 172.21.15.69:0/1069188214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9730153dd0 0x7f97300c8f20 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:29.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.417+0000 7f9737348700 1 --2- 172.21.15.69:0/1069188214 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f97300cf110 0x7f97300c62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:29.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.417+0000 7f9737348700 1 --2- 172.21.15.69:0/1069188214 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9730153a00 0x7f97300c67e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:29.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.417+0000 7f9737348700 1 -- 172.21.15.69:0/1069188214 >> 172.21.15.69:0/1069188214 conn(0x7f97300703a0 msgr2=0x7f97300ce7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:29.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.417+0000 7f9737348700 1 -- 172.21.15.69:0/1069188214 shutdown_connections 2023-10-06T01:39:29.420 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.417+0000 7f9737348700 1 -- 172.21.15.69:0/1069188214 wait complete. 2023-10-06T01:39:29.432 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T01:39:29.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.554+0000 7fdf6af77700 1 Processor -- start 2023-10-06T01:39:29.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.554+0000 7fdf6af77700 1 -- start start 2023-10-06T01:39:29.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.554+0000 7fdf6af77700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fdf64088400 0x7fdf640a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:29.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.554+0000 7fdf6af77700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf640ae6f0 0x7fdf640aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:29.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.554+0000 7fdf6af77700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf640ce1c0 con 0x7fdf640a8aa0 2023-10-06T01:39:29.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.554+0000 7fdf6af77700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf640af050 con 0x7fdf64088400 2023-10-06T01:39:29.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.555+0000 7fdf6af77700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf640cd5b0 con 0x7fdf640ae6f0 2023-10-06T01:39:29.557 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.555+0000 7fdf63fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fdf64088400 0x7fdf640a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:29.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.555+0000 7fdf68d13700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fdf640a8aa0 0x7fdf640b0830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38682/0 (socket says 172.21.15.69:38682) 2023-10-06T01:39:29.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.555+0000 7fdf68d13700 1 -- 172.21.15.69:0/1223918329 learned_addr learned my addr 172.21.15.69:0/1223918329 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:29.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.555+0000 7fdf63fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fdf64088400 0x7fdf640a8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44222/0 (socket says 172.21.15.69:44222) 2023-10-06T01:39:29.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.555+0000 7fdf69514700 1 --2- 172.21.15.69:0/1223918329 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf640ae6f0 0x7fdf640aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:29.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.555+0000 7fdf63fff700 1 -- 172.21.15.69:0/1223918329 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf640ae6f0 msgr2=0x7fdf640aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:29.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.555+0000 7fdf63fff700 1 --2- 172.21.15.69:0/1223918329 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf640ae6f0 0x7fdf640aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:29.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.555+0000 7fdf63fff700 1 -- 172.21.15.69:0/1223918329 >> v1:172.21.15.69:6789/0 conn(0x7fdf640a8aa0 legacy=0x7fdf640b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:29.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.555+0000 7fdf63fff700 1 -- 172.21.15.69:0/1223918329 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf640cd890 con 0x7fdf64088400 2023-10-06T01:39:29.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.555+0000 7fdf69514700 1 --2- 172.21.15.69:0/1223918329 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf640ae6f0 0x7fdf640aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:29.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.555+0000 7fdf63fff700 1 --2- 172.21.15.69:0/1223918329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf64088400 0x7fdf640a8e70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdf500098e0 tx=0x7fdf500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2c141bf50856887 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:29.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.556+0000 7fdf637fe700 1 -- 172.21.15.69:0/1223918329 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf50009e80 con 0x7fdf64088400 2023-10-06T01:39:29.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.556+0000 7fdf637fe700 1 -- 172.21.15.69:0/1223918329 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5000b860 con 0x7fdf64088400 2023-10-06T01:39:29.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.556+0000 7fdf637fe700 1 -- 172.21.15.69:0/1223918329 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5000bbe0 con 0x7fdf64088400 2023-10-06T01:39:29.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.557+0000 7fdf6af77700 1 -- 172.21.15.69:0/1223918329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf64088400 msgr2=0x7fdf640a8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:29.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.557+0000 7fdf6af77700 1 --2- 172.21.15.69:0/1223918329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf64088400 0x7fdf640a8e70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fdf500098e0 tx=0x7fdf500091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:29.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.557+0000 7fdf6af77700 1 -- 172.21.15.69:0/1223918329 shutdown_connections 2023-10-06T01:39:29.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.557+0000 7fdf6af77700 1 --2- 172.21.15.69:0/1223918329 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf640ae6f0 0x7fdf640aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:29.563 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.557+0000 7fdf6af77700 1 --2- 172.21.15.69:0/1223918329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf64088400 0x7fdf640a8e70 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:29.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.557+0000 7fdf6af77700 1 -- 172.21.15.69:0/1223918329 >> 172.21.15.69:0/1223918329 conn(0x7fdf64088000 msgr2=0x7fdf640ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:29.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.557+0000 7fdf6af77700 1 -- 172.21.15.69:0/1223918329 shutdown_connections 2023-10-06T01:39:29.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.557+0000 7fdf6af77700 1 -- 172.21.15.69:0/1223918329 wait complete. 2023-10-06T01:39:29.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.558+0000 7fdf6af77700 1 Processor -- start 2023-10-06T01:39:29.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.558+0000 7fdf6af77700 1 -- start start 2023-10-06T01:39:29.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.559+0000 7fdf6af77700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf640a8aa0 0x7fdf640c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:29.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.559+0000 7fdf6af77700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf640ae6f0 0x7fdf640c7be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:29.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.559+0000 7fdf6af77700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf640c8120 0x7fdf6406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:29.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.559+0000 7fdf6af77700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf64169e90 con 0x7fdf640ae6f0 2023-10-06T01:39:29.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.559+0000 7fdf6af77700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf640c86e0 con 0x7fdf640c8120 2023-10-06T01:39:29.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.559+0000 7fdf6af77700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf640c89c0 con 0x7fdf640a8aa0 2023-10-06T01:39:29.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.559+0000 7fdf63fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf640ae6f0 0x7fdf640c7be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:29.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.559+0000 7fdf63fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf640ae6f0 0x7fdf640c7be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44232/0 (socket says 172.21.15.69:44232) 2023-10-06T01:39:29.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.559+0000 7fdf63fff700 1 -- 172.21.15.69:0/27473058 learned_addr learned my addr 172.21.15.69:0/27473058 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:29.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.559+0000 7fdf69514700 1 --2- 172.21.15.69:0/27473058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf640c8120 0x7fdf6406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:29.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.559+0000 7fdf68d13700 1 --2- 172.21.15.69:0/27473058 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf640a8aa0 0x7fdf640c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:29.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.559+0000 7fdf63fff700 1 -- 172.21.15.69:0/27473058 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf640a8aa0 msgr2=0x7fdf640c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:29.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.559+0000 7fdf63fff700 1 --2- 172.21.15.69:0/27473058 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf640a8aa0 0x7fdf640c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:29.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.559+0000 7fdf63fff700 1 -- 172.21.15.69:0/27473058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf640c8120 msgr2=0x7fdf6406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:29.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.559+0000 7fdf63fff700 1 --2- 172.21.15.69:0/27473058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf640c8120 0x7fdf6406d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:29.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.559+0000 7fdf63fff700 1 -- 172.21.15.69:0/27473058 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf50009420 con 0x7fdf640ae6f0 2023-10-06T01:39:29.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.559+0000 7fdf63fff700 1 --2- 172.21.15.69:0/27473058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf640ae6f0 0x7fdf640c7be0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdf6406ad40 tx=0x7fdf50017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:29.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.559+0000 7fdf60ff9700 1 -- 172.21.15.69:0/27473058 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5000b9d0 con 0x7fdf640ae6f0 2023-10-06T01:39:29.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.559+0000 7fdf60ff9700 1 -- 172.21.15.69:0/27473058 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5000bb30 con 0x7fdf640ae6f0 2023-10-06T01:39:29.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.559+0000 7fdf60ff9700 1 -- 172.21.15.69:0/27473058 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf50011630 con 0x7fdf640ae6f0 2023-10-06T01:39:29.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.559+0000 7fdf6af77700 1 -- 172.21.15.69:0/27473058 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf640c8ca0 con 0x7fdf640ae6f0 2023-10-06T01:39:29.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.560+0000 7fdf6af77700 1 -- 172.21.15.69:0/27473058 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf640ca0c0 con 0x7fdf640ae6f0 2023-10-06T01:39:29.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.560+0000 7fdf6af77700 1 -- 172.21.15.69:0/27473058 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf6416a060 con 0x7fdf640ae6f0 2023-10-06T01:39:29.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.561+0000 7fdf60ff9700 1 -- 172.21.15.69:0/27473058 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdf500119a0 con 0x7fdf640ae6f0 2023-10-06T01:39:29.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.561+0000 7fdf60ff9700 1 --2- 172.21.15.69:0/27473058 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fdf48066f30 0x7fdf480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:29.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.561+0000 7fdf60ff9700 1 -- 172.21.15.69:0/27473058 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fdf50085e50 con 0x7fdf640ae6f0 2023-10-06T01:39:29.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.561+0000 7fdf68d13700 1 --2- 172.21.15.69:0/27473058 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fdf48066f30 0x7fdf480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:29.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.561+0000 7fdf68d13700 1 --2- 172.21.15.69:0/27473058 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fdf48066f30 0x7fdf480693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdf58007fd0 tx=0x7fdf58009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:29.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.565+0000 7fdf60ff9700 1 -- 172.21.15.69:0/27473058 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf6416a060 con 0x7fdf640ae6f0 2023-10-06T01:39:29.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:29.748+0000 7fdf6af77700 1 -- 172.21.15.69:0/27473058 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdf6416a060 con 0x7fdf640ae6f0 2023-10-06T01:39:30.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.563+0000 7fdf60ff9700 1 -- 172.21.15.69:0/27473058 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) v1 ==== 181+0+0 (secure 0 0 0) 0x7fdf6416a060 con 0x7fdf640ae6f0 2023-10-06T01:39:30.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.566+0000 7fdf6af77700 1 -- 172.21.15.69:0/27473058 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fdf48066f30 msgr2=0x7fdf480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:30.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.566+0000 7fdf6af77700 1 --2- 172.21.15.69:0/27473058 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fdf48066f30 0x7fdf480693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdf58007fd0 tx=0x7fdf58009040 comp rx=0 tx=0).stop 2023-10-06T01:39:30.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.566+0000 7fdf6af77700 1 -- 172.21.15.69:0/27473058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf640ae6f0 msgr2=0x7fdf640c7be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:30.567 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.566+0000 7fdf6af77700 1 --2- 172.21.15.69:0/27473058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf640ae6f0 0x7fdf640c7be0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdf6406ad40 tx=0x7fdf50017000 comp rx=0 tx=0).stop 2023-10-06T01:39:30.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.566+0000 7fdf6af77700 1 -- 172.21.15.69:0/27473058 shutdown_connections 2023-10-06T01:39:30.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.566+0000 7fdf6af77700 1 --2- 172.21.15.69:0/27473058 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fdf48066f30 0x7fdf480693e0 secure :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdf58007fd0 tx=0x7fdf58009040 comp rx=0 tx=0).stop 2023-10-06T01:39:30.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.566+0000 7fdf6af77700 1 --2- 172.21.15.69:0/27473058 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fdf640c8120 0x7fdf6406d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:30.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.566+0000 7fdf6af77700 1 --2- 172.21.15.69:0/27473058 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fdf640a8aa0 0x7fdf640c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:30.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.566+0000 7fdf6af77700 1 --2- 172.21.15.69:0/27473058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdf640ae6f0 0x7fdf640c7be0 secure :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdf6406ad40 tx=0x7fdf50017000 comp rx=0 tx=0).stop 2023-10-06T01:39:30.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.566+0000 7fdf6af77700 1 -- 172.21.15.69:0/27473058 >> 172.21.15.69:0/27473058 conn(0x7fdf64088000 msgr2=0x7fdf64069230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:30.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.567+0000 7fdf6af77700 1 -- 172.21.15.69:0/27473058 shutdown_connections 2023-10-06T01:39:30.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.567+0000 7fdf6af77700 1 -- 172.21.15.69:0/27473058 wait complete. 2023-10-06T01:39:30.569 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_metadata' removed 2023-10-06T01:39:30.584 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T01:39:30.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.702+0000 7f355099f700 1 Processor -- start 2023-10-06T01:39:30.704 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.702+0000 7f355099f700 1 -- start start 2023-10-06T01:39:30.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.703+0000 7f355099f700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f354c0cce90 0x7f354c0cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:30.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.703+0000 7f355099f700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f354c0cd840 con 0x7f354c0cb440 2023-10-06T01:39:30.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.703+0000 7f355099f700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f354c15d570 con 0x7f354c159fb0 2023-10-06T01:39:30.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.703+0000 7f355099f700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f354c15e180 con 0x7f354c0cce90 2023-10-06T01:39:30.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.703+0000 7f354bfff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f354c0cb440 0x7f354c0cb860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38686/0 (socket says 172.21.15.69:38686) 2023-10-06T01:39:30.706 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.703+0000 7f354bfff700 1 -- 172.21.15.69:0/700072841 learned_addr learned my addr 172.21.15.69:0/700072841 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:30.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.703+0000 7f354affd700 1 --2- 172.21.15.69:0/700072841 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f354c0cce90 0x7f354c0cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:30.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.704+0000 7f354a7fc700 1 -- 172.21.15.69:0/700072841 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3113729379 0 0) 0x7f354c0cd840 con 0x7f354c0cb440 2023-10-06T01:39:30.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.704+0000 7f354a7fc700 1 -- 172.21.15.69:0/700072841 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3534003570 con 0x7f354c0cb440 2023-10-06T01:39:30.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.704+0000 7f354a7fc700 1 -- 172.21.15.69:0/700072841 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3829241189 0 0) 0x7f354c15d570 con 0x7f354c159fb0 2023-10-06T01:39:30.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.704+0000 7f354a7fc700 1 -- 172.21.15.69:0/700072841 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f354c0cd840 con 0x7f354c159fb0 2023-10-06T01:39:30.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.704+0000 7f354affd700 1 -- 172.21.15.69:0/700072841 >> v1:172.21.15.88:6789/0 conn(0x7f354c159fb0 legacy=0x7f354c15a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:30.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.704+0000 7f354affd700 1 -- 172.21.15.69:0/700072841 >> v1:172.21.15.69:6789/0 conn(0x7f354c0cb440 legacy=0x7f354c0cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:30.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.704+0000 7f354affd700 1 -- 172.21.15.69:0/700072841 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f354c15d850 con 0x7f354c0cce90 2023-10-06T01:39:30.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.704+0000 7f354affd700 1 --2- 172.21.15.69:0/700072841 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f354c0cce90 0x7f354c0cd300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3540009910 tx=0x7f35400091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=deb1aad1c9c84b9f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:30.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.704+0000 7f354a7fc700 1 -- 172.21.15.69:0/700072841 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3540011630 con 0x7f354c0cce90 2023-10-06T01:39:30.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.704+0000 7f354a7fc700 1 -- 172.21.15.69:0/700072841 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3540011790 con 0x7f354c0cce90 2023-10-06T01:39:30.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.704+0000 7f354a7fc700 1 -- 172.21.15.69:0/700072841 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3540011b30 con 0x7f354c0cce90 2023-10-06T01:39:30.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.705+0000 7f355099f700 1 -- 172.21.15.69:0/700072841 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f354c0cce90 msgr2=0x7f354c0cd300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:30.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.705+0000 7f355099f700 1 --2- 172.21.15.69:0/700072841 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f354c0cce90 0x7f354c0cd300 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3540009910 tx=0x7f35400091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:30.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.705+0000 7f355099f700 1 -- 172.21.15.69:0/700072841 shutdown_connections 2023-10-06T01:39:30.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.705+0000 7f355099f700 1 --2- 172.21.15.69:0/700072841 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f354c0cce90 0x7f354c0cd300 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:30.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.705+0000 7f355099f700 1 -- 172.21.15.69:0/700072841 >> 172.21.15.69:0/700072841 conn(0x7f354c0703a0 msgr2=0x7f354c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:30.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.705+0000 7f355099f700 1 -- 172.21.15.69:0/700072841 shutdown_connections 2023-10-06T01:39:30.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.705+0000 7f355099f700 1 -- 172.21.15.69:0/700072841 wait complete. 2023-10-06T01:39:30.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.706+0000 7f355099f700 1 Processor -- start 2023-10-06T01:39:30.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.706+0000 7f355099f700 1 -- start start 2023-10-06T01:39:30.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.707+0000 7f355099f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f354c0cb440 0x7f354c0b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:30.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.707+0000 7f355099f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f354c0cce90 0x7f354c16ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:30.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.707+0000 7f355099f700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f354c159fb0 0x7f354c150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:30.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.707+0000 7f355099f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354c0b1050 con 0x7f354c0cce90 2023-10-06T01:39:30.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.707+0000 7f355099f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f354c16b220 con 0x7f354c0cb440 2023-10-06T01:39:30.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.707+0000 7f355099f700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f354c0b0760 con 0x7f354c159fb0 2023-10-06T01:39:30.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.707+0000 7f354affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f354c0cce90 0x7f354c16ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:30.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.707+0000 7f354affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f354c0cce90 0x7f354c16ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44246/0 (socket says 172.21.15.69:44246) 2023-10-06T01:39:30.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.707+0000 7f354affd700 1 -- 172.21.15.69:0/1511030532 learned_addr learned my addr 172.21.15.69:0/1511030532 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:30.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.707+0000 7f354b7fe700 1 --2- 172.21.15.69:0/1511030532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f354c0cb440 0x7f354c0b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:30.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.707+0000 7f354bfff700 1 --2- 172.21.15.69:0/1511030532 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f354c159fb0 0x7f354c150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:30.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.707+0000 7f354affd700 1 -- 172.21.15.69:0/1511030532 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f354c159fb0 msgr2=0x7f354c150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:30.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.707+0000 7f354affd700 1 --2- 172.21.15.69:0/1511030532 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f354c159fb0 0x7f354c150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:30.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.707+0000 7f354affd700 1 -- 172.21.15.69:0/1511030532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f354c0cb440 msgr2=0x7f354c0b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:30.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.707+0000 7f354affd700 1 --2- 172.21.15.69:0/1511030532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f354c0cb440 0x7f354c0b5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:30.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.707+0000 7f354affd700 1 -- 172.21.15.69:0/1511030532 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3540009420 con 0x7f354c0cce90 2023-10-06T01:39:30.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.707+0000 7f354affd700 1 --2- 172.21.15.69:0/1511030532 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f354c0cce90 0x7f354c16ace0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3540009fd0 tx=0x7f3540017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:30.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.707+0000 7f35337fe700 1 -- 172.21.15.69:0/1511030532 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f354001f070 con 0x7f354c0cce90 2023-10-06T01:39:30.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.707+0000 7f35337fe700 1 -- 172.21.15.69:0/1511030532 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3540002f70 con 0x7f354c0cce90 2023-10-06T01:39:30.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.707+0000 7f355099f700 1 -- 172.21.15.69:0/1511030532 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f354c0b0a00 con 0x7f354c0cce90 2023-10-06T01:39:30.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.707+0000 7f35337fe700 1 -- 172.21.15.69:0/1511030532 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3540023410 con 0x7f354c0cce90 2023-10-06T01:39:30.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.708+0000 7f355099f700 1 -- 172.21.15.69:0/1511030532 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f354c153b50 con 0x7f354c0cce90 2023-10-06T01:39:30.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.708+0000 7f355099f700 1 -- 172.21.15.69:0/1511030532 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f354c04c3c0 con 0x7f354c0cce90 2023-10-06T01:39:30.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.709+0000 7f35337fe700 1 -- 172.21.15.69:0/1511030532 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3540023840 con 0x7f354c0cce90 2023-10-06T01:39:30.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.709+0000 7f35337fe700 1 --2- 172.21.15.69:0/1511030532 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3538066f30 0x7f35380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:30.713 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.709+0000 7f35337fe700 1 -- 172.21.15.69:0/1511030532 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 5764+0+0 (secure 0 0 0) 0x7f3540085590 con 0x7f354c0cce90 2023-10-06T01:39:30.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.709+0000 7f354b7fe700 1 --2- 172.21.15.69:0/1511030532 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3538066f30 0x7f35380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:30.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.710+0000 7f354b7fe700 1 --2- 172.21.15.69:0/1511030532 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3538066f30 0x7f35380693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f353c004140 tx=0x7f353c007f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:30.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.713+0000 7f35337fe700 1 -- 172.21.15.69:0/1511030532 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35400527c0 con 0x7f354c0cce90 2023-10-06T01:39:30.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:30.899+0000 7f355099f700 1 -- 172.21.15.69:0/1511030532 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f354c0b1190 con 0x7f354c0cce90 2023-10-06T01:39:31.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.567+0000 7f35337fe700 1 -- 172.21.15.69:0/1511030532 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) v1 ==== 169+0+0 (secure 0 0 0) 0x7f3540055de0 con 0x7f354c0cce90 2023-10-06T01:39:31.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.570+0000 7f355099f700 1 -- 172.21.15.69:0/1511030532 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3538066f30 msgr2=0x7f35380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:31.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.570+0000 7f355099f700 1 --2- 172.21.15.69:0/1511030532 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3538066f30 0x7f35380693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f353c004140 tx=0x7f353c007f90 comp rx=0 tx=0).stop 2023-10-06T01:39:31.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.570+0000 7f355099f700 1 -- 172.21.15.69:0/1511030532 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f354c0cce90 msgr2=0x7f354c16ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:31.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.570+0000 7f355099f700 1 --2- 172.21.15.69:0/1511030532 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f354c0cce90 0x7f354c16ace0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3540009fd0 tx=0x7f3540017000 comp rx=0 tx=0).stop 2023-10-06T01:39:31.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.571+0000 7f355099f700 1 -- 172.21.15.69:0/1511030532 shutdown_connections 2023-10-06T01:39:31.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.571+0000 7f355099f700 1 --2- 172.21.15.69:0/1511030532 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3538066f30 0x7f35380693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:31.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.571+0000 7f355099f700 1 --2- 172.21.15.69:0/1511030532 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f354c159fb0 0x7f354c150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:31.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.571+0000 7f355099f700 1 --2- 172.21.15.69:0/1511030532 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f354c0cb440 0x7f354c0b5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:31.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.571+0000 7f355099f700 1 --2- 172.21.15.69:0/1511030532 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f354c0cce90 0x7f354c16ace0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:31.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.571+0000 7f355099f700 1 -- 172.21.15.69:0/1511030532 >> 172.21.15.69:0/1511030532 conn(0x7f354c0703a0 msgr2=0x7f354c14dd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:31.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.571+0000 7f355099f700 1 -- 172.21.15.69:0/1511030532 shutdown_connections 2023-10-06T01:39:31.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.571+0000 7f355099f700 1 -- 172.21.15.69:0/1511030532 wait complete. 2023-10-06T01:39:31.574 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_data' removed 2023-10-06T01:39:31.586 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-06T01:39:31.586 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-06T01:39:31.586 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T01:39:31.586 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:39:31.586 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-06T01:39:31.586 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-06T01:39:31.587 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T01:39:31.587 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:39:31.587 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-06T01:39:31.587 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-06T01:39:31.587 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T01:39:31.587 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:39:31.588 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-06T01:39:31.588 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-06T01:39:31.588 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T01:39:31.588 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:39:31.596 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T01:39:31.596 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-06T01:39:31.597 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T01:39:31.597 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-06T01:39:31.600 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T01:39:31.600 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-06T01:39:31.601 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T01:39:31.601 DEBUG:teuthology.orchestra.run.smithi088:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-06T01:39:31.638 INFO:tasks.ceph.mds.a:Started 2023-10-06T01:39:31.639 DEBUG:teuthology.parallel:result is None 2023-10-06T01:39:31.639 INFO:tasks.ceph.mds.c:Started 2023-10-06T01:39:31.639 DEBUG:teuthology.parallel:result is None 2023-10-06T01:39:31.643 INFO:tasks.ceph.mds.b:Started 2023-10-06T01:39:31.643 DEBUG:teuthology.parallel:result is None 2023-10-06T01:39:31.643 INFO:tasks.ceph.mds.d:Started 2023-10-06T01:39:31.644 DEBUG:teuthology.parallel:result is None 2023-10-06T01:39:31.644 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-06T01:39:31.713 INFO:tasks.ceph.mds.c.smithi069.stdout:starting mds.c at 2023-10-06T01:39:31.713 INFO:tasks.ceph.mds.a.smithi069.stdout:starting mds.a at 2023-10-06T01:39:31.726 INFO:tasks.ceph.mds.b.smithi088.stdout:starting mds.b at 2023-10-06T01:39:31.726 INFO:tasks.ceph.mds.d.smithi088.stdout:starting mds.d at 2023-10-06T01:39:31.727 INFO:tasks.ceph.mds.b.smithi088.stderr:2023-10-06T01:39:31.726+0000 7feaa21ba700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6832/0: (98) Address already in use 2023-10-06T01:39:31.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.764+0000 7fa39af64700 1 Processor -- start 2023-10-06T01:39:31.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.764+0000 7fa39af64700 1 -- start start 2023-10-06T01:39:31.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.765+0000 7fa39af64700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa39413fcc0 0x7fa394156af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:31.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.765+0000 7fa39af64700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa394070410 0x7fa394160120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:31.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.765+0000 7fa39af64700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3940c3a30 con 0x7fa3940c29b0 2023-10-06T01:39:31.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.765+0000 7fa39af64700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3940c2e20 con 0x7fa39413fcc0 2023-10-06T01:39:31.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.765+0000 7fa39af64700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3940c3100 con 0x7fa394070410 2023-10-06T01:39:31.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.765+0000 7fa393fff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fa3940c29b0 0x7fa3940c43a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38696/0 (socket says 172.21.15.69:38696) 2023-10-06T01:39:31.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.765+0000 7fa393fff700 1 -- 172.21.15.69:0/2778844751 learned_addr learned my addr 172.21.15.69:0/2778844751 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:31.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.766+0000 7fa398d00700 1 --2- 172.21.15.69:0/2778844751 >> v2:172.21.15.88:3300/0 conn(0x7fa39413fcc0 0x7fa394156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:31.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.766+0000 7fa399501700 1 --2- 172.21.15.69:0/2778844751 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa394070410 0x7fa394160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:31.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.766+0000 7fa3937fe700 1 -- 172.21.15.69:0/2778844751 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1362995535 0 0) 0x7fa3940c3a30 con 0x7fa3940c29b0 2023-10-06T01:39:31.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.766+0000 7fa3937fe700 1 -- 172.21.15.69:0/2778844751 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa380003570 con 0x7fa3940c29b0 2023-10-06T01:39:31.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.766+0000 7fa398d00700 1 -- 172.21.15.69:0/2778844751 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa394070410 msgr2=0x7fa394160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:31.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.766+0000 7fa398d00700 1 --2- 172.21.15.69:0/2778844751 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa394070410 0x7fa394160120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:31.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.766+0000 7fa3937fe700 1 -- 172.21.15.69:0/2778844751 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 959538988 0 0) 0x7fa380003570 con 0x7fa3940c29b0 2023-10-06T01:39:31.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.766+0000 7fa398d00700 1 -- 172.21.15.69:0/2778844751 >> v1:172.21.15.69:6789/0 conn(0x7fa3940c29b0 legacy=0x7fa3940c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:31.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.766+0000 7fa398d00700 1 -- 172.21.15.69:0/2778844751 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3940c33e0 con 0x7fa39413fcc0 2023-10-06T01:39:31.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.766+0000 7fa399501700 1 --2- 172.21.15.69:0/2778844751 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa394070410 0x7fa394160120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:31.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.766+0000 7fa398d00700 1 --2- 172.21.15.69:0/2778844751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa39413fcc0 0x7fa394156af0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa384009e60 tx=0x7fa384009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc13f49213ef7e8e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:31.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.766+0000 7fa3937fe700 1 -- 172.21.15.69:0/2778844751 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38400e070 con 0x7fa39413fcc0 2023-10-06T01:39:31.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.766+0000 7fa3937fe700 1 -- 172.21.15.69:0/2778844751 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38400b7a0 con 0x7fa39413fcc0 2023-10-06T01:39:31.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.766+0000 7fa3937fe700 1 -- 172.21.15.69:0/2778844751 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa37c001470 con 0x7fa39413fcc0 2023-10-06T01:39:31.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.767+0000 7fa39af64700 1 -- 172.21.15.69:0/2778844751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa39413fcc0 msgr2=0x7fa394156af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:31.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.767+0000 7fa39af64700 1 --2- 172.21.15.69:0/2778844751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa39413fcc0 0x7fa394156af0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa384009e60 tx=0x7fa384009780 comp rx=0 tx=0).stop 2023-10-06T01:39:31.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.767+0000 7fa39af64700 1 -- 172.21.15.69:0/2778844751 shutdown_connections 2023-10-06T01:39:31.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.767+0000 7fa39af64700 1 --2- 172.21.15.69:0/2778844751 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa394070410 0x7fa394160120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:31.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.767+0000 7fa39af64700 1 --2- 172.21.15.69:0/2778844751 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa39413fcc0 0x7fa394156af0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:31.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.767+0000 7fa39af64700 1 -- 172.21.15.69:0/2778844751 >> 172.21.15.69:0/2778844751 conn(0x7fa3940ccb60 msgr2=0x7fa3940ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:31.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.767+0000 7fa39af64700 1 -- 172.21.15.69:0/2778844751 shutdown_connections 2023-10-06T01:39:31.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.767+0000 7fa39af64700 1 -- 172.21.15.69:0/2778844751 wait complete. 2023-10-06T01:39:31.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.768+0000 7fa39af64700 1 Processor -- start 2023-10-06T01:39:31.774 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.768+0000 7fa39af64700 1 -- start start 2023-10-06T01:39:31.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.769+0000 7fa39af64700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa394070410 0x7fa394142320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:31.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.769+0000 7fa39af64700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa3940c29b0 0x7fa3940c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:31.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.769+0000 7fa39af64700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa39413fcc0 0x7fa3940cb830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:31.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.769+0000 7fa39af64700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa39413b930 con 0x7fa39413fcc0 2023-10-06T01:39:31.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.769+0000 7fa39af64700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa394167a30 con 0x7fa394070410 2023-10-06T01:39:31.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.769+0000 7fa39af64700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa394167cf0 con 0x7fa3940c29b0 2023-10-06T01:39:31.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.769+0000 7fa399501700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa39413fcc0 0x7fa3940cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:31.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.769+0000 7fa399501700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa39413fcc0 0x7fa3940cb830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44280/0 (socket says 172.21.15.69:44280) 2023-10-06T01:39:31.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.769+0000 7fa399501700 1 -- 172.21.15.69:0/2405384903 learned_addr learned my addr 172.21.15.69:0/2405384903 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:31.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.769+0000 7fa398d00700 1 --2- 172.21.15.69:0/2405384903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa394070410 0x7fa394142320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:31.775 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.769+0000 7fa393fff700 1 --2- 172.21.15.69:0/2405384903 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa3940c29b0 0x7fa3940c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:31.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.769+0000 7fa399501700 1 -- 172.21.15.69:0/2405384903 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa3940c29b0 msgr2=0x7fa3940c6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:31.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.769+0000 7fa399501700 1 --2- 172.21.15.69:0/2405384903 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa3940c29b0 0x7fa3940c6440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:31.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.769+0000 7fa399501700 1 -- 172.21.15.69:0/2405384903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa394070410 msgr2=0x7fa394142320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:31.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.769+0000 7fa399501700 1 --2- 172.21.15.69:0/2405384903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa394070410 0x7fa394142320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:31.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.769+0000 7fa399501700 1 -- 172.21.15.69:0/2405384903 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa38c009420 con 0x7fa39413fcc0 2023-10-06T01:39:31.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.769+0000 7fa398d00700 1 --2- 172.21.15.69:0/2405384903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa394070410 0x7fa394142320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:31.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.769+0000 7fa399501700 1 --2- 172.21.15.69:0/2405384903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa39413fcc0 0x7fa3940cb830 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa38c00ea70 tx=0x7fa38c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:31.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.769+0000 7fa390ff9700 1 -- 172.21.15.69:0/2405384903 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c00c920 con 0x7fa39413fcc0 2023-10-06T01:39:31.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.770+0000 7fa390ff9700 1 -- 172.21.15.69:0/2405384903 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa38c00caa0 con 0x7fa39413fcc0 2023-10-06T01:39:31.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.770+0000 7fa39af64700 1 -- 172.21.15.69:0/2405384903 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa384009a20 con 0x7fa39413fcc0 2023-10-06T01:39:31.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.770+0000 7fa390ff9700 1 -- 172.21.15.69:0/2405384903 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa38c00ce60 con 0x7fa39413fcc0 2023-10-06T01:39:31.776 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.770+0000 7fa39af64700 1 -- 172.21.15.69:0/2405384903 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3941682b0 con 0x7fa39413fcc0 2023-10-06T01:39:31.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.770+0000 7fa39af64700 1 -- 172.21.15.69:0/2405384903 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa39404c3c0 con 0x7fa39413fcc0 2023-10-06T01:39:31.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.771+0000 7fa390ff9700 1 -- 172.21.15.69:0/2405384903 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa38c013680 con 0x7fa39413fcc0 2023-10-06T01:39:31.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.772+0000 7fa390ff9700 1 --2- 172.21.15.69:0/2405384903 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa374066f30 0x7fa3740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:31.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.772+0000 7fa390ff9700 1 -- 172.21.15.69:0/2405384903 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fa38c084c80 con 0x7fa39413fcc0 2023-10-06T01:39:31.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.772+0000 7fa398d00700 1 --2- 172.21.15.69:0/2405384903 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa374066f30 0x7fa3740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:31.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.772+0000 7fa398d00700 1 --2- 172.21.15.69:0/2405384903 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa374066f30 0x7fa3740693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa3840099f0 tx=0x7fa384018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:31.777 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.775+0000 7fa390ff9700 1 -- 172.21.15.69:0/2405384903 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa38c052110 con 0x7fa39413fcc0 2023-10-06T01:39:31.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:31.971+0000 7fa39af64700 1 -- 172.21.15.69:0/2405384903 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fa3940c36c0 con 0x7fa39413fcc0 2023-10-06T01:39:32.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.576+0000 7fa390ff9700 1 -- 172.21.15.69:0/2405384903 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v29) v1 ==== 97+0+0 (secure 0 0 0) 0x7fa38c055730 con 0x7fa39413fcc0 2023-10-06T01:39:32.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.578+0000 7fa39af64700 1 -- 172.21.15.69:0/2405384903 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa374066f30 msgr2=0x7fa3740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:32.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.578+0000 7fa39af64700 1 --2- 172.21.15.69:0/2405384903 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa374066f30 0x7fa3740693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa3840099f0 tx=0x7fa384018000 comp rx=0 tx=0).stop 2023-10-06T01:39:32.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.578+0000 7fa39af64700 1 -- 172.21.15.69:0/2405384903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa39413fcc0 msgr2=0x7fa3940cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:32.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.578+0000 7fa39af64700 1 --2- 172.21.15.69:0/2405384903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa39413fcc0 0x7fa3940cb830 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa38c00ea70 tx=0x7fa38c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:32.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.578+0000 7fa39af64700 1 -- 172.21.15.69:0/2405384903 shutdown_connections 2023-10-06T01:39:32.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.578+0000 7fa39af64700 1 --2- 172.21.15.69:0/2405384903 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa374066f30 0x7fa3740693e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:32.582 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.578+0000 7fa39af64700 1 --2- 172.21.15.69:0/2405384903 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa39413fcc0 0x7fa3940cb830 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:32.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.578+0000 7fa39af64700 1 --2- 172.21.15.69:0/2405384903 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa394070410 0x7fa394142320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:32.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.578+0000 7fa39af64700 1 --2- 172.21.15.69:0/2405384903 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa3940c29b0 0x7fa3940c6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:32.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.578+0000 7fa39af64700 1 -- 172.21.15.69:0/2405384903 >> 172.21.15.69:0/2405384903 conn(0x7fa3940ccb60 msgr2=0x7fa39413e920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:32.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.579+0000 7fa39af64700 1 -- 172.21.15.69:0/2405384903 shutdown_connections 2023-10-06T01:39:32.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.579+0000 7fa39af64700 1 -- 172.21.15.69:0/2405384903 wait complete. 2023-10-06T01:39:32.583 INFO:teuthology.orchestra.run.smithi069.stderr: removed all blocklist entries 2023-10-06T01:39:32.593 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-06T01:39:32.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.705+0000 7f7547387700 1 Processor -- start 2023-10-06T01:39:32.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.706+0000 7f7547387700 1 -- start start 2023-10-06T01:39:32.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.706+0000 7f7547387700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f75400cb5a0 0x7f75400cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:32.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.706+0000 7f7547387700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f75400cd9e0 0x7f7540159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:32.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.707+0000 7f7547387700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f754015ae40 con 0x7f75400cde50 2023-10-06T01:39:32.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.707+0000 7f7547387700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75400d13f0 con 0x7f75400cd9e0 2023-10-06T01:39:32.708 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.707+0000 7f7547387700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f754015ab60 con 0x7f75400cb5a0 2023-10-06T01:39:32.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.707+0000 7f7545123700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f75400cb5a0 0x7f75400cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:32.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.707+0000 7f7544922700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f75400cd9e0 0x7f7540159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:32.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.707+0000 7f7545123700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f75400cb5a0 0x7f75400cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.69:40558/0 (socket says 172.21.15.69:40558) 2023-10-06T01:39:32.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.707+0000 7f7545123700 1 -- 172.21.15.69:0/331735578 learned_addr learned my addr 172.21.15.69:0/331735578 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:32.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.707+0000 7f7544922700 1 -- 172.21.15.69:0/331735578 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f75400cb5a0 msgr2=0x7f75400cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:32.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.707+0000 7f7544922700 1 --2- 172.21.15.69:0/331735578 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f75400cb5a0 0x7f75400cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:32.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.707+0000 7f7544922700 1 -- 172.21.15.69:0/331735578 >> v1:172.21.15.88:6789/0 conn(0x7f75400cde50 legacy=0x7f7540156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:32.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.707+0000 7f7544922700 1 -- 172.21.15.69:0/331735578 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75400ccf00 con 0x7f75400cd9e0 2023-10-06T01:39:32.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.707+0000 7f7545123700 1 --2- 172.21.15.69:0/331735578 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f75400cb5a0 0x7f75400cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:32.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.708+0000 7f7544922700 1 --2- 172.21.15.69:0/331735578 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75400cd9e0 0x7f7540159ec0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f75340098e0 tx=0x7f75340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=540d53cf9dbec54b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:32.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.708+0000 7f753ffff700 1 -- 172.21.15.69:0/331735578 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753400b640 con 0x7f75400cd9e0 2023-10-06T01:39:32.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.708+0000 7f753ffff700 1 -- 172.21.15.69:0/331735578 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753400b7a0 con 0x7f75400cd9e0 2023-10-06T01:39:32.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.708+0000 7f753ffff700 1 -- 172.21.15.69:0/331735578 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753400bb40 con 0x7f75400cd9e0 2023-10-06T01:39:32.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.708+0000 7f7547387700 1 -- 172.21.15.69:0/331735578 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75400cd9e0 msgr2=0x7f7540159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:32.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.708+0000 7f7547387700 1 --2- 172.21.15.69:0/331735578 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75400cd9e0 0x7f7540159ec0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f75340098e0 tx=0x7f75340091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:32.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.708+0000 7f7547387700 1 -- 172.21.15.69:0/331735578 shutdown_connections 2023-10-06T01:39:32.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.708+0000 7f7547387700 1 --2- 172.21.15.69:0/331735578 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f75400cb5a0 0x7f75400cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:32.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.708+0000 7f7547387700 1 --2- 172.21.15.69:0/331735578 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75400cd9e0 0x7f7540159ec0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:32.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.708+0000 7f7547387700 1 -- 172.21.15.69:0/331735578 >> 172.21.15.69:0/331735578 conn(0x7f7540070e30 msgr2=0x7f75400d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:32.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.708+0000 7f7547387700 1 -- 172.21.15.69:0/331735578 shutdown_connections 2023-10-06T01:39:32.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.708+0000 7f7547387700 1 -- 172.21.15.69:0/331735578 wait complete. 2023-10-06T01:39:32.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.709+0000 7f7547387700 1 Processor -- start 2023-10-06T01:39:32.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.710+0000 7f7547387700 1 -- start start 2023-10-06T01:39:32.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.710+0000 7f7547387700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75400cb5a0 0x7f754015a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:32.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.710+0000 7f7547387700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75400cd9e0 0x7f75400c8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:32.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.710+0000 7f7547387700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7540157a70 0x7f75400c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:32.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.710+0000 7f7547387700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75400c79f0 con 0x7f75400cb5a0 2023-10-06T01:39:32.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.710+0000 7f7547387700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f754015a8d0 con 0x7f75400cd9e0 2023-10-06T01:39:32.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.710+0000 7f7547387700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7540157f30 con 0x7f7540157a70 2023-10-06T01:39:32.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.711+0000 7f7545123700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75400cb5a0 0x7f754015a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:32.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.711+0000 7f7545123700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75400cb5a0 0x7f754015a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44284/0 (socket says 172.21.15.69:44284) 2023-10-06T01:39:32.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.711+0000 7f7545123700 1 -- 172.21.15.69:0/3537945051 learned_addr learned my addr 172.21.15.69:0/3537945051 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:32.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.711+0000 7f7544922700 1 --2- 172.21.15.69:0/3537945051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75400cd9e0 0x7f75400c8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:32.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.711+0000 7f7545924700 1 --2- 172.21.15.69:0/3537945051 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7540157a70 0x7f75400c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:32.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.711+0000 7f7545123700 1 -- 172.21.15.69:0/3537945051 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7540157a70 msgr2=0x7f75400c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:32.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.711+0000 7f7545123700 1 --2- 172.21.15.69:0/3537945051 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7540157a70 0x7f75400c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:32.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.711+0000 7f7545123700 1 -- 172.21.15.69:0/3537945051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75400cd9e0 msgr2=0x7f75400c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:32.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.711+0000 7f7545123700 1 --2- 172.21.15.69:0/3537945051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75400cd9e0 0x7f75400c8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:32.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.711+0000 7f7545123700 1 -- 172.21.15.69:0/3537945051 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7530009ae0 con 0x7f75400cb5a0 2023-10-06T01:39:32.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.711+0000 7f7545123700 1 --2- 172.21.15.69:0/3537945051 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75400cb5a0 0x7f754015a390 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7530009fc0 tx=0x7f753000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:32.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.711+0000 7f753d7fa700 1 -- 172.21.15.69:0/3537945051 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753000c9c0 con 0x7f75400cb5a0 2023-10-06T01:39:32.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.711+0000 7f7547387700 1 -- 172.21.15.69:0/3537945051 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7534009420 con 0x7f75400cb5a0 2023-10-06T01:39:32.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.711+0000 7f753d7fa700 1 -- 172.21.15.69:0/3537945051 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f753000f040 con 0x7f75400cb5a0 2023-10-06T01:39:32.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.711+0000 7f753d7fa700 1 -- 172.21.15.69:0/3537945051 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f753000cd50 con 0x7f75400cb5a0 2023-10-06T01:39:32.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.711+0000 7f7547387700 1 -- 172.21.15.69:0/3537945051 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75401584f0 con 0x7f75400cb5a0 2023-10-06T01:39:32.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.712+0000 7f7547387700 1 -- 172.21.15.69:0/3537945051 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75400c7cd0 con 0x7f75400cb5a0 2023-10-06T01:39:32.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.712+0000 7f753d7fa700 1 -- 172.21.15.69:0/3537945051 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7530014690 con 0x7f75400cb5a0 2023-10-06T01:39:32.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.713+0000 7f753d7fa700 1 --2- 172.21.15.69:0/3537945051 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f752c066f30 0x7f752c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:32.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.713+0000 7f753d7fa700 1 -- 172.21.15.69:0/3537945051 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f75300849c0 con 0x7f75400cb5a0 2023-10-06T01:39:32.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.713+0000 7f7544922700 1 --2- 172.21.15.69:0/3537945051 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f752c066f30 0x7f752c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:32.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.713+0000 7f7544922700 1 --2- 172.21.15.69:0/3537945051 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f752c066f30 0x7f752c0693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f75340091e0 tx=0x7f7534017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:32.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.717+0000 7f753d7fa700 1 -- 172.21.15.69:0/3537945051 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7530051e20 con 0x7f75400cb5a0 2023-10-06T01:39:32.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.974+0000 7f7547387700 1 -- 172.21.15.69:0/3537945051 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f75401586e0 con 0x7f75400cb5a0 2023-10-06T01:39:32.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.974+0000 7f753d7fa700 1 -- 172.21.15.69:0/3537945051 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f7530055440 con 0x7f75400cb5a0 2023-10-06T01:39:32.976 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:32.976 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-10-06T01:39:32.976 INFO:teuthology.orchestra.run.smithi069.stdout: "auth_dump": [ 2023-10-06T01:39:32.976 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:32.976 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "mds.a", 2023-10-06T01:39:32.976 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQDvZB9lDLBHCBAA9LtyIH7woDBhEceD0hDkiw==", 2023-10-06T01:39:32.976 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-10-06T01:39:32.976 INFO:teuthology.orchestra.run.smithi069.stdout: "mds": "allow", 2023-10-06T01:39:32.976 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow *", 2023-10-06T01:39:32.977 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow *", 2023-10-06T01:39:32.977 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-10-06T01:39:32.977 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:32.977 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:39:32.977 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:32.977 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "mds.b", 2023-10-06T01:39:32.977 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQDvZB9lximTExAAwY6J7LEDzucnYmuiEjOS+g==", 2023-10-06T01:39:32.977 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-10-06T01:39:32.977 INFO:teuthology.orchestra.run.smithi069.stdout: "mds": "allow", 2023-10-06T01:39:32.977 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow *", 2023-10-06T01:39:32.977 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow *", 2023-10-06T01:39:32.978 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-10-06T01:39:32.978 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:32.978 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:39:32.978 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:32.978 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "mds.c", 2023-10-06T01:39:32.978 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQDvZB9lkh0jDxAAH6lMaQuBexeD5eDZIUYPpA==", 2023-10-06T01:39:32.978 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-10-06T01:39:32.978 INFO:teuthology.orchestra.run.smithi069.stdout: "mds": "allow", 2023-10-06T01:39:32.978 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow *", 2023-10-06T01:39:32.978 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow *", 2023-10-06T01:39:32.978 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-10-06T01:39:32.979 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:32.979 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:39:32.979 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:32.979 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "mds.d", 2023-10-06T01:39:32.979 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQDvZB9lX7RnGhAAWglHygzv/JYLnoZlkdyucQ==", 2023-10-06T01:39:32.979 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-10-06T01:39:32.979 INFO:teuthology.orchestra.run.smithi069.stdout: "mds": "allow", 2023-10-06T01:39:32.979 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow *", 2023-10-06T01:39:32.979 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow *", 2023-10-06T01:39:32.979 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-10-06T01:39:32.979 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:32.979 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:39:32.980 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:32.980 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "osd.0", 2023-10-06T01:39:32.980 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQDyZB9ltmXzORAAx/wCbigTzSc5osl/ABC4jA==", 2023-10-06T01:39:32.980 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-10-06T01:39:32.980 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow profile osd", 2023-10-06T01:39:32.980 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile osd", 2023-10-06T01:39:32.980 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-10-06T01:39:32.980 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:32.980 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:39:32.980 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:32.980 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "osd.1", 2023-10-06T01:39:32.980 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQD1ZB9lkKZCNxAA7sQjwntcRwmMTPMNVYOMEw==", 2023-10-06T01:39:32.981 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-10-06T01:39:32.981 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow profile osd", 2023-10-06T01:39:32.981 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile osd", 2023-10-06T01:39:32.981 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-10-06T01:39:32.981 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:32.981 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:39:32.981 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:32.981 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "osd.2", 2023-10-06T01:39:32.981 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQD4ZB9lavwmNxAA35fbJbgShm+zes1JZ38/kg==", 2023-10-06T01:39:32.981 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-10-06T01:39:32.981 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow profile osd", 2023-10-06T01:39:32.981 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile osd", 2023-10-06T01:39:32.982 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-10-06T01:39:32.982 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:32.982 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:39:32.982 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:32.982 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "osd.3", 2023-10-06T01:39:32.982 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQD7ZB9lZ6eONxAAQ17q0pJXN4YlzHTl47iaiw==", 2023-10-06T01:39:32.982 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-10-06T01:39:32.982 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow profile osd", 2023-10-06T01:39:32.982 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile osd", 2023-10-06T01:39:32.982 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-10-06T01:39:32.982 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:32.983 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:39:32.983 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:32.983 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "osd.4", 2023-10-06T01:39:32.983 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQACZR9ldk4/BRAAvDlRT/Kx90icSA+ifSG1Xw==", 2023-10-06T01:39:32.983 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-10-06T01:39:32.983 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow profile osd", 2023-10-06T01:39:32.983 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile osd", 2023-10-06T01:39:32.983 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-10-06T01:39:32.983 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:32.983 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:39:32.983 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:32.983 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "osd.5", 2023-10-06T01:39:32.984 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQAFZR9lOjPTAhAAaaLbdYCPlSOezx8HmIY9Xg==", 2023-10-06T01:39:32.984 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-10-06T01:39:32.984 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow profile osd", 2023-10-06T01:39:32.984 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile osd", 2023-10-06T01:39:32.984 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-10-06T01:39:32.984 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:32.984 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:39:32.984 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:32.984 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "osd.6", 2023-10-06T01:39:32.984 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQAIZR9lgsB4AhAAVT0MZ1Yh0LSsfMEUIrpH+Q==", 2023-10-06T01:39:32.984 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-10-06T01:39:32.984 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow profile osd", 2023-10-06T01:39:32.985 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile osd", 2023-10-06T01:39:32.985 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-10-06T01:39:32.985 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:32.985 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:39:32.985 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:32.985 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "osd.7", 2023-10-06T01:39:32.985 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQALZR9lY+cnABAAS9Z7IGrXNwxnPW49vD3iCg==", 2023-10-06T01:39:32.985 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-10-06T01:39:32.985 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow profile osd", 2023-10-06T01:39:32.985 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile osd", 2023-10-06T01:39:32.985 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-10-06T01:39:32.986 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:32.986 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:39:32.986 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:32.986 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "client.0", 2023-10-06T01:39:32.986 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQDvZB9lccI4HhAAylGGkLosRiajQ2YJiLp7iQ==", 2023-10-06T01:39:32.986 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-10-06T01:39:32.986 INFO:teuthology.orchestra.run.smithi069.stdout: "mds": "allow", 2023-10-06T01:39:32.986 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow r", 2023-10-06T01:39:32.986 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow rw", 2023-10-06T01:39:32.987 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow rwx" 2023-10-06T01:39:32.987 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:32.987 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:39:32.987 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:32.987 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "client.1", 2023-10-06T01:39:32.987 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQDvZB9lBm2MJhAAltQ9hAlMOOIoVnXIqwn/kA==", 2023-10-06T01:39:32.988 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-10-06T01:39:32.988 INFO:teuthology.orchestra.run.smithi069.stdout: "mds": "allow", 2023-10-06T01:39:32.988 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow r", 2023-10-06T01:39:32.988 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow rw", 2023-10-06T01:39:32.988 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow rwx" 2023-10-06T01:39:32.989 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:32.989 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:39:32.989 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:32.989 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "client.2", 2023-10-06T01:39:32.989 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQDvZB9lvhaWIxAAMcWf1R8HSodkk1qDMe8lhg==", 2023-10-06T01:39:32.989 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-10-06T01:39:32.989 INFO:teuthology.orchestra.run.smithi069.stdout: "mds": "allow", 2023-10-06T01:39:32.989 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow r", 2023-10-06T01:39:32.989 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow rw", 2023-10-06T01:39:32.989 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow rwx" 2023-10-06T01:39:32.989 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:32.990 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:39:32.990 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:32.990 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "client.3", 2023-10-06T01:39:32.990 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQDvZB9lKLThKxAA7PxLW5OznMc1jQ/Ec2kW1Q==", 2023-10-06T01:39:32.990 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-10-06T01:39:32.990 INFO:teuthology.orchestra.run.smithi069.stdout: "mds": "allow", 2023-10-06T01:39:32.990 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow r", 2023-10-06T01:39:32.990 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow rw", 2023-10-06T01:39:32.990 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow rwx" 2023-10-06T01:39:32.990 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:32.990 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:39:32.990 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:32.991 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "client.admin", 2023-10-06T01:39:32.991 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQDuZB9l9KneKBAA7er+BwaHlzWyLecjfFLcMA==", 2023-10-06T01:39:32.991 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-10-06T01:39:32.991 INFO:teuthology.orchestra.run.smithi069.stdout: "mds": "allow *", 2023-10-06T01:39:32.991 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": "allow *", 2023-10-06T01:39:32.991 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow *", 2023-10-06T01:39:32.991 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-10-06T01:39:32.991 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:32.991 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:39:32.991 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:32.992 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "client.bootstrap-mds", 2023-10-06T01:39:32.992 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQAQZR9lyay/KxAAhE64Zbayy0HUbMF91w9qeg==", 2023-10-06T01:39:32.992 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-10-06T01:39:32.992 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile bootstrap-mds" 2023-10-06T01:39:32.992 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:32.992 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:39:32.992 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:32.992 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "client.bootstrap-mgr", 2023-10-06T01:39:32.992 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQAQZR9lZLa/KxAAXBJd6cXhdbc140dLX9uwOA==", 2023-10-06T01:39:32.992 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-10-06T01:39:32.992 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-06T01:39:32.992 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:32.992 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:39:32.993 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:32.993 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "client.bootstrap-osd", 2023-10-06T01:39:32.993 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQAQZR9lGL+/KxAA1ziMEEX5M/VwN0ZpxMl7xw==", 2023-10-06T01:39:32.993 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-10-06T01:39:32.993 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile bootstrap-osd" 2023-10-06T01:39:32.993 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:32.993 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:39:32.993 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:32.993 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "client.bootstrap-rbd", 2023-10-06T01:39:32.993 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQAQZR9lGsa/KxAAHSSIQ4wrCOD0Fm0WTy/NmQ==", 2023-10-06T01:39:32.993 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-10-06T01:39:32.993 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-06T01:39:32.994 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:32.994 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:39:32.994 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:32.994 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-06T01:39:32.994 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQAQZR9ly82/KxAA+9JSZiE7H5beDia+5+R9XQ==", 2023-10-06T01:39:32.994 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-10-06T01:39:32.995 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-06T01:39:32.995 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:32.995 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:39:32.995 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:32.995 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "client.bootstrap-rgw", 2023-10-06T01:39:32.995 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQAQZR9lP9W/KxAAwA1kSd8iLtIEbfeRu1lz1w==", 2023-10-06T01:39:32.995 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-10-06T01:39:32.995 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-06T01:39:32.995 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:32.995 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:39:32.995 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:32.996 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "mgr.x", 2023-10-06T01:39:32.996 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQDvZB9lsTtPBRAASyhxUCZeGPQ+Kd4nV3TDSw==", 2023-10-06T01:39:32.996 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-10-06T01:39:32.996 INFO:teuthology.orchestra.run.smithi069.stdout: "mds": "allow *", 2023-10-06T01:39:32.996 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile mgr", 2023-10-06T01:39:32.996 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-10-06T01:39:32.996 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:32.996 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:39:32.996 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:32.996 INFO:teuthology.orchestra.run.smithi069.stdout: "entity": "mgr.y", 2023-10-06T01:39:32.996 INFO:teuthology.orchestra.run.smithi069.stdout: "key": "AQDvZB9lnLdnARAABp2Qojj2sIXz8haVNkf8Nw==", 2023-10-06T01:39:32.996 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": { 2023-10-06T01:39:32.997 INFO:teuthology.orchestra.run.smithi069.stdout: "mds": "allow *", 2023-10-06T01:39:32.997 INFO:teuthology.orchestra.run.smithi069.stdout: "mon": "allow profile mgr", 2023-10-06T01:39:32.997 INFO:teuthology.orchestra.run.smithi069.stdout: "osd": "allow *" 2023-10-06T01:39:32.997 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:32.997 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:32.997 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-10-06T01:39:32.997 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-10-06T01:39:32.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.976+0000 7f7547387700 1 -- 172.21.15.69:0/3537945051 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f752c066f30 msgr2=0x7f752c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:32.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.976+0000 7f7547387700 1 --2- 172.21.15.69:0/3537945051 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f752c066f30 0x7f752c0693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f75340091e0 tx=0x7f7534017000 comp rx=0 tx=0).stop 2023-10-06T01:39:32.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.976+0000 7f7547387700 1 -- 172.21.15.69:0/3537945051 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75400cb5a0 msgr2=0x7f754015a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:32.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.976+0000 7f7547387700 1 --2- 172.21.15.69:0/3537945051 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75400cb5a0 0x7f754015a390 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7530009fc0 tx=0x7f753000b040 comp rx=0 tx=0).stop 2023-10-06T01:39:32.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.976+0000 7f7547387700 1 -- 172.21.15.69:0/3537945051 shutdown_connections 2023-10-06T01:39:32.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.976+0000 7f7547387700 1 --2- 172.21.15.69:0/3537945051 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f752c066f30 0x7f752c0693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:32.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.976+0000 7f7547387700 1 --2- 172.21.15.69:0/3537945051 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7540157a70 0x7f75400c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:32.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.976+0000 7f7547387700 1 --2- 172.21.15.69:0/3537945051 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f75400cb5a0 0x7f754015a390 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:32.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.976+0000 7f7547387700 1 --2- 172.21.15.69:0/3537945051 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f75400cd9e0 0x7f75400c8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:32.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.976+0000 7f7547387700 1 -- 172.21.15.69:0/3537945051 >> 172.21.15.69:0/3537945051 conn(0x7f7540070e30 msgr2=0x7f75400c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:33.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.976+0000 7f7547387700 1 -- 172.21.15.69:0/3537945051 shutdown_connections 2023-10-06T01:39:33.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:32.976+0000 7f7547387700 1 -- 172.21.15.69:0/3537945051 wait complete. 2023-10-06T01:39:33.000 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-06T01:39:33.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.114+0000 7f05c81e4700 1 Processor -- start 2023-10-06T01:39:33.116 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.115+0000 7f05c81e4700 1 -- start start 2023-10-06T01:39:33.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.115+0000 7f05c81e4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f05c00cb5a0 0x7f05c00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:33.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.115+0000 7f05c81e4700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f05c015a5d0 0x7f05c0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:33.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.115+0000 7f05c81e4700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05c015ae40 con 0x7f05c00cd9e0 2023-10-06T01:39:33.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.115+0000 7f05c81e4700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05c00d13f0 con 0x7f05c00cb5a0 2023-10-06T01:39:33.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.115+0000 7f05c81e4700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c015ab60 con 0x7f05c015a5d0 2023-10-06T01:39:33.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.116+0000 7f05c577f700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f05c00cd9e0 0x7f05c0159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38704/0 (socket says 172.21.15.69:38704) 2023-10-06T01:39:33.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.116+0000 7f05c577f700 1 -- 172.21.15.69:0/1132942979 learned_addr learned my addr 172.21.15.69:0/1132942979 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:33.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.116+0000 7f05c5f80700 1 --2- 172.21.15.69:0/1132942979 >> v2:172.21.15.88:3300/0 conn(0x7f05c00cb5a0 0x7f05c00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:33.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.116+0000 7f05c4f7e700 1 -- 172.21.15.69:0/1132942979 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1257730590 0 0) 0x7f05c015ae40 con 0x7f05c00cd9e0 2023-10-06T01:39:33.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.116+0000 7f05c6781700 1 --2- 172.21.15.69:0/1132942979 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f05c015a5d0 0x7f05c0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:33.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.116+0000 7f05c4f7e700 1 -- 172.21.15.69:0/1132942979 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f05a8003570 con 0x7f05c00cd9e0 2023-10-06T01:39:33.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.116+0000 7f05c4f7e700 1 -- 172.21.15.69:0/1132942979 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3330692754 0 0) 0x7f05a8003570 con 0x7f05c00cd9e0 2023-10-06T01:39:33.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.116+0000 7f05c4f7e700 1 -- 172.21.15.69:0/1132942979 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f05c015a5d0 msgr2=0x7f05c0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:33.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.116+0000 7f05c4f7e700 1 --2- 172.21.15.69:0/1132942979 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f05c015a5d0 0x7f05c0156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:33.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.116+0000 7f05c4f7e700 1 -- 172.21.15.69:0/1132942979 >> v2:172.21.15.88:3300/0 conn(0x7f05c00cb5a0 msgr2=0x7f05c00cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:33.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.116+0000 7f05c4f7e700 1 --2- 172.21.15.69:0/1132942979 >> v2:172.21.15.88:3300/0 conn(0x7f05c00cb5a0 0x7f05c00cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:33.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.116+0000 7f05c4f7e700 1 -- 172.21.15.69:0/1132942979 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c00ccf00 con 0x7f05c00cd9e0 2023-10-06T01:39:33.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.116+0000 7f05c4f7e700 1 -- 172.21.15.69:0/1132942979 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f05b4001470 con 0x7f05c00cd9e0 2023-10-06T01:39:33.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.116+0000 7f05c4f7e700 1 -- 172.21.15.69:0/1132942979 >> v1:172.21.15.69:6789/0 conn(0x7f05c00cd9e0 legacy=0x7f05c0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:33.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.116+0000 7f05c4f7e700 1 --2- 172.21.15.69:0/1132942979 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05a8003a60 0x7f05a8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:33.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.116+0000 7f05c4f7e700 1 --2- 172.21.15.69:0/1132942979 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f05c015a5d0 0x7f05a8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:33.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.116+0000 7f05c4f7e700 1 --2- 172.21.15.69:0/1132942979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05a8004d50 0x7f05a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:33.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.116+0000 7f05c4f7e700 1 -- 172.21.15.69:0/1132942979 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c015ab60 con 0x7f05a8003a60 2023-10-06T01:39:33.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.116+0000 7f05c4f7e700 1 -- 172.21.15.69:0/1132942979 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05a800ba60 con 0x7f05a8004d50 2023-10-06T01:39:33.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.116+0000 7f05c4f7e700 1 -- 172.21.15.69:0/1132942979 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05a800bba0 con 0x7f05c015a5d0 2023-10-06T01:39:33.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.116+0000 7f05c5f80700 1 --2- 172.21.15.69:0/1132942979 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05a8003a60 0x7f05a8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:33.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.116+0000 7f05c6781700 1 --2- 172.21.15.69:0/1132942979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05a8004d50 0x7f05a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:33.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.116+0000 7f05c577f700 1 --2- 172.21.15.69:0/1132942979 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f05c015a5d0 0x7f05a8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:33.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.117+0000 7f05c5f80700 1 -- 172.21.15.69:0/1132942979 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f05c015a5d0 msgr2=0x7f05a8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:33.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.117+0000 7f05c5f80700 1 --2- 172.21.15.69:0/1132942979 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f05c015a5d0 0x7f05a8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:33.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.117+0000 7f05c5f80700 1 -- 172.21.15.69:0/1132942979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05a8004d50 msgr2=0x7f05a80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:33.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.117+0000 7f05c5f80700 1 --2- 172.21.15.69:0/1132942979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05a8004d50 0x7f05a80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:33.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.117+0000 7f05c5f80700 1 -- 172.21.15.69:0/1132942979 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05a8003570 con 0x7f05a8003a60 2023-10-06T01:39:33.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.117+0000 7f05c6781700 1 --2- 172.21.15.69:0/1132942979 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05a8004d50 0x7f05a80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:33.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.117+0000 7f05c5f80700 1 --2- 172.21.15.69:0/1132942979 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05a8003a60 0x7f05a8003e70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f05b000e210 tx=0x7f05b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e788c147e8737672 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:33.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.117+0000 7f05c4f7e700 1 -- 172.21.15.69:0/1132942979 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b000ea60 con 0x7f05a8003a60 2023-10-06T01:39:33.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.117+0000 7f05c4f7e700 1 -- 172.21.15.69:0/1132942979 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b000f040 con 0x7f05a8003a60 2023-10-06T01:39:33.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.117+0000 7f05c4f7e700 1 -- 172.21.15.69:0/1132942979 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b000ee10 con 0x7f05a8003a60 2023-10-06T01:39:33.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.117+0000 7f05c81e4700 1 -- 172.21.15.69:0/1132942979 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05a8003a60 msgr2=0x7f05a8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:33.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.117+0000 7f05c81e4700 1 --2- 172.21.15.69:0/1132942979 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05a8003a60 0x7f05a8003e70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f05b000e210 tx=0x7f05b000b040 comp rx=0 tx=0).stop 2023-10-06T01:39:33.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.117+0000 7f05c6781700 1 -- 172.21.15.69:0/1132942979 reap_dead start 2023-10-06T01:39:33.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.117+0000 7f05c81e4700 1 -- 172.21.15.69:0/1132942979 shutdown_connections 2023-10-06T01:39:33.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.117+0000 7f05c81e4700 1 -- 172.21.15.69:0/1132942979 >> 172.21.15.69:0/1132942979 conn(0x7f05c0070e30 msgr2=0x7f05c00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:33.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.118+0000 7f05c81e4700 1 -- 172.21.15.69:0/1132942979 shutdown_connections 2023-10-06T01:39:33.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.118+0000 7f05c81e4700 1 -- 172.21.15.69:0/1132942979 wait complete. 2023-10-06T01:39:33.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.119+0000 7f05c81e4700 1 Processor -- start 2023-10-06T01:39:33.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.119+0000 7f05c81e4700 1 -- start start 2023-10-06T01:39:33.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.119+0000 7f05c81e4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05a8003a60 0x7f05c0153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:33.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.119+0000 7f05c81e4700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f05c00c5730 0x7f05c00c6c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:33.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.119+0000 7f05c81e4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05c00c8b40 0x7f05c00b3840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:33.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.119+0000 7f05c81e4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c00c71a0 con 0x7f05c00c8b40 2023-10-06T01:39:33.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.119+0000 7f05c81e4700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05c00c5bc0 con 0x7f05a8003a60 2023-10-06T01:39:33.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.119+0000 7f05c81e4700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05c00c5ea0 con 0x7f05c00c5730 2023-10-06T01:39:33.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.119+0000 7f05c6781700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05c00c8b40 0x7f05c00b3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:33.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.119+0000 7f05c6781700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05c00c8b40 0x7f05c00b3840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44288/0 (socket says 172.21.15.69:44288) 2023-10-06T01:39:33.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.119+0000 7f05c6781700 1 -- 172.21.15.69:0/725790604 learned_addr learned my addr 172.21.15.69:0/725790604 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:33.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.120+0000 7f05c577f700 1 --2- 172.21.15.69:0/725790604 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f05c00c5730 0x7f05c00c6c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:33.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.120+0000 7f05c5f80700 1 --2- 172.21.15.69:0/725790604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05a8003a60 0x7f05c0153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:33.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.120+0000 7f05c6781700 1 -- 172.21.15.69:0/725790604 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f05c00c5730 msgr2=0x7f05c00c6c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:33.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.120+0000 7f05c6781700 1 --2- 172.21.15.69:0/725790604 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f05c00c5730 0x7f05c00c6c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:33.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.120+0000 7f05c6781700 1 -- 172.21.15.69:0/725790604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05a8003a60 msgr2=0x7f05c0153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:33.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.120+0000 7f05c6781700 1 --2- 172.21.15.69:0/725790604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05a8003a60 0x7f05c0153af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:33.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.120+0000 7f05c6781700 1 -- 172.21.15.69:0/725790604 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05c00c6180 con 0x7f05c00c8b40 2023-10-06T01:39:33.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.120+0000 7f05c6781700 1 --2- 172.21.15.69:0/725790604 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05c00c8b40 0x7f05c00b3840 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f05c00cbeb0 tx=0x7f05b8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:33.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.120+0000 7f05bdffb700 1 -- 172.21.15.69:0/725790604 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b8015670 con 0x7f05c00c8b40 2023-10-06T01:39:33.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.120+0000 7f05bdffb700 1 -- 172.21.15.69:0/725790604 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05b80157d0 con 0x7f05c00c8b40 2023-10-06T01:39:33.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.120+0000 7f05c81e4700 1 -- 172.21.15.69:0/725790604 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05c00c6460 con 0x7f05c00c8b40 2023-10-06T01:39:33.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.120+0000 7f05bdffb700 1 -- 172.21.15.69:0/725790604 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05b8015b90 con 0x7f05c00c8b40 2023-10-06T01:39:33.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.120+0000 7f05c81e4700 1 -- 172.21.15.69:0/725790604 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05c0152d20 con 0x7f05c00c8b40 2023-10-06T01:39:33.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.121+0000 7f05c81e4700 1 -- 172.21.15.69:0/725790604 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05c00c6980 con 0x7f05c00c8b40 2023-10-06T01:39:33.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.121+0000 7f05bdffb700 1 -- 172.21.15.69:0/725790604 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f05b8020460 con 0x7f05c00c8b40 2023-10-06T01:39:33.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.122+0000 7f05bdffb700 1 --2- 172.21.15.69:0/725790604 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f05ac066f30 0x7f05ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:33.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.122+0000 7f05bdffb700 1 -- 172.21.15.69:0/725790604 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f05b8084540 con 0x7f05c00c8b40 2023-10-06T01:39:33.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.122+0000 7f05c5f80700 1 --2- 172.21.15.69:0/725790604 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f05ac066f30 0x7f05ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:33.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.122+0000 7f05c5f80700 1 --2- 172.21.15.69:0/725790604 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f05ac066f30 0x7f05ac0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f05b000afd0 tx=0x7f05b001a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:33.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.126+0000 7f05bdffb700 1 -- 172.21.15.69:0/725790604 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f05b8055430 con 0x7f05c00c8b40 2023-10-06T01:39:33.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.385+0000 7f05c81e4700 1 -- 172.21.15.69:0/725790604 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f05c004c3c0 con 0x7f05c00c8b40 2023-10-06T01:39:33.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.388+0000 7f05bdffb700 1 -- 172.21.15.69:0/725790604 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) v1 ==== 90+0+0 (secure 0 0 0) 0x7f05b8054fc0 con 0x7f05c00c8b40 2023-10-06T01:39:33.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.390+0000 7f05c81e4700 1 -- 172.21.15.69:0/725790604 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f05ac066f30 msgr2=0x7f05ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:33.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.390+0000 7f05c81e4700 1 --2- 172.21.15.69:0/725790604 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f05ac066f30 0x7f05ac0693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f05b000afd0 tx=0x7f05b001a000 comp rx=0 tx=0).stop 2023-10-06T01:39:33.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.390+0000 7f05c81e4700 1 -- 172.21.15.69:0/725790604 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05c00c8b40 msgr2=0x7f05c00b3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:33.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.390+0000 7f05c81e4700 1 --2- 172.21.15.69:0/725790604 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05c00c8b40 0x7f05c00b3840 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f05c00cbeb0 tx=0x7f05b8008040 comp rx=0 tx=0).stop 2023-10-06T01:39:33.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.390+0000 7f05c81e4700 1 -- 172.21.15.69:0/725790604 shutdown_connections 2023-10-06T01:39:33.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.390+0000 7f05c81e4700 1 --2- 172.21.15.69:0/725790604 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f05ac066f30 0x7f05ac0693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:33.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.390+0000 7f05c81e4700 1 --2- 172.21.15.69:0/725790604 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f05c00c8b40 0x7f05c00b3840 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:33.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.390+0000 7f05c81e4700 1 --2- 172.21.15.69:0/725790604 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f05a8003a60 0x7f05c0153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:33.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.390+0000 7f05c81e4700 1 --2- 172.21.15.69:0/725790604 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f05c00c5730 0x7f05c00c6c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:33.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.390+0000 7f05c81e4700 1 -- 172.21.15.69:0/725790604 >> 172.21.15.69:0/725790604 conn(0x7f05c0070e30 msgr2=0x7f05c00b07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:33.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.390+0000 7f05c81e4700 1 -- 172.21.15.69:0/725790604 shutdown_connections 2023-10-06T01:39:33.393 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.390+0000 7f05c81e4700 1 -- 172.21.15.69:0/725790604 wait complete. 2023-10-06T01:39:33.403 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-06T01:39:33.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.517+0000 7fd460473700 1 Processor -- start 2023-10-06T01:39:33.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.517+0000 7fd460473700 1 -- start start 2023-10-06T01:39:33.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.518+0000 7fd460473700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd4580cb5a0 0x7fd4580cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:33.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.518+0000 7fd460473700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd45815ae40 con 0x7fd45815a5d0 2023-10-06T01:39:33.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.518+0000 7fd460473700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd45815ab60 con 0x7fd4580cd9e0 2023-10-06T01:39:33.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.518+0000 7fd460473700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4580d13f0 con 0x7fd4580cb5a0 2023-10-06T01:39:33.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.518+0000 7fd45e20f700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd4580cb5a0 0x7fd4580cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:33.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.518+0000 7fd45ea10700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fd45815a5d0 0x7fd458156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38718/0 (socket says 172.21.15.69:38718) 2023-10-06T01:39:33.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.518+0000 7fd45ea10700 1 -- 172.21.15.69:0/2932244524 learned_addr learned my addr 172.21.15.69:0/2932244524 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:33.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.519+0000 7fd45e20f700 1 -- 172.21.15.69:0/2932244524 >> v1:172.21.15.88:6789/0 conn(0x7fd4580cd9e0 legacy=0x7fd458159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:33.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.519+0000 7fd45e20f700 1 -- 172.21.15.69:0/2932244524 >> v1:172.21.15.69:6789/0 conn(0x7fd45815a5d0 legacy=0x7fd458156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:33.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.519+0000 7fd45e20f700 1 -- 172.21.15.69:0/2932244524 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4580ccf00 con 0x7fd4580cb5a0 2023-10-06T01:39:33.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.519+0000 7fd45d20d700 1 -- 172.21.15.69:0/2932244524 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 915171393 0 0) 0x7fd45815ae40 con 0x7fd45815a5d0 2023-10-06T01:39:33.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.519+0000 7fd45e20f700 1 --2- 172.21.15.69:0/2932244524 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4580cb5a0 0x7fd4580cb970 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd448009e90 tx=0x7fd448009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=288d720e1a40cef1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:33.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.519+0000 7fd45d20d700 1 -- 172.21.15.69:0/2932244524 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44800e070 con 0x7fd4580cb5a0 2023-10-06T01:39:33.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.519+0000 7fd45d20d700 1 -- 172.21.15.69:0/2932244524 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44800bbb0 con 0x7fd4580cb5a0 2023-10-06T01:39:33.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.519+0000 7fd45d20d700 1 -- 172.21.15.69:0/2932244524 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd448012430 con 0x7fd4580cb5a0 2023-10-06T01:39:33.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.519+0000 7fd460473700 1 -- 172.21.15.69:0/2932244524 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4580cb5a0 msgr2=0x7fd4580cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:33.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.519+0000 7fd460473700 1 --2- 172.21.15.69:0/2932244524 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4580cb5a0 0x7fd4580cb970 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd448009e90 tx=0x7fd448009780 comp rx=0 tx=0).stop 2023-10-06T01:39:33.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.519+0000 7fd460473700 1 -- 172.21.15.69:0/2932244524 shutdown_connections 2023-10-06T01:39:33.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.519+0000 7fd460473700 1 --2- 172.21.15.69:0/2932244524 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4580cb5a0 0x7fd4580cb970 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:33.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.519+0000 7fd460473700 1 -- 172.21.15.69:0/2932244524 >> 172.21.15.69:0/2932244524 conn(0x7fd458070e30 msgr2=0x7fd4580d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:33.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.520+0000 7fd460473700 1 -- 172.21.15.69:0/2932244524 shutdown_connections 2023-10-06T01:39:33.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.520+0000 7fd460473700 1 -- 172.21.15.69:0/2932244524 wait complete. 2023-10-06T01:39:33.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.521+0000 7fd460473700 1 Processor -- start 2023-10-06T01:39:33.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.521+0000 7fd460473700 1 -- start start 2023-10-06T01:39:33.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.521+0000 7fd460473700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4580cb5a0 0x7fd458151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:33.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.521+0000 7fd460473700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd4580cd9e0 0x7fd4580c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:33.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.521+0000 7fd460473700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd45815a5d0 0x7fd4580c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:33.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.521+0000 7fd460473700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4580b4a10 con 0x7fd4580cb5a0 2023-10-06T01:39:33.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.521+0000 7fd460473700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4580b4cf0 con 0x7fd45815a5d0 2023-10-06T01:39:33.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.521+0000 7fd460473700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4580b4fd0 con 0x7fd4580cd9e0 2023-10-06T01:39:33.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.521+0000 7fd45e20f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4580cb5a0 0x7fd458151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:33.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.521+0000 7fd45e20f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4580cb5a0 0x7fd458151120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44306/0 (socket says 172.21.15.69:44306) 2023-10-06T01:39:33.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.521+0000 7fd45e20f700 1 -- 172.21.15.69:0/2147447787 learned_addr learned my addr 172.21.15.69:0/2147447787 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:33.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.522+0000 7fd45e20f700 1 -- 172.21.15.69:0/2147447787 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd4580cd9e0 msgr2=0x7fd4580c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:33.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.522+0000 7fd45e20f700 1 --2- 172.21.15.69:0/2147447787 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd4580cd9e0 0x7fd4580c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:33.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.522+0000 7fd45e20f700 1 -- 172.21.15.69:0/2147447787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd45815a5d0 msgr2=0x7fd4580c6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:33.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.522+0000 7fd45e20f700 1 --2- 172.21.15.69:0/2147447787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd45815a5d0 0x7fd4580c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:33.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.522+0000 7fd45e20f700 1 -- 172.21.15.69:0/2147447787 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd448009a20 con 0x7fd4580cb5a0 2023-10-06T01:39:33.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.522+0000 7fd45e20f700 1 --2- 172.21.15.69:0/2147447787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4580cb5a0 0x7fd458151120 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd4480099f0 tx=0x7fd448018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:33.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.522+0000 7fd4567fc700 1 -- 172.21.15.69:0/2147447787 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd448012e60 con 0x7fd4580cb5a0 2023-10-06T01:39:33.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.522+0000 7fd4567fc700 1 -- 172.21.15.69:0/2147447787 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44801d640 con 0x7fd4580cb5a0 2023-10-06T01:39:33.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.522+0000 7fd4567fc700 1 -- 172.21.15.69:0/2147447787 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44801d9e0 con 0x7fd4580cb5a0 2023-10-06T01:39:33.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.522+0000 7fd460473700 1 -- 172.21.15.69:0/2147447787 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4580b52b0 con 0x7fd4580cb5a0 2023-10-06T01:39:33.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.522+0000 7fd460473700 1 -- 172.21.15.69:0/2147447787 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd458151660 con 0x7fd4580cb5a0 2023-10-06T01:39:33.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.523+0000 7fd460473700 1 -- 172.21.15.69:0/2147447787 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4580b57d0 con 0x7fd4580cb5a0 2023-10-06T01:39:33.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.523+0000 7fd4567fc700 1 -- 172.21.15.69:0/2147447787 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd448024070 con 0x7fd4580cb5a0 2023-10-06T01:39:33.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.523+0000 7fd4567fc700 1 --2- 172.21.15.69:0/2147447787 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd444066f30 0x7fd4440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:33.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.524+0000 7fd4567fc700 1 -- 172.21.15.69:0/2147447787 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd448086d90 con 0x7fd4580cb5a0 2023-10-06T01:39:33.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.524+0000 7fd45da0e700 1 --2- 172.21.15.69:0/2147447787 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd444066f30 0x7fd4440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:33.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.524+0000 7fd45da0e700 1 --2- 172.21.15.69:0/2147447787 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd444066f30 0x7fd4440693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd44c007fd0 tx=0x7fd44c007b20 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:33.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.528+0000 7fd4567fc700 1 -- 172.21.15.69:0/2147447787 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4580b57d0 con 0x7fd4580cb5a0 2023-10-06T01:39:33.788 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.787+0000 7fd460473700 1 -- 172.21.15.69:0/2147447787 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fd4580b57d0 con 0x7fd4580cb5a0 2023-10-06T01:39:33.792 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.791+0000 7fd4567fc700 1 -- 172.21.15.69:0/2147447787 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd4580b57d0 con 0x7fd4580cb5a0 2023-10-06T01:39:33.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.793+0000 7fd460473700 1 -- 172.21.15.69:0/2147447787 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd444066f30 msgr2=0x7fd4440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:33.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.793+0000 7fd460473700 1 --2- 172.21.15.69:0/2147447787 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd444066f30 0x7fd4440693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fd44c007fd0 tx=0x7fd44c007b20 comp rx=0 tx=0).stop 2023-10-06T01:39:33.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.793+0000 7fd460473700 1 -- 172.21.15.69:0/2147447787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4580cb5a0 msgr2=0x7fd458151120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:33.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.793+0000 7fd460473700 1 --2- 172.21.15.69:0/2147447787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4580cb5a0 0x7fd458151120 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fd4480099f0 tx=0x7fd448018000 comp rx=0 tx=0).stop 2023-10-06T01:39:33.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.793+0000 7fd460473700 1 -- 172.21.15.69:0/2147447787 shutdown_connections 2023-10-06T01:39:33.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.793+0000 7fd460473700 1 --2- 172.21.15.69:0/2147447787 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd444066f30 0x7fd4440693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:33.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.793+0000 7fd460473700 1 --2- 172.21.15.69:0/2147447787 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd45815a5d0 0x7fd4580c6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:33.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.793+0000 7fd460473700 1 --2- 172.21.15.69:0/2147447787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd4580cb5a0 0x7fd458151120 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:33.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.793+0000 7fd460473700 1 --2- 172.21.15.69:0/2147447787 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd4580cd9e0 0x7fd4580c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:33.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.793+0000 7fd460473700 1 -- 172.21.15.69:0/2147447787 >> 172.21.15.69:0/2147447787 conn(0x7fd458070e30 msgr2=0x7fd4580cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:33.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.793+0000 7fd460473700 1 -- 172.21.15.69:0/2147447787 shutdown_connections 2023-10-06T01:39:33.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.793+0000 7fd460473700 1 -- 172.21.15.69:0/2147447787 wait complete. 2023-10-06T01:39:33.806 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-06T01:39:33.921 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.920+0000 7f277277c700 1 Processor -- start 2023-10-06T01:39:33.922 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.920+0000 7f277277c700 1 -- start start 2023-10-06T01:39:33.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.921+0000 7f277277c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f276c0cec90 0x7f276c0cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:33.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.921+0000 7f277277c700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f276c06e560 con 0x7f276c0b05a0 2023-10-06T01:39:33.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.921+0000 7f277277c700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f276c06e260 con 0x7f276c0b0970 2023-10-06T01:39:33.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.921+0000 7f277277c700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f276c0c3240 con 0x7f276c0cec90 2023-10-06T01:39:33.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.921+0000 7f2770f79700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f276c0cec90 0x7f276c0cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:33.923 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.921+0000 7f277177a700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f276c0b05a0 0x7f276c0c89b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38732/0 (socket says 172.21.15.69:38732) 2023-10-06T01:39:33.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.921+0000 7f277177a700 1 -- 172.21.15.69:0/2142094374 learned_addr learned my addr 172.21.15.69:0/2142094374 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:33.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.921+0000 7f2770f79700 1 -- 172.21.15.69:0/2142094374 >> v1:172.21.15.88:6789/0 conn(0x7f276c0b0970 legacy=0x7f276c0c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:33.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.921+0000 7f2770f79700 1 -- 172.21.15.69:0/2142094374 >> v1:172.21.15.69:6789/0 conn(0x7f276c0b05a0 legacy=0x7f276c0c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:33.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.921+0000 7f2770f79700 1 -- 172.21.15.69:0/2142094374 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276c0c3520 con 0x7f276c0cec90 2023-10-06T01:39:33.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.921+0000 7f276bfff700 1 -- 172.21.15.69:0/2142094374 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3580474089 0 0) 0x7f276c06e560 con 0x7f276c0b05a0 2023-10-06T01:39:33.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.922+0000 7f2770f79700 1 --2- 172.21.15.69:0/2142094374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f276c0cec90 0x7f276c0cd7d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f27600098e0 tx=0x7f27600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b476aa1ce70bf9 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:33.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.922+0000 7f276bfff700 1 -- 172.21.15.69:0/2142094374 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2760009e80 con 0x7f276c0cec90 2023-10-06T01:39:33.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.922+0000 7f276bfff700 1 -- 172.21.15.69:0/2142094374 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f276000b820 con 0x7f276c0cec90 2023-10-06T01:39:33.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.922+0000 7f276bfff700 1 -- 172.21.15.69:0/2142094374 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f276000bba0 con 0x7f276c0cec90 2023-10-06T01:39:33.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.922+0000 7f277277c700 1 -- 172.21.15.69:0/2142094374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f276c0cec90 msgr2=0x7f276c0cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:33.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.922+0000 7f277277c700 1 --2- 172.21.15.69:0/2142094374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f276c0cec90 0x7f276c0cd7d0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f27600098e0 tx=0x7f27600091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:33.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.922+0000 7f277277c700 1 -- 172.21.15.69:0/2142094374 shutdown_connections 2023-10-06T01:39:33.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.922+0000 7f277277c700 1 --2- 172.21.15.69:0/2142094374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f276c0cec90 0x7f276c0cd7d0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:33.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.922+0000 7f277277c700 1 -- 172.21.15.69:0/2142094374 >> 172.21.15.69:0/2142094374 conn(0x7f276c088000 msgr2=0x7f276c0ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:33.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.922+0000 7f277277c700 1 -- 172.21.15.69:0/2142094374 shutdown_connections 2023-10-06T01:39:33.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.922+0000 7f277277c700 1 -- 172.21.15.69:0/2142094374 wait complete. 2023-10-06T01:39:33.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.923+0000 7f277277c700 1 Processor -- start 2023-10-06T01:39:33.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.924+0000 7f277277c700 1 -- start start 2023-10-06T01:39:33.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.924+0000 7f277277c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f276c0b05a0 0x7f276c0c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:33.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.924+0000 7f277277c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f276c0b0970 0x7f276c0c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:33.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.924+0000 7f277277c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f276c0cec90 0x7f276c14a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:33.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.924+0000 7f277277c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276c15c2e0 con 0x7f276c0b05a0 2023-10-06T01:39:33.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.924+0000 7f277277c700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f276c0c6530 con 0x7f276c0b0970 2023-10-06T01:39:33.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.924+0000 7f277277c700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f276c15b9b0 con 0x7f276c0cec90 2023-10-06T01:39:33.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.924+0000 7f277177a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f276c0b05a0 0x7f276c0c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:33.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.924+0000 7f277177a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f276c0b05a0 0x7f276c0c5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44334/0 (socket says 172.21.15.69:44334) 2023-10-06T01:39:33.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.925+0000 7f277177a700 1 -- 172.21.15.69:0/3402596869 learned_addr learned my addr 172.21.15.69:0/3402596869 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:33.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.925+0000 7f2771f7b700 1 --2- 172.21.15.69:0/3402596869 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f276c0cec90 0x7f276c14a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:33.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.925+0000 7f2770f79700 1 --2- 172.21.15.69:0/3402596869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f276c0b0970 0x7f276c0c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:33.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.925+0000 7f277177a700 1 -- 172.21.15.69:0/3402596869 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f276c0cec90 msgr2=0x7f276c14a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:33.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.925+0000 7f277177a700 1 --2- 172.21.15.69:0/3402596869 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f276c0cec90 0x7f276c14a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:33.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.925+0000 7f277177a700 1 -- 172.21.15.69:0/3402596869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f276c0b0970 msgr2=0x7f276c0c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:33.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.925+0000 7f277177a700 1 --2- 172.21.15.69:0/3402596869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f276c0b0970 0x7f276c0c7e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:33.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.925+0000 7f277177a700 1 -- 172.21.15.69:0/3402596869 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2760009420 con 0x7f276c0b05a0 2023-10-06T01:39:33.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.925+0000 7f2771f7b700 1 --2- 172.21.15.69:0/3402596869 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f276c0cec90 0x7f276c14a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:33.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.925+0000 7f2770f79700 1 --2- 172.21.15.69:0/3402596869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f276c0b0970 0x7f276c0c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:33.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.925+0000 7f277177a700 1 --2- 172.21.15.69:0/3402596869 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f276c0b05a0 0x7f276c0c5e30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f275c00c8e0 tx=0x7f275c0016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:33.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.925+0000 7f27697fa700 1 -- 172.21.15.69:0/3402596869 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c00ce80 con 0x7f276c0b05a0 2023-10-06T01:39:33.930 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.925+0000 7f27697fa700 1 -- 172.21.15.69:0/3402596869 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275c005d80 con 0x7f276c0b05a0 2023-10-06T01:39:33.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.925+0000 7f277277c700 1 -- 172.21.15.69:0/3402596869 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f276c15bc90 con 0x7f276c0b05a0 2023-10-06T01:39:33.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.925+0000 7f27697fa700 1 -- 172.21.15.69:0/3402596869 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c00a820 con 0x7f276c0b05a0 2023-10-06T01:39:33.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.925+0000 7f277277c700 1 -- 172.21.15.69:0/3402596869 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f276c14a6e0 con 0x7f276c0b05a0 2023-10-06T01:39:33.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.926+0000 7f277277c700 1 -- 172.21.15.69:0/3402596869 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f276c04c3c0 con 0x7f276c0b05a0 2023-10-06T01:39:33.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.926+0000 7f27697fa700 1 -- 172.21.15.69:0/3402596869 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f275c00ac10 con 0x7f276c0b05a0 2023-10-06T01:39:33.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.927+0000 7f27697fa700 1 --2- 172.21.15.69:0/3402596869 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2758066f30 0x7f27580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:33.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.927+0000 7f27697fa700 1 -- 172.21.15.69:0/3402596869 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f275c0840c0 con 0x7f276c0b05a0 2023-10-06T01:39:33.931 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.927+0000 7f2770f79700 1 --2- 172.21.15.69:0/3402596869 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2758066f30 0x7f27580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:33.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.927+0000 7f2770f79700 1 --2- 172.21.15.69:0/3402596869 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2758066f30 0x7f27580693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f27600098e0 tx=0x7f2760016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:33.932 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:33.931+0000 7f27697fa700 1 -- 172.21.15.69:0/3402596869 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f275c0515a0 con 0x7f276c0b05a0 2023-10-06T01:39:34.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.187+0000 7f277277c700 1 -- 172.21.15.69:0/3402596869 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f276c0885a0 con 0x7f276c0b05a0 2023-10-06T01:39:34.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.191+0000 7f27697fa700 1 -- 172.21.15.69:0/3402596869 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f275c054bc0 con 0x7f276c0b05a0 2023-10-06T01:39:34.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.193+0000 7f277277c700 1 -- 172.21.15.69:0/3402596869 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2758066f30 msgr2=0x7f27580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:34.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.193+0000 7f277277c700 1 --2- 172.21.15.69:0/3402596869 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2758066f30 0x7f27580693e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f27600098e0 tx=0x7f2760016000 comp rx=0 tx=0).stop 2023-10-06T01:39:34.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.193+0000 7f277277c700 1 -- 172.21.15.69:0/3402596869 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f276c0b05a0 msgr2=0x7f276c0c5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:34.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.193+0000 7f277277c700 1 --2- 172.21.15.69:0/3402596869 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f276c0b05a0 0x7f276c0c5e30 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f275c00c8e0 tx=0x7f275c0016f0 comp rx=0 tx=0).stop 2023-10-06T01:39:34.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.193+0000 7f277277c700 1 -- 172.21.15.69:0/3402596869 shutdown_connections 2023-10-06T01:39:34.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.193+0000 7f277277c700 1 --2- 172.21.15.69:0/3402596869 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2758066f30 0x7f27580693e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:34.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.193+0000 7f277277c700 1 --2- 172.21.15.69:0/3402596869 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f276c0cec90 0x7f276c14a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:34.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.193+0000 7f277277c700 1 --2- 172.21.15.69:0/3402596869 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f276c0b05a0 0x7f276c0c5e30 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:34.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.193+0000 7f277277c700 1 --2- 172.21.15.69:0/3402596869 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f276c0b0970 0x7f276c0c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:34.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.193+0000 7f277277c700 1 -- 172.21.15.69:0/3402596869 >> 172.21.15.69:0/3402596869 conn(0x7f276c088000 msgr2=0x7f276c157d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:34.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.193+0000 7f277277c700 1 -- 172.21.15.69:0/3402596869 shutdown_connections 2023-10-06T01:39:34.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.193+0000 7f277277c700 1 -- 172.21.15.69:0/3402596869 wait complete. 2023-10-06T01:39:34.206 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-06T01:39:34.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.320+0000 7f731d5a1700 1 Processor -- start 2023-10-06T01:39:34.321 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.320+0000 7f731d5a1700 1 -- start start 2023-10-06T01:39:34.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.321+0000 7f731d5a1700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f73180b2980 0x7f73180cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:34.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.321+0000 7f731d5a1700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f731815a8c0 0x7f731806d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:34.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.321+0000 7f731d5a1700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73180cec30 con 0x7f731806ddd0 2023-10-06T01:39:34.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.321+0000 7f731d5a1700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f731806e220 con 0x7f731815a8c0 2023-10-06T01:39:34.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.321+0000 7f731d5a1700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73180ce930 con 0x7f73180b2980 2023-10-06T01:39:34.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.321+0000 7f73177fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f731815a8c0 0x7f731806d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:34.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.321+0000 7f731cda0700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f731806ddd0 0x7f731815d280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38738/0 (socket says 172.21.15.69:38738) 2023-10-06T01:39:34.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.321+0000 7f731cda0700 1 -- 172.21.15.69:0/2216242184 learned_addr learned my addr 172.21.15.69:0/2216242184 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:34.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.321+0000 7f7316ffd700 1 -- 172.21.15.69:0/2216242184 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1423468528 0 0) 0x7f73180cec30 con 0x7f731806ddd0 2023-10-06T01:39:34.324 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.321+0000 7f7317fff700 1 --2- 172.21.15.69:0/2216242184 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f73180b2980 0x7f73180cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:34.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.321+0000 7f7316ffd700 1 -- 172.21.15.69:0/2216242184 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7304003570 con 0x7f731806ddd0 2023-10-06T01:39:34.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.321+0000 7f73177fe700 1 -- 172.21.15.69:0/2216242184 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f73180b2980 msgr2=0x7f73180cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:34.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.321+0000 7f73177fe700 1 --2- 172.21.15.69:0/2216242184 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f73180b2980 0x7f73180cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:34.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.321+0000 7f73177fe700 1 -- 172.21.15.69:0/2216242184 >> v1:172.21.15.69:6789/0 conn(0x7f731806ddd0 legacy=0x7f731815d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:34.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.321+0000 7f73177fe700 1 -- 172.21.15.69:0/2216242184 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73180d00d0 con 0x7f731815a8c0 2023-10-06T01:39:34.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.321+0000 7f7317fff700 1 --2- 172.21.15.69:0/2216242184 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f73180b2980 0x7f73180cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:34.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.321+0000 7f73177fe700 1 --2- 172.21.15.69:0/2216242184 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f731815a8c0 0x7f731806d890 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f73000098e0 tx=0x7f73000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f881f196d433ebb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:34.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.321+0000 7f7316ffd700 1 -- 172.21.15.69:0/2216242184 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730000b640 con 0x7f731815a8c0 2023-10-06T01:39:34.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.321+0000 7f7316ffd700 1 -- 172.21.15.69:0/2216242184 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f730000b7a0 con 0x7f731815a8c0 2023-10-06T01:39:34.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.321+0000 7f7316ffd700 1 -- 172.21.15.69:0/2216242184 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f730000bb40 con 0x7f731815a8c0 2023-10-06T01:39:34.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.322+0000 7f731d5a1700 1 -- 172.21.15.69:0/2216242184 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f731815a8c0 msgr2=0x7f731806d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:34.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.322+0000 7f731d5a1700 1 --2- 172.21.15.69:0/2216242184 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f731815a8c0 0x7f731806d890 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f73000098e0 tx=0x7f73000091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:34.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.322+0000 7f731d5a1700 1 -- 172.21.15.69:0/2216242184 shutdown_connections 2023-10-06T01:39:34.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.322+0000 7f731d5a1700 1 --2- 172.21.15.69:0/2216242184 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f73180b2980 0x7f73180cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:34.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.322+0000 7f731d5a1700 1 --2- 172.21.15.69:0/2216242184 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f731815a8c0 0x7f731806d890 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:34.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.322+0000 7f731d5a1700 1 -- 172.21.15.69:0/2216242184 >> 172.21.15.69:0/2216242184 conn(0x7f73180703a0 msgr2=0x7f73180707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:34.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.322+0000 7f731d5a1700 1 -- 172.21.15.69:0/2216242184 shutdown_connections 2023-10-06T01:39:34.326 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.322+0000 7f731d5a1700 1 -- 172.21.15.69:0/2216242184 wait complete. 2023-10-06T01:39:34.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.323+0000 7f731d5a1700 1 Processor -- start 2023-10-06T01:39:34.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.323+0000 7f731d5a1700 1 -- start start 2023-10-06T01:39:34.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.324+0000 7f731d5a1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f731806ddd0 0x7f73180b59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:34.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.324+0000 7f731d5a1700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f73180b2980 0x7f73180b1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:34.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.324+0000 7f731d5a1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f731815a8c0 0x7f731814ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:34.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.324+0000 7f731d5a1700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731815acd0 con 0x7f731815a8c0 2023-10-06T01:39:34.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.324+0000 7f731d5a1700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73181535c0 con 0x7f731806ddd0 2023-10-06T01:39:34.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.324+0000 7f731d5a1700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73181538a0 con 0x7f73180b2980 2023-10-06T01:39:34.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.324+0000 7f731cda0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f731815a8c0 0x7f731814ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:34.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.324+0000 7f731cda0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f731815a8c0 0x7f731814ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44358/0 (socket says 172.21.15.69:44358) 2023-10-06T01:39:34.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.324+0000 7f731cda0700 1 -- 172.21.15.69:0/3554777433 learned_addr learned my addr 172.21.15.69:0/3554777433 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:34.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.324+0000 7f7317fff700 1 --2- 172.21.15.69:0/3554777433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f731806ddd0 0x7f73180b59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:34.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.324+0000 7f73177fe700 1 --2- 172.21.15.69:0/3554777433 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f73180b2980 0x7f73180b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:34.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.324+0000 7f731cda0700 1 -- 172.21.15.69:0/3554777433 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f73180b2980 msgr2=0x7f73180b1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:34.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.324+0000 7f731cda0700 1 --2- 172.21.15.69:0/3554777433 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f73180b2980 0x7f73180b1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:34.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.324+0000 7f731cda0700 1 -- 172.21.15.69:0/3554777433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f731806ddd0 msgr2=0x7f73180b59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:34.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.324+0000 7f731cda0700 1 --2- 172.21.15.69:0/3554777433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f731806ddd0 0x7f73180b59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:34.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.324+0000 7f731cda0700 1 -- 172.21.15.69:0/3554777433 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7300009420 con 0x7f731815a8c0 2023-10-06T01:39:34.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.324+0000 7f731cda0700 1 --2- 172.21.15.69:0/3554777433 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f731815a8c0 0x7f731814ea80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7310001460 tx=0x7f7310001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:34.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.325+0000 7f730ffff700 1 -- 172.21.15.69:0/3554777433 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731000a940 con 0x7f731815a8c0 2023-10-06T01:39:34.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.325+0000 7f730ffff700 1 -- 172.21.15.69:0/3554777433 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f731000aaa0 con 0x7f731815a8c0 2023-10-06T01:39:34.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.325+0000 7f731d5a1700 1 -- 172.21.15.69:0/3554777433 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7318153b80 con 0x7f731815a8c0 2023-10-06T01:39:34.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.325+0000 7f730ffff700 1 -- 172.21.15.69:0/3554777433 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f731000ae20 con 0x7f731815a8c0 2023-10-06T01:39:34.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.325+0000 7f731d5a1700 1 -- 172.21.15.69:0/3554777433 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73180b37d0 con 0x7f731815a8c0 2023-10-06T01:39:34.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.325+0000 7f731d5a1700 1 -- 172.21.15.69:0/3554777433 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73180b39f0 con 0x7f731815a8c0 2023-10-06T01:39:34.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.326+0000 7f730ffff700 1 -- 172.21.15.69:0/3554777433 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7310007300 con 0x7f731815a8c0 2023-10-06T01:39:34.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.326+0000 7f730ffff700 1 --2- 172.21.15.69:0/3554777433 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f72f8066f30 0x7f72f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:34.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.326+0000 7f730ffff700 1 -- 172.21.15.69:0/3554777433 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f7310084770 con 0x7f731815a8c0 2023-10-06T01:39:34.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.326+0000 7f7317fff700 1 --2- 172.21.15.69:0/3554777433 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f72f8066f30 0x7f72f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:34.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.327+0000 7f7317fff700 1 --2- 172.21.15.69:0/3554777433 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f72f8066f30 0x7f72f80693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f730800adc0 tx=0x7f7308006f90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:34.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.330+0000 7f730ffff700 1 -- 172.21.15.69:0/3554777433 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7310051bc0 con 0x7f731815a8c0 2023-10-06T01:39:34.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.587+0000 7f731d5a1700 1 -- 172.21.15.69:0/3554777433 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f731804c3c0 con 0x7f731815a8c0 2023-10-06T01:39:34.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.590+0000 7f730ffff700 1 -- 172.21.15.69:0/3554777433 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f73100551e0 con 0x7f731815a8c0 2023-10-06T01:39:34.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.592+0000 7f731d5a1700 1 -- 172.21.15.69:0/3554777433 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f72f8066f30 msgr2=0x7f72f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:34.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.592+0000 7f731d5a1700 1 --2- 172.21.15.69:0/3554777433 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f72f8066f30 0x7f72f80693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f730800adc0 tx=0x7f7308006f90 comp rx=0 tx=0).stop 2023-10-06T01:39:34.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.592+0000 7f731d5a1700 1 -- 172.21.15.69:0/3554777433 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f731815a8c0 msgr2=0x7f731814ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:34.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.592+0000 7f731d5a1700 1 --2- 172.21.15.69:0/3554777433 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f731815a8c0 0x7f731814ea80 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f7310001460 tx=0x7f7310001ae0 comp rx=0 tx=0).stop 2023-10-06T01:39:34.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.592+0000 7f731d5a1700 1 -- 172.21.15.69:0/3554777433 shutdown_connections 2023-10-06T01:39:34.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.592+0000 7f731d5a1700 1 --2- 172.21.15.69:0/3554777433 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f72f8066f30 0x7f72f80693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:34.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.592+0000 7f731d5a1700 1 --2- 172.21.15.69:0/3554777433 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f731815a8c0 0x7f731814ea80 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:34.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.592+0000 7f731d5a1700 1 --2- 172.21.15.69:0/3554777433 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f731806ddd0 0x7f73180b59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:34.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.592+0000 7f731d5a1700 1 --2- 172.21.15.69:0/3554777433 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f73180b2980 0x7f73180b1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:34.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.592+0000 7f731d5a1700 1 -- 172.21.15.69:0/3554777433 >> 172.21.15.69:0/3554777433 conn(0x7f73180703a0 msgr2=0x7f73180ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:34.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.593+0000 7f731d5a1700 1 -- 172.21.15.69:0/3554777433 shutdown_connections 2023-10-06T01:39:34.595 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.593+0000 7f731d5a1700 1 -- 172.21.15.69:0/3554777433 wait complete. 2023-10-06T01:39:34.605 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-06T01:39:34.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.719+0000 7f47119e3700 1 Processor -- start 2023-10-06T01:39:34.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.719+0000 7f47119e3700 1 -- start start 2023-10-06T01:39:34.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.720+0000 7f47119e3700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f470c15a5d0 0x7f470c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:34.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.720+0000 7f47119e3700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f470c15ae40 con 0x7f470c0cb970 2023-10-06T01:39:34.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.720+0000 7f47119e3700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f470c15ab60 con 0x7f470c0cb5a0 2023-10-06T01:39:34.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.720+0000 7f47119e3700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f470c0ce0f0 con 0x7f470c15a5d0 2023-10-06T01:39:34.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.720+0000 7f470b7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f470c15a5d0 0x7f470c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:34.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.720+0000 7f470a7fc700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f470c0cb970 0x7f470c159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38752/0 (socket says 172.21.15.69:38752) 2023-10-06T01:39:34.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.720+0000 7f470a7fc700 1 -- 172.21.15.69:0/3246866746 learned_addr learned my addr 172.21.15.69:0/3246866746 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:34.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.720+0000 7f470b7fe700 1 -- 172.21.15.69:0/3246866746 >> v1:172.21.15.88:6789/0 conn(0x7f470c0cb5a0 legacy=0x7f470c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:34.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.720+0000 7f470b7fe700 1 -- 172.21.15.69:0/3246866746 >> v1:172.21.15.69:6789/0 conn(0x7f470c0cb970 legacy=0x7f470c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:34.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.720+0000 7f4709ffb700 1 -- 172.21.15.69:0/3246866746 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2935534551 0 0) 0x7f470c15ae40 con 0x7f470c0cb970 2023-10-06T01:39:34.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.720+0000 7f470b7fe700 1 -- 172.21.15.69:0/3246866746 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f470c0ccf00 con 0x7f470c15a5d0 2023-10-06T01:39:34.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.720+0000 7f470b7fe700 1 --2- 172.21.15.69:0/3246866746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f470c15a5d0 0x7f470c156e90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f47040098e0 tx=0x7f47040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=827c8cdb7417deb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:34.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.720+0000 7f4709ffb700 1 -- 172.21.15.69:0/3246866746 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4704009e80 con 0x7f470c15a5d0 2023-10-06T01:39:34.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.720+0000 7f4709ffb700 1 -- 172.21.15.69:0/3246866746 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f470400b820 con 0x7f470c15a5d0 2023-10-06T01:39:34.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.720+0000 7f4709ffb700 1 -- 172.21.15.69:0/3246866746 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f470400bba0 con 0x7f470c15a5d0 2023-10-06T01:39:34.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.721+0000 7f47119e3700 1 -- 172.21.15.69:0/3246866746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f470c15a5d0 msgr2=0x7f470c156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:34.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.721+0000 7f47119e3700 1 --2- 172.21.15.69:0/3246866746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f470c15a5d0 0x7f470c156e90 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f47040098e0 tx=0x7f47040091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:34.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.721+0000 7f47119e3700 1 -- 172.21.15.69:0/3246866746 shutdown_connections 2023-10-06T01:39:34.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.721+0000 7f47119e3700 1 --2- 172.21.15.69:0/3246866746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f470c15a5d0 0x7f470c156e90 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:34.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.721+0000 7f47119e3700 1 -- 172.21.15.69:0/3246866746 >> 172.21.15.69:0/3246866746 conn(0x7f470c070e30 msgr2=0x7f470c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:34.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.721+0000 7f47119e3700 1 -- 172.21.15.69:0/3246866746 shutdown_connections 2023-10-06T01:39:34.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.721+0000 7f47119e3700 1 -- 172.21.15.69:0/3246866746 wait complete. 2023-10-06T01:39:34.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.722+0000 7f47119e3700 1 Processor -- start 2023-10-06T01:39:34.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.722+0000 7f47119e3700 1 -- start start 2023-10-06T01:39:34.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.723+0000 7f47119e3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f470c0cb5a0 0x7f470c1524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:34.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.723+0000 7f47119e3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f470c0cb970 0x7f470c0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:34.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.723+0000 7f47119e3700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f470c15a5d0 0x7f470c0b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:34.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.723+0000 7f47119e3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470c152a30 con 0x7f470c0cb5a0 2023-10-06T01:39:34.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.723+0000 7f47119e3700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f470c15b070 con 0x7f470c0cb970 2023-10-06T01:39:34.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.723+0000 7f47119e3700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f470c15b2c0 con 0x7f470c15a5d0 2023-10-06T01:39:34.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.723+0000 7f470affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f470c0cb5a0 0x7f470c1524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:34.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.723+0000 7f470affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f470c0cb5a0 0x7f470c1524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44370/0 (socket says 172.21.15.69:44370) 2023-10-06T01:39:34.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.723+0000 7f470affd700 1 -- 172.21.15.69:0/3058039413 learned_addr learned my addr 172.21.15.69:0/3058039413 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:34.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.723+0000 7f470a7fc700 1 --2- 172.21.15.69:0/3058039413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f470c0cb970 0x7f470c0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:34.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.723+0000 7f470b7fe700 1 --2- 172.21.15.69:0/3058039413 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f470c15a5d0 0x7f470c0b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:34.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.723+0000 7f470affd700 1 -- 172.21.15.69:0/3058039413 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f470c15a5d0 msgr2=0x7f470c0b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:34.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.723+0000 7f470affd700 1 --2- 172.21.15.69:0/3058039413 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f470c15a5d0 0x7f470c0b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:34.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.723+0000 7f470affd700 1 -- 172.21.15.69:0/3058039413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f470c0cb970 msgr2=0x7f470c0b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:34.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.723+0000 7f470affd700 1 --2- 172.21.15.69:0/3058039413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f470c0cb970 0x7f470c0b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:34.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.723+0000 7f470affd700 1 -- 172.21.15.69:0/3058039413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4704009420 con 0x7f470c0cb5a0 2023-10-06T01:39:34.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.724+0000 7f470affd700 1 --2- 172.21.15.69:0/3058039413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f470c0cb5a0 0x7f470c1524f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00c950 tx=0x7f46fc002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:34.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.724+0000 7f46f2ffd700 1 -- 172.21.15.69:0/3058039413 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc00a7e0 con 0x7f470c0cb5a0 2023-10-06T01:39:34.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.724+0000 7f46f2ffd700 1 -- 172.21.15.69:0/3058039413 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46fc00a940 con 0x7f470c0cb5a0 2023-10-06T01:39:34.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.724+0000 7f46f2ffd700 1 -- 172.21.15.69:0/3058039413 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46fc00ad00 con 0x7f470c0cb5a0 2023-10-06T01:39:34.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.724+0000 7f47119e3700 1 -- 172.21.15.69:0/3058039413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f470c15b5a0 con 0x7f470c0cb5a0 2023-10-06T01:39:34.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.724+0000 7f47119e3700 1 -- 172.21.15.69:0/3058039413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f470c15bb60 con 0x7f470c0cb5a0 2023-10-06T01:39:34.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.725+0000 7f47119e3700 1 -- 172.21.15.69:0/3058039413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f470c04c3c0 con 0x7f470c0cb5a0 2023-10-06T01:39:34.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.725+0000 7f46f2ffd700 1 -- 172.21.15.69:0/3058039413 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f46fc012630 con 0x7f470c0cb5a0 2023-10-06T01:39:34.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.725+0000 7f46f2ffd700 1 --2- 172.21.15.69:0/3058039413 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f46f8066f30 0x7f46f80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:34.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.725+0000 7f46f2ffd700 1 -- 172.21.15.69:0/3058039413 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f46fc0848a0 con 0x7f470c0cb5a0 2023-10-06T01:39:34.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.726+0000 7f470a7fc700 1 --2- 172.21.15.69:0/3058039413 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f46f8066f30 0x7f46f80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:34.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.726+0000 7f470a7fc700 1 --2- 172.21.15.69:0/3058039413 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f46f8066f30 0x7f46f80693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f470c16d020 tx=0x7f4700009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:34.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.730+0000 7f46f2ffd700 1 -- 172.21.15.69:0/3058039413 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46fc051db0 con 0x7f470c0cb5a0 2023-10-06T01:39:34.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.986+0000 7f47119e3700 1 -- 172.21.15.69:0/3058039413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f470c0b0100 con 0x7f470c0cb5a0 2023-10-06T01:39:34.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.990+0000 7f46f2ffd700 1 -- 172.21.15.69:0/3058039413 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) v1 ==== 97+0+0 (secure 0 0 0) 0x7f46fc00ae60 con 0x7f470c0cb5a0 2023-10-06T01:39:34.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.992+0000 7f47119e3700 1 -- 172.21.15.69:0/3058039413 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f46f8066f30 msgr2=0x7f46f80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:34.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.992+0000 7f47119e3700 1 --2- 172.21.15.69:0/3058039413 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f46f8066f30 0x7f46f80693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f470c16d020 tx=0x7f4700009040 comp rx=0 tx=0).stop 2023-10-06T01:39:34.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.992+0000 7f47119e3700 1 -- 172.21.15.69:0/3058039413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f470c0cb5a0 msgr2=0x7f470c1524f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:34.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.992+0000 7f47119e3700 1 --2- 172.21.15.69:0/3058039413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f470c0cb5a0 0x7f470c1524f0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f46fc00c950 tx=0x7f46fc002760 comp rx=0 tx=0).stop 2023-10-06T01:39:34.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.992+0000 7f47119e3700 1 -- 172.21.15.69:0/3058039413 shutdown_connections 2023-10-06T01:39:34.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.992+0000 7f47119e3700 1 --2- 172.21.15.69:0/3058039413 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f46f8066f30 0x7f46f80693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:34.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.992+0000 7f47119e3700 1 --2- 172.21.15.69:0/3058039413 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f470c15a5d0 0x7f470c0b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:34.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.992+0000 7f47119e3700 1 --2- 172.21.15.69:0/3058039413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f470c0cb5a0 0x7f470c1524f0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:34.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.992+0000 7f47119e3700 1 --2- 172.21.15.69:0/3058039413 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f470c0cb970 0x7f470c0b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:34.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.992+0000 7f47119e3700 1 -- 172.21.15.69:0/3058039413 >> 172.21.15.69:0/3058039413 conn(0x7f470c070e30 msgr2=0x7f470c0c6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:34.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.992+0000 7f47119e3700 1 -- 172.21.15.69:0/3058039413 shutdown_connections 2023-10-06T01:39:34.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:34.992+0000 7f47119e3700 1 -- 172.21.15.69:0/3058039413 wait complete. 2023-10-06T01:39:35.005 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-06T01:39:35.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.118+0000 7fd15b59e700 1 Processor -- start 2023-10-06T01:39:35.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.118+0000 7fd15b59e700 1 -- start start 2023-10-06T01:39:35.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.119+0000 7fd15b59e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd15c15de50 0x7fd15c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:35.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.119+0000 7fd15b59e700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd15c0cf3c0 con 0x7fd15c153c30 2023-10-06T01:39:35.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.119+0000 7fd15b59e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd15c15afd0 con 0x7fd15c0cef40 2023-10-06T01:39:35.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.119+0000 7fd15b59e700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd15c15b2b0 con 0x7fd15c15de50 2023-10-06T01:39:35.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.119+0000 7fd15a59c700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fd15c153c30 0x7fd15c15a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38768/0 (socket says 172.21.15.69:38768) 2023-10-06T01:39:35.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.119+0000 7fd15a59c700 1 -- 172.21.15.69:0/786268692 learned_addr learned my addr 172.21.15.69:0/786268692 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:35.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.119+0000 7fd159d9b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd15c15de50 0x7fd15c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:35.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.119+0000 7fd15959a700 1 -- 172.21.15.69:0/786268692 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3256992025 0 0) 0x7fd15c0cf3c0 con 0x7fd15c153c30 2023-10-06T01:39:35.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.119+0000 7fd15959a700 1 -- 172.21.15.69:0/786268692 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd144003570 con 0x7fd15c153c30 2023-10-06T01:39:35.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.119+0000 7fd159d9b700 1 -- 172.21.15.69:0/786268692 >> v1:172.21.15.88:6789/0 conn(0x7fd15c0cef40 legacy=0x7fd15c15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:35.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.119+0000 7fd159d9b700 1 -- 172.21.15.69:0/786268692 >> v1:172.21.15.69:6789/0 conn(0x7fd15c153c30 legacy=0x7fd15c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:35.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.119+0000 7fd159d9b700 1 -- 172.21.15.69:0/786268692 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd15c15b590 con 0x7fd15c15de50 2023-10-06T01:39:35.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.120+0000 7fd159d9b700 1 --2- 172.21.15.69:0/786268692 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd15c15de50 0x7fd15c0cea00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd1500098e0 tx=0x7fd1500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88ef0ed7e9b52a71 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:35.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.120+0000 7fd15959a700 1 -- 172.21.15.69:0/786268692 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd150011630 con 0x7fd15c15de50 2023-10-06T01:39:35.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.120+0000 7fd15959a700 1 -- 172.21.15.69:0/786268692 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd150011790 con 0x7fd15c15de50 2023-10-06T01:39:35.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.120+0000 7fd15959a700 1 -- 172.21.15.69:0/786268692 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd150011b30 con 0x7fd15c15de50 2023-10-06T01:39:35.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.120+0000 7fd15b59e700 1 -- 172.21.15.69:0/786268692 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd15c15de50 msgr2=0x7fd15c0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:35.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.120+0000 7fd15b59e700 1 --2- 172.21.15.69:0/786268692 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd15c15de50 0x7fd15c0cea00 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fd1500098e0 tx=0x7fd1500091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:35.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.120+0000 7fd15b59e700 1 -- 172.21.15.69:0/786268692 shutdown_connections 2023-10-06T01:39:35.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.120+0000 7fd15b59e700 1 --2- 172.21.15.69:0/786268692 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd15c15de50 0x7fd15c0cea00 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:35.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.120+0000 7fd15b59e700 1 -- 172.21.15.69:0/786268692 >> 172.21.15.69:0/786268692 conn(0x7fd15c0703a0 msgr2=0x7fd15c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:35.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.120+0000 7fd15b59e700 1 -- 172.21.15.69:0/786268692 shutdown_connections 2023-10-06T01:39:35.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.120+0000 7fd15b59e700 1 -- 172.21.15.69:0/786268692 wait complete. 2023-10-06T01:39:35.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.121+0000 7fd15b59e700 1 Processor -- start 2023-10-06T01:39:35.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.121+0000 7fd15b59e700 1 -- start start 2023-10-06T01:39:35.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.122+0000 7fd15b59e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd15c0cef40 0x7fd15c0c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:35.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.122+0000 7fd15b59e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd15c153c30 0x7fd15c16a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:35.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.122+0000 7fd15b59e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd15c15de50 0x7fd15c0b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:35.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.122+0000 7fd15b59e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c0c95e0 con 0x7fd15c15de50 2023-10-06T01:39:35.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.122+0000 7fd15b59e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c0c98c0 con 0x7fd15c0cef40 2023-10-06T01:39:35.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.122+0000 7fd15b59e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd15c0c8cb0 con 0x7fd15c153c30 2023-10-06T01:39:35.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.122+0000 7fd15ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd15c15de50 0x7fd15c0b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:35.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.122+0000 7fd15ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd15c15de50 0x7fd15c0b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44402/0 (socket says 172.21.15.69:44402) 2023-10-06T01:39:35.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.122+0000 7fd15ad9d700 1 -- 172.21.15.69:0/179768816 learned_addr learned my addr 172.21.15.69:0/179768816 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:35.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.122+0000 7fd15a59c700 1 --2- 172.21.15.69:0/179768816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd15c0cef40 0x7fd15c0c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:35.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.122+0000 7fd159d9b700 1 --2- 172.21.15.69:0/179768816 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd15c153c30 0x7fd15c16a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:35.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.123+0000 7fd15ad9d700 1 -- 172.21.15.69:0/179768816 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd15c153c30 msgr2=0x7fd15c16a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:35.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.123+0000 7fd15ad9d700 1 --2- 172.21.15.69:0/179768816 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd15c153c30 0x7fd15c16a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:35.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.123+0000 7fd15ad9d700 1 -- 172.21.15.69:0/179768816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd15c0cef40 msgr2=0x7fd15c0c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:35.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.123+0000 7fd15ad9d700 1 --2- 172.21.15.69:0/179768816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd15c0cef40 0x7fd15c0c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:35.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.123+0000 7fd15ad9d700 1 -- 172.21.15.69:0/179768816 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd150009420 con 0x7fd15c15de50 2023-10-06T01:39:35.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.123+0000 7fd159d9b700 1 --2- 172.21.15.69:0/179768816 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd15c153c30 0x7fd15c16a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:35.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.123+0000 7fd15ad9d700 1 --2- 172.21.15.69:0/179768816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd15c15de50 0x7fd15c0b4ec0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd15400bc30 tx=0x7fd154009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:35.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.123+0000 7fd14a7fc700 1 -- 172.21.15.69:0/179768816 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15400c900 con 0x7fd15c15de50 2023-10-06T01:39:35.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.123+0000 7fd14a7fc700 1 -- 172.21.15.69:0/179768816 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd15400caa0 con 0x7fd15c15de50 2023-10-06T01:39:35.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.123+0000 7fd15b59e700 1 -- 172.21.15.69:0/179768816 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd15c0c8f90 con 0x7fd15c15de50 2023-10-06T01:39:35.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.123+0000 7fd14a7fc700 1 -- 172.21.15.69:0/179768816 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15400ce60 con 0x7fd15c15de50 2023-10-06T01:39:35.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.123+0000 7fd15b59e700 1 -- 172.21.15.69:0/179768816 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd15c0b5400 con 0x7fd15c15de50 2023-10-06T01:39:35.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.124+0000 7fd15b59e700 1 -- 172.21.15.69:0/179768816 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd15c04c3c0 con 0x7fd15c15de50 2023-10-06T01:39:35.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.124+0000 7fd14a7fc700 1 -- 172.21.15.69:0/179768816 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd154014620 con 0x7fd15c15de50 2023-10-06T01:39:35.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.125+0000 7fd14a7fc700 1 --2- 172.21.15.69:0/179768816 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd13c066f30 0x7fd13c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:35.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.125+0000 7fd14a7fc700 1 -- 172.21.15.69:0/179768816 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7fd154084380 con 0x7fd15c15de50 2023-10-06T01:39:35.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.125+0000 7fd15a59c700 1 --2- 172.21.15.69:0/179768816 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd13c066f30 0x7fd13c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:35.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.125+0000 7fd15a59c700 1 --2- 172.21.15.69:0/179768816 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd13c066f30 0x7fd13c0693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd14c007fd0 tx=0x7fd14c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:35.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.129+0000 7fd14a7fc700 1 -- 172.21.15.69:0/179768816 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1540517e0 con 0x7fd15c15de50 2023-10-06T01:39:35.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.387+0000 7fd15b59e700 1 -- 172.21.15.69:0/179768816 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7fd15c0b6300 con 0x7fd15c15de50 2023-10-06T01:39:35.394 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.392+0000 7fd14a7fc700 1 -- 172.21.15.69:0/179768816 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fd154054e00 con 0x7fd15c15de50 2023-10-06T01:39:35.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.395+0000 7fd15b59e700 1 -- 172.21.15.69:0/179768816 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd13c066f30 msgr2=0x7fd13c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:35.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.395+0000 7fd15b59e700 1 --2- 172.21.15.69:0/179768816 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd13c066f30 0x7fd13c0693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd14c007fd0 tx=0x7fd14c009040 comp rx=0 tx=0).stop 2023-10-06T01:39:35.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.395+0000 7fd15b59e700 1 -- 172.21.15.69:0/179768816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd15c15de50 msgr2=0x7fd15c0b4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:35.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.395+0000 7fd15b59e700 1 --2- 172.21.15.69:0/179768816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd15c15de50 0x7fd15c0b4ec0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd15400bc30 tx=0x7fd154009820 comp rx=0 tx=0).stop 2023-10-06T01:39:35.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.395+0000 7fd15b59e700 1 -- 172.21.15.69:0/179768816 shutdown_connections 2023-10-06T01:39:35.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.395+0000 7fd15b59e700 1 --2- 172.21.15.69:0/179768816 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd13c066f30 0x7fd13c0693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:35.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.395+0000 7fd15b59e700 1 --2- 172.21.15.69:0/179768816 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd15c15de50 0x7fd15c0b4ec0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:35.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.395+0000 7fd15b59e700 1 --2- 172.21.15.69:0/179768816 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd15c0cef40 0x7fd15c0c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:35.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.395+0000 7fd15b59e700 1 --2- 172.21.15.69:0/179768816 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd15c153c30 0x7fd15c16a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:35.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.395+0000 7fd15b59e700 1 -- 172.21.15.69:0/179768816 >> 172.21.15.69:0/179768816 conn(0x7fd15c0703a0 msgr2=0x7fd15c152fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:35.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.395+0000 7fd15b59e700 1 -- 172.21.15.69:0/179768816 shutdown_connections 2023-10-06T01:39:35.397 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.395+0000 7fd15b59e700 1 -- 172.21.15.69:0/179768816 wait complete. 2023-10-06T01:39:35.408 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:39:35.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.520+0000 7f19abed2700 1 Processor -- start 2023-10-06T01:39:35.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.521+0000 7f19abed2700 1 -- start start 2023-10-06T01:39:35.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.521+0000 7f19abed2700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19a40cb5a0 0x7f19a40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:35.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.521+0000 7f19abed2700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f19a40cde50 0x7f19a4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:35.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.521+0000 7f19abed2700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a415ae40 con 0x7f19a40cd9e0 2023-10-06T01:39:35.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.521+0000 7f19abed2700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a40d13f0 con 0x7f19a40cde50 2023-10-06T01:39:35.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.521+0000 7f19abed2700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a415ab60 con 0x7f19a40cb5a0 2023-10-06T01:39:35.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.522+0000 7f19aa46f700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f19a40cde50 0x7f19a4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:35.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.522+0000 7f19a946d700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f19a40cd9e0 0x7f19a4159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38778/0 (socket says 172.21.15.69:38778) 2023-10-06T01:39:35.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.522+0000 7f19a946d700 1 -- 172.21.15.69:0/1910656114 learned_addr learned my addr 172.21.15.69:0/1910656114 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:35.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.522+0000 7f19aa46f700 1 -- 172.21.15.69:0/1910656114 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19a40cb5a0 msgr2=0x7f19a40cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:35.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.522+0000 7f19aa46f700 1 --2- 172.21.15.69:0/1910656114 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19a40cb5a0 0x7f19a40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:35.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.522+0000 7f19aa46f700 1 -- 172.21.15.69:0/1910656114 >> v1:172.21.15.69:6789/0 conn(0x7f19a40cd9e0 legacy=0x7f19a4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:35.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.522+0000 7f19a8c6c700 1 -- 172.21.15.69:0/1910656114 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1884585360 0 0) 0x7f19a415ae40 con 0x7f19a40cd9e0 2023-10-06T01:39:35.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.522+0000 7f19aa46f700 1 -- 172.21.15.69:0/1910656114 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a40ccf00 con 0x7f19a40cde50 2023-10-06T01:39:35.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.522+0000 7f19aa46f700 1 --2- 172.21.15.69:0/1910656114 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19a40cde50 0x7f19a4156e90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f199c009e60 tx=0x7f199c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac5fa76246504654 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:35.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.522+0000 7f19a8c6c700 1 -- 172.21.15.69:0/1910656114 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c00e070 con 0x7f19a40cde50 2023-10-06T01:39:35.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.522+0000 7f19a8c6c700 1 -- 172.21.15.69:0/1910656114 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199c00bc30 con 0x7f19a40cde50 2023-10-06T01:39:35.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.522+0000 7f19a8c6c700 1 -- 172.21.15.69:0/1910656114 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199c012430 con 0x7f19a40cde50 2023-10-06T01:39:35.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.523+0000 7f19abed2700 1 -- 172.21.15.69:0/1910656114 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19a40cde50 msgr2=0x7f19a4156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:35.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.523+0000 7f19abed2700 1 --2- 172.21.15.69:0/1910656114 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19a40cde50 0x7f19a4156e90 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f199c009e60 tx=0x7f199c009780 comp rx=0 tx=0).stop 2023-10-06T01:39:35.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.523+0000 7f19abed2700 1 -- 172.21.15.69:0/1910656114 shutdown_connections 2023-10-06T01:39:35.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.523+0000 7f19abed2700 1 --2- 172.21.15.69:0/1910656114 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19a40cde50 0x7f19a4156e90 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:35.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.523+0000 7f19abed2700 1 --2- 172.21.15.69:0/1910656114 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19a40cb5a0 0x7f19a40cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:35.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.523+0000 7f19abed2700 1 -- 172.21.15.69:0/1910656114 >> 172.21.15.69:0/1910656114 conn(0x7f19a4070e30 msgr2=0x7f19a40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:35.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.523+0000 7f19abed2700 1 -- 172.21.15.69:0/1910656114 shutdown_connections 2023-10-06T01:39:35.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.523+0000 7f19abed2700 1 -- 172.21.15.69:0/1910656114 wait complete. 2023-10-06T01:39:35.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.524+0000 7f19abed2700 1 Processor -- start 2023-10-06T01:39:35.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.524+0000 7f19abed2700 1 -- start start 2023-10-06T01:39:35.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.525+0000 7f19abed2700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19a40cb5a0 0x7f19a416a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:35.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.525+0000 7f19abed2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19a40cd9e0 0x7f19a41590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:35.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.525+0000 7f19abed2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19a40b34b0 0x7f19a40b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:35.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.525+0000 7f19abed2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a40b3e70 con 0x7f19a40cd9e0 2023-10-06T01:39:35.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.525+0000 7f19abed2700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a4169e40 con 0x7f19a40b34b0 2023-10-06T01:39:35.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.525+0000 7f19abed2700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a4169550 con 0x7f19a40cb5a0 2023-10-06T01:39:35.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.525+0000 7f19a946d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19a40cd9e0 0x7f19a41590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:35.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.525+0000 7f19a946d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19a40cd9e0 0x7f19a41590d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44416/0 (socket says 172.21.15.69:44416) 2023-10-06T01:39:35.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.525+0000 7f19a946d700 1 -- 172.21.15.69:0/2242844004 learned_addr learned my addr 172.21.15.69:0/2242844004 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:35.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.525+0000 7f19a946d700 1 -- 172.21.15.69:0/2242844004 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19a40cb5a0 msgr2=0x7f19a416a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:35.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.525+0000 7f19a946d700 1 --2- 172.21.15.69:0/2242844004 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19a40cb5a0 0x7f19a416a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:35.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.525+0000 7f19a946d700 1 -- 172.21.15.69:0/2242844004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19a40b34b0 msgr2=0x7f19a40b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:35.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.525+0000 7f19aa46f700 1 --2- 172.21.15.69:0/2242844004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19a40b34b0 0x7f19a40b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:35.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.525+0000 7f19a946d700 1 --2- 172.21.15.69:0/2242844004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19a40b34b0 0x7f19a40b3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:35.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.525+0000 7f19a946d700 1 -- 172.21.15.69:0/2242844004 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c009a20 con 0x7f19a40cd9e0 2023-10-06T01:39:35.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.525+0000 7f19a946d700 1 --2- 172.21.15.69:0/2242844004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19a40cd9e0 0x7f19a41590d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f199400c7e0 tx=0x7f1994007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:35.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.525+0000 7f1999ffb700 1 -- 172.21.15.69:0/2242844004 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1994005b30 con 0x7f19a40cd9e0 2023-10-06T01:39:35.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.525+0000 7f1999ffb700 1 -- 172.21.15.69:0/2242844004 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1994005c90 con 0x7f19a40cd9e0 2023-10-06T01:39:35.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.525+0000 7f1999ffb700 1 -- 172.21.15.69:0/2242844004 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19940072e0 con 0x7f19a40cd9e0 2023-10-06T01:39:35.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.525+0000 7f19abed2700 1 -- 172.21.15.69:0/2242844004 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a4159610 con 0x7f19a40cd9e0 2023-10-06T01:39:35.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.526+0000 7f19abed2700 1 -- 172.21.15.69:0/2242844004 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a4169ad0 con 0x7f19a40cd9e0 2023-10-06T01:39:35.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.527+0000 7f19abed2700 1 -- 172.21.15.69:0/2242844004 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a404c3c0 con 0x7f19a40cd9e0 2023-10-06T01:39:35.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.527+0000 7f1999ffb700 1 -- 172.21.15.69:0/2242844004 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1994007690 con 0x7f19a40cd9e0 2023-10-06T01:39:35.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.527+0000 7f1999ffb700 1 --2- 172.21.15.69:0/2242844004 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1988066f30 0x7f19880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:35.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.527+0000 7f1999ffb700 1 -- 172.21.15.69:0/2242844004 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1994083790 con 0x7f19a40cd9e0 2023-10-06T01:39:35.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.527+0000 7f19a9c6e700 1 --2- 172.21.15.69:0/2242844004 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1988066f30 0x7f19880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:35.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.528+0000 7f19a9c6e700 1 --2- 172.21.15.69:0/2242844004 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1988066f30 0x7f19880693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f19a00097e0 tx=0x7f19a0006d10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:35.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.531+0000 7f1999ffb700 1 -- 172.21.15.69:0/2242844004 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f199404b5a0 con 0x7f19a40cd9e0 2023-10-06T01:39:35.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.714+0000 7f19abed2700 1 -- 172.21.15.69:0/2242844004 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19a40afa90 con 0x7f19a40cd9e0 2023-10-06T01:39:35.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.715+0000 7f1999ffb700 1 -- 172.21.15.69:0/2242844004 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+13602 (secure 0 0 0) 0x7f1994054730 con 0x7f19a40cd9e0 2023-10-06T01:39:35.717 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:35.717 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":31,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:39:32.581943+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:38:43.046056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:39:35.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.717+0000 7f19abed2700 1 -- 172.21.15.69:0/2242844004 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1988066f30 msgr2=0x7f19880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:35.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.717+0000 7f19abed2700 1 --2- 172.21.15.69:0/2242844004 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1988066f30 0x7f19880693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f19a00097e0 tx=0x7f19a0006d10 comp rx=0 tx=0).stop 2023-10-06T01:39:35.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.717+0000 7f19abed2700 1 -- 172.21.15.69:0/2242844004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19a40cd9e0 msgr2=0x7f19a41590d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:35.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.717+0000 7f19abed2700 1 --2- 172.21.15.69:0/2242844004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19a40cd9e0 0x7f19a41590d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f199400c7e0 tx=0x7f1994007df0 comp rx=0 tx=0).stop 2023-10-06T01:39:35.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.717+0000 7f19abed2700 1 -- 172.21.15.69:0/2242844004 shutdown_connections 2023-10-06T01:39:35.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.717+0000 7f19abed2700 1 --2- 172.21.15.69:0/2242844004 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1988066f30 0x7f19880693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:35.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.717+0000 7f19abed2700 1 --2- 172.21.15.69:0/2242844004 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19a40b34b0 0x7f19a40b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:35.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.717+0000 7f19abed2700 1 --2- 172.21.15.69:0/2242844004 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19a40cb5a0 0x7f19a416a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:35.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.717+0000 7f19abed2700 1 --2- 172.21.15.69:0/2242844004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19a40cd9e0 0x7f19a41590d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:35.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.717+0000 7f19abed2700 1 -- 172.21.15.69:0/2242844004 >> 172.21.15.69:0/2242844004 conn(0x7f19a4070e30 msgr2=0x7f19a4159dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:35.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.717+0000 7f19abed2700 1 -- 172.21.15.69:0/2242844004 shutdown_connections 2023-10-06T01:39:35.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.717+0000 7f19abed2700 1 -- 172.21.15.69:0/2242844004 wait complete. 2023-10-06T01:39:35.731 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:38:38.288642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:38:43.046056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T01:39:35.731 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:39:35.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.847+0000 7f1885408700 1 Processor -- start 2023-10-06T01:39:35.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.847+0000 7f1885408700 1 -- start start 2023-10-06T01:39:35.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.848+0000 7f1885408700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f18800cc320 0x7f188013c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:35.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.848+0000 7f1885408700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f188006d7b0 con 0x7f18800cc6f0 2023-10-06T01:39:35.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.848+0000 7f1885408700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f188006e330 con 0x7f188006a110 2023-10-06T01:39:35.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.848+0000 7f1885408700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f188006a570 con 0x7f18800cc320 2023-10-06T01:39:35.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.848+0000 7f187e7fc700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f18800cc6f0 0x7f1880069a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38782/0 (socket says 172.21.15.69:38782) 2023-10-06T01:39:35.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.848+0000 7f187e7fc700 1 -- 172.21.15.69:0/407429451 learned_addr learned my addr 172.21.15.69:0/407429451 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.848+0000 7f187effd700 1 --2- 172.21.15.69:0/407429451 >> v2:172.21.15.88:3300/0 conn(0x7f18800cc320 0x7f188013c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.848+0000 7f187dffb700 1 -- 172.21.15.69:0/407429451 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2585310548 0 0) 0x7f188006d7b0 con 0x7f18800cc6f0 2023-10-06T01:39:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.848+0000 7f187dffb700 1 -- 172.21.15.69:0/407429451 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1868003570 con 0x7f18800cc6f0 2023-10-06T01:39:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.849+0000 7f187dffb700 1 -- 172.21.15.69:0/407429451 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4000173440 0 0) 0x7f1868003570 con 0x7f18800cc6f0 2023-10-06T01:39:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.849+0000 7f187dffb700 1 -- 172.21.15.69:0/407429451 >> v2:172.21.15.88:3300/0 conn(0x7f18800cc320 msgr2=0x7f188013c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.849+0000 7f187dffb700 1 --2- 172.21.15.69:0/407429451 >> v2:172.21.15.88:3300/0 conn(0x7f18800cc320 0x7f188013c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.849+0000 7f187dffb700 1 -- 172.21.15.69:0/407429451 >> v1:172.21.15.88:6789/0 conn(0x7f188006a110 legacy=0x7f188006e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.849+0000 7f187dffb700 1 -- 172.21.15.69:0/407429451 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f188006da00 con 0x7f18800cc6f0 2023-10-06T01:39:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.849+0000 7f187dffb700 1 -- 172.21.15.69:0/407429451 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f1874001470 con 0x7f18800cc6f0 2023-10-06T01:39:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.849+0000 7f187dffb700 1 -- 172.21.15.69:0/407429451 >> v1:172.21.15.69:6789/0 conn(0x7f18800cc6f0 legacy=0x7f1880069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.849+0000 7f187dffb700 1 --2- 172.21.15.69:0/407429451 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1868003a60 0x7f1868003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.849+0000 7f187dffb700 1 --2- 172.21.15.69:0/407429451 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1868004810 0x7f1868004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:35.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.849+0000 7f187dffb700 1 --2- 172.21.15.69:0/407429451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18680051c0 0x7f186800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:35.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.849+0000 7f187dffb700 1 -- 172.21.15.69:0/407429451 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188006a570 con 0x7f1868004810 2023-10-06T01:39:35.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.849+0000 7f187dffb700 1 -- 172.21.15.69:0/407429451 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186800c160 con 0x7f18680051c0 2023-10-06T01:39:35.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.849+0000 7f187dffb700 1 -- 172.21.15.69:0/407429451 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186800c320 con 0x7f1868003a60 2023-10-06T01:39:35.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.849+0000 7f187e7fc700 1 --2- 172.21.15.69:0/407429451 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1868004810 0x7f1868004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:35.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.849+0000 7f187f7fe700 1 --2- 172.21.15.69:0/407429451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18680051c0 0x7f186800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:35.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.849+0000 7f187effd700 1 --2- 172.21.15.69:0/407429451 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1868003a60 0x7f1868003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:35.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.849+0000 7f187e7fc700 1 -- 172.21.15.69:0/407429451 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1868003a60 msgr2=0x7f1868003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:35.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.849+0000 7f187e7fc700 1 --2- 172.21.15.69:0/407429451 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1868003a60 0x7f1868003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:35.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.849+0000 7f187e7fc700 1 -- 172.21.15.69:0/407429451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18680051c0 msgr2=0x7f186800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:35.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.849+0000 7f187e7fc700 1 --2- 172.21.15.69:0/407429451 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18680051c0 0x7f186800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:35.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.849+0000 7f187e7fc700 1 -- 172.21.15.69:0/407429451 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1868003570 con 0x7f1868004810 2023-10-06T01:39:35.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.849+0000 7f187f7fe700 1 -- 172.21.15.69:0/407429451 reap_dead start 2023-10-06T01:39:35.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.849+0000 7f187e7fc700 1 --2- 172.21.15.69:0/407429451 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1868004810 0x7f1868004c80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f187400c3c0 tx=0x7f1874001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893f10ff71f000ae server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:35.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.849+0000 7f187dffb700 1 -- 172.21.15.69:0/407429451 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187400cc90 con 0x7f1868004810 2023-10-06T01:39:35.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.850+0000 7f187dffb700 1 -- 172.21.15.69:0/407429451 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187400cdf0 con 0x7f1868004810 2023-10-06T01:39:35.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.850+0000 7f187dffb700 1 -- 172.21.15.69:0/407429451 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1874005b50 con 0x7f1868004810 2023-10-06T01:39:35.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.850+0000 7f1885408700 1 -- 172.21.15.69:0/407429451 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1868004810 msgr2=0x7f1868004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:35.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.850+0000 7f1885408700 1 --2- 172.21.15.69:0/407429451 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1868004810 0x7f1868004c80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f187400c3c0 tx=0x7f1874001e50 comp rx=0 tx=0).stop 2023-10-06T01:39:35.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.850+0000 7f1885408700 1 -- 172.21.15.69:0/407429451 shutdown_connections 2023-10-06T01:39:35.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.850+0000 7f1885408700 1 --2- 172.21.15.69:0/407429451 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1868004810 0x7f1868004c80 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:35.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.850+0000 7f1885408700 1 -- 172.21.15.69:0/407429451 >> 172.21.15.69:0/407429451 conn(0x7f1880067f00 msgr2=0x7f1880068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:35.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.850+0000 7f1885408700 1 -- 172.21.15.69:0/407429451 shutdown_connections 2023-10-06T01:39:35.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.850+0000 7f1885408700 1 -- 172.21.15.69:0/407429451 wait complete. 2023-10-06T01:39:35.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.851+0000 7f1885408700 1 Processor -- start 2023-10-06T01:39:35.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.851+0000 7f1885408700 1 -- start start 2023-10-06T01:39:35.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.852+0000 7f1885408700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1868004810 0x7f18800b0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:35.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.852+0000 7f1885408700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f188015cc10 0x7f18801535d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:35.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.852+0000 7f1885408700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18800aede0 0x7f1880169d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:35.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.852+0000 7f1885408700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f188015d080 con 0x7f1868004810 2023-10-06T01:39:35.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.852+0000 7f1885408700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18800b0520 con 0x7f188015cc10 2023-10-06T01:39:35.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.852+0000 7f1885408700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18800aff60 con 0x7f18800aede0 2023-10-06T01:39:35.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.852+0000 7f187effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1868004810 0x7f18800b0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:35.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.852+0000 7f187effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1868004810 0x7f18800b0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44428/0 (socket says 172.21.15.69:44428) 2023-10-06T01:39:35.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.852+0000 7f187effd700 1 -- 172.21.15.69:0/1753579081 learned_addr learned my addr 172.21.15.69:0/1753579081 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:35.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.852+0000 7f187f7fe700 1 --2- 172.21.15.69:0/1753579081 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18800aede0 0x7f1880169d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:35.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.852+0000 7f187e7fc700 1 --2- 172.21.15.69:0/1753579081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f188015cc10 0x7f18801535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:35.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.852+0000 7f187effd700 1 -- 172.21.15.69:0/1753579081 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18800aede0 msgr2=0x7f1880169d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:35.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.852+0000 7f187effd700 1 --2- 172.21.15.69:0/1753579081 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18800aede0 0x7f1880169d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:35.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.852+0000 7f187effd700 1 -- 172.21.15.69:0/1753579081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f188015cc10 msgr2=0x7f18801535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:35.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.852+0000 7f187effd700 1 --2- 172.21.15.69:0/1753579081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f188015cc10 0x7f18801535d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:35.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.852+0000 7f187effd700 1 -- 172.21.15.69:0/1753579081 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18800b0240 con 0x7f1868004810 2023-10-06T01:39:35.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.853+0000 7f187effd700 1 --2- 172.21.15.69:0/1753579081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1868004810 0x7f18800b0850 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1870011f80 tx=0x7f187000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:35.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.853+0000 7f1866ffd700 1 -- 172.21.15.69:0/1753579081 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f187000e040 con 0x7f1868004810 2023-10-06T01:39:35.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.853+0000 7f1866ffd700 1 -- 172.21.15.69:0/1753579081 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f187000f040 con 0x7f1868004810 2023-10-06T01:39:35.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.853+0000 7f1866ffd700 1 -- 172.21.15.69:0/1753579081 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1870015430 con 0x7f1868004810 2023-10-06T01:39:35.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.853+0000 7f1885408700 1 -- 172.21.15.69:0/1753579081 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18800ae5e0 con 0x7f1868004810 2023-10-06T01:39:35.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.853+0000 7f1885408700 1 -- 172.21.15.69:0/1753579081 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1880153b10 con 0x7f1868004810 2023-10-06T01:39:35.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.854+0000 7f1885408700 1 -- 172.21.15.69:0/1753579081 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18800aea80 con 0x7f1868004810 2023-10-06T01:39:35.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.854+0000 7f1866ffd700 1 -- 172.21.15.69:0/1753579081 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f18700157e0 con 0x7f1868004810 2023-10-06T01:39:35.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.855+0000 7f1866ffd700 1 --2- 172.21.15.69:0/1753579081 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f186c066f30 0x7f186c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:35.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.855+0000 7f1866ffd700 1 -- 172.21.15.69:0/1753579081 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f1870085180 con 0x7f1868004810 2023-10-06T01:39:35.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.855+0000 7f187e7fc700 1 --2- 172.21.15.69:0/1753579081 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f186c066f30 0x7f186c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:35.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.855+0000 7f187e7fc700 1 --2- 172.21.15.69:0/1753579081 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f186c066f30 0x7f186c0693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1874000c00 tx=0x7f1874015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:35.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:35.859+0000 7f1866ffd700 1 -- 172.21.15.69:0/1753579081 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1870055fd0 con 0x7f1868004810 2023-10-06T01:39:36.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.040+0000 7f1885408700 1 -- 172.21.15.69:0/1753579081 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f18800aec30 con 0x7f1868004810 2023-10-06T01:39:36.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.040+0000 7f1866ffd700 1 -- 172.21.15.69:0/1753579081 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1870055bc0 con 0x7f1868004810 2023-10-06T01:39:36.042 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-10-06T01:39:36.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.042+0000 7f1885408700 1 -- 172.21.15.69:0/1753579081 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f186c066f30 msgr2=0x7f186c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:36.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.042+0000 7f1885408700 1 --2- 172.21.15.69:0/1753579081 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f186c066f30 0x7f186c0693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1874000c00 tx=0x7f1874015000 comp rx=0 tx=0).stop 2023-10-06T01:39:36.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.042+0000 7f1885408700 1 -- 172.21.15.69:0/1753579081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1868004810 msgr2=0x7f18800b0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:36.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.042+0000 7f1885408700 1 --2- 172.21.15.69:0/1753579081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1868004810 0x7f18800b0850 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1870011f80 tx=0x7f187000b040 comp rx=0 tx=0).stop 2023-10-06T01:39:36.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.042+0000 7f1885408700 1 -- 172.21.15.69:0/1753579081 shutdown_connections 2023-10-06T01:39:36.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.042+0000 7f1885408700 1 --2- 172.21.15.69:0/1753579081 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f186c066f30 0x7f186c0693e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.042+0000 7f1885408700 1 --2- 172.21.15.69:0/1753579081 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18800aede0 0x7f1880169d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.042+0000 7f1885408700 1 --2- 172.21.15.69:0/1753579081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1868004810 0x7f18800b0850 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.042+0000 7f1885408700 1 --2- 172.21.15.69:0/1753579081 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f188015cc10 0x7f18801535d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.043+0000 7f1885408700 1 -- 172.21.15.69:0/1753579081 >> 172.21.15.69:0/1753579081 conn(0x7f1880067f00 msgr2=0x7f18800ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:36.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.043+0000 7f1885408700 1 -- 172.21.15.69:0/1753579081 shutdown_connections 2023-10-06T01:39:36.045 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.043+0000 7f1885408700 1 -- 172.21.15.69:0/1753579081 wait complete. 2023-10-06T01:39:36.056 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:39:36.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.172+0000 7ff38bfff700 1 Processor -- start 2023-10-06T01:39:36.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.172+0000 7ff38bfff700 1 -- start start 2023-10-06T01:39:36.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.173+0000 7ff38bfff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff38c153a00 0x7ff38c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:36.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.173+0000 7ff38bfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff38c15de50 0x7ff38c15a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:36.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.173+0000 7ff38bfff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff38c0cea00 0x7ff38c0cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:36.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.173+0000 7ff38bfff700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff38c15af60 con 0x7ff38c0cea00 2023-10-06T01:39:36.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.173+0000 7ff38bfff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff38c15b240 con 0x7ff38c15de50 2023-10-06T01:39:36.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.173+0000 7ff38bfff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c15b520 con 0x7ff38c153a00 2023-10-06T01:39:36.176 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.173+0000 7ff38b7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff38c0cea00 0x7ff38c0cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:36.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.173+0000 7ff38b7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff38c0cea00 0x7ff38c0cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44434/0 (socket says 172.21.15.69:44434) 2023-10-06T01:39:36.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.173+0000 7ff38b7fe700 1 -- 172.21.15.69:0/3118315631 learned_addr learned my addr 172.21.15.69:0/3118315631 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:36.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.173+0000 7ff38affd700 1 --2- 172.21.15.69:0/3118315631 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff38c153a00 0x7ff38c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:36.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.173+0000 7ff38a7fc700 1 --2- 172.21.15.69:0/3118315631 >> v2:172.21.15.88:3300/0 conn(0x7ff38c15de50 0x7ff38c15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:36.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.173+0000 7ff38b7fe700 1 -- 172.21.15.69:0/3118315631 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff38c153a00 msgr2=0x7ff38c153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:36.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.173+0000 7ff38b7fe700 1 --2- 172.21.15.69:0/3118315631 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff38c153a00 0x7ff38c153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.173+0000 7ff38b7fe700 1 -- 172.21.15.69:0/3118315631 >> v2:172.21.15.88:3300/0 conn(0x7ff38c15de50 msgr2=0x7ff38c15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:36.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.173+0000 7ff38b7fe700 1 --2- 172.21.15.69:0/3118315631 >> v2:172.21.15.88:3300/0 conn(0x7ff38c15de50 0x7ff38c15a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.173+0000 7ff38b7fe700 1 -- 172.21.15.69:0/3118315631 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff38c15b800 con 0x7ff38c0cea00 2023-10-06T01:39:36.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.173+0000 7ff38b7fe700 1 --2- 172.21.15.69:0/3118315631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff38c0cea00 0x7ff38c0cee40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff38c06e800 tx=0x7ff384009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d0936287b9c2eb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:36.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.174+0000 7ff389ffb700 1 -- 172.21.15.69:0/3118315631 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff38400e070 con 0x7ff38c0cea00 2023-10-06T01:39:36.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.174+0000 7ff389ffb700 1 -- 172.21.15.69:0/3118315631 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff38400b970 con 0x7ff38c0cea00 2023-10-06T01:39:36.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.174+0000 7ff389ffb700 1 -- 172.21.15.69:0/3118315631 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3840092e0 con 0x7ff38c0cea00 2023-10-06T01:39:36.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.174+0000 7ff38bfff700 1 -- 172.21.15.69:0/3118315631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff38c0cea00 msgr2=0x7ff38c0cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:36.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.174+0000 7ff38bfff700 1 --2- 172.21.15.69:0/3118315631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff38c0cea00 0x7ff38c0cee40 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7ff38c06e800 tx=0x7ff384009840 comp rx=0 tx=0).stop 2023-10-06T01:39:36.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.174+0000 7ff38bfff700 1 -- 172.21.15.69:0/3118315631 shutdown_connections 2023-10-06T01:39:36.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.174+0000 7ff38bfff700 1 --2- 172.21.15.69:0/3118315631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff38c0cea00 0x7ff38c0cee40 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.174+0000 7ff38bfff700 1 --2- 172.21.15.69:0/3118315631 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff38c153a00 0x7ff38c153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.174+0000 7ff38bfff700 1 --2- 172.21.15.69:0/3118315631 >> v2:172.21.15.88:3300/0 conn(0x7ff38c15de50 0x7ff38c15a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.174+0000 7ff38bfff700 1 -- 172.21.15.69:0/3118315631 >> 172.21.15.69:0/3118315631 conn(0x7ff38c0703a0 msgr2=0x7ff38c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:36.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.174+0000 7ff38bfff700 1 -- 172.21.15.69:0/3118315631 shutdown_connections 2023-10-06T01:39:36.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.174+0000 7ff38bfff700 1 -- 172.21.15.69:0/3118315631 wait complete. 2023-10-06T01:39:36.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.175+0000 7ff38bfff700 1 Processor -- start 2023-10-06T01:39:36.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.175+0000 7ff38bfff700 1 -- start start 2023-10-06T01:39:36.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.176+0000 7ff38bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff38c0cea00 0x7ff38c1520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:36.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.176+0000 7ff38bfff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff38c153a00 0x7ff38c14f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:36.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.176+0000 7ff38bfff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff38c15de50 0x7ff38c158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:36.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.176+0000 7ff38bfff700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c0c72e0 con 0x7ff38c0cea00 2023-10-06T01:39:36.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.176+0000 7ff38bfff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c0cdb80 con 0x7ff38c15de50 2023-10-06T01:39:36.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.176+0000 7ff38bfff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff38c151310 con 0x7ff38c153a00 2023-10-06T01:39:36.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.176+0000 7ff38affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff38c0cea00 0x7ff38c1520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:36.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.176+0000 7ff38affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff38c0cea00 0x7ff38c1520d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44436/0 (socket says 172.21.15.69:44436) 2023-10-06T01:39:36.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.176+0000 7ff38affd700 1 -- 172.21.15.69:0/3722627494 learned_addr learned my addr 172.21.15.69:0/3722627494 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:36.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.176+0000 7ff38a7fc700 1 --2- 172.21.15.69:0/3722627494 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff38c153a00 0x7ff38c14f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:36.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.176+0000 7ff38b7fe700 1 --2- 172.21.15.69:0/3722627494 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff38c15de50 0x7ff38c158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:36.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.176+0000 7ff38affd700 1 -- 172.21.15.69:0/3722627494 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff38c153a00 msgr2=0x7ff38c14f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:36.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.176+0000 7ff38affd700 1 --2- 172.21.15.69:0/3722627494 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff38c153a00 0x7ff38c14f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.176+0000 7ff38affd700 1 -- 172.21.15.69:0/3722627494 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff38c15de50 msgr2=0x7ff38c158520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:36.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.176+0000 7ff38affd700 1 --2- 172.21.15.69:0/3722627494 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff38c15de50 0x7ff38c158520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.176+0000 7ff38affd700 1 -- 172.21.15.69:0/3722627494 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff384009ae0 con 0x7ff38c0cea00 2023-10-06T01:39:36.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.176+0000 7ff38a7fc700 1 --2- 172.21.15.69:0/3722627494 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff38c153a00 0x7ff38c14f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:36.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.177+0000 7ff38affd700 1 --2- 172.21.15.69:0/3722627494 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff38c0cea00 0x7ff38c1520d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff37c00ec80 tx=0x7ff37c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:36.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.177+0000 7ff372ffd700 1 -- 172.21.15.69:0/3722627494 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c00c9d0 con 0x7ff38c0cea00 2023-10-06T01:39:36.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.177+0000 7ff372ffd700 1 -- 172.21.15.69:0/3722627494 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff37c00cb30 con 0x7ff38c0cea00 2023-10-06T01:39:36.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.177+0000 7ff38bfff700 1 -- 172.21.15.69:0/3722627494 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff38c1515f0 con 0x7ff38c0cea00 2023-10-06T01:39:36.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.177+0000 7ff372ffd700 1 -- 172.21.15.69:0/3722627494 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff37c013470 con 0x7ff38c0cea00 2023-10-06T01:39:36.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.177+0000 7ff38bfff700 1 -- 172.21.15.69:0/3722627494 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff38c151bb0 con 0x7ff38c0cea00 2023-10-06T01:39:36.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.178+0000 7ff38bfff700 1 -- 172.21.15.69:0/3722627494 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff38c04c3c0 con 0x7ff38c0cea00 2023-10-06T01:39:36.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.178+0000 7ff372ffd700 1 -- 172.21.15.69:0/3722627494 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff37c013820 con 0x7ff38c0cea00 2023-10-06T01:39:36.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.178+0000 7ff372ffd700 1 --2- 172.21.15.69:0/3722627494 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff378066f30 0x7ff3780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:36.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.178+0000 7ff372ffd700 1 -- 172.21.15.69:0/3722627494 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7ff37c0846d0 con 0x7ff38c0cea00 2023-10-06T01:39:36.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.178+0000 7ff38a7fc700 1 --2- 172.21.15.69:0/3722627494 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff378066f30 0x7ff3780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:36.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.179+0000 7ff38a7fc700 1 --2- 172.21.15.69:0/3722627494 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff378066f30 0x7ff3780693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff38c0b23a0 tx=0x7ff380008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:36.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.183+0000 7ff372ffd700 1 -- 172.21.15.69:0/3722627494 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff37c051b30 con 0x7ff38c0cea00 2023-10-06T01:39:36.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.364+0000 7ff38bfff700 1 -- 172.21.15.69:0/3722627494 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff38c15bae0 con 0x7ff38c0cea00 2023-10-06T01:39:36.365 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.364+0000 7ff372ffd700 1 -- 172.21.15.69:0/3722627494 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v31) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff37c055150 con 0x7ff38c0cea00 2023-10-06T01:39:36.366 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 8 2023-10-06T01:39:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.366+0000 7ff38bfff700 1 -- 172.21.15.69:0/3722627494 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff378066f30 msgr2=0x7ff3780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.366+0000 7ff38bfff700 1 --2- 172.21.15.69:0/3722627494 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff378066f30 0x7ff3780693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff38c0b23a0 tx=0x7ff380008040 comp rx=0 tx=0).stop 2023-10-06T01:39:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.366+0000 7ff38bfff700 1 -- 172.21.15.69:0/3722627494 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff38c0cea00 msgr2=0x7ff38c1520d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.366+0000 7ff38bfff700 1 --2- 172.21.15.69:0/3722627494 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff38c0cea00 0x7ff38c1520d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7ff37c00ec80 tx=0x7ff37c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.366+0000 7ff38bfff700 1 -- 172.21.15.69:0/3722627494 shutdown_connections 2023-10-06T01:39:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.366+0000 7ff38bfff700 1 --2- 172.21.15.69:0/3722627494 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff378066f30 0x7ff3780693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.366+0000 7ff38bfff700 1 --2- 172.21.15.69:0/3722627494 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff38c15de50 0x7ff38c158520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.366+0000 7ff38bfff700 1 --2- 172.21.15.69:0/3722627494 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff38c0cea00 0x7ff38c1520d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.366+0000 7ff38bfff700 1 --2- 172.21.15.69:0/3722627494 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff38c153a00 0x7ff38c14f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.366+0000 7ff38bfff700 1 -- 172.21.15.69:0/3722627494 >> 172.21.15.69:0/3722627494 conn(0x7ff38c0703a0 msgr2=0x7ff38c0d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.366+0000 7ff38bfff700 1 -- 172.21.15.69:0/3722627494 shutdown_connections 2023-10-06T01:39:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.366+0000 7ff38bfff700 1 -- 172.21.15.69:0/3722627494 wait complete. 2023-10-06T01:39:36.379 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-06T01:39:36.494 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.493+0000 7f465c07f700 1 Processor -- start 2023-10-06T01:39:36.495 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.493+0000 7f465c07f700 1 -- start start 2023-10-06T01:39:36.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.494+0000 7f465c07f700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f46540cb970 0x7f4654159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:36.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.494+0000 7f465c07f700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f465415a400 0x7f4654156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:36.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.494+0000 7f465c07f700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f465415ae40 con 0x7f46540cb5a0 2023-10-06T01:39:36.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.494+0000 7f465c07f700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46540ce0f0 con 0x7f46540cb970 2023-10-06T01:39:36.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.494+0000 7f465c07f700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46540d13f0 con 0x7f465415a400 2023-10-06T01:39:36.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.494+0000 7f465961a700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f46540cb970 0x7f4654159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:36.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.494+0000 7f4659e1b700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f46540cb5a0 0x7f46540cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38792/0 (socket says 172.21.15.69:38792) 2023-10-06T01:39:36.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.494+0000 7f4659e1b700 1 -- 172.21.15.69:0/4120372471 learned_addr learned my addr 172.21.15.69:0/4120372471 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:36.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.494+0000 7f465961a700 1 -- 172.21.15.69:0/4120372471 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f465415a400 msgr2=0x7f4654156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:36.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.494+0000 7f465a61c700 1 --2- 172.21.15.69:0/4120372471 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f465415a400 0x7f4654156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:36.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.494+0000 7f465961a700 1 --2- 172.21.15.69:0/4120372471 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f465415a400 0x7f4654156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.494+0000 7f465961a700 1 -- 172.21.15.69:0/4120372471 >> v1:172.21.15.69:6789/0 conn(0x7f46540cb5a0 legacy=0x7f46540cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:36.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.494+0000 7f4658e19700 1 -- 172.21.15.69:0/4120372471 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416541209 0 0) 0x7f465415ae40 con 0x7f46540cb5a0 2023-10-06T01:39:36.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.494+0000 7f465961a700 1 -- 172.21.15.69:0/4120372471 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f465415ab60 con 0x7f46540cb970 2023-10-06T01:39:36.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.494+0000 7f465961a700 1 --2- 172.21.15.69:0/4120372471 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46540cb970 0x7f4654159ec0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f46440098e0 tx=0x7f46440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81558cada9b9c2dc server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:36.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.494+0000 7f4658e19700 1 -- 172.21.15.69:0/4120372471 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4644009e80 con 0x7f46540cb970 2023-10-06T01:39:36.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.494+0000 7f4658e19700 1 -- 172.21.15.69:0/4120372471 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f464400b860 con 0x7f46540cb970 2023-10-06T01:39:36.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.494+0000 7f4658e19700 1 -- 172.21.15.69:0/4120372471 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f464400bbe0 con 0x7f46540cb970 2023-10-06T01:39:36.506 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.495+0000 7f465c07f700 1 -- 172.21.15.69:0/4120372471 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46540cb970 msgr2=0x7f4654159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:36.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.495+0000 7f465c07f700 1 --2- 172.21.15.69:0/4120372471 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46540cb970 0x7f4654159ec0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f46440098e0 tx=0x7f46440091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.495+0000 7f465c07f700 1 -- 172.21.15.69:0/4120372471 shutdown_connections 2023-10-06T01:39:36.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.495+0000 7f465c07f700 1 --2- 172.21.15.69:0/4120372471 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f465415a400 0x7f4654156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.495+0000 7f465c07f700 1 --2- 172.21.15.69:0/4120372471 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f46540cb970 0x7f4654159ec0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.507 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.495+0000 7f465c07f700 1 -- 172.21.15.69:0/4120372471 >> 172.21.15.69:0/4120372471 conn(0x7f4654070e30 msgr2=0x7f46540d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:36.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.495+0000 7f465c07f700 1 -- 172.21.15.69:0/4120372471 shutdown_connections 2023-10-06T01:39:36.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.495+0000 7f465c07f700 1 -- 172.21.15.69:0/4120372471 wait complete. 2023-10-06T01:39:36.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.496+0000 7f465c07f700 1 Processor -- start 2023-10-06T01:39:36.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.496+0000 7f465c07f700 1 -- start start 2023-10-06T01:39:36.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.497+0000 7f465c07f700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f46540cb5a0 0x7f46540b5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:36.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.497+0000 7f465c07f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46540cb970 0x7f465415baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:36.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.497+0000 7f465c07f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f465415a400 0x7f465415bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:36.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.497+0000 7f465c07f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46541595b0 con 0x7f465415a400 2023-10-06T01:39:36.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.497+0000 7f465c07f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f465415df70 con 0x7f46540cb970 2023-10-06T01:39:36.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.497+0000 7f465c07f700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46540b6450 con 0x7f46540cb5a0 2023-10-06T01:39:36.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.497+0000 7f465a61c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f465415a400 0x7f465415bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:36.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.497+0000 7f465a61c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f465415a400 0x7f465415bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44446/0 (socket says 172.21.15.69:44446) 2023-10-06T01:39:36.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.497+0000 7f465a61c700 1 -- 172.21.15.69:0/910135885 learned_addr learned my addr 172.21.15.69:0/910135885 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:36.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.497+0000 7f4659e1b700 1 --2- 172.21.15.69:0/910135885 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f46540cb5a0 0x7f46540b5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:36.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.497+0000 7f465961a700 1 --2- 172.21.15.69:0/910135885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46540cb970 0x7f465415baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:36.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.497+0000 7f465a61c700 1 -- 172.21.15.69:0/910135885 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f46540cb5a0 msgr2=0x7f46540b5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:36.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.497+0000 7f465a61c700 1 --2- 172.21.15.69:0/910135885 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f46540cb5a0 0x7f46540b5f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.497+0000 7f465a61c700 1 -- 172.21.15.69:0/910135885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46540cb970 msgr2=0x7f465415baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:36.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.497+0000 7f465a61c700 1 --2- 172.21.15.69:0/910135885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46540cb970 0x7f465415baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.497+0000 7f465a61c700 1 -- 172.21.15.69:0/910135885 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4644009420 con 0x7f465415a400 2023-10-06T01:39:36.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.497+0000 7f465a61c700 1 --2- 172.21.15.69:0/910135885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f465415a400 0x7f465415bfe0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f465000ceb0 tx=0x7f4650007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:36.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.497+0000 7f4649ffb700 1 -- 172.21.15.69:0/910135885 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f465000ad90 con 0x7f465415a400 2023-10-06T01:39:36.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.497+0000 7f4649ffb700 1 -- 172.21.15.69:0/910135885 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4650016430 con 0x7f465415a400 2023-10-06T01:39:36.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.498+0000 7f465c07f700 1 -- 172.21.15.69:0/910135885 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4654159a40 con 0x7f465415a400 2023-10-06T01:39:36.512 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.498+0000 7f4649ffb700 1 -- 172.21.15.69:0/910135885 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46500167d0 con 0x7f465415a400 2023-10-06T01:39:36.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.498+0000 7f465c07f700 1 -- 172.21.15.69:0/910135885 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4654158c80 con 0x7f465415a400 2023-10-06T01:39:36.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.499+0000 7f465c07f700 1 -- 172.21.15.69:0/910135885 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46540b0b90 con 0x7f465415a400 2023-10-06T01:39:36.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.499+0000 7f4649ffb700 1 -- 172.21.15.69:0/910135885 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4650003020 con 0x7f465415a400 2023-10-06T01:39:36.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.499+0000 7f4649ffb700 1 --2- 172.21.15.69:0/910135885 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4638066f30 0x7f46380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:36.513 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.499+0000 7f4649ffb700 1 -- 172.21.15.69:0/910135885 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f4650012070 con 0x7f465415a400 2023-10-06T01:39:36.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.499+0000 7f4659e1b700 1 --2- 172.21.15.69:0/910135885 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4638066f30 0x7f46380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:36.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.500+0000 7f4659e1b700 1 --2- 172.21.15.69:0/910135885 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4638066f30 0x7f46380693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f464c007160 tx=0x7f464c007f50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:36.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.503+0000 7f4649ffb700 1 -- 172.21.15.69:0/910135885 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46500525a0 con 0x7f465415a400 2023-10-06T01:39:36.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.690+0000 7f465c07f700 1 -- 172.21.15.69:0/910135885 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f465404c3c0 con 0x7f465415a400 2023-10-06T01:39:36.691 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.690+0000 7f4649ffb700 1 -- 172.21.15.69:0/910135885 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) v1 ==== 84+0+126 (secure 0 0 0) 0x7f4650055bc0 con 0x7f465415a400 2023-10-06T01:39:36.692 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:36.692 INFO:teuthology.orchestra.run.smithi069.stdout:[ 2023-10-06T01:39:36.692 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:36.692 INFO:teuthology.orchestra.run.smithi069.stdout: "poolnum": 1, 2023-10-06T01:39:36.692 INFO:teuthology.orchestra.run.smithi069.stdout: "poolname": ".mgr" 2023-10-06T01:39:36.692 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:39:36.692 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:36.692 INFO:teuthology.orchestra.run.smithi069.stdout: "poolnum": 2, 2023-10-06T01:39:36.692 INFO:teuthology.orchestra.run.smithi069.stdout: "poolname": "rbd" 2023-10-06T01:39:36.692 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:36.692 INFO:teuthology.orchestra.run.smithi069.stdout:] 2023-10-06T01:39:36.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.692+0000 7f465c07f700 1 -- 172.21.15.69:0/910135885 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4638066f30 msgr2=0x7f46380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:36.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.692+0000 7f465c07f700 1 --2- 172.21.15.69:0/910135885 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4638066f30 0x7f46380693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f464c007160 tx=0x7f464c007f50 comp rx=0 tx=0).stop 2023-10-06T01:39:36.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.692+0000 7f465c07f700 1 -- 172.21.15.69:0/910135885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f465415a400 msgr2=0x7f465415bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:36.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.692+0000 7f465c07f700 1 --2- 172.21.15.69:0/910135885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f465415a400 0x7f465415bfe0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f465000ceb0 tx=0x7f4650007870 comp rx=0 tx=0).stop 2023-10-06T01:39:36.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.692+0000 7f465c07f700 1 -- 172.21.15.69:0/910135885 shutdown_connections 2023-10-06T01:39:36.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.692+0000 7f465c07f700 1 --2- 172.21.15.69:0/910135885 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4638066f30 0x7f46380693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.694 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.692+0000 7f465c07f700 1 --2- 172.21.15.69:0/910135885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f465415a400 0x7f465415bfe0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.692+0000 7f465c07f700 1 --2- 172.21.15.69:0/910135885 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f46540cb5a0 0x7f46540b5f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.692+0000 7f465c07f700 1 --2- 172.21.15.69:0/910135885 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f46540cb970 0x7f465415baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.692+0000 7f465c07f700 1 -- 172.21.15.69:0/910135885 >> 172.21.15.69:0/910135885 conn(0x7f4654070e30 msgr2=0x7f46540b2450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:36.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.692+0000 7f465c07f700 1 -- 172.21.15.69:0/910135885 shutdown_connections 2023-10-06T01:39:36.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.692+0000 7f465c07f700 1 -- 172.21.15.69:0/910135885 wait complete. 2023-10-06T01:39:36.705 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-06T01:39:36.705 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-06T01:39:36.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.824+0000 7f93eed1f700 1 Processor -- start 2023-10-06T01:39:36.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.824+0000 7f93eed1f700 1 -- start start 2023-10-06T01:39:36.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.825+0000 7f93eed1f700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f93e80cce90 0x7f93e80cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:36.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.825+0000 7f93eed1f700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f93e80cb440 0x7f93e80cb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:36.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.825+0000 7f93eed1f700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e815d570 con 0x7f93e8159fb0 2023-10-06T01:39:36.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.825+0000 7f93eed1f700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e815e180 con 0x7f93e80cb440 2023-10-06T01:39:36.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.825+0000 7f93eed1f700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e80cd870 con 0x7f93e80cce90 2023-10-06T01:39:36.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.825+0000 7f93ee51e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f93e80cb440 0x7f93e80cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:36.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.825+0000 7f93edd1d700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f93e8159fb0 0x7f93e815a380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:38808/0 (socket says 172.21.15.69:38808) 2023-10-06T01:39:36.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.825+0000 7f93ee51e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f93e80cb440 0x7f93e80cb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44448/0 (socket says 172.21.15.69:44448) 2023-10-06T01:39:36.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.825+0000 7f93edd1d700 1 -- 172.21.15.69:0/2390451359 learned_addr learned my addr 172.21.15.69:0/2390451359 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:36.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.825+0000 7f93ed51c700 1 --2- 172.21.15.69:0/2390451359 >> v2:172.21.15.88:3300/0 conn(0x7f93e80cce90 0x7f93e80cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:36.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.825+0000 7f93ee51e700 1 -- 172.21.15.69:0/2390451359 >> v2:172.21.15.88:3300/0 conn(0x7f93e80cce90 msgr2=0x7f93e80cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:36.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.825+0000 7f93ee51e700 1 --2- 172.21.15.69:0/2390451359 >> v2:172.21.15.88:3300/0 conn(0x7f93e80cce90 0x7f93e80cd330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.825+0000 7f93ee51e700 1 -- 172.21.15.69:0/2390451359 >> v1:172.21.15.69:6789/0 conn(0x7f93e8159fb0 legacy=0x7f93e815a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:36.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.825+0000 7f93ee51e700 1 -- 172.21.15.69:0/2390451359 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e815d850 con 0x7f93e80cb440 2023-10-06T01:39:36.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.825+0000 7f93ecd1b700 1 -- 172.21.15.69:0/2390451359 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4113058207 0 0) 0x7f93e815d570 con 0x7f93e8159fb0 2023-10-06T01:39:36.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.825+0000 7f93ee51e700 1 --2- 172.21.15.69:0/2390451359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93e80cb440 0x7f93e80cb810 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f93e80d04b0 tx=0x7f93d8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad073562b4a6dea server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:36.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.825+0000 7f93ecd1b700 1 -- 172.21.15.69:0/2390451359 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d800e070 con 0x7f93e80cb440 2023-10-06T01:39:36.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.825+0000 7f93ecd1b700 1 -- 172.21.15.69:0/2390451359 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93d800bc30 con 0x7f93e80cb440 2023-10-06T01:39:36.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.825+0000 7f93ecd1b700 1 -- 172.21.15.69:0/2390451359 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93d8012430 con 0x7f93e80cb440 2023-10-06T01:39:36.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.825+0000 7f93eed1f700 1 -- 172.21.15.69:0/2390451359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93e80cb440 msgr2=0x7f93e80cb810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:36.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.825+0000 7f93eed1f700 1 --2- 172.21.15.69:0/2390451359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93e80cb440 0x7f93e80cb810 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f93e80d04b0 tx=0x7f93d8009780 comp rx=0 tx=0).stop 2023-10-06T01:39:36.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.825+0000 7f93eed1f700 1 -- 172.21.15.69:0/2390451359 shutdown_connections 2023-10-06T01:39:36.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.825+0000 7f93eed1f700 1 --2- 172.21.15.69:0/2390451359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93e80cb440 0x7f93e80cb810 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.825+0000 7f93eed1f700 1 --2- 172.21.15.69:0/2390451359 >> v2:172.21.15.88:3300/0 conn(0x7f93e80cce90 0x7f93e80cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.825+0000 7f93eed1f700 1 -- 172.21.15.69:0/2390451359 >> 172.21.15.69:0/2390451359 conn(0x7f93e80703a0 msgr2=0x7f93e80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:36.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.825+0000 7f93eed1f700 1 -- 172.21.15.69:0/2390451359 shutdown_connections 2023-10-06T01:39:36.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.825+0000 7f93eed1f700 1 -- 172.21.15.69:0/2390451359 wait complete. 2023-10-06T01:39:36.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.826+0000 7f93eed1f700 1 Processor -- start 2023-10-06T01:39:36.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.826+0000 7f93eed1f700 1 -- start start 2023-10-06T01:39:36.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.827+0000 7f93eed1f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93e80cb440 0x7f93e8156cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:36.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.827+0000 7f93eed1f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93e80cce90 0x7f93e81542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:36.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.827+0000 7f93eed1f700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93e8159fb0 0x7f93e80b21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:36.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.827+0000 7f93eed1f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e8154a60 con 0x7f93e80cb440 2023-10-06T01:39:36.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.827+0000 7f93eed1f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e80b1d20 con 0x7f93e80cce90 2023-10-06T01:39:36.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.827+0000 7f93eed1f700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e81547e0 con 0x7f93e8159fb0 2023-10-06T01:39:36.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.827+0000 7f93edd1d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93e80cb440 0x7f93e8156cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:36.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.827+0000 7f93edd1d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93e80cb440 0x7f93e8156cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44458/0 (socket says 172.21.15.69:44458) 2023-10-06T01:39:36.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.827+0000 7f93edd1d700 1 -- 172.21.15.69:0/90052745 learned_addr learned my addr 172.21.15.69:0/90052745 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:36.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.827+0000 7f93ee51e700 1 --2- 172.21.15.69:0/90052745 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93e8159fb0 0x7f93e80b21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:36.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.827+0000 7f93ed51c700 1 --2- 172.21.15.69:0/90052745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93e80cce90 0x7f93e81542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:36.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.827+0000 7f93edd1d700 1 -- 172.21.15.69:0/90052745 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93e8159fb0 msgr2=0x7f93e80b21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:36.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.827+0000 7f93edd1d700 1 --2- 172.21.15.69:0/90052745 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93e8159fb0 0x7f93e80b21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.827+0000 7f93edd1d700 1 -- 172.21.15.69:0/90052745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93e80cce90 msgr2=0x7f93e81542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:36.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.827+0000 7f93edd1d700 1 --2- 172.21.15.69:0/90052745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93e80cce90 0x7f93e81542a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:36.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.827+0000 7f93edd1d700 1 -- 172.21.15.69:0/90052745 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93d8009a20 con 0x7f93e80cb440 2023-10-06T01:39:36.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.828+0000 7f93edd1d700 1 --2- 172.21.15.69:0/90052745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93e80cb440 0x7f93e8156cc0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f93e000c7e0 tx=0x7f93e0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:36.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.828+0000 7f93e5ffb700 1 -- 172.21.15.69:0/90052745 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e0005b30 con 0x7f93e80cb440 2023-10-06T01:39:36.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.828+0000 7f93e5ffb700 1 -- 172.21.15.69:0/90052745 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e0005c90 con 0x7f93e80cb440 2023-10-06T01:39:36.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.828+0000 7f93eed1f700 1 -- 172.21.15.69:0/90052745 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e80b13f0 con 0x7f93e80cb440 2023-10-06T01:39:36.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.828+0000 7f93e5ffb700 1 -- 172.21.15.69:0/90052745 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e0007300 con 0x7f93e80cb440 2023-10-06T01:39:36.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.828+0000 7f93eed1f700 1 -- 172.21.15.69:0/90052745 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e80b19b0 con 0x7f93e80cb440 2023-10-06T01:39:36.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.829+0000 7f93eed1f700 1 -- 172.21.15.69:0/90052745 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e804c3c0 con 0x7f93e80cb440 2023-10-06T01:39:36.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.829+0000 7f93e5ffb700 1 -- 172.21.15.69:0/90052745 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f93e001b400 con 0x7f93e80cb440 2023-10-06T01:39:36.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.829+0000 7f93e5ffb700 1 --2- 172.21.15.69:0/90052745 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f93d4066f30 0x7f93d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:36.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.829+0000 7f93e5ffb700 1 -- 172.21.15.69:0/90052745 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5206+0+0 (secure 0 0 0) 0x7f93e0083e20 con 0x7f93e80cb440 2023-10-06T01:39:36.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.830+0000 7f93ed51c700 1 --2- 172.21.15.69:0/90052745 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f93d4066f30 0x7f93d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:36.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.830+0000 7f93ed51c700 1 --2- 172.21.15.69:0/90052745 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f93d4066f30 0x7f93d40693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f93e8155cc0 tx=0x7f93dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:36.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:36.834+0000 7f93e5ffb700 1 -- 172.21.15.69:0/90052745 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f93e0051300 con 0x7f93e80cb440 2023-10-06T01:39:37.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.015+0000 7f93eed1f700 1 -- 172.21.15.69:0/90052745 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f93e80caef0 con 0x7f93e80cb440 2023-10-06T01:39:37.602 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.601+0000 7f93e5ffb700 1 -- 172.21.15.69:0/90052745 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) v1 ==== 138+0+0 (secure 0 0 0) 0x7f93e0054920 con 0x7f93e80cb440 2023-10-06T01:39:37.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.605+0000 7f93eed1f700 1 -- 172.21.15.69:0/90052745 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f93d4066f30 msgr2=0x7f93d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:37.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.605+0000 7f93eed1f700 1 --2- 172.21.15.69:0/90052745 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f93d4066f30 0x7f93d40693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f93e8155cc0 tx=0x7f93dc008040 comp rx=0 tx=0).stop 2023-10-06T01:39:37.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.605+0000 7f93eed1f700 1 -- 172.21.15.69:0/90052745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93e80cb440 msgr2=0x7f93e8156cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:37.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.605+0000 7f93eed1f700 1 --2- 172.21.15.69:0/90052745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93e80cb440 0x7f93e8156cc0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f93e000c7e0 tx=0x7f93e0007df0 comp rx=0 tx=0).stop 2023-10-06T01:39:37.605 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.605+0000 7f93eed1f700 1 -- 172.21.15.69:0/90052745 shutdown_connections 2023-10-06T01:39:37.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.605+0000 7f93eed1f700 1 --2- 172.21.15.69:0/90052745 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f93d4066f30 0x7f93d40693e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:37.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.605+0000 7f93eed1f700 1 --2- 172.21.15.69:0/90052745 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f93e8159fb0 0x7f93e80b21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:37.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.605+0000 7f93eed1f700 1 --2- 172.21.15.69:0/90052745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f93e80cb440 0x7f93e8156cc0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:37.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.605+0000 7f93eed1f700 1 --2- 172.21.15.69:0/90052745 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f93e80cce90 0x7f93e81542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:37.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.605+0000 7f93eed1f700 1 -- 172.21.15.69:0/90052745 >> 172.21.15.69:0/90052745 conn(0x7f93e80703a0 msgr2=0x7f93e81500c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:37.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.605+0000 7f93eed1f700 1 -- 172.21.15.69:0/90052745 shutdown_connections 2023-10-06T01:39:37.606 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.605+0000 7f93eed1f700 1 -- 172.21.15.69:0/90052745 wait complete. 2023-10-06T01:39:37.607 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_metadata' created 2023-10-06T01:39:37.619 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-06T01:39:37.739 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.739+0000 7fb741f27700 1 Processor -- start 2023-10-06T01:39:37.740 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.739+0000 7fb741f27700 1 -- start start 2023-10-06T01:39:37.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.740+0000 7fb741f27700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb73c159530 0x7fb73c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:37.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.740+0000 7fb741f27700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb73c06dc70 0x7fb73c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:37.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.740+0000 7fb741f27700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb73c0ccfd0 con 0x7fb73c06e0e0 2023-10-06T01:39:37.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.740+0000 7fb741f27700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb73c0cf0e0 con 0x7fb73c159530 2023-10-06T01:39:37.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.740+0000 7fb741f27700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb73c15a3d0 con 0x7fb73c06dc70 2023-10-06T01:39:37.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.740+0000 7fb73b7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb73c159530 0x7fb73c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:37.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.740+0000 7fb73bfff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fb73c06e0e0 0x7fb73c0cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:43312/0 (socket says 172.21.15.69:43312) 2023-10-06T01:39:37.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.740+0000 7fb73bfff700 1 -- 172.21.15.69:0/3572299310 learned_addr learned my addr 172.21.15.69:0/3572299310 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:37.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.740+0000 7fb73b7fe700 1 -- 172.21.15.69:0/3572299310 >> v2:172.21.15.88:3300/0 conn(0x7fb73c06dc70 msgr2=0x7fb73c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:37.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.740+0000 7fb73affd700 1 --2- 172.21.15.69:0/3572299310 >> v2:172.21.15.88:3300/0 conn(0x7fb73c06dc70 0x7fb73c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:37.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.740+0000 7fb73b7fe700 1 --2- 172.21.15.69:0/3572299310 >> v2:172.21.15.88:3300/0 conn(0x7fb73c06dc70 0x7fb73c159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:37.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.740+0000 7fb73a7fc700 1 -- 172.21.15.69:0/3572299310 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 379356840 0 0) 0x7fb73c0ccfd0 con 0x7fb73c06e0e0 2023-10-06T01:39:37.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.740+0000 7fb73b7fe700 1 -- 172.21.15.69:0/3572299310 >> v1:172.21.15.69:6789/0 conn(0x7fb73c06e0e0 legacy=0x7fb73c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:37.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.740+0000 7fb73b7fe700 1 -- 172.21.15.69:0/3572299310 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb73c15a6b0 con 0x7fb73c159530 2023-10-06T01:39:37.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.740+0000 7fb73b7fe700 1 --2- 172.21.15.69:0/3572299310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb73c159530 0x7fb73c0ceba0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0b66e0 tx=0x7fb734009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a915ea67174dc1f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:37.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.740+0000 7fb73a7fc700 1 -- 172.21.15.69:0/3572299310 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb73400e070 con 0x7fb73c159530 2023-10-06T01:39:37.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.740+0000 7fb73a7fc700 1 -- 172.21.15.69:0/3572299310 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb73400bc30 con 0x7fb73c159530 2023-10-06T01:39:37.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.740+0000 7fb73a7fc700 1 -- 172.21.15.69:0/3572299310 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb734012430 con 0x7fb73c159530 2023-10-06T01:39:37.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.741+0000 7fb741f27700 1 -- 172.21.15.69:0/3572299310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb73c159530 msgr2=0x7fb73c0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:37.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.741+0000 7fb741f27700 1 --2- 172.21.15.69:0/3572299310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb73c159530 0x7fb73c0ceba0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0b66e0 tx=0x7fb734009780 comp rx=0 tx=0).stop 2023-10-06T01:39:37.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.741+0000 7fb741f27700 1 -- 172.21.15.69:0/3572299310 shutdown_connections 2023-10-06T01:39:37.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.741+0000 7fb741f27700 1 --2- 172.21.15.69:0/3572299310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb73c159530 0x7fb73c0ceba0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:37.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.741+0000 7fb741f27700 1 --2- 172.21.15.69:0/3572299310 >> v2:172.21.15.88:3300/0 conn(0x7fb73c06dc70 0x7fb73c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:37.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.741+0000 7fb741f27700 1 -- 172.21.15.69:0/3572299310 >> 172.21.15.69:0/3572299310 conn(0x7fb73c0703a0 msgr2=0x7fb73c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:37.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.741+0000 7fb741f27700 1 -- 172.21.15.69:0/3572299310 shutdown_connections 2023-10-06T01:39:37.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.741+0000 7fb741f27700 1 -- 172.21.15.69:0/3572299310 wait complete. 2023-10-06T01:39:37.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.742+0000 7fb741f27700 1 Processor -- start 2023-10-06T01:39:37.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.742+0000 7fb741f27700 1 -- start start 2023-10-06T01:39:37.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.743+0000 7fb741f27700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb73c06dc70 0x7fb73c153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:37.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.743+0000 7fb741f27700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb73c06e0e0 0x7fb73c0b5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:37.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.743+0000 7fb741f27700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb73c159530 0x7fb73c0b1d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:37.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.743+0000 7fb741f27700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73c0c8780 con 0x7fb73c06e0e0 2023-10-06T01:39:37.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.743+0000 7fb741f27700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb73c0c8c10 con 0x7fb73c159530 2023-10-06T01:39:37.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.743+0000 7fb741f27700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb73c0b6180 con 0x7fb73c06dc70 2023-10-06T01:39:37.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.743+0000 7fb73affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb73c06e0e0 0x7fb73c0b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:37.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.743+0000 7fb73affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb73c06e0e0 0x7fb73c0b5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58648/0 (socket says 172.21.15.69:58648) 2023-10-06T01:39:37.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.743+0000 7fb73affd700 1 -- 172.21.15.69:0/2190346839 learned_addr learned my addr 172.21.15.69:0/2190346839 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:37.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.743+0000 7fb73bfff700 1 --2- 172.21.15.69:0/2190346839 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb73c159530 0x7fb73c0b1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:37.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.743+0000 7fb73b7fe700 1 --2- 172.21.15.69:0/2190346839 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb73c06dc70 0x7fb73c153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:37.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.743+0000 7fb73affd700 1 -- 172.21.15.69:0/2190346839 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb73c06dc70 msgr2=0x7fb73c153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:37.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.743+0000 7fb73affd700 1 --2- 172.21.15.69:0/2190346839 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb73c06dc70 0x7fb73c153f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:37.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.743+0000 7fb73affd700 1 -- 172.21.15.69:0/2190346839 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb73c159530 msgr2=0x7fb73c0b1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:37.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.743+0000 7fb73affd700 1 --2- 172.21.15.69:0/2190346839 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb73c159530 0x7fb73c0b1d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:37.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.743+0000 7fb73affd700 1 -- 172.21.15.69:0/2190346839 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb734009a20 con 0x7fb73c06e0e0 2023-10-06T01:39:37.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.743+0000 7fb73bfff700 1 --2- 172.21.15.69:0/2190346839 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb73c159530 0x7fb73c0b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:37.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.743+0000 7fb73affd700 1 --2- 172.21.15.69:0/2190346839 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb73c06e0e0 0x7fb73c0b5550 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb72400c7d0 tx=0x7fb724008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:37.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.744+0000 7fb7337fe700 1 -- 172.21.15.69:0/2190346839 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb724011600 con 0x7fb73c06e0e0 2023-10-06T01:39:37.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.744+0000 7fb7337fe700 1 -- 172.21.15.69:0/2190346839 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb724011760 con 0x7fb73c06e0e0 2023-10-06T01:39:37.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.744+0000 7fb741f27700 1 -- 172.21.15.69:0/2190346839 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb73c0c7b70 con 0x7fb73c06e0e0 2023-10-06T01:39:37.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.744+0000 7fb7337fe700 1 -- 172.21.15.69:0/2190346839 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb724011b20 con 0x7fb73c06e0e0 2023-10-06T01:39:37.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.744+0000 7fb741f27700 1 -- 172.21.15.69:0/2190346839 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb73c0c8130 con 0x7fb73c06e0e0 2023-10-06T01:39:37.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.745+0000 7fb741f27700 1 -- 172.21.15.69:0/2190346839 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb73c04c3c0 con 0x7fb73c06e0e0 2023-10-06T01:39:37.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.746+0000 7fb7337fe700 1 -- 172.21.15.69:0/2190346839 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb7240193f0 con 0x7fb73c06e0e0 2023-10-06T01:39:37.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.746+0000 7fb7337fe700 1 --2- 172.21.15.69:0/2190346839 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb71c066f30 0x7fb71c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:37.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.746+0000 7fb7337fe700 1 -- 172.21.15.69:0/2190346839 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5576+0+0 (secure 0 0 0) 0x7fb724084e90 con 0x7fb73c06e0e0 2023-10-06T01:39:37.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.746+0000 7fb73b7fe700 1 --2- 172.21.15.69:0/2190346839 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb71c066f30 0x7fb71c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:37.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.746+0000 7fb73b7fe700 1 --2- 172.21.15.69:0/2190346839 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb71c066f30 0x7fb71c0693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0b66e0 tx=0x7fb734019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:37.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.750+0000 7fb7337fe700 1 -- 172.21.15.69:0/2190346839 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7240515a0 con 0x7fb73c06e0e0 2023-10-06T01:39:37.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:37.933+0000 7fb741f27700 1 -- 172.21.15.69:0/2190346839 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb73c0c88c0 con 0x7fb73c06e0e0 2023-10-06T01:39:38.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.609+0000 7fb7337fe700 1 -- 172.21.15.69:0/2190346839 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb724055820 con 0x7fb73c06e0e0 2023-10-06T01:39:38.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.612+0000 7fb741f27700 1 -- 172.21.15.69:0/2190346839 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb71c066f30 msgr2=0x7fb71c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:38.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.612+0000 7fb741f27700 1 --2- 172.21.15.69:0/2190346839 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb71c066f30 0x7fb71c0693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fb73c0b66e0 tx=0x7fb734019000 comp rx=0 tx=0).stop 2023-10-06T01:39:38.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.612+0000 7fb741f27700 1 -- 172.21.15.69:0/2190346839 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb73c06e0e0 msgr2=0x7fb73c0b5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:38.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.613+0000 7fb741f27700 1 --2- 172.21.15.69:0/2190346839 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb73c06e0e0 0x7fb73c0b5550 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb72400c7d0 tx=0x7fb724008040 comp rx=0 tx=0).stop 2023-10-06T01:39:38.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.613+0000 7fb741f27700 1 -- 172.21.15.69:0/2190346839 shutdown_connections 2023-10-06T01:39:38.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.613+0000 7fb741f27700 1 --2- 172.21.15.69:0/2190346839 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb71c066f30 0x7fb71c0693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:38.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.613+0000 7fb741f27700 1 --2- 172.21.15.69:0/2190346839 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb73c159530 0x7fb73c0b1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:38.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.613+0000 7fb741f27700 1 --2- 172.21.15.69:0/2190346839 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb73c06dc70 0x7fb73c153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:38.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.613+0000 7fb741f27700 1 --2- 172.21.15.69:0/2190346839 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb73c06e0e0 0x7fb73c0b5550 secure :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb72400c7d0 tx=0x7fb724008040 comp rx=0 tx=0).stop 2023-10-06T01:39:38.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.613+0000 7fb741f27700 1 -- 172.21.15.69:0/2190346839 >> 172.21.15.69:0/2190346839 conn(0x7fb73c0703a0 msgr2=0x7fb73c15afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:38.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.614+0000 7fb741f27700 1 -- 172.21.15.69:0/2190346839 shutdown_connections 2023-10-06T01:39:38.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.615+0000 7fb741f27700 1 -- 172.21.15.69:0/2190346839 wait complete. 2023-10-06T01:39:38.620 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_data' created 2023-10-06T01:39:38.635 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-06T01:39:38.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.754+0000 7f1f361da700 1 Processor -- start 2023-10-06T01:39:38.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.754+0000 7f1f361da700 1 -- start start 2023-10-06T01:39:38.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.755+0000 7f1f361da700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1f30153dd0 0x7f1f3015de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:38.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.755+0000 7f1f361da700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3015ac50 con 0x7f1f30153a00 2023-10-06T01:39:38.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.755+0000 7f1f361da700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f3015d010 con 0x7f1f300cea00 2023-10-06T01:39:38.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.755+0000 7f1f361da700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f3015af60 con 0x7f1f30153dd0 2023-10-06T01:39:38.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.755+0000 7f1f351d8700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f1f30153a00 0x7f1f3015a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:43314/0 (socket says 172.21.15.69:43314) 2023-10-06T01:39:38.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.755+0000 7f1f351d8700 1 -- 172.21.15.69:0/3667976390 learned_addr learned my addr 172.21.15.69:0/3667976390 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:38.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.755+0000 7f1f349d7700 1 --2- 172.21.15.69:0/3667976390 >> v2:172.21.15.88:3300/0 conn(0x7f1f30153dd0 0x7f1f3015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:38.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.755+0000 7f1f27fff700 1 -- 172.21.15.69:0/3667976390 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541627421 0 0) 0x7f1f3015ac50 con 0x7f1f30153a00 2023-10-06T01:39:38.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.755+0000 7f1f27fff700 1 -- 172.21.15.69:0/3667976390 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f1c003570 con 0x7f1f30153a00 2023-10-06T01:39:38.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.755+0000 7f1f349d7700 1 -- 172.21.15.69:0/3667976390 >> v1:172.21.15.88:6789/0 conn(0x7f1f300cea00 legacy=0x7f1f300ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:38.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.755+0000 7f1f349d7700 1 -- 172.21.15.69:0/3667976390 >> v1:172.21.15.69:6789/0 conn(0x7f1f30153a00 legacy=0x7f1f3015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:38.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.755+0000 7f1f27fff700 1 -- 172.21.15.69:0/3667976390 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2728915042 0 0) 0x7f1f1c003570 con 0x7f1f30153a00 2023-10-06T01:39:38.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.755+0000 7f1f349d7700 1 -- 172.21.15.69:0/3667976390 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f3015b240 con 0x7f1f30153dd0 2023-10-06T01:39:38.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.756+0000 7f1f349d7700 1 --2- 172.21.15.69:0/3667976390 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f30153dd0 0x7f1f3015de50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1f20009860 tx=0x7f1f200091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df371b1538cd4a2b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:38.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.756+0000 7f1f27fff700 1 -- 172.21.15.69:0/3667976390 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f280017f0 con 0x7f1f30153dd0 2023-10-06T01:39:38.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.756+0000 7f1f27fff700 1 -- 172.21.15.69:0/3667976390 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f20011420 con 0x7f1f30153dd0 2023-10-06T01:39:38.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.756+0000 7f1f27fff700 1 -- 172.21.15.69:0/3667976390 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f200117c0 con 0x7f1f30153dd0 2023-10-06T01:39:38.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.756+0000 7f1f361da700 1 -- 172.21.15.69:0/3667976390 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f30153dd0 msgr2=0x7f1f3015de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:38.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.756+0000 7f1f361da700 1 --2- 172.21.15.69:0/3667976390 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f30153dd0 0x7f1f3015de50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1f20009860 tx=0x7f1f200091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:38.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.756+0000 7f1f361da700 1 -- 172.21.15.69:0/3667976390 shutdown_connections 2023-10-06T01:39:38.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.756+0000 7f1f361da700 1 --2- 172.21.15.69:0/3667976390 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f30153dd0 0x7f1f3015de50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:38.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.756+0000 7f1f361da700 1 -- 172.21.15.69:0/3667976390 >> 172.21.15.69:0/3667976390 conn(0x7f1f300703a0 msgr2=0x7f1f300707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:38.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.756+0000 7f1f361da700 1 -- 172.21.15.69:0/3667976390 shutdown_connections 2023-10-06T01:39:38.760 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.756+0000 7f1f361da700 1 -- 172.21.15.69:0/3667976390 wait complete. 2023-10-06T01:39:38.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.758+0000 7f1f361da700 1 Processor -- start 2023-10-06T01:39:38.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.758+0000 7f1f361da700 1 -- start start 2023-10-06T01:39:38.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.758+0000 7f1f361da700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f300cea00 0x7f1f30168d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:38.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.758+0000 7f1f361da700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f30153a00 0x7f1f300ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:38.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.758+0000 7f1f361da700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f30153dd0 0x7f1f3006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:38.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.758+0000 7f1f361da700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3014b960 con 0x7f1f30153a00 2023-10-06T01:39:38.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.758+0000 7f1f361da700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f3014fac0 con 0x7f1f30153dd0 2023-10-06T01:39:38.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.758+0000 7f1f361da700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f30150580 con 0x7f1f300cea00 2023-10-06T01:39:38.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.759+0000 7f1f349d7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f30153a00 0x7f1f300ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:38.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.759+0000 7f1f349d7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f30153a00 0x7f1f300ccdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58664/0 (socket says 172.21.15.69:58664) 2023-10-06T01:39:38.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.759+0000 7f1f349d7700 1 -- 172.21.15.69:0/3608819650 learned_addr learned my addr 172.21.15.69:0/3608819650 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:38.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.759+0000 7f1f359d9700 1 --2- 172.21.15.69:0/3608819650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f30153dd0 0x7f1f3006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:38.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.759+0000 7f1f351d8700 1 --2- 172.21.15.69:0/3608819650 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f300cea00 0x7f1f30168d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:38.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.759+0000 7f1f349d7700 1 -- 172.21.15.69:0/3608819650 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f300cea00 msgr2=0x7f1f30168d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:38.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.759+0000 7f1f349d7700 1 --2- 172.21.15.69:0/3608819650 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f300cea00 0x7f1f30168d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:38.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.759+0000 7f1f349d7700 1 -- 172.21.15.69:0/3608819650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f30153dd0 msgr2=0x7f1f3006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:38.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.759+0000 7f1f349d7700 1 --2- 172.21.15.69:0/3608819650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f30153dd0 0x7f1f3006d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:38.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.759+0000 7f1f349d7700 1 -- 172.21.15.69:0/3608819650 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f20009420 con 0x7f1f30153a00 2023-10-06T01:39:38.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.759+0000 7f1f351d8700 1 --2- 172.21.15.69:0/3608819650 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f300cea00 0x7f1f30168d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:38.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.759+0000 7f1f349d7700 1 --2- 172.21.15.69:0/3608819650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f30153a00 0x7f1f300ccdf0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1f20002000 tx=0x7f1f20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:38.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.759+0000 7f1f257fa700 1 -- 172.21.15.69:0/3608819650 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f200091a0 con 0x7f1f30153a00 2023-10-06T01:39:38.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.759+0000 7f1f257fa700 1 -- 172.21.15.69:0/3608819650 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f20010b70 con 0x7f1f30153a00 2023-10-06T01:39:38.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.759+0000 7f1f257fa700 1 -- 172.21.15.69:0/3608819650 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f2001d430 con 0x7f1f30153a00 2023-10-06T01:39:38.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.759+0000 7f1f361da700 1 -- 172.21.15.69:0/3608819650 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f300cb4f0 con 0x7f1f30153a00 2023-10-06T01:39:38.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.759+0000 7f1f361da700 1 -- 172.21.15.69:0/3608819650 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f3014fd80 con 0x7f1f30153a00 2023-10-06T01:39:38.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.760+0000 7f1f361da700 1 -- 172.21.15.69:0/3608819650 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f3004c3c0 con 0x7f1f30153a00 2023-10-06T01:39:38.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.761+0000 7f1f257fa700 1 -- 172.21.15.69:0/3608819650 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1f2001d820 con 0x7f1f30153a00 2023-10-06T01:39:38.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.761+0000 7f1f257fa700 1 --2- 172.21.15.69:0/3608819650 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1f14066f30 0x7f1f140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:38.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.761+0000 7f1f257fa700 1 -- 172.21.15.69:0/3608819650 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5958+0+0 (secure 0 0 0) 0x7f1f20086050 con 0x7f1f30153a00 2023-10-06T01:39:38.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.761+0000 7f1f351d8700 1 --2- 172.21.15.69:0/3608819650 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1f14066f30 0x7f1f140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:38.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.761+0000 7f1f351d8700 1 --2- 172.21.15.69:0/3608819650 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1f14066f30 0x7f1f140693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1f28001920 tx=0x7f1f28000f40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:38.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.765+0000 7f1f257fa700 1 -- 172.21.15.69:0/3608819650 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f200531c0 con 0x7f1f30153a00 2023-10-06T01:39:38.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:38.992+0000 7f1f361da700 1 -- 172.21.15.69:0/3608819650 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1f3015b520 con 0x7f1f30153a00 2023-10-06T01:39:39.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.609+0000 7f1f257fa700 1 -- 172.21.15.69:0/3608819650 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7f1f200567e0 con 0x7f1f30153a00 2023-10-06T01:39:39.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.612+0000 7f1f361da700 1 -- 172.21.15.69:0/3608819650 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1f14066f30 msgr2=0x7f1f140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:39.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.612+0000 7f1f361da700 1 --2- 172.21.15.69:0/3608819650 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1f14066f30 0x7f1f140693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1f28001920 tx=0x7f1f28000f40 comp rx=0 tx=0).stop 2023-10-06T01:39:39.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.612+0000 7f1f361da700 1 -- 172.21.15.69:0/3608819650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f30153a00 msgr2=0x7f1f300ccdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:39.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.612+0000 7f1f361da700 1 --2- 172.21.15.69:0/3608819650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f30153a00 0x7f1f300ccdf0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f1f20002000 tx=0x7f1f20017000 comp rx=0 tx=0).stop 2023-10-06T01:39:39.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.612+0000 7f1f361da700 1 -- 172.21.15.69:0/3608819650 shutdown_connections 2023-10-06T01:39:39.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.612+0000 7f1f361da700 1 --2- 172.21.15.69:0/3608819650 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1f14066f30 0x7f1f140693e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:39.614 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.612+0000 7f1f361da700 1 --2- 172.21.15.69:0/3608819650 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1f30153dd0 0x7f1f3006d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:39.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.612+0000 7f1f361da700 1 --2- 172.21.15.69:0/3608819650 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1f300cea00 0x7f1f30168d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:39.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.612+0000 7f1f361da700 1 --2- 172.21.15.69:0/3608819650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1f30153a00 0x7f1f300ccdf0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:39.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.612+0000 7f1f361da700 1 -- 172.21.15.69:0/3608819650 >> 172.21.15.69:0/3608819650 conn(0x7f1f300703a0 msgr2=0x7f1f300ceea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:39.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.612+0000 7f1f361da700 1 -- 172.21.15.69:0/3608819650 shutdown_connections 2023-10-06T01:39:39.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.614+0000 7f1f361da700 1 -- 172.21.15.69:0/3608819650 wait complete. 2023-10-06T01:39:39.615 INFO:teuthology.orchestra.run.smithi069.stderr:new fs with metadata pool 5 and data pool 6 2023-10-06T01:39:39.627 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:39:39.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.741+0000 7f8bf68ef700 1 Processor -- start 2023-10-06T01:39:39.742 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.741+0000 7f8bf68ef700 1 -- start start 2023-10-06T01:39:39.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.742+0000 7f8bf68ef700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8bf015a7d0 0x7f8bf0158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:39.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.742+0000 7f8bf68ef700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf0158c80 con 0x7f8bf01508c0 2023-10-06T01:39:39.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.742+0000 7f8bf68ef700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf0158f60 con 0x7f8bf0150c90 2023-10-06T01:39:39.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.742+0000 7f8bf68ef700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf015afc0 con 0x7f8bf015a7d0 2023-10-06T01:39:39.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.742+0000 7f8beffff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f8bf01508c0 0x7f8bf015a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:43316/0 (socket says 172.21.15.69:43316) 2023-10-06T01:39:39.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.742+0000 7f8beffff700 1 -- 172.21.15.69:0/3065248278 learned_addr learned my addr 172.21.15.69:0/3065248278 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:39.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.742+0000 7f8bef7fe700 1 --2- 172.21.15.69:0/3065248278 >> v2:172.21.15.88:3300/0 conn(0x7f8bf015a7d0 0x7f8bf0158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:39.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8beeffd700 1 -- 172.21.15.69:0/3065248278 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1109583605 0 0) 0x7f8bf0158c80 con 0x7f8bf01508c0 2023-10-06T01:39:39.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8beeffd700 1 -- 172.21.15.69:0/3065248278 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bd8003570 con 0x7f8bf01508c0 2023-10-06T01:39:39.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8beeffd700 1 -- 172.21.15.69:0/3065248278 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1857020435 0 0) 0x7f8bf0158f60 con 0x7f8bf0150c90 2023-10-06T01:39:39.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8beeffd700 1 -- 172.21.15.69:0/3065248278 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8bf0158c80 con 0x7f8bf0150c90 2023-10-06T01:39:39.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8beeffd700 1 -- 172.21.15.69:0/3065248278 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 749192813 0 0) 0x7f8bd8003570 con 0x7f8bf01508c0 2023-10-06T01:39:39.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8beeffd700 1 -- 172.21.15.69:0/3065248278 >> v2:172.21.15.88:3300/0 conn(0x7f8bf015a7d0 msgr2=0x7f8bf0158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:39.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8beeffd700 1 --2- 172.21.15.69:0/3065248278 >> v2:172.21.15.88:3300/0 conn(0x7f8bf015a7d0 0x7f8bf0158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:39.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8beeffd700 1 -- 172.21.15.69:0/3065248278 >> v1:172.21.15.88:6789/0 conn(0x7f8bf0150c90 legacy=0x7f8bf0154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:39.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8beeffd700 1 -- 172.21.15.69:0/3065248278 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf0159240 con 0x7f8bf01508c0 2023-10-06T01:39:39.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8beeffd700 1 -- 172.21.15.69:0/3065248278 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f8be0001470 con 0x7f8bf01508c0 2023-10-06T01:39:39.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8bef7fe700 1 --2- 172.21.15.69:0/3065248278 >> v2:172.21.15.88:3300/0 conn(0x7f8bf015a7d0 0x7f8bf0158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:39.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8beeffd700 1 -- 172.21.15.69:0/3065248278 >> v1:172.21.15.69:6789/0 conn(0x7f8bf01508c0 legacy=0x7f8bf015a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:39.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8beeffd700 1 --2- 172.21.15.69:0/3065248278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8bd8003bf0 0x7f8bd8003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:39.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8beeffd700 1 --2- 172.21.15.69:0/3065248278 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8bd8004810 0x7f8bd8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:39.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8beeffd700 1 --2- 172.21.15.69:0/3065248278 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bd80051c0 0x7f8bd800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:39.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8beeffd700 1 -- 172.21.15.69:0/3065248278 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd800c080 con 0x7f8bd80051c0 2023-10-06T01:39:39.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8beeffd700 1 -- 172.21.15.69:0/3065248278 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd800c1f0 con 0x7f8bd8003bf0 2023-10-06T01:39:39.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8beeffd700 1 -- 172.21.15.69:0/3065248278 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bd800c3b0 con 0x7f8bd8004810 2023-10-06T01:39:39.748 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8bf4e8c700 1 --2- 172.21.15.69:0/3065248278 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bd80051c0 0x7f8bd800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:39.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8beffff700 1 --2- 172.21.15.69:0/3065248278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8bd8003bf0 0x7f8bd8003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:39.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8bef7fe700 1 --2- 172.21.15.69:0/3065248278 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8bd8004810 0x7f8bd8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:39.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8bf4e8c700 1 -- 172.21.15.69:0/3065248278 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8bd8004810 msgr2=0x7f8bd8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:39.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8bf4e8c700 1 --2- 172.21.15.69:0/3065248278 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8bd8004810 0x7f8bd8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:39.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8bf4e8c700 1 -- 172.21.15.69:0/3065248278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8bd8003bf0 msgr2=0x7f8bd8003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:39.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8bf4e8c700 1 --2- 172.21.15.69:0/3065248278 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8bd8003bf0 0x7f8bd8003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:39.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8bf4e8c700 1 -- 172.21.15.69:0/3065248278 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd8003570 con 0x7f8bd80051c0 2023-10-06T01:39:39.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8bf4e8c700 1 -- 172.21.15.69:0/3065248278 reap_dead start 2023-10-06T01:39:39.749 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8bf4e8c700 1 --2- 172.21.15.69:0/3065248278 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bd80051c0 0x7f8bd800ba60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8be8002120 tx=0x7f8be80017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=545a7e0fb0abfdc0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:39.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.743+0000 7f8beeffd700 1 -- 172.21.15.69:0/3065248278 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be800c980 con 0x7f8bd80051c0 2023-10-06T01:39:39.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.744+0000 7f8beeffd700 1 -- 172.21.15.69:0/3065248278 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be800cae0 con 0x7f8bd80051c0 2023-10-06T01:39:39.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.744+0000 7f8beeffd700 1 -- 172.21.15.69:0/3065248278 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be800ce80 con 0x7f8bd80051c0 2023-10-06T01:39:39.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.744+0000 7f8bf68ef700 1 -- 172.21.15.69:0/3065248278 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bd80051c0 msgr2=0x7f8bd800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:39.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.744+0000 7f8bf68ef700 1 --2- 172.21.15.69:0/3065248278 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bd80051c0 0x7f8bd800ba60 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f8be8002120 tx=0x7f8be80017a0 comp rx=0 tx=0).stop 2023-10-06T01:39:39.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.744+0000 7f8bf68ef700 1 -- 172.21.15.69:0/3065248278 shutdown_connections 2023-10-06T01:39:39.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.744+0000 7f8bf68ef700 1 --2- 172.21.15.69:0/3065248278 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bd80051c0 0x7f8bd800ba60 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:39.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.744+0000 7f8bf68ef700 1 -- 172.21.15.69:0/3065248278 >> 172.21.15.69:0/3065248278 conn(0x7f8bf00cded0 msgr2=0x7f8bf006add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:39.750 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.744+0000 7f8bf68ef700 1 -- 172.21.15.69:0/3065248278 shutdown_connections 2023-10-06T01:39:39.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.744+0000 7f8bf68ef700 1 -- 172.21.15.69:0/3065248278 wait complete. 2023-10-06T01:39:39.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.745+0000 7f8bf68ef700 1 Processor -- start 2023-10-06T01:39:39.751 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.745+0000 7f8bf68ef700 1 -- start start 2023-10-06T01:39:39.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.746+0000 7f8bf68ef700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bd80051c0 0x7f8bf014ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:39.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.746+0000 7f8bf68ef700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8bf00cbf50 0x7f8bf0153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:39.753 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.746+0000 7f8bf68ef700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8bf00cc3c0 0x7f8bf0153850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:39.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.746+0000 7f8bf68ef700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf0167500 con 0x7f8bd80051c0 2023-10-06T01:39:39.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.746+0000 7f8bf68ef700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf0167700 con 0x7f8bf00cc3c0 2023-10-06T01:39:39.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.746+0000 7f8bf68ef700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf01679e0 con 0x7f8bf00cbf50 2023-10-06T01:39:39.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.746+0000 7f8beffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bd80051c0 0x7f8bf014ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:39.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.746+0000 7f8beffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bd80051c0 0x7f8bf014ee20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58676/0 (socket says 172.21.15.69:58676) 2023-10-06T01:39:39.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.746+0000 7f8beffff700 1 -- 172.21.15.69:0/1419740531 learned_addr learned my addr 172.21.15.69:0/1419740531 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:39.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.746+0000 7f8beffff700 1 -- 172.21.15.69:0/1419740531 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8bf00cbf50 msgr2=0x7f8bf0153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:39.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.746+0000 7f8beffff700 1 --2- 172.21.15.69:0/1419740531 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8bf00cbf50 0x7f8bf0153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:39.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.746+0000 7f8beffff700 1 -- 172.21.15.69:0/1419740531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8bf00cc3c0 msgr2=0x7f8bf0153850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:39.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.746+0000 7f8beffff700 1 --2- 172.21.15.69:0/1419740531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8bf00cc3c0 0x7f8bf0153850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:39.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.746+0000 7f8beffff700 1 -- 172.21.15.69:0/1419740531 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf0167cc0 con 0x7f8bd80051c0 2023-10-06T01:39:39.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.747+0000 7f8beffff700 1 --2- 172.21.15.69:0/1419740531 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bd80051c0 0x7f8bf014ee20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8be00073c0 tx=0x7f8be0001df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:39.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.747+0000 7f8bd7fff700 1 -- 172.21.15.69:0/1419740531 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be0018030 con 0x7f8bd80051c0 2023-10-06T01:39:39.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.747+0000 7f8bd7fff700 1 -- 172.21.15.69:0/1419740531 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be0007830 con 0x7f8bd80051c0 2023-10-06T01:39:39.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.747+0000 7f8bf68ef700 1 -- 172.21.15.69:0/1419740531 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf0167fa0 con 0x7f8bd80051c0 2023-10-06T01:39:39.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.747+0000 7f8bd7fff700 1 -- 172.21.15.69:0/1419740531 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be000fb00 con 0x7f8bd80051c0 2023-10-06T01:39:39.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.747+0000 7f8bf68ef700 1 -- 172.21.15.69:0/1419740531 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf014f360 con 0x7f8bd80051c0 2023-10-06T01:39:39.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.748+0000 7f8bf68ef700 1 -- 172.21.15.69:0/1419740531 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf004c3c0 con 0x7f8bd80051c0 2023-10-06T01:39:39.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.748+0000 7f8bd7fff700 1 -- 172.21.15.69:0/1419740531 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8be001b070 con 0x7f8bd80051c0 2023-10-06T01:39:39.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.748+0000 7f8bd7fff700 1 --2- 172.21.15.69:0/1419740531 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8bdc066f30 0x7f8bdc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:39.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.748+0000 7f8bd7fff700 1 -- 172.21.15.69:0/1419740531 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8be0019070 con 0x7f8bd80051c0 2023-10-06T01:39:39.755 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.748+0000 7f8bef7fe700 1 --2- 172.21.15.69:0/1419740531 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8bdc066f30 0x7f8bdc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:39.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.749+0000 7f8bef7fe700 1 --2- 172.21.15.69:0/1419740531 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8bdc066f30 0x7f8bdc0693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8be4009170 tx=0x7f8be40091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:39.756 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.753+0000 7f8bd7fff700 1 -- 172.21.15.69:0/1419740531 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8be0051580 con 0x7f8bd80051c0 2023-10-06T01:39:39.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.937+0000 7f8bf68ef700 1 -- 172.21.15.69:0/1419740531 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8bf0159520 con 0x7f8bd80051c0 2023-10-06T01:39:39.938 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.938+0000 7f8bd7fff700 1 -- 172.21.15.69:0/1419740531 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16831 (secure 0 0 0) 0x7f8be0054ba0 con 0x7f8bd80051c0 2023-10-06T01:39:39.938 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:39.939 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":34,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:39:38.992847+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:38:43.046056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:39:37.033167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T01:39:37.950855+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:39:39.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.940+0000 7f8bf68ef700 1 -- 172.21.15.69:0/1419740531 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8bdc066f30 msgr2=0x7f8bdc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:39.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.940+0000 7f8bf68ef700 1 --2- 172.21.15.69:0/1419740531 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8bdc066f30 0x7f8bdc0693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8be4009170 tx=0x7f8be40091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:39.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.940+0000 7f8bf68ef700 1 -- 172.21.15.69:0/1419740531 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bd80051c0 msgr2=0x7f8bf014ee20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:39.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.940+0000 7f8bf68ef700 1 --2- 172.21.15.69:0/1419740531 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bd80051c0 0x7f8bf014ee20 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8be00073c0 tx=0x7f8be0001df0 comp rx=0 tx=0).stop 2023-10-06T01:39:39.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.940+0000 7f8bf68ef700 1 -- 172.21.15.69:0/1419740531 shutdown_connections 2023-10-06T01:39:39.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.940+0000 7f8bf68ef700 1 --2- 172.21.15.69:0/1419740531 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8bdc066f30 0x7f8bdc0693e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:39.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.940+0000 7f8bf68ef700 1 --2- 172.21.15.69:0/1419740531 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8bf00cc3c0 0x7f8bf0153850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:39.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.940+0000 7f8bf68ef700 1 --2- 172.21.15.69:0/1419740531 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8bd80051c0 0x7f8bf014ee20 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:39.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.940+0000 7f8bf68ef700 1 --2- 172.21.15.69:0/1419740531 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8bf00cbf50 0x7f8bf0153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:39.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.940+0000 7f8bf68ef700 1 -- 172.21.15.69:0/1419740531 >> 172.21.15.69:0/1419740531 conn(0x7f8bf00cded0 msgr2=0x7f8bf0158460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:39.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.940+0000 7f8bf68ef700 1 -- 172.21.15.69:0/1419740531 shutdown_connections 2023-10-06T01:39:39.941 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:39.940+0000 7f8bf68ef700 1 -- 172.21.15.69:0/1419740531 wait complete. 2023-10-06T01:39:39.954 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:39:40.067 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.067+0000 7f04427e4700 1 Processor -- start 2023-10-06T01:39:40.068 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.067+0000 7f04427e4700 1 -- start start 2023-10-06T01:39:40.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.068+0000 7f04427e4700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f043c15de50 0x7f043c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:40.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.068+0000 7f04427e4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f043c0cef40 0x7f043c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:40.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.068+0000 7f04427e4700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f043c0cf3c0 con 0x7f043c153c30 2023-10-06T01:39:40.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.068+0000 7f04427e4700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f043c15afd0 con 0x7f043c15de50 2023-10-06T01:39:40.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.068+0000 7f04427e4700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f043c15b2b0 con 0x7f043c0cef40 2023-10-06T01:39:40.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.068+0000 7f0440fe1700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f043c15de50 0x7f043c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:40.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.068+0000 7f0440fe1700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f043c15de50 0x7f043c0cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58684/0 (socket says 172.21.15.69:58684) 2023-10-06T01:39:40.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.068+0000 7f0441fe3700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f043c0cef40 0x7f043c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:40.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.068+0000 7f0440fe1700 1 -- 172.21.15.69:0/273375843 learned_addr learned my addr 172.21.15.69:0/273375843 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:40.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.068+0000 7f0440fe1700 1 -- 172.21.15.69:0/273375843 >> v2:172.21.15.88:3300/0 conn(0x7f043c0cef40 msgr2=0x7f043c15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:40.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.068+0000 7f0440fe1700 1 --2- 172.21.15.69:0/273375843 >> v2:172.21.15.88:3300/0 conn(0x7f043c0cef40 0x7f043c15c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:40.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.068+0000 7f0440fe1700 1 -- 172.21.15.69:0/273375843 >> v1:172.21.15.88:6789/0 conn(0x7f043c153c30 legacy=0x7f043c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:40.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.068+0000 7f0433fff700 1 -- 172.21.15.69:0/273375843 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279677115 0 0) 0x7f043c0cf3c0 con 0x7f043c153c30 2023-10-06T01:39:40.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.068+0000 7f0440fe1700 1 -- 172.21.15.69:0/273375843 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043c15b590 con 0x7f043c15de50 2023-10-06T01:39:40.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.068+0000 7f0440fe1700 1 --2- 172.21.15.69:0/273375843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f043c15de50 0x7f043c0cea00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f043c0cdab0 tx=0x7f042c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a64eabc254c67d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:40.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.069+0000 7f0433fff700 1 -- 172.21.15.69:0/273375843 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c009e70 con 0x7f043c15de50 2023-10-06T01:39:40.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.069+0000 7f0433fff700 1 -- 172.21.15.69:0/273375843 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f042c00b860 con 0x7f043c15de50 2023-10-06T01:39:40.071 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.069+0000 7f0433fff700 1 -- 172.21.15.69:0/273375843 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f042c00bc00 con 0x7f043c15de50 2023-10-06T01:39:40.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.069+0000 7f04427e4700 1 -- 172.21.15.69:0/273375843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f043c15de50 msgr2=0x7f043c0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:40.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.069+0000 7f04427e4700 1 --2- 172.21.15.69:0/273375843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f043c15de50 0x7f043c0cea00 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f043c0cdab0 tx=0x7f042c009250 comp rx=0 tx=0).stop 2023-10-06T01:39:40.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.069+0000 7f04427e4700 1 -- 172.21.15.69:0/273375843 shutdown_connections 2023-10-06T01:39:40.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.069+0000 7f04427e4700 1 --2- 172.21.15.69:0/273375843 >> v2:172.21.15.88:3300/0 conn(0x7f043c0cef40 0x7f043c15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:40.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.069+0000 7f04427e4700 1 --2- 172.21.15.69:0/273375843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f043c15de50 0x7f043c0cea00 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:40.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.069+0000 7f04427e4700 1 -- 172.21.15.69:0/273375843 >> 172.21.15.69:0/273375843 conn(0x7f043c0703a0 msgr2=0x7f043c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:40.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.069+0000 7f04427e4700 1 -- 172.21.15.69:0/273375843 shutdown_connections 2023-10-06T01:39:40.072 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.069+0000 7f04427e4700 1 -- 172.21.15.69:0/273375843 wait complete. 2023-10-06T01:39:40.075 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.070+0000 7f04427e4700 1 Processor -- start 2023-10-06T01:39:40.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.070+0000 7f04427e4700 1 -- start start 2023-10-06T01:39:40.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.071+0000 7f04427e4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f043c0cef40 0x7f043c143d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:40.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.071+0000 7f04427e4700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f043c153c30 0x7f043c0c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:40.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.071+0000 7f04427e4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f043c15de50 0x7f043c0b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:40.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.071+0000 7f04427e4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0b4080 con 0x7f043c0cef40 2023-10-06T01:39:40.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.071+0000 7f04427e4700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0b3470 con 0x7f043c15de50 2023-10-06T01:39:40.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.071+0000 7f04427e4700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f043c0b3750 con 0x7f043c153c30 2023-10-06T01:39:40.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.071+0000 7f04417e2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f043c0cef40 0x7f043c143d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:40.076 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.071+0000 7f04417e2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f043c0cef40 0x7f043c143d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58696/0 (socket says 172.21.15.69:58696) 2023-10-06T01:39:40.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.071+0000 7f04417e2700 1 -- 172.21.15.69:0/803804425 learned_addr learned my addr 172.21.15.69:0/803804425 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:40.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.071+0000 7f0440fe1700 1 --2- 172.21.15.69:0/803804425 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f043c153c30 0x7f043c0c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:40.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.071+0000 7f0441fe3700 1 --2- 172.21.15.69:0/803804425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f043c15de50 0x7f043c0b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:40.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.072+0000 7f04417e2700 1 -- 172.21.15.69:0/803804425 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f043c153c30 msgr2=0x7f043c0c9950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:40.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.072+0000 7f04417e2700 1 --2- 172.21.15.69:0/803804425 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f043c153c30 0x7f043c0c9950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:40.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.072+0000 7f04417e2700 1 -- 172.21.15.69:0/803804425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f043c15de50 msgr2=0x7f043c0b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:40.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.072+0000 7f04417e2700 1 --2- 172.21.15.69:0/803804425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f043c15de50 0x7f043c0b4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:40.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.072+0000 7f04417e2700 1 -- 172.21.15.69:0/803804425 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042c0094f0 con 0x7f043c0cef40 2023-10-06T01:39:40.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.072+0000 7f04417e2700 1 --2- 172.21.15.69:0/803804425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f043c0cef40 0x7f043c143d60 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f043800c530 tx=0x7f043800c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:40.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.072+0000 7f04317fa700 1 -- 172.21.15.69:0/803804425 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0438011590 con 0x7f043c0cef40 2023-10-06T01:39:40.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.072+0000 7f04317fa700 1 -- 172.21.15.69:0/803804425 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0438011710 con 0x7f043c0cef40 2023-10-06T01:39:40.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.072+0000 7f04427e4700 1 -- 172.21.15.69:0/803804425 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f043c0b3a30 con 0x7f043c0cef40 2023-10-06T01:39:40.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.072+0000 7f04317fa700 1 -- 172.21.15.69:0/803804425 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0438011ad0 con 0x7f043c0cef40 2023-10-06T01:39:40.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.072+0000 7f04427e4700 1 -- 172.21.15.69:0/803804425 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f043c16abe0 con 0x7f043c0cef40 2023-10-06T01:39:40.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.073+0000 7f04427e4700 1 -- 172.21.15.69:0/803804425 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f043c04c3c0 con 0x7f043c0cef40 2023-10-06T01:39:40.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.073+0000 7f04317fa700 1 -- 172.21.15.69:0/803804425 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f043801b3b0 con 0x7f043c0cef40 2023-10-06T01:39:40.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.074+0000 7f04317fa700 1 --2- 172.21.15.69:0/803804425 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0420066f30 0x7f04200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:40.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.074+0000 7f04317fa700 1 -- 172.21.15.69:0/803804425 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0438083b20 con 0x7f043c0cef40 2023-10-06T01:39:40.078 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.074+0000 7f0440fe1700 1 --2- 172.21.15.69:0/803804425 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0420066f30 0x7f04200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:40.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.074+0000 7f0440fe1700 1 --2- 172.21.15.69:0/803804425 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0420066f30 0x7f04200693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f043c0cdab0 tx=0x7f042c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:40.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.078+0000 7f04317fa700 1 -- 172.21.15.69:0/803804425 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0438050c30 con 0x7f043c0cef40 2023-10-06T01:39:40.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.262+0000 7f04427e4700 1 -- 172.21.15.69:0/803804425 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f043c0cc070 con 0x7f043c0cef40 2023-10-06T01:39:40.263 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.263+0000 7f04317fa700 1 -- 172.21.15.69:0/803804425 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+16831 (secure 0 0 0) 0x7f0438017070 con 0x7f043c0cef40 2023-10-06T01:39:40.264 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:40.264 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":34,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:39:38.992847+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:38:43.046056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:39:37.033167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T01:39:37.950855+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:39:40.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.265+0000 7f04427e4700 1 -- 172.21.15.69:0/803804425 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0420066f30 msgr2=0x7f04200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:40.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.265+0000 7f04427e4700 1 --2- 172.21.15.69:0/803804425 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0420066f30 0x7f04200693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f043c0cdab0 tx=0x7f042c017000 comp rx=0 tx=0).stop 2023-10-06T01:39:40.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.265+0000 7f04427e4700 1 -- 172.21.15.69:0/803804425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f043c0cef40 msgr2=0x7f043c143d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:40.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.265+0000 7f04427e4700 1 --2- 172.21.15.69:0/803804425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f043c0cef40 0x7f043c143d60 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f043800c530 tx=0x7f043800c840 comp rx=0 tx=0).stop 2023-10-06T01:39:40.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.265+0000 7f04427e4700 1 -- 172.21.15.69:0/803804425 shutdown_connections 2023-10-06T01:39:40.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.265+0000 7f04427e4700 1 --2- 172.21.15.69:0/803804425 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0420066f30 0x7f04200693e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:40.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.265+0000 7f04427e4700 1 --2- 172.21.15.69:0/803804425 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f043c15de50 0x7f043c0b4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:40.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.265+0000 7f04427e4700 1 --2- 172.21.15.69:0/803804425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f043c0cef40 0x7f043c143d60 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:40.266 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.265+0000 7f04427e4700 1 --2- 172.21.15.69:0/803804425 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f043c153c30 0x7f043c0c9950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:40.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.265+0000 7f04427e4700 1 -- 172.21.15.69:0/803804425 >> 172.21.15.69:0/803804425 conn(0x7f043c0703a0 msgr2=0x7f043c152fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:40.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.265+0000 7f04427e4700 1 -- 172.21.15.69:0/803804425 shutdown_connections 2023-10-06T01:39:40.267 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.265+0000 7f04427e4700 1 -- 172.21.15.69:0/803804425 wait complete. 2023-10-06T01:39:40.278 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-06T01:39:40.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.396+0000 7f493cdb9700 1 Processor -- start 2023-10-06T01:39:40.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.396+0000 7f493cdb9700 1 -- start start 2023-10-06T01:39:40.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.397+0000 7f493cdb9700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4938159530 0x7f49380ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:40.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.397+0000 7f493cdb9700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49380ccfd0 con 0x7f493806dc70 2023-10-06T01:39:40.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.397+0000 7f493cdb9700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49380cf0e0 con 0x7f493806e0e0 2023-10-06T01:39:40.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.397+0000 7f493cdb9700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493815a3d0 con 0x7f4938159530 2023-10-06T01:39:40.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.397+0000 7f4935d9b700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f493806dc70 0x7f4938159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:43332/0 (socket says 172.21.15.69:43332) 2023-10-06T01:39:40.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.397+0000 7f4935d9b700 1 -- 172.21.15.69:0/523127478 learned_addr learned my addr 172.21.15.69:0/523127478 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:40.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.397+0000 7f493659c700 1 --2- 172.21.15.69:0/523127478 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4938159530 0x7f49380ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:40.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.397+0000 7f493559a700 1 -- 172.21.15.69:0/523127478 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3099008073 0 0) 0x7f49380ccfd0 con 0x7f493806dc70 2023-10-06T01:39:40.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.397+0000 7f493559a700 1 -- 172.21.15.69:0/523127478 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4920003570 con 0x7f493806dc70 2023-10-06T01:39:40.399 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.397+0000 7f493559a700 1 -- 172.21.15.69:0/523127478 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3188378950 0 0) 0x7f49380cf0e0 con 0x7f493806e0e0 2023-10-06T01:39:40.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.397+0000 7f493559a700 1 -- 172.21.15.69:0/523127478 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49380ccfd0 con 0x7f493806e0e0 2023-10-06T01:39:40.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.397+0000 7f493659c700 1 -- 172.21.15.69:0/523127478 >> v1:172.21.15.88:6789/0 conn(0x7f493806e0e0 legacy=0x7f49380cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:40.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.397+0000 7f493659c700 1 -- 172.21.15.69:0/523127478 >> v1:172.21.15.69:6789/0 conn(0x7f493806dc70 legacy=0x7f4938159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:40.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.397+0000 7f493559a700 1 -- 172.21.15.69:0/523127478 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3128570685 0 0) 0x7f4920003570 con 0x7f493806dc70 2023-10-06T01:39:40.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.397+0000 7f493659c700 1 -- 172.21.15.69:0/523127478 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f493815a6b0 con 0x7f4938159530 2023-10-06T01:39:40.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.398+0000 7f493659c700 1 --2- 172.21.15.69:0/523127478 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4938159530 0x7f49380ceba0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4928009910 tx=0x7f49280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=677174f575a721d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:40.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.398+0000 7f493559a700 1 -- 172.21.15.69:0/523127478 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f492c001470 con 0x7f4938159530 2023-10-06T01:39:40.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.398+0000 7f493559a700 1 -- 172.21.15.69:0/523127478 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4928011420 con 0x7f4938159530 2023-10-06T01:39:40.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.398+0000 7f493559a700 1 -- 172.21.15.69:0/523127478 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49280117a0 con 0x7f4938159530 2023-10-06T01:39:40.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.398+0000 7f493cdb9700 1 -- 172.21.15.69:0/523127478 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4938159530 msgr2=0x7f49380ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:40.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.398+0000 7f493cdb9700 1 --2- 172.21.15.69:0/523127478 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4938159530 0x7f49380ceba0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4928009910 tx=0x7f49280091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:40.400 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.398+0000 7f493cdb9700 1 -- 172.21.15.69:0/523127478 shutdown_connections 2023-10-06T01:39:40.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.398+0000 7f493cdb9700 1 --2- 172.21.15.69:0/523127478 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f4938159530 0x7f49380ceba0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:40.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.398+0000 7f493cdb9700 1 -- 172.21.15.69:0/523127478 >> 172.21.15.69:0/523127478 conn(0x7f49380703a0 msgr2=0x7f49380707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:40.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.398+0000 7f493cdb9700 1 -- 172.21.15.69:0/523127478 shutdown_connections 2023-10-06T01:39:40.401 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.398+0000 7f493cdb9700 1 -- 172.21.15.69:0/523127478 wait complete. 2023-10-06T01:39:40.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.399+0000 7f493cdb9700 1 Processor -- start 2023-10-06T01:39:40.403 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.400+0000 7f493cdb9700 1 -- start start 2023-10-06T01:39:40.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.400+0000 7f493cdb9700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f493806dc70 0x7f4938154710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:40.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.400+0000 7f493cdb9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f493806e0e0 0x7f493816e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:40.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.400+0000 7f493cdb9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4938159530 0x7f49380cf860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:40.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.400+0000 7f493cdb9700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49380b4370 con 0x7f4938159530 2023-10-06T01:39:40.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.400+0000 7f493cdb9700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4938154c50 con 0x7f493806e0e0 2023-10-06T01:39:40.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.400+0000 7f493cdb9700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f493816ee40 con 0x7f493806dc70 2023-10-06T01:39:40.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.400+0000 7f4936d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4938159530 0x7f49380cf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:40.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.400+0000 7f4936d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4938159530 0x7f49380cf860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58704/0 (socket says 172.21.15.69:58704) 2023-10-06T01:39:40.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.400+0000 7f4936d9d700 1 -- 172.21.15.69:0/1686286941 learned_addr learned my addr 172.21.15.69:0/1686286941 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:40.404 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.401+0000 7f4935d9b700 1 --2- 172.21.15.69:0/1686286941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f493806e0e0 0x7f493816e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:40.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.401+0000 7f493659c700 1 --2- 172.21.15.69:0/1686286941 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f493806dc70 0x7f4938154710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:40.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.401+0000 7f4936d9d700 1 -- 172.21.15.69:0/1686286941 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f493806dc70 msgr2=0x7f4938154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:40.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.401+0000 7f4936d9d700 1 --2- 172.21.15.69:0/1686286941 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f493806dc70 0x7f4938154710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:40.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.401+0000 7f4936d9d700 1 -- 172.21.15.69:0/1686286941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f493806e0e0 msgr2=0x7f493816e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:40.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.401+0000 7f4936d9d700 1 --2- 172.21.15.69:0/1686286941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f493806e0e0 0x7f493816e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:40.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.401+0000 7f4936d9d700 1 -- 172.21.15.69:0/1686286941 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4928009420 con 0x7f4938159530 2023-10-06T01:39:40.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.401+0000 7f493659c700 1 --2- 172.21.15.69:0/1686286941 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f493806dc70 0x7f4938154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:40.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.401+0000 7f4936d9d700 1 --2- 172.21.15.69:0/1686286941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4938159530 0x7f49380cf860 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f493000c910 tx=0x7f4930007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:40.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.401+0000 7f49267fc700 1 -- 172.21.15.69:0/1686286941 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4930012630 con 0x7f4938159530 2023-10-06T01:39:40.405 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.401+0000 7f49267fc700 1 -- 172.21.15.69:0/1686286941 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49300127b0 con 0x7f4938159530 2023-10-06T01:39:40.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.401+0000 7f493cdb9700 1 -- 172.21.15.69:0/1686286941 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49380b3480 con 0x7f4938159530 2023-10-06T01:39:40.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.401+0000 7f49267fc700 1 -- 172.21.15.69:0/1686286941 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4930012b70 con 0x7f4938159530 2023-10-06T01:39:40.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.401+0000 7f493cdb9700 1 -- 172.21.15.69:0/1686286941 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49380b3a40 con 0x7f4938159530 2023-10-06T01:39:40.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.402+0000 7f493cdb9700 1 -- 172.21.15.69:0/1686286941 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f493804c3c0 con 0x7f4938159530 2023-10-06T01:39:40.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.402+0000 7f49267fc700 1 -- 172.21.15.69:0/1686286941 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f493001b400 con 0x7f4938159530 2023-10-06T01:39:40.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.403+0000 7f49267fc700 1 --2- 172.21.15.69:0/1686286941 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4918066f30 0x7f49180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:40.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.403+0000 7f493659c700 1 --2- 172.21.15.69:0/1686286941 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4918066f30 0x7f49180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:40.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.403+0000 7f49267fc700 1 -- 172.21.15.69:0/1686286941 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4930084aa0 con 0x7f4938159530 2023-10-06T01:39:40.406 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.403+0000 7f493659c700 1 --2- 172.21.15.69:0/1686286941 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4918066f30 0x7f49180693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f49280091e0 tx=0x7f4928016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:40.407 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.407+0000 7f49267fc700 1 -- 172.21.15.69:0/1686286941 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4930051bb0 con 0x7f4938159530 2023-10-06T01:39:40.635 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:40.634+0000 7f493cdb9700 1 -- 172.21.15.69:0/1686286941 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f493815a990 con 0x7f4938159530 2023-10-06T01:39:41.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.621+0000 7f49267fc700 1 -- 172.21.15.69:0/1686286941 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4930016020 con 0x7f4938159530 2023-10-06T01:39:41.624 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.624+0000 7f493cdb9700 1 -- 172.21.15.69:0/1686286941 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4918066f30 msgr2=0x7f49180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:41.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.624+0000 7f493cdb9700 1 --2- 172.21.15.69:0/1686286941 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4918066f30 0x7f49180693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f49280091e0 tx=0x7f4928016000 comp rx=0 tx=0).stop 2023-10-06T01:39:41.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.624+0000 7f493cdb9700 1 -- 172.21.15.69:0/1686286941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4938159530 msgr2=0x7f49380cf860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:41.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.624+0000 7f493cdb9700 1 --2- 172.21.15.69:0/1686286941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4938159530 0x7f49380cf860 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f493000c910 tx=0x7f4930007f90 comp rx=0 tx=0).stop 2023-10-06T01:39:41.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.624+0000 7f493cdb9700 1 -- 172.21.15.69:0/1686286941 shutdown_connections 2023-10-06T01:39:41.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.624+0000 7f493cdb9700 1 --2- 172.21.15.69:0/1686286941 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4918066f30 0x7f49180693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:41.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.624+0000 7f493cdb9700 1 --2- 172.21.15.69:0/1686286941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4938159530 0x7f49380cf860 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:41.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.624+0000 7f493cdb9700 1 --2- 172.21.15.69:0/1686286941 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f493806dc70 0x7f4938154710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:41.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.624+0000 7f493cdb9700 1 --2- 172.21.15.69:0/1686286941 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f493806e0e0 0x7f493816e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:41.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.624+0000 7f493cdb9700 1 -- 172.21.15.69:0/1686286941 >> 172.21.15.69:0/1686286941 conn(0x7f49380703a0 msgr2=0x7f49380b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:41.625 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.624+0000 7f493cdb9700 1 -- 172.21.15.69:0/1686286941 shutdown_connections 2023-10-06T01:39:41.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.624+0000 7f493cdb9700 1 -- 172.21.15.69:0/1686286941 wait complete. 2023-10-06T01:39:41.639 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-06T01:39:41.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.761+0000 7f13b98a5700 1 Processor -- start 2023-10-06T01:39:41.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.761+0000 7f13b98a5700 1 -- start start 2023-10-06T01:39:41.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.762+0000 7f13b98a5700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f13b406dc70 0x7f13b4159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:41.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.762+0000 7f13b98a5700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f13b406e0e0 0x7f13b40cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:41.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.762+0000 7f13b98a5700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13b40ccfd0 con 0x7f13b4159530 2023-10-06T01:39:41.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.762+0000 7f13b98a5700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13b415a3d0 con 0x7f13b406e0e0 2023-10-06T01:39:41.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.762+0000 7f13b98a5700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b415a6b0 con 0x7f13b406dc70 2023-10-06T01:39:41.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.762+0000 7f13b2ffd700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f13b4159530 0x7f13b40ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:43344/0 (socket says 172.21.15.69:43344) 2023-10-06T01:39:41.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.762+0000 7f13b2ffd700 1 -- 172.21.15.69:0/431861661 learned_addr learned my addr 172.21.15.69:0/431861661 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:41.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.762+0000 7f13b27fc700 1 --2- 172.21.15.69:0/431861661 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f13b406dc70 0x7f13b4159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:41.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.762+0000 7f13b37fe700 1 --2- 172.21.15.69:0/431861661 >> v2:172.21.15.88:3300/0 conn(0x7f13b406e0e0 0x7f13b40cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:41.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.763+0000 7f13b1ffb700 1 -- 172.21.15.69:0/431861661 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 135588672 0 0) 0x7f13b40ccfd0 con 0x7f13b4159530 2023-10-06T01:39:41.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.763+0000 7f13b1ffb700 1 -- 172.21.15.69:0/431861661 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f139c003570 con 0x7f13b4159530 2023-10-06T01:39:41.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.763+0000 7f13b27fc700 1 -- 172.21.15.69:0/431861661 >> v2:172.21.15.88:3300/0 conn(0x7f13b406e0e0 msgr2=0x7f13b40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:41.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.763+0000 7f13b27fc700 1 --2- 172.21.15.69:0/431861661 >> v2:172.21.15.88:3300/0 conn(0x7f13b406e0e0 0x7f13b40cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:41.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.763+0000 7f13b27fc700 1 -- 172.21.15.69:0/431861661 >> v1:172.21.15.69:6789/0 conn(0x7f13b4159530 legacy=0x7f13b40ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:41.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.763+0000 7f13b27fc700 1 -- 172.21.15.69:0/431861661 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13b415a990 con 0x7f13b406dc70 2023-10-06T01:39:41.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.763+0000 7f13b37fe700 1 --2- 172.21.15.69:0/431861661 >> v2:172.21.15.88:3300/0 conn(0x7f13b406e0e0 0x7f13b40cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:41.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.763+0000 7f13b27fc700 1 --2- 172.21.15.69:0/431861661 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f13b406dc70 0x7f13b4159900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f13a80098e0 tx=0x7f13a80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65832c3f7790f93a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:41.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.763+0000 7f13b1ffb700 1 -- 172.21.15.69:0/431861661 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a8011630 con 0x7f13b406dc70 2023-10-06T01:39:41.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.763+0000 7f13b1ffb700 1 -- 172.21.15.69:0/431861661 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a8011790 con 0x7f13b406dc70 2023-10-06T01:39:41.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.763+0000 7f13b1ffb700 1 -- 172.21.15.69:0/431861661 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a8011b10 con 0x7f13b406dc70 2023-10-06T01:39:41.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.764+0000 7f13b98a5700 1 -- 172.21.15.69:0/431861661 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f13b406dc70 msgr2=0x7f13b4159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:41.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.764+0000 7f13b98a5700 1 --2- 172.21.15.69:0/431861661 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f13b406dc70 0x7f13b4159900 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f13a80098e0 tx=0x7f13a80091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:41.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.764+0000 7f13b98a5700 1 -- 172.21.15.69:0/431861661 shutdown_connections 2023-10-06T01:39:41.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.764+0000 7f13b98a5700 1 --2- 172.21.15.69:0/431861661 >> v2:172.21.15.88:3300/0 conn(0x7f13b406e0e0 0x7f13b40cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:41.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.764+0000 7f13b98a5700 1 --2- 172.21.15.69:0/431861661 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f13b406dc70 0x7f13b4159900 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:41.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.764+0000 7f13b98a5700 1 -- 172.21.15.69:0/431861661 >> 172.21.15.69:0/431861661 conn(0x7f13b40703a0 msgr2=0x7f13b40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:41.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.764+0000 7f13b98a5700 1 -- 172.21.15.69:0/431861661 shutdown_connections 2023-10-06T01:39:41.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.764+0000 7f13b98a5700 1 -- 172.21.15.69:0/431861661 wait complete. 2023-10-06T01:39:41.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.765+0000 7f13b98a5700 1 Processor -- start 2023-10-06T01:39:41.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.765+0000 7f13b98a5700 1 -- start start 2023-10-06T01:39:41.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.766+0000 7f13b98a5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13b406dc70 0x7f13b41533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:41.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.766+0000 7f13b98a5700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f13b406e0e0 0x7f13b406add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:41.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.766+0000 7f13b98a5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13b4159530 0x7f13b406b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:41.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.766+0000 7f13b98a5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b40c9a70 con 0x7f13b406dc70 2023-10-06T01:39:41.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.766+0000 7f13b98a5700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13b41538f0 con 0x7f13b4159530 2023-10-06T01:39:41.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.766+0000 7f13b98a5700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13b40c9ce0 con 0x7f13b406e0e0 2023-10-06T01:39:41.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.766+0000 7f13b2ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13b406dc70 0x7f13b41533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:41.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.766+0000 7f13b2ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13b406dc70 0x7f13b41533b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58720/0 (socket says 172.21.15.69:58720) 2023-10-06T01:39:41.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.766+0000 7f13b2ffd700 1 -- 172.21.15.69:0/1509980187 learned_addr learned my addr 172.21.15.69:0/1509980187 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:41.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.766+0000 7f13b37fe700 1 --2- 172.21.15.69:0/1509980187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13b4159530 0x7f13b406b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:41.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.766+0000 7f13b27fc700 1 --2- 172.21.15.69:0/1509980187 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f13b406e0e0 0x7f13b406add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:41.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.766+0000 7f13b2ffd700 1 -- 172.21.15.69:0/1509980187 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f13b406e0e0 msgr2=0x7f13b406add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:41.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.766+0000 7f13b2ffd700 1 --2- 172.21.15.69:0/1509980187 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f13b406e0e0 0x7f13b406add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:41.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.766+0000 7f13b2ffd700 1 -- 172.21.15.69:0/1509980187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13b4159530 msgr2=0x7f13b406b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:41.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.766+0000 7f13b2ffd700 1 --2- 172.21.15.69:0/1509980187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13b4159530 0x7f13b406b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:41.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.766+0000 7f13b2ffd700 1 -- 172.21.15.69:0/1509980187 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13ac009420 con 0x7f13b406dc70 2023-10-06T01:39:41.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.766+0000 7f13b27fc700 1 --2- 172.21.15.69:0/1509980187 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f13b406e0e0 0x7f13b406add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:41.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.766+0000 7f13b2ffd700 1 --2- 172.21.15.69:0/1509980187 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13b406dc70 0x7f13b41533b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f13a400cc40 tx=0x7f13a4001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:41.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.766+0000 7f139affd700 1 -- 172.21.15.69:0/1509980187 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a400a980 con 0x7f13b406dc70 2023-10-06T01:39:41.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.766+0000 7f139affd700 1 -- 172.21.15.69:0/1509980187 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13a400aae0 con 0x7f13b406dc70 2023-10-06T01:39:41.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.766+0000 7f13b98a5700 1 -- 172.21.15.69:0/1509980187 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a8009420 con 0x7f13b406dc70 2023-10-06T01:39:41.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.766+0000 7f139affd700 1 -- 172.21.15.69:0/1509980187 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13a400ae80 con 0x7f13b406dc70 2023-10-06T01:39:41.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.766+0000 7f13b98a5700 1 -- 172.21.15.69:0/1509980187 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13b40ca2a0 con 0x7f13b406dc70 2023-10-06T01:39:41.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.767+0000 7f13b98a5700 1 -- 172.21.15.69:0/1509980187 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13b404c3c0 con 0x7f13b406dc70 2023-10-06T01:39:41.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.768+0000 7f139affd700 1 -- 172.21.15.69:0/1509980187 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f13a4007300 con 0x7f13b406dc70 2023-10-06T01:39:41.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.768+0000 7f139affd700 1 --2- 172.21.15.69:0/1509980187 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f13a0066f30 0x7f13a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:41.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.768+0000 7f139affd700 1 -- 172.21.15.69:0/1509980187 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f13a4084a60 con 0x7f13b406dc70 2023-10-06T01:39:41.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.768+0000 7f13b27fc700 1 --2- 172.21.15.69:0/1509980187 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f13a0066f30 0x7f13a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:41.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.769+0000 7f13b27fc700 1 --2- 172.21.15.69:0/1509980187 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f13a0066f30 0x7f13a00693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f13b40b66b0 tx=0x7f13a8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:41.772 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.772+0000 7f139affd700 1 -- 172.21.15.69:0/1509980187 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f13a4051bf0 con 0x7f13b406dc70 2023-10-06T01:39:41.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:41.999+0000 7f13b98a5700 1 -- 172.21.15.69:0/1509980187 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f13b415ace0 con 0x7f13b406dc70 2023-10-06T01:39:42.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.626+0000 7f139affd700 1 -- 172.21.15.69:0/1509980187 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7f13a4055210 con 0x7f13b406dc70 2023-10-06T01:39:42.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.629+0000 7f13b98a5700 1 -- 172.21.15.69:0/1509980187 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f13a0066f30 msgr2=0x7f13a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:42.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.629+0000 7f13b98a5700 1 --2- 172.21.15.69:0/1509980187 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f13a0066f30 0x7f13a00693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f13b40b66b0 tx=0x7f13a8017000 comp rx=0 tx=0).stop 2023-10-06T01:39:42.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.629+0000 7f13b98a5700 1 -- 172.21.15.69:0/1509980187 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13b406dc70 msgr2=0x7f13b41533b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:42.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.629+0000 7f13b98a5700 1 --2- 172.21.15.69:0/1509980187 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13b406dc70 0x7f13b41533b0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f13a400cc40 tx=0x7f13a4001a60 comp rx=0 tx=0).stop 2023-10-06T01:39:42.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.629+0000 7f13b98a5700 1 -- 172.21.15.69:0/1509980187 shutdown_connections 2023-10-06T01:39:42.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.629+0000 7f13b98a5700 1 --2- 172.21.15.69:0/1509980187 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f13a0066f30 0x7f13a00693e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:42.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.629+0000 7f13b98a5700 1 --2- 172.21.15.69:0/1509980187 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f13b4159530 0x7f13b406b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:42.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.629+0000 7f13b98a5700 1 --2- 172.21.15.69:0/1509980187 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f13b406dc70 0x7f13b41533b0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:42.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.629+0000 7f13b98a5700 1 --2- 172.21.15.69:0/1509980187 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f13b406e0e0 0x7f13b406add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:42.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.629+0000 7f13b98a5700 1 -- 172.21.15.69:0/1509980187 >> 172.21.15.69:0/1509980187 conn(0x7f13b40703a0 msgr2=0x7f13b4153c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:42.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.629+0000 7f13b98a5700 1 -- 172.21.15.69:0/1509980187 shutdown_connections 2023-10-06T01:39:42.630 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.629+0000 7f13b98a5700 1 -- 172.21.15.69:0/1509980187 wait complete. 2023-10-06T01:39:42.642 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:39:42.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.757+0000 7f40853c9700 1 Processor -- start 2023-10-06T01:39:42.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.757+0000 7f40853c9700 1 -- start start 2023-10-06T01:39:42.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.758+0000 7f40853c9700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f408015a5d0 0x7f4080156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:42.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.758+0000 7f40853c9700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f408015ae40 con 0x7f40800cb970 2023-10-06T01:39:42.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.758+0000 7f40853c9700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f408015ab60 con 0x7f40800cb5a0 2023-10-06T01:39:42.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.758+0000 7f40853c9700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40800ce0f0 con 0x7f408015a5d0 2023-10-06T01:39:42.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.758+0000 7f407e7fc700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f40800cb970 0x7f4080159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:43350/0 (socket says 172.21.15.69:43350) 2023-10-06T01:39:42.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.758+0000 7f407e7fc700 1 -- 172.21.15.69:0/1232760483 learned_addr learned my addr 172.21.15.69:0/1232760483 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:42.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.758+0000 7f407dffb700 1 -- 172.21.15.69:0/1232760483 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2913898696 0 0) 0x7f408015ae40 con 0x7f40800cb970 2023-10-06T01:39:42.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.758+0000 7f407f7fe700 1 --2- 172.21.15.69:0/1232760483 >> v2:172.21.15.88:3300/0 conn(0x7f408015a5d0 0x7f4080156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:42.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.758+0000 7f407dffb700 1 -- 172.21.15.69:0/1232760483 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4068003570 con 0x7f40800cb970 2023-10-06T01:39:42.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.758+0000 7f407dffb700 1 -- 172.21.15.69:0/1232760483 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3410391757 0 0) 0x7f4068003570 con 0x7f40800cb970 2023-10-06T01:39:42.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.758+0000 7f407dffb700 1 -- 172.21.15.69:0/1232760483 >> v2:172.21.15.88:3300/0 conn(0x7f408015a5d0 msgr2=0x7f4080156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:42.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.758+0000 7f407dffb700 1 --2- 172.21.15.69:0/1232760483 >> v2:172.21.15.88:3300/0 conn(0x7f408015a5d0 0x7f4080156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:42.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.758+0000 7f407dffb700 1 -- 172.21.15.69:0/1232760483 >> v1:172.21.15.88:6789/0 conn(0x7f40800cb5a0 legacy=0x7f40800cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:42.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.758+0000 7f407dffb700 1 -- 172.21.15.69:0/1232760483 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40800ccf00 con 0x7f40800cb970 2023-10-06T01:39:42.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.758+0000 7f407dffb700 1 -- 172.21.15.69:0/1232760483 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f4074001470 con 0x7f40800cb970 2023-10-06T01:39:42.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.758+0000 7f407dffb700 1 -- 172.21.15.69:0/1232760483 >> v1:172.21.15.69:6789/0 conn(0x7f40800cb970 legacy=0x7f4080159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:42.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.758+0000 7f407dffb700 1 --2- 172.21.15.69:0/1232760483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4068003a60 0x7f4068003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:42.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.758+0000 7f407dffb700 1 --2- 172.21.15.69:0/1232760483 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4068004810 0x7f4068004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:42.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.758+0000 7f407dffb700 1 --2- 172.21.15.69:0/1232760483 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f40680051c0 0x7f406800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:42.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.758+0000 7f407dffb700 1 -- 172.21.15.69:0/1232760483 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40800ce0f0 con 0x7f4068004810 2023-10-06T01:39:42.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.758+0000 7f407dffb700 1 -- 172.21.15.69:0/1232760483 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f406800c0d0 con 0x7f4068003a60 2023-10-06T01:39:42.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.758+0000 7f407dffb700 1 -- 172.21.15.69:0/1232760483 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f406800c290 con 0x7f40680051c0 2023-10-06T01:39:42.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.759+0000 7f407e7fc700 1 --2- 172.21.15.69:0/1232760483 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4068004810 0x7f4068004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:42.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.759+0000 7f407effd700 1 --2- 172.21.15.69:0/1232760483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4068003a60 0x7f4068003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:42.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.759+0000 7f407f7fe700 1 --2- 172.21.15.69:0/1232760483 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f40680051c0 0x7f406800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:42.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.759+0000 7f407e7fc700 1 -- 172.21.15.69:0/1232760483 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f40680051c0 msgr2=0x7f406800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:42.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.759+0000 7f407e7fc700 1 --2- 172.21.15.69:0/1232760483 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f40680051c0 0x7f406800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:42.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.759+0000 7f407e7fc700 1 -- 172.21.15.69:0/1232760483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4068003a60 msgr2=0x7f4068003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:42.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.759+0000 7f407e7fc700 1 --2- 172.21.15.69:0/1232760483 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4068003a60 0x7f4068003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:42.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.759+0000 7f407f7fe700 1 -- 172.21.15.69:0/1232760483 reap_dead start 2023-10-06T01:39:42.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.759+0000 7f407e7fc700 1 -- 172.21.15.69:0/1232760483 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4068003570 con 0x7f4068004810 2023-10-06T01:39:42.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.759+0000 7f407e7fc700 1 --2- 172.21.15.69:0/1232760483 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4068004810 0x7f4068004c80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f407400c3c0 tx=0x7f4074001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4dd27745321806c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:42.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.759+0000 7f407dffb700 1 -- 172.21.15.69:0/1232760483 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407400cc10 con 0x7f4068004810 2023-10-06T01:39:42.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.759+0000 7f407dffb700 1 -- 172.21.15.69:0/1232760483 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407400cd70 con 0x7f4068004810 2023-10-06T01:39:42.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.759+0000 7f407dffb700 1 -- 172.21.15.69:0/1232760483 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4074005b50 con 0x7f4068004810 2023-10-06T01:39:42.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.760+0000 7f40853c9700 1 -- 172.21.15.69:0/1232760483 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4068004810 msgr2=0x7f4068004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:42.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.760+0000 7f40853c9700 1 --2- 172.21.15.69:0/1232760483 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4068004810 0x7f4068004c80 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f407400c3c0 tx=0x7f4074001e50 comp rx=0 tx=0).stop 2023-10-06T01:39:42.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.760+0000 7f40853c9700 1 -- 172.21.15.69:0/1232760483 shutdown_connections 2023-10-06T01:39:42.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.760+0000 7f40853c9700 1 --2- 172.21.15.69:0/1232760483 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4068004810 0x7f4068004c80 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:42.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.760+0000 7f40853c9700 1 -- 172.21.15.69:0/1232760483 >> 172.21.15.69:0/1232760483 conn(0x7f4080070e30 msgr2=0x7f40800d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:42.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.760+0000 7f40853c9700 1 -- 172.21.15.69:0/1232760483 shutdown_connections 2023-10-06T01:39:42.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.760+0000 7f40853c9700 1 -- 172.21.15.69:0/1232760483 wait complete. 2023-10-06T01:39:42.765 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.761+0000 7f40853c9700 1 Processor -- start 2023-10-06T01:39:42.766 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.761+0000 7f40853c9700 1 -- start start 2023-10-06T01:39:42.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.762+0000 7f40853c9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4068004810 0x7f4080157670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:42.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.762+0000 7f40853c9700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f40800b4410 0x7f4080150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:42.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.762+0000 7f40853c9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40800b4ff0 0x7f40800ceae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:42.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.762+0000 7f40853c9700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4080157d30 con 0x7f40800b4ff0 2023-10-06T01:39:42.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.762+0000 7f40853c9700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40800b3f80 con 0x7f4068004810 2023-10-06T01:39:42.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.762+0000 7f40853c9700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40801513c0 con 0x7f40800b4410 2023-10-06T01:39:42.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.762+0000 7f407f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40800b4ff0 0x7f40800ceae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:42.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.762+0000 7f407f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40800b4ff0 0x7f40800ceae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58734/0 (socket says 172.21.15.69:58734) 2023-10-06T01:39:42.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.762+0000 7f407f7fe700 1 -- 172.21.15.69:0/125330984 learned_addr learned my addr 172.21.15.69:0/125330984 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:42.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.762+0000 7f407effd700 1 --2- 172.21.15.69:0/125330984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4068004810 0x7f4080157670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:42.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.762+0000 7f407e7fc700 1 --2- 172.21.15.69:0/125330984 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f40800b4410 0x7f4080150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:42.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.762+0000 7f407f7fe700 1 -- 172.21.15.69:0/125330984 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f40800b4410 msgr2=0x7f4080150e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:42.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.762+0000 7f407f7fe700 1 --2- 172.21.15.69:0/125330984 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f40800b4410 0x7f4080150e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:42.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.762+0000 7f407f7fe700 1 -- 172.21.15.69:0/125330984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4068004810 msgr2=0x7f4080157670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:42.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.762+0000 7f407f7fe700 1 --2- 172.21.15.69:0/125330984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4068004810 0x7f4080157670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:42.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.762+0000 7f407f7fe700 1 -- 172.21.15.69:0/125330984 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40800b3650 con 0x7f40800b4ff0 2023-10-06T01:39:42.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.762+0000 7f407f7fe700 1 --2- 172.21.15.69:0/125330984 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40800b4ff0 0x7f40800ceae0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f40780094d0 tx=0x7f407800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:42.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.762+0000 7f4066ffd700 1 -- 172.21.15.69:0/125330984 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407800e040 con 0x7f40800b4ff0 2023-10-06T01:39:42.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.762+0000 7f4066ffd700 1 -- 172.21.15.69:0/125330984 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407800f040 con 0x7f40800b4ff0 2023-10-06T01:39:42.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.762+0000 7f40853c9700 1 -- 172.21.15.69:0/125330984 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40800b3930 con 0x7f40800b4ff0 2023-10-06T01:39:42.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.762+0000 7f4066ffd700 1 -- 172.21.15.69:0/125330984 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407800fd60 con 0x7f40800b4ff0 2023-10-06T01:39:42.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.762+0000 7f40853c9700 1 -- 172.21.15.69:0/125330984 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40800b5460 con 0x7f40800b4ff0 2023-10-06T01:39:42.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.763+0000 7f40853c9700 1 -- 172.21.15.69:0/125330984 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40800cb030 con 0x7f40800b4ff0 2023-10-06T01:39:42.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.764+0000 7f4066ffd700 1 -- 172.21.15.69:0/125330984 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4078015640 con 0x7f40800b4ff0 2023-10-06T01:39:42.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.764+0000 7f4066ffd700 1 --2- 172.21.15.69:0/125330984 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f406c066f30 0x7f406c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:42.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.764+0000 7f4066ffd700 1 -- 172.21.15.69:0/125330984 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4078084ff0 con 0x7f40800b4ff0 2023-10-06T01:39:42.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.764+0000 7f407effd700 1 --2- 172.21.15.69:0/125330984 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f406c066f30 0x7f406c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:42.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.765+0000 7f407effd700 1 --2- 172.21.15.69:0/125330984 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f406c066f30 0x7f406c0693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f40800cc300 tx=0x7f4070007d30 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:42.771 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.768+0000 7f4066ffd700 1 -- 172.21.15.69:0/125330984 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40780520a0 con 0x7f40800b4ff0 2023-10-06T01:39:42.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.990+0000 7f40853c9700 1 -- 172.21.15.69:0/125330984 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f408004c3c0 con 0x7f40800b4ff0 2023-10-06T01:39:42.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.991+0000 7f4066ffd700 1 -- 172.21.15.69:0/125330984 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f40780556c0 con 0x7f40800b4ff0 2023-10-06T01:39:42.991 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:42.992 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4837,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2963206981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":2963206981},{"type":"v1","addr":"172.21.15.88:6835","nonce":2963206981}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5028,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6836/1958085129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":1958085129},{"type":"v1","addr":"172.21.15.69:6836","nonce":1958085129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5031,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1745977228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6835","nonce":1745977228},{"type":"v1","addr":"172.21.15.69:6837","nonce":1745977228}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:39:38.993158+0000","modified":"2023-10-06T01:39:42.621141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5037},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5037":{"gid":5037,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6834/3221701951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3221701951},{"type":"v1","addr":"172.21.15.88:6834","nonce":3221701951}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T01:39:42.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.993+0000 7f40853c9700 1 -- 172.21.15.69:0/125330984 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f406c066f30 msgr2=0x7f406c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:42.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.993+0000 7f40853c9700 1 --2- 172.21.15.69:0/125330984 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f406c066f30 0x7f406c0693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f40800cc300 tx=0x7f4070007d30 comp rx=0 tx=0).stop 2023-10-06T01:39:42.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.993+0000 7f40853c9700 1 -- 172.21.15.69:0/125330984 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40800b4ff0 msgr2=0x7f40800ceae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:42.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.993+0000 7f40853c9700 1 --2- 172.21.15.69:0/125330984 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40800b4ff0 0x7f40800ceae0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f40780094d0 tx=0x7f407800b040 comp rx=0 tx=0).stop 2023-10-06T01:39:42.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.993+0000 7f40853c9700 1 -- 172.21.15.69:0/125330984 shutdown_connections 2023-10-06T01:39:42.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.993+0000 7f40853c9700 1 --2- 172.21.15.69:0/125330984 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f406c066f30 0x7f406c0693e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:42.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.993+0000 7f40853c9700 1 --2- 172.21.15.69:0/125330984 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40800b4ff0 0x7f40800ceae0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:42.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.993+0000 7f40853c9700 1 --2- 172.21.15.69:0/125330984 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f4068004810 0x7f4080157670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:42.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.993+0000 7f40853c9700 1 --2- 172.21.15.69:0/125330984 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f40800b4410 0x7f4080150e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:42.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.993+0000 7f40853c9700 1 -- 172.21.15.69:0/125330984 >> 172.21.15.69:0/125330984 conn(0x7f4080070e30 msgr2=0x7f4080154a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:42.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.993+0000 7f40853c9700 1 -- 172.21.15.69:0/125330984 shutdown_connections 2023-10-06T01:39:42.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:42.993+0000 7f40853c9700 1 -- 172.21.15.69:0/125330984 wait complete. 2023-10-06T01:39:42.995 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 17 2023-10-06T01:39:43.006 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:39:43.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.119+0000 7f5fbbc46700 1 Processor -- start 2023-10-06T01:39:43.120 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.120+0000 7f5fbbc46700 1 -- start start 2023-10-06T01:39:43.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.120+0000 7f5fbbc46700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5fb40a90d0 0x7f5fb406de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:43.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.120+0000 7f5fbbc46700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5fb406e380 0x7f5fb40af370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:43.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.120+0000 7f5fbbc46700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fb406e7f0 con 0x7f5fb40a8d00 2023-10-06T01:39:43.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.120+0000 7f5fbbc46700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fb40ae680 con 0x7f5fb406e380 2023-10-06T01:39:43.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.120+0000 7f5fbbc46700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb40aeee0 con 0x7f5fb40a90d0 2023-10-06T01:39:43.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.120+0000 7f5fba1e3700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5fb406e380 0x7f5fb40af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:43.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.121+0000 7f5fba1e3700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5fb406e380 0x7f5fb40af370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58742/0 (socket says 172.21.15.69:58742) 2023-10-06T01:39:43.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.121+0000 7f5fba1e3700 1 -- 172.21.15.69:0/20390496 learned_addr learned my addr 172.21.15.69:0/20390496 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:43.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.121+0000 7f5fb99e2700 1 --1- 172.21.15.69:0/20390496 >> v1:172.21.15.88:6789/0 conn(0x7f5fb40a8d00 0x7f5fb40cddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.69:43996/0 (socket says 172.21.15.69:43996) 2023-10-06T01:39:43.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.121+0000 7f5fb91e1700 1 --2- 172.21.15.69:0/20390496 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5fb40a90d0 0x7f5fb406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:43.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.121+0000 7f5fba1e3700 1 -- 172.21.15.69:0/20390496 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5fb40a90d0 msgr2=0x7f5fb406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:43.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.121+0000 7f5fba1e3700 1 --2- 172.21.15.69:0/20390496 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5fb40a90d0 0x7f5fb406de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:43.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.121+0000 7f5fba1e3700 1 -- 172.21.15.69:0/20390496 >> v1:172.21.15.88:6789/0 conn(0x7f5fb40a8d00 legacy=0x7f5fb40cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:43.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.121+0000 7f5fb89e0700 1 -- 172.21.15.69:0/20390496 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1443807017 0 0) 0x7f5fb406e7f0 con 0x7f5fb40a8d00 2023-10-06T01:39:43.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.121+0000 7f5fba1e3700 1 -- 172.21.15.69:0/20390496 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb40cf490 con 0x7f5fb406e380 2023-10-06T01:39:43.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.121+0000 7f5fba1e3700 1 --2- 172.21.15.69:0/20390496 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fb406e380 0x7f5fb40af370 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5fac0099b0 tx=0x7f5fac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=115611558dc016a6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:43.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.121+0000 7f5fb89e0700 1 -- 172.21.15.69:0/20390496 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac00b860 con 0x7f5fb406e380 2023-10-06T01:39:43.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.121+0000 7f5fb89e0700 1 -- 172.21.15.69:0/20390496 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fac00b9c0 con 0x7f5fb406e380 2023-10-06T01:39:43.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.121+0000 7f5fb89e0700 1 -- 172.21.15.69:0/20390496 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac00bd60 con 0x7f5fb406e380 2023-10-06T01:39:43.124 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.122+0000 7f5fbbc46700 1 -- 172.21.15.69:0/20390496 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fb406e380 msgr2=0x7f5fb40af370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:43.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.122+0000 7f5fbbc46700 1 --2- 172.21.15.69:0/20390496 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fb406e380 0x7f5fb40af370 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f5fac0099b0 tx=0x7f5fac009250 comp rx=0 tx=0).stop 2023-10-06T01:39:43.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.122+0000 7f5fbbc46700 1 -- 172.21.15.69:0/20390496 shutdown_connections 2023-10-06T01:39:43.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.122+0000 7f5fbbc46700 1 --2- 172.21.15.69:0/20390496 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fb406e380 0x7f5fb40af370 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:43.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.122+0000 7f5fbbc46700 1 --2- 172.21.15.69:0/20390496 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5fb40a90d0 0x7f5fb406de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:43.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.122+0000 7f5fbbc46700 1 -- 172.21.15.69:0/20390496 >> 172.21.15.69:0/20390496 conn(0x7f5fb406ce80 msgr2=0x7f5fb40ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:43.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.122+0000 7f5fbbc46700 1 -- 172.21.15.69:0/20390496 shutdown_connections 2023-10-06T01:39:43.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.122+0000 7f5fbbc46700 1 -- 172.21.15.69:0/20390496 wait complete. 2023-10-06T01:39:43.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.123+0000 7f5fbbc46700 1 Processor -- start 2023-10-06T01:39:43.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.123+0000 7f5fbbc46700 1 -- start start 2023-10-06T01:39:43.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.123+0000 7f5fbbc46700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fb406e380 0x7f5fb415e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:43.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.123+0000 7f5fbbc46700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fb40a8d00 0x7f5fb415a670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:43.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.124+0000 7f5fbbc46700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5fb40a90d0 0x7f5fb41571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:43.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.124+0000 7f5fbbc46700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb415dc30 con 0x7f5fb40a8d00 2023-10-06T01:39:43.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.124+0000 7f5fbbc46700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb4159f20 con 0x7f5fb406e380 2023-10-06T01:39:43.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.124+0000 7f5fbbc46700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb415d020 con 0x7f5fb40a90d0 2023-10-06T01:39:43.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.124+0000 7f5fb91e1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fb40a8d00 0x7f5fb415a670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:43.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.124+0000 7f5fb91e1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fb40a8d00 0x7f5fb415a670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58746/0 (socket says 172.21.15.69:58746) 2023-10-06T01:39:43.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.124+0000 7f5fb91e1700 1 -- 172.21.15.69:0/3219826682 learned_addr learned my addr 172.21.15.69:0/3219826682 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:43.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.124+0000 7f5fb99e2700 1 --2- 172.21.15.69:0/3219826682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fb406e380 0x7f5fb415e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:43.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.124+0000 7f5fba1e3700 1 --2- 172.21.15.69:0/3219826682 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5fb40a90d0 0x7f5fb41571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:43.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.124+0000 7f5fb91e1700 1 -- 172.21.15.69:0/3219826682 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5fb40a90d0 msgr2=0x7f5fb41571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:43.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.124+0000 7f5fb91e1700 1 --2- 172.21.15.69:0/3219826682 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5fb40a90d0 0x7f5fb41571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:43.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.124+0000 7f5fb91e1700 1 -- 172.21.15.69:0/3219826682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fb406e380 msgr2=0x7f5fb415e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:43.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.124+0000 7f5fb91e1700 1 --2- 172.21.15.69:0/3219826682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fb406e380 0x7f5fb415e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:43.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.124+0000 7f5fb91e1700 1 -- 172.21.15.69:0/3219826682 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fac0094f0 con 0x7f5fb40a8d00 2023-10-06T01:39:43.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.124+0000 7f5fb99e2700 1 --2- 172.21.15.69:0/3219826682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fb406e380 0x7f5fb415e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:43.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.124+0000 7f5fb91e1700 1 --2- 172.21.15.69:0/3219826682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fb40a8d00 0x7f5fb415a670 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800d810 tx=0x7f5fa8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:43.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.124+0000 7f5fb1ffb700 1 -- 172.21.15.69:0/3219826682 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa8018070 con 0x7f5fb40a8d00 2023-10-06T01:39:43.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.124+0000 7f5fb1ffb700 1 -- 172.21.15.69:0/3219826682 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fa800b630 con 0x7f5fb40a8d00 2023-10-06T01:39:43.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.124+0000 7f5fbbc46700 1 -- 172.21.15.69:0/3219826682 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fb415d300 con 0x7f5fb40a8d00 2023-10-06T01:39:43.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.124+0000 7f5fb1ffb700 1 -- 172.21.15.69:0/3219826682 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fa800b9f0 con 0x7f5fb40a8d00 2023-10-06T01:39:43.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.124+0000 7f5fbbc46700 1 -- 172.21.15.69:0/3219826682 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fb415d8c0 con 0x7f5fb40a8d00 2023-10-06T01:39:43.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.125+0000 7f5fbbc46700 1 -- 172.21.15.69:0/3219826682 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fb415dde0 con 0x7f5fb40a8d00 2023-10-06T01:39:43.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.125+0000 7f5fb1ffb700 1 -- 172.21.15.69:0/3219826682 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5fa8014430 con 0x7f5fb40a8d00 2023-10-06T01:39:43.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.126+0000 7f5fb1ffb700 1 --2- 172.21.15.69:0/3219826682 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5fa0066f30 0x7f5fa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:43.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.126+0000 7f5fb1ffb700 1 -- 172.21.15.69:0/3219826682 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5fa8084780 con 0x7f5fb40a8d00 2023-10-06T01:39:43.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.126+0000 7f5fb99e2700 1 --2- 172.21.15.69:0/3219826682 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5fa0066f30 0x7f5fa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:43.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.126+0000 7f5fb99e2700 1 --2- 172.21.15.69:0/3219826682 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5fa0066f30 0x7f5fa00693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4002280 tx=0x7f5fa40019f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:43.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.130+0000 7f5fb1ffb700 1 -- 172.21.15.69:0/3219826682 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5fb415dde0 con 0x7f5fb40a8d00 2023-10-06T01:39:43.315 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.315+0000 7f5fbbc46700 1 -- 172.21.15.69:0/3219826682 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fb415dde0 con 0x7f5fb40a8d00 2023-10-06T01:39:43.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.316+0000 7f5fb1ffb700 1 -- 172.21.15.69:0/3219826682 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f5fb415dde0 con 0x7f5fb40a8d00 2023-10-06T01:39:43.317 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:43.317 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":35,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:39:40.515179+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:38:43.046056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:39:37.033167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T01:39:37.950855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:39:43.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.318+0000 7f5fbbc46700 1 -- 172.21.15.69:0/3219826682 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5fa0066f30 msgr2=0x7f5fa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:43.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.318+0000 7f5fbbc46700 1 --2- 172.21.15.69:0/3219826682 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5fa0066f30 0x7f5fa00693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5fa4002280 tx=0x7f5fa40019f0 comp rx=0 tx=0).stop 2023-10-06T01:39:43.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.318+0000 7f5fbbc46700 1 -- 172.21.15.69:0/3219826682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fb40a8d00 msgr2=0x7f5fb415a670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:43.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.318+0000 7f5fbbc46700 1 --2- 172.21.15.69:0/3219826682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fb40a8d00 0x7f5fb415a670 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800d810 tx=0x7f5fa8008040 comp rx=0 tx=0).stop 2023-10-06T01:39:43.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.318+0000 7f5fbbc46700 1 -- 172.21.15.69:0/3219826682 shutdown_connections 2023-10-06T01:39:43.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.318+0000 7f5fbbc46700 1 --2- 172.21.15.69:0/3219826682 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5fa0066f30 0x7f5fa00693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:43.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.318+0000 7f5fbbc46700 1 --2- 172.21.15.69:0/3219826682 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5fb40a90d0 0x7f5fb41571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:43.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.318+0000 7f5fbbc46700 1 --2- 172.21.15.69:0/3219826682 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fb406e380 0x7f5fb415e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:43.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.318+0000 7f5fbbc46700 1 --2- 172.21.15.69:0/3219826682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fb40a8d00 0x7f5fb415a670 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:43.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.318+0000 7f5fbbc46700 1 -- 172.21.15.69:0/3219826682 >> 172.21.15.69:0/3219826682 conn(0x7f5fb406ce80 msgr2=0x7f5fb40ce670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:43.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.319+0000 7f5fbbc46700 1 -- 172.21.15.69:0/3219826682 shutdown_connections 2023-10-06T01:39:43.320 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.319+0000 7f5fbbc46700 1 -- 172.21.15.69:0/3219826682 wait complete. 2023-10-06T01:39:43.331 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-06T01:39:43.331 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:39:43.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.446+0000 7f90475ae700 1 Processor -- start 2023-10-06T01:39:43.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.446+0000 7f90475ae700 1 -- start start 2023-10-06T01:39:43.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.447+0000 7f90475ae700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f90400cb5a0 0x7f90400cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:43.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.447+0000 7f90475ae700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f90400cde50 0x7f9040156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:43.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.447+0000 7f90475ae700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904015ae40 con 0x7f90400cd9e0 2023-10-06T01:39:43.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.447+0000 7f90475ae700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90400d13f0 con 0x7f90400cde50 2023-10-06T01:39:43.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.447+0000 7f90475ae700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904015ab60 con 0x7f90400cb5a0 2023-10-06T01:39:43.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.447+0000 7f9045b4b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f90400cde50 0x7f9040156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:43.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.447+0000 7f9044b49700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f90400cd9e0 0x7f9040159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:43354/0 (socket says 172.21.15.69:43354) 2023-10-06T01:39:43.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.447+0000 7f9044b49700 1 -- 172.21.15.69:0/4052385255 learned_addr learned my addr 172.21.15.69:0/4052385255 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:43.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.447+0000 7f9045b4b700 1 -- 172.21.15.69:0/4052385255 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f90400cb5a0 msgr2=0x7f90400cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:43.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.447+0000 7f9045b4b700 1 --2- 172.21.15.69:0/4052385255 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f90400cb5a0 0x7f90400cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:43.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.447+0000 7f9045b4b700 1 -- 172.21.15.69:0/4052385255 >> v1:172.21.15.69:6789/0 conn(0x7f90400cd9e0 legacy=0x7f9040159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:43.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.447+0000 7f9045b4b700 1 -- 172.21.15.69:0/4052385255 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90400ccf00 con 0x7f90400cde50 2023-10-06T01:39:43.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.447+0000 7f9037fff700 1 -- 172.21.15.69:0/4052385255 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1415707171 0 0) 0x7f904015ae40 con 0x7f90400cd9e0 2023-10-06T01:39:43.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.447+0000 7f9045b4b700 1 --2- 172.21.15.69:0/4052385255 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90400cde50 0x7f9040156e90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9038009e60 tx=0x7f9038009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79fc88b9fcf87923 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:43.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.447+0000 7f9037fff700 1 -- 172.21.15.69:0/4052385255 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903800e070 con 0x7f90400cde50 2023-10-06T01:39:43.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.447+0000 7f9037fff700 1 -- 172.21.15.69:0/4052385255 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903800bc30 con 0x7f90400cde50 2023-10-06T01:39:43.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.447+0000 7f9037fff700 1 -- 172.21.15.69:0/4052385255 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9038012430 con 0x7f90400cde50 2023-10-06T01:39:43.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.448+0000 7f90475ae700 1 -- 172.21.15.69:0/4052385255 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90400cde50 msgr2=0x7f9040156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:43.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.448+0000 7f90475ae700 1 --2- 172.21.15.69:0/4052385255 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90400cde50 0x7f9040156e90 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f9038009e60 tx=0x7f9038009780 comp rx=0 tx=0).stop 2023-10-06T01:39:43.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.448+0000 7f90475ae700 1 -- 172.21.15.69:0/4052385255 shutdown_connections 2023-10-06T01:39:43.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.448+0000 7f90475ae700 1 --2- 172.21.15.69:0/4052385255 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90400cde50 0x7f9040156e90 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:43.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.448+0000 7f90475ae700 1 --2- 172.21.15.69:0/4052385255 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f90400cb5a0 0x7f90400cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:43.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.448+0000 7f90475ae700 1 -- 172.21.15.69:0/4052385255 >> 172.21.15.69:0/4052385255 conn(0x7f9040070e30 msgr2=0x7f90400d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:43.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.448+0000 7f90475ae700 1 -- 172.21.15.69:0/4052385255 shutdown_connections 2023-10-06T01:39:43.451 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.448+0000 7f90475ae700 1 -- 172.21.15.69:0/4052385255 wait complete. 2023-10-06T01:39:43.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.449+0000 7f90475ae700 1 Processor -- start 2023-10-06T01:39:43.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.449+0000 7f90475ae700 1 -- start start 2023-10-06T01:39:43.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.450+0000 7f90475ae700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f90400cb5a0 0x7f904016a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:43.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.450+0000 7f90475ae700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90400cd9e0 0x7f90401590d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:43.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.450+0000 7f90475ae700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90400b34b0 0x7f90400b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:43.454 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.450+0000 7f90475ae700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90400b3e70 con 0x7f90400b34b0 2023-10-06T01:39:43.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.450+0000 7f90475ae700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9040169e40 con 0x7f90400cd9e0 2023-10-06T01:39:43.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.450+0000 7f90475ae700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9040169550 con 0x7f90400cb5a0 2023-10-06T01:39:43.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.450+0000 7f9045b4b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90400b34b0 0x7f90400b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:43.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.450+0000 7f9045b4b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90400b34b0 0x7f90400b3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58770/0 (socket says 172.21.15.69:58770) 2023-10-06T01:39:43.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.450+0000 7f9045b4b700 1 -- 172.21.15.69:0/2042296336 learned_addr learned my addr 172.21.15.69:0/2042296336 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:43.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.450+0000 7f904534a700 1 --2- 172.21.15.69:0/2042296336 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f90400cb5a0 0x7f904016a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:43.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.450+0000 7f9044b49700 1 --2- 172.21.15.69:0/2042296336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90400cd9e0 0x7f90401590d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:43.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.450+0000 7f9045b4b700 1 -- 172.21.15.69:0/2042296336 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f90400cb5a0 msgr2=0x7f904016a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:43.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.450+0000 7f9045b4b700 1 --2- 172.21.15.69:0/2042296336 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f90400cb5a0 0x7f904016a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:43.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.450+0000 7f9045b4b700 1 -- 172.21.15.69:0/2042296336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90400cd9e0 msgr2=0x7f90401590d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:43.455 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.450+0000 7f9045b4b700 1 --2- 172.21.15.69:0/2042296336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90400cd9e0 0x7f90401590d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:43.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.450+0000 7f9045b4b700 1 -- 172.21.15.69:0/2042296336 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9038009a20 con 0x7f90400b34b0 2023-10-06T01:39:43.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.450+0000 7f9044b49700 1 --2- 172.21.15.69:0/2042296336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90400cd9e0 0x7f90401590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:43.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.451+0000 7f9045b4b700 1 --2- 172.21.15.69:0/2042296336 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90400b34b0 0x7f90400b3930 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9038013000 tx=0x7f9038019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:43.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.451+0000 7f90357fa700 1 -- 172.21.15.69:0/2042296336 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903801e630 con 0x7f90400b34b0 2023-10-06T01:39:43.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.451+0000 7f90357fa700 1 -- 172.21.15.69:0/2042296336 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903801e7b0 con 0x7f90400b34b0 2023-10-06T01:39:43.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.451+0000 7f90475ae700 1 -- 172.21.15.69:0/2042296336 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9040159610 con 0x7f90400b34b0 2023-10-06T01:39:43.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.451+0000 7f90357fa700 1 -- 172.21.15.69:0/2042296336 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903801eb70 con 0x7f90400b34b0 2023-10-06T01:39:43.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.451+0000 7f90475ae700 1 -- 172.21.15.69:0/2042296336 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9040169ad0 con 0x7f90400b34b0 2023-10-06T01:39:43.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.452+0000 7f90475ae700 1 -- 172.21.15.69:0/2042296336 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f904004c3c0 con 0x7f90400b34b0 2023-10-06T01:39:43.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.452+0000 7f90357fa700 1 -- 172.21.15.69:0/2042296336 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9038024070 con 0x7f90400b34b0 2023-10-06T01:39:43.456 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.453+0000 7f90357fa700 1 --2- 172.21.15.69:0/2042296336 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9024066f30 0x7f90240693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:43.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.453+0000 7f90357fa700 1 -- 172.21.15.69:0/2042296336 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f90380870f0 con 0x7f90400b34b0 2023-10-06T01:39:43.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.453+0000 7f904534a700 1 --2- 172.21.15.69:0/2042296336 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9024066f30 0x7f90240693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:43.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.453+0000 7f904534a700 1 --2- 172.21.15.69:0/2042296336 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9024066f30 0x7f90240693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f903c009b40 tx=0x7f903c0090f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:43.457 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.456+0000 7f90357fa700 1 -- 172.21.15.69:0/2042296336 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9038054280 con 0x7f90400b34b0 2023-10-06T01:39:43.584 INFO:tasks.ceph.mds.d.smithi088.stderr:2023-10-06T01:39:43.583+0000 7f163c21d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-06T01:39:43.638 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.638+0000 7f90475ae700 1 -- 172.21.15.69:0/2042296336 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9040169f80 con 0x7f9024066f30 2023-10-06T01:39:43.646 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.646+0000 7f90357fa700 1 -- 172.21.15.69:0/2042296336 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+304423 (secure 0 0 0) 0x7f9040169f80 con 0x7f9024066f30 2023-10-06T01:39:43.650 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:43.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.650+0000 7f90475ae700 1 -- 172.21.15.69:0/2042296336 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9024066f30 msgr2=0x7f90240693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:43.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.650+0000 7f90475ae700 1 --2- 172.21.15.69:0/2042296336 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9024066f30 0x7f90240693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f903c009b40 tx=0x7f903c0090f0 comp rx=0 tx=0).stop 2023-10-06T01:39:43.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.650+0000 7f90475ae700 1 -- 172.21.15.69:0/2042296336 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90400b34b0 msgr2=0x7f90400b3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:43.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.650+0000 7f90475ae700 1 --2- 172.21.15.69:0/2042296336 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90400b34b0 0x7f90400b3930 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f9038013000 tx=0x7f9038019000 comp rx=0 tx=0).stop 2023-10-06T01:39:43.653 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.650+0000 7f90475ae700 1 -- 172.21.15.69:0/2042296336 shutdown_connections 2023-10-06T01:39:43.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.650+0000 7f90475ae700 1 --2- 172.21.15.69:0/2042296336 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9024066f30 0x7f90240693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:43.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.650+0000 7f90475ae700 1 --2- 172.21.15.69:0/2042296336 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90400b34b0 0x7f90400b3930 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:43.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.650+0000 7f90475ae700 1 --2- 172.21.15.69:0/2042296336 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f90400cb5a0 0x7f904016a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:43.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.650+0000 7f90475ae700 1 --2- 172.21.15.69:0/2042296336 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90400cd9e0 0x7f90401590d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:43.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.650+0000 7f90475ae700 1 -- 172.21.15.69:0/2042296336 >> 172.21.15.69:0/2042296336 conn(0x7f9040070e30 msgr2=0x7f9040159dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:43.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.650+0000 7f90475ae700 1 -- 172.21.15.69:0/2042296336 shutdown_connections 2023-10-06T01:39:43.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.650+0000 7f90475ae700 1 -- 172.21.15.69:0/2042296336 wait complete. 2023-10-06T01:39:43.654 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-10-06T01:39:43.662 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2023-10-06T01:39:42.271146+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":201,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":168,"acting":168,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382528,"kb_used_data":4224,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592192,"statfs":{"total":773094113280,"available":770654404608,"internally_reserved":0,"allocated":4325376,"data_stored":2420858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.670350"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.531235+0000","last_change":"2023-10-06T01:39:39.526915+0000","last_active":"2023-10-06T01:39:39.531235+0000","last_peered":"2023-10-06T01:39:39.531235+0000","last_clean":"2023-10-06T01:39:39.531235+0000","last_became_active":"2023-10-06T01:39:39.526686+0000","last_became_peered":"2023-10-06T01:39:39.526686+0000","last_unstale":"2023-10-06T01:39:39.531235+0000","last_undegraded":"2023-10-06T01:39:39.531235+0000","last_fullsized":"2023-10-06T01:39:39.531235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:07:20.141113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.527522+0000","last_change":"2023-10-06T01:39:39.524003+0000","last_active":"2023-10-06T01:39:39.527522+0000","last_peered":"2023-10-06T01:39:39.527522+0000","last_clean":"2023-10-06T01:39:39.527522+0000","last_became_active":"2023-10-06T01:39:39.523726+0000","last_became_peered":"2023-10-06T01:39:39.523726+0000","last_unstale":"2023-10-06T01:39:39.527522+0000","last_undegraded":"2023-10-06T01:39:39.527522+0000","last_fullsized":"2023-10-06T01:39:39.527522+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:40.175833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.539552+0000","last_change":"2023-10-06T01:39:39.538503+0000","last_active":"2023-10-06T01:39:39.539552+0000","last_peered":"2023-10-06T01:39:39.539552+0000","last_clean":"2023-10-06T01:39:39.539552+0000","last_became_active":"2023-10-06T01:39:39.538337+0000","last_became_peered":"2023-10-06T01:39:39.538337+0000","last_unstale":"2023-10-06T01:39:39.539552+0000","last_undegraded":"2023-10-06T01:39:39.539552+0000","last_fullsized":"2023-10-06T01:39:39.539552+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:13.353533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532785+0000","last_change":"2023-10-06T01:39:39.530772+0000","last_active":"2023-10-06T01:39:39.532785+0000","last_peered":"2023-10-06T01:39:39.532785+0000","last_clean":"2023-10-06T01:39:39.532785+0000","last_became_active":"2023-10-06T01:39:39.530517+0000","last_became_peered":"2023-10-06T01:39:39.530517+0000","last_unstale":"2023-10-06T01:39:39.532785+0000","last_undegraded":"2023-10-06T01:39:39.532785+0000","last_fullsized":"2023-10-06T01:39:39.532785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.642217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532800+0000","last_change":"2023-10-06T01:39:39.527585+0000","last_active":"2023-10-06T01:39:39.532800+0000","last_peered":"2023-10-06T01:39:39.532800+0000","last_clean":"2023-10-06T01:39:39.532800+0000","last_became_active":"2023-10-06T01:39:39.527217+0000","last_became_peered":"2023-10-06T01:39:39.527217+0000","last_unstale":"2023-10-06T01:39:39.532800+0000","last_undegraded":"2023-10-06T01:39:39.532800+0000","last_fullsized":"2023-10-06T01:39:39.532800+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:55.203229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533099+0000","last_change":"2023-10-06T01:39:39.530203+0000","last_active":"2023-10-06T01:39:39.533099+0000","last_peered":"2023-10-06T01:39:39.533099+0000","last_clean":"2023-10-06T01:39:39.533099+0000","last_became_active":"2023-10-06T01:39:39.529971+0000","last_became_peered":"2023-10-06T01:39:39.529971+0000","last_unstale":"2023-10-06T01:39:39.533099+0000","last_undegraded":"2023-10-06T01:39:39.533099+0000","last_fullsized":"2023-10-06T01:39:39.533099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:50:02.715525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541363+0000","last_change":"2023-10-06T01:39:39.533186+0000","last_active":"2023-10-06T01:39:39.541363+0000","last_peered":"2023-10-06T01:39:39.541363+0000","last_clean":"2023-10-06T01:39:39.541363+0000","last_became_active":"2023-10-06T01:39:39.532941+0000","last_became_peered":"2023-10-06T01:39:39.532941+0000","last_unstale":"2023-10-06T01:39:39.541363+0000","last_undegraded":"2023-10-06T01:39:39.541363+0000","last_fullsized":"2023-10-06T01:39:39.541363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:28.581592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541518+0000","last_change":"2023-10-06T01:39:39.537465+0000","last_active":"2023-10-06T01:39:39.541518+0000","last_peered":"2023-10-06T01:39:39.541518+0000","last_clean":"2023-10-06T01:39:39.541518+0000","last_became_active":"2023-10-06T01:39:39.537237+0000","last_became_peered":"2023-10-06T01:39:39.537237+0000","last_unstale":"2023-10-06T01:39:39.541518+0000","last_undegraded":"2023-10-06T01:39:39.541518+0000","last_fullsized":"2023-10-06T01:39:39.541518+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:43.913718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541368+0000","last_change":"2023-10-06T01:39:39.533041+0000","last_active":"2023-10-06T01:39:39.541368+0000","last_peered":"2023-10-06T01:39:39.541368+0000","last_clean":"2023-10-06T01:39:39.541368+0000","last_became_active":"2023-10-06T01:39:39.532764+0000","last_became_peered":"2023-10-06T01:39:39.532764+0000","last_unstale":"2023-10-06T01:39:39.541368+0000","last_undegraded":"2023-10-06T01:39:39.541368+0000","last_fullsized":"2023-10-06T01:39:39.541368+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:49.497096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541823+0000","last_change":"2023-10-06T01:39:39.539028+0000","last_active":"2023-10-06T01:39:39.541823+0000","last_peered":"2023-10-06T01:39:39.541823+0000","last_clean":"2023-10-06T01:39:39.541823+0000","last_became_active":"2023-10-06T01:39:39.538655+0000","last_became_peered":"2023-10-06T01:39:39.538655+0000","last_unstale":"2023-10-06T01:39:39.541823+0000","last_undegraded":"2023-10-06T01:39:39.541823+0000","last_fullsized":"2023-10-06T01:39:39.541823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:16.101682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.530715+0000","last_change":"2023-10-06T01:39:39.524232+0000","last_active":"2023-10-06T01:39:39.530715+0000","last_peered":"2023-10-06T01:39:39.530715+0000","last_clean":"2023-10-06T01:39:39.530715+0000","last_became_active":"2023-10-06T01:39:39.523956+0000","last_became_peered":"2023-10-06T01:39:39.523956+0000","last_unstale":"2023-10-06T01:39:39.530715+0000","last_undegraded":"2023-10-06T01:39:39.530715+0000","last_fullsized":"2023-10-06T01:39:39.530715+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:05:05.351196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535445+0000","last_change":"2023-10-06T01:39:39.531764+0000","last_active":"2023-10-06T01:39:39.535445+0000","last_peered":"2023-10-06T01:39:39.535445+0000","last_clean":"2023-10-06T01:39:39.535445+0000","last_became_active":"2023-10-06T01:39:39.531514+0000","last_became_peered":"2023-10-06T01:39:39.531514+0000","last_unstale":"2023-10-06T01:39:39.535445+0000","last_undegraded":"2023-10-06T01:39:39.535445+0000","last_fullsized":"2023-10-06T01:39:39.535445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:03.781047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536300+0000","last_change":"2023-10-06T01:39:39.534404+0000","last_active":"2023-10-06T01:39:39.536300+0000","last_peered":"2023-10-06T01:39:39.536300+0000","last_clean":"2023-10-06T01:39:39.536300+0000","last_became_active":"2023-10-06T01:39:39.533543+0000","last_became_peered":"2023-10-06T01:39:39.533543+0000","last_unstale":"2023-10-06T01:39:39.536300+0000","last_undegraded":"2023-10-06T01:39:39.536300+0000","last_fullsized":"2023-10-06T01:39:39.536300+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:49.497096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.538610+0000","last_change":"2023-10-06T01:39:39.532117+0000","last_active":"2023-10-06T01:39:39.538610+0000","last_peered":"2023-10-06T01:39:39.538610+0000","last_clean":"2023-10-06T01:39:39.538610+0000","last_became_active":"2023-10-06T01:39:39.531824+0000","last_became_peered":"2023-10-06T01:39:39.531824+0000","last_unstale":"2023-10-06T01:39:39.538610+0000","last_undegraded":"2023-10-06T01:39:39.538610+0000","last_fullsized":"2023-10-06T01:39:39.538610+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.642217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532043+0000","last_change":"2023-10-06T01:39:39.527764+0000","last_active":"2023-10-06T01:39:39.532043+0000","last_peered":"2023-10-06T01:39:39.532043+0000","last_clean":"2023-10-06T01:39:39.532043+0000","last_became_active":"2023-10-06T01:39:39.527017+0000","last_became_peered":"2023-10-06T01:39:39.527017+0000","last_unstale":"2023-10-06T01:39:39.532043+0000","last_undegraded":"2023-10-06T01:39:39.532043+0000","last_fullsized":"2023-10-06T01:39:39.532043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:36.816199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541320+0000","last_change":"2023-10-06T01:39:39.538515+0000","last_active":"2023-10-06T01:39:39.541320+0000","last_peered":"2023-10-06T01:39:39.541320+0000","last_clean":"2023-10-06T01:39:39.541320+0000","last_became_active":"2023-10-06T01:39:39.538214+0000","last_became_peered":"2023-10-06T01:39:39.538214+0000","last_unstale":"2023-10-06T01:39:39.541320+0000","last_undegraded":"2023-10-06T01:39:39.541320+0000","last_fullsized":"2023-10-06T01:39:39.541320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:50:32.520206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532460+0000","last_change":"2023-10-06T01:39:39.527312+0000","last_active":"2023-10-06T01:39:39.532460+0000","last_peered":"2023-10-06T01:39:39.532460+0000","last_clean":"2023-10-06T01:39:39.532460+0000","last_became_active":"2023-10-06T01:39:39.526997+0000","last_became_peered":"2023-10-06T01:39:39.526997+0000","last_unstale":"2023-10-06T01:39:39.532460+0000","last_undegraded":"2023-10-06T01:39:39.532460+0000","last_fullsized":"2023-10-06T01:39:39.532460+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:06.076326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.539115+0000","last_change":"2023-10-06T01:39:39.534940+0000","last_active":"2023-10-06T01:39:39.539115+0000","last_peered":"2023-10-06T01:39:39.539115+0000","last_clean":"2023-10-06T01:39:39.539115+0000","last_became_active":"2023-10-06T01:39:39.534650+0000","last_became_peered":"2023-10-06T01:39:39.534650+0000","last_unstale":"2023-10-06T01:39:39.539115+0000","last_undegraded":"2023-10-06T01:39:39.539115+0000","last_fullsized":"2023-10-06T01:39:39.539115+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:54.181909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535947+0000","last_change":"2023-10-06T01:39:39.534201+0000","last_active":"2023-10-06T01:39:39.535947+0000","last_peered":"2023-10-06T01:39:39.535947+0000","last_clean":"2023-10-06T01:39:39.535947+0000","last_became_active":"2023-10-06T01:39:39.533900+0000","last_became_peered":"2023-10-06T01:39:39.533900+0000","last_unstale":"2023-10-06T01:39:39.535947+0000","last_undegraded":"2023-10-06T01:39:39.535947+0000","last_fullsized":"2023-10-06T01:39:39.535947+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:36.108288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532873+0000","last_change":"2023-10-06T01:39:39.531717+0000","last_active":"2023-10-06T01:39:39.532873+0000","last_peered":"2023-10-06T01:39:39.532873+0000","last_clean":"2023-10-06T01:39:39.532873+0000","last_became_active":"2023-10-06T01:39:39.531485+0000","last_became_peered":"2023-10-06T01:39:39.531485+0000","last_unstale":"2023-10-06T01:39:39.532873+0000","last_undegraded":"2023-10-06T01:39:39.532873+0000","last_fullsized":"2023-10-06T01:39:39.532873+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:42.574061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533787+0000","last_change":"2023-10-06T01:39:39.528899+0000","last_active":"2023-10-06T01:39:39.533787+0000","last_peered":"2023-10-06T01:39:39.533787+0000","last_clean":"2023-10-06T01:39:39.533787+0000","last_became_active":"2023-10-06T01:39:39.528582+0000","last_became_peered":"2023-10-06T01:39:39.528582+0000","last_unstale":"2023-10-06T01:39:39.533787+0000","last_undegraded":"2023-10-06T01:39:39.533787+0000","last_fullsized":"2023-10-06T01:39:39.533787+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:23.534135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.539109+0000","last_change":"2023-10-06T01:39:39.536007+0000","last_active":"2023-10-06T01:39:39.539109+0000","last_peered":"2023-10-06T01:39:39.539109+0000","last_clean":"2023-10-06T01:39:39.539109+0000","last_became_active":"2023-10-06T01:39:39.533706+0000","last_became_peered":"2023-10-06T01:39:39.533706+0000","last_unstale":"2023-10-06T01:39:39.539109+0000","last_undegraded":"2023-10-06T01:39:39.539109+0000","last_fullsized":"2023-10-06T01:39:39.539109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:13.353533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535778+0000","last_change":"2023-10-06T01:39:39.529699+0000","last_active":"2023-10-06T01:39:39.535778+0000","last_peered":"2023-10-06T01:39:39.535778+0000","last_clean":"2023-10-06T01:39:39.535778+0000","last_became_active":"2023-10-06T01:39:39.529341+0000","last_became_peered":"2023-10-06T01:39:39.529341+0000","last_unstale":"2023-10-06T01:39:39.535778+0000","last_undegraded":"2023-10-06T01:39:39.535778+0000","last_fullsized":"2023-10-06T01:39:39.535778+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:51:05.439429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533050+0000","last_change":"2023-10-06T01:39:39.528443+0000","last_active":"2023-10-06T01:39:39.533050+0000","last_peered":"2023-10-06T01:39:39.533050+0000","last_clean":"2023-10-06T01:39:39.533050+0000","last_became_active":"2023-10-06T01:39:39.528008+0000","last_became_peered":"2023-10-06T01:39:39.528008+0000","last_unstale":"2023-10-06T01:39:39.533050+0000","last_undegraded":"2023-10-06T01:39:39.533050+0000","last_fullsized":"2023-10-06T01:39:39.533050+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:42.574061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.538139+0000","last_change":"2023-10-06T01:39:39.531595+0000","last_active":"2023-10-06T01:39:39.538139+0000","last_peered":"2023-10-06T01:39:39.538139+0000","last_clean":"2023-10-06T01:39:39.538139+0000","last_became_active":"2023-10-06T01:39:39.531416+0000","last_became_peered":"2023-10-06T01:39:39.531416+0000","last_unstale":"2023-10-06T01:39:39.538139+0000","last_undegraded":"2023-10-06T01:39:39.538139+0000","last_fullsized":"2023-10-06T01:39:39.538139+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:23.999705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535927+0000","last_change":"2023-10-06T01:39:39.533940+0000","last_active":"2023-10-06T01:39:39.535927+0000","last_peered":"2023-10-06T01:39:39.535927+0000","last_clean":"2023-10-06T01:39:39.535927+0000","last_became_active":"2023-10-06T01:39:39.533195+0000","last_became_peered":"2023-10-06T01:39:39.533195+0000","last_unstale":"2023-10-06T01:39:39.535927+0000","last_undegraded":"2023-10-06T01:39:39.535927+0000","last_fullsized":"2023-10-06T01:39:39.535927+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:55.203229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535010+0000","last_change":"2023-10-06T01:39:39.533042+0000","last_active":"2023-10-06T01:39:39.535010+0000","last_peered":"2023-10-06T01:39:39.535010+0000","last_clean":"2023-10-06T01:39:39.535010+0000","last_became_active":"2023-10-06T01:39:39.532433+0000","last_became_peered":"2023-10-06T01:39:39.532433+0000","last_unstale":"2023-10-06T01:39:39.535010+0000","last_undegraded":"2023-10-06T01:39:39.535010+0000","last_fullsized":"2023-10-06T01:39:39.535010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:51:05.439429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"34'4","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.616579+0000","last_change":"2023-10-06T01:39:38.626494+0000","last_active":"2023-10-06T01:39:39.616579+0000","last_peered":"2023-10-06T01:39:39.616579+0000","last_clean":"2023-10-06T01:39:39.616579+0000","last_became_active":"2023-10-06T01:39:38.625958+0000","last_became_peered":"2023-10-06T01:39:38.625958+0000","last_unstale":"2023-10-06T01:39:39.616579+0000","last_undegraded":"2023-10-06T01:39:39.616579+0000","last_fullsized":"2023-10-06T01:39:39.616579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:12.414360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:37.589723+0000","last_change":"2023-10-06T01:39:37.589723+0000","last_active":"2023-10-06T01:39:37.589723+0000","last_peered":"2023-10-06T01:39:37.589723+0000","last_clean":"2023-10-06T01:39:37.589723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:37.589723+0000","last_undegraded":"2023-10-06T01:39:37.589723+0000","last_fullsized":"2023-10-06T01:39:37.589723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541310+0000","last_change":"2023-10-06T01:39:39.535667+0000","last_active":"2023-10-06T01:39:39.541310+0000","last_peered":"2023-10-06T01:39:39.541310+0000","last_clean":"2023-10-06T01:39:39.541310+0000","last_became_active":"2023-10-06T01:39:39.535332+0000","last_became_peered":"2023-10-06T01:39:39.535332+0000","last_unstale":"2023-10-06T01:39:39.541310+0000","last_undegraded":"2023-10-06T01:39:39.541310+0000","last_fullsized":"2023-10-06T01:39:39.541310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:37.318580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:37.589723+0000","last_change":"2023-10-06T01:39:37.589723+0000","last_active":"2023-10-06T01:39:37.589723+0000","last_peered":"2023-10-06T01:39:37.589723+0000","last_clean":"2023-10-06T01:39:37.589723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:37.589723+0000","last_undegraded":"2023-10-06T01:39:37.589723+0000","last_fullsized":"2023-10-06T01:39:37.589723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533622+0000","last_change":"2023-10-06T01:39:39.531136+0000","last_active":"2023-10-06T01:39:39.533622+0000","last_peered":"2023-10-06T01:39:39.533622+0000","last_clean":"2023-10-06T01:39:39.533622+0000","last_became_active":"2023-10-06T01:39:39.530908+0000","last_became_peered":"2023-10-06T01:39:39.530908+0000","last_unstale":"2023-10-06T01:39:39.533622+0000","last_undegraded":"2023-10-06T01:39:39.533622+0000","last_fullsized":"2023-10-06T01:39:39.533622+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:26.799204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.616014+0000","last_change":"2023-10-06T01:39:38.623866+0000","last_active":"2023-10-06T01:39:39.616014+0000","last_peered":"2023-10-06T01:39:39.616014+0000","last_clean":"2023-10-06T01:39:39.616014+0000","last_became_active":"2023-10-06T01:39:38.623558+0000","last_became_peered":"2023-10-06T01:39:38.623558+0000","last_unstale":"2023-10-06T01:39:39.616014+0000","last_undegraded":"2023-10-06T01:39:39.616014+0000","last_fullsized":"2023-10-06T01:39:39.616014+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:19.711959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.615600+0000","last_change":"2023-10-06T01:39:38.624485+0000","last_active":"2023-10-06T01:39:39.615600+0000","last_peered":"2023-10-06T01:39:39.615600+0000","last_clean":"2023-10-06T01:39:39.615600+0000","last_became_active":"2023-10-06T01:39:38.624224+0000","last_became_peered":"2023-10-06T01:39:38.624224+0000","last_unstale":"2023-10-06T01:39:39.615600+0000","last_undegraded":"2023-10-06T01:39:39.615600+0000","last_fullsized":"2023-10-06T01:39:39.615600+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:41.565197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532780+0000","last_change":"2023-10-06T01:39:39.527154+0000","last_active":"2023-10-06T01:39:39.532780+0000","last_peered":"2023-10-06T01:39:39.532780+0000","last_clean":"2023-10-06T01:39:39.532780+0000","last_became_active":"2023-10-06T01:39:39.526851+0000","last_became_peered":"2023-10-06T01:39:39.526851+0000","last_unstale":"2023-10-06T01:39:39.532780+0000","last_undegraded":"2023-10-06T01:39:39.532780+0000","last_fullsized":"2023-10-06T01:39:39.532780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:40.175833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.616307+0000","last_change":"2023-10-06T01:39:38.625182+0000","last_active":"2023-10-06T01:39:39.616307+0000","last_peered":"2023-10-06T01:39:39.616307+0000","last_clean":"2023-10-06T01:39:39.616307+0000","last_became_active":"2023-10-06T01:39:38.624900+0000","last_became_peered":"2023-10-06T01:39:38.624900+0000","last_unstale":"2023-10-06T01:39:39.616307+0000","last_undegraded":"2023-10-06T01:39:39.616307+0000","last_fullsized":"2023-10-06T01:39:39.616307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:48.430978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536320+0000","last_change":"2023-10-06T01:39:39.532155+0000","last_active":"2023-10-06T01:39:39.536320+0000","last_peered":"2023-10-06T01:39:39.536320+0000","last_clean":"2023-10-06T01:39:39.536320+0000","last_became_active":"2023-10-06T01:39:39.531870+0000","last_became_peered":"2023-10-06T01:39:39.531870+0000","last_unstale":"2023-10-06T01:39:39.536320+0000","last_undegraded":"2023-10-06T01:39:39.536320+0000","last_fullsized":"2023-10-06T01:39:39.536320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:42.351468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:37.589723+0000","last_change":"2023-10-06T01:39:37.589723+0000","last_active":"2023-10-06T01:39:37.589723+0000","last_peered":"2023-10-06T01:39:37.589723+0000","last_clean":"2023-10-06T01:39:37.589723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:37.589723+0000","last_undegraded":"2023-10-06T01:39:37.589723+0000","last_fullsized":"2023-10-06T01:39:37.589723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532100+0000","last_change":"2023-10-06T01:39:39.528278+0000","last_active":"2023-10-06T01:39:39.532100+0000","last_peered":"2023-10-06T01:39:39.532100+0000","last_clean":"2023-10-06T01:39:39.532100+0000","last_became_active":"2023-10-06T01:39:39.527700+0000","last_became_peered":"2023-10-06T01:39:39.527700+0000","last_unstale":"2023-10-06T01:39:39.532100+0000","last_undegraded":"2023-10-06T01:39:39.532100+0000","last_fullsized":"2023-10-06T01:39:39.532100+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:28.581592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.529680+0000","last_change":"2023-10-06T01:39:38.630745+0000","last_active":"2023-10-06T01:39:39.529680+0000","last_peered":"2023-10-06T01:39:39.529680+0000","last_clean":"2023-10-06T01:39:39.529680+0000","last_became_active":"2023-10-06T01:39:38.630466+0000","last_became_peered":"2023-10-06T01:39:38.630466+0000","last_unstale":"2023-10-06T01:39:39.529680+0000","last_undegraded":"2023-10-06T01:39:39.529680+0000","last_fullsized":"2023-10-06T01:39:39.529680+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:30.512210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.539563+0000","last_change":"2023-10-06T01:39:39.538565+0000","last_active":"2023-10-06T01:39:39.539563+0000","last_peered":"2023-10-06T01:39:39.539563+0000","last_clean":"2023-10-06T01:39:39.539563+0000","last_became_active":"2023-10-06T01:39:39.538331+0000","last_became_peered":"2023-10-06T01:39:39.538331+0000","last_unstale":"2023-10-06T01:39:39.539563+0000","last_undegraded":"2023-10-06T01:39:39.539563+0000","last_fullsized":"2023-10-06T01:39:39.539563+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:23.999705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.517658+0000","last_change":"2023-10-06T01:39:38.628795+0000","last_active":"2023-10-06T01:39:39.517658+0000","last_peered":"2023-10-06T01:39:39.517658+0000","last_clean":"2023-10-06T01:39:39.517658+0000","last_became_active":"2023-10-06T01:39:38.628536+0000","last_became_peered":"2023-10-06T01:39:38.628536+0000","last_unstale":"2023-10-06T01:39:39.517658+0000","last_undegraded":"2023-10-06T01:39:39.517658+0000","last_fullsized":"2023-10-06T01:39:39.517658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:27.661354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536001+0000","last_change":"2023-10-06T01:39:39.534373+0000","last_active":"2023-10-06T01:39:39.536001+0000","last_peered":"2023-10-06T01:39:39.536001+0000","last_clean":"2023-10-06T01:39:39.536001+0000","last_became_active":"2023-10-06T01:39:39.533475+0000","last_became_peered":"2023-10-06T01:39:39.533475+0000","last_unstale":"2023-10-06T01:39:39.536001+0000","last_undegraded":"2023-10-06T01:39:39.536001+0000","last_fullsized":"2023-10-06T01:39:39.536001+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:44.243800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.521871+0000","last_change":"2023-10-06T01:39:38.628870+0000","last_active":"2023-10-06T01:39:39.521871+0000","last_peered":"2023-10-06T01:39:39.521871+0000","last_clean":"2023-10-06T01:39:39.521871+0000","last_became_active":"2023-10-06T01:39:38.628553+0000","last_became_peered":"2023-10-06T01:39:38.628553+0000","last_unstale":"2023-10-06T01:39:39.521871+0000","last_undegraded":"2023-10-06T01:39:39.521871+0000","last_fullsized":"2023-10-06T01:39:39.521871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:22.525270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"34'3","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.623127+0000","last_change":"2023-10-06T01:39:38.628825+0000","last_active":"2023-10-06T01:39:39.623127+0000","last_peered":"2023-10-06T01:39:39.623127+0000","last_clean":"2023-10-06T01:39:39.623127+0000","last_became_active":"2023-10-06T01:39:38.628517+0000","last_became_peered":"2023-10-06T01:39:38.628517+0000","last_unstale":"2023-10-06T01:39:39.623127+0000","last_undegraded":"2023-10-06T01:39:39.623127+0000","last_fullsized":"2023-10-06T01:39:39.623127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:50:31.511342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.538694+0000","last_change":"2023-10-06T01:39:39.534285+0000","last_active":"2023-10-06T01:39:39.538694+0000","last_peered":"2023-10-06T01:39:39.538694+0000","last_clean":"2023-10-06T01:39:39.538694+0000","last_became_active":"2023-10-06T01:39:39.534034+0000","last_became_peered":"2023-10-06T01:39:39.534034+0000","last_unstale":"2023-10-06T01:39:39.538694+0000","last_undegraded":"2023-10-06T01:39:39.538694+0000","last_fullsized":"2023-10-06T01:39:39.538694+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:19:39.808879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"34'6","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.618668+0000","last_change":"2023-10-06T01:39:38.622530+0000","last_active":"2023-10-06T01:39:39.618668+0000","last_peered":"2023-10-06T01:39:39.618668+0000","last_clean":"2023-10-06T01:39:39.618668+0000","last_became_active":"2023-10-06T01:39:38.622273+0000","last_became_peered":"2023-10-06T01:39:38.622273+0000","last_unstale":"2023-10-06T01:39:39.618668+0000","last_undegraded":"2023-10-06T01:39:39.618668+0000","last_fullsized":"2023-10-06T01:39:39.618668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:09.207989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.615312+0000","last_change":"2023-10-06T01:39:38.620186+0000","last_active":"2023-10-06T01:39:39.615312+0000","last_peered":"2023-10-06T01:39:39.615312+0000","last_clean":"2023-10-06T01:39:39.615312+0000","last_became_active":"2023-10-06T01:39:38.619533+0000","last_became_peered":"2023-10-06T01:39:38.619533+0000","last_unstale":"2023-10-06T01:39:39.615312+0000","last_undegraded":"2023-10-06T01:39:39.615312+0000","last_fullsized":"2023-10-06T01:39:39.615312+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:39.151951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.526690+0000","last_change":"2023-10-06T01:39:39.524124+0000","last_active":"2023-10-06T01:39:39.526690+0000","last_peered":"2023-10-06T01:39:39.526690+0000","last_clean":"2023-10-06T01:39:39.526690+0000","last_became_active":"2023-10-06T01:39:39.523937+0000","last_became_peered":"2023-10-06T01:39:39.523937+0000","last_unstale":"2023-10-06T01:39:39.526690+0000","last_undegraded":"2023-10-06T01:39:39.526690+0000","last_fullsized":"2023-10-06T01:39:39.526690+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:43.467840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:37.589723+0000","last_change":"2023-10-06T01:39:37.589723+0000","last_active":"2023-10-06T01:39:37.589723+0000","last_peered":"2023-10-06T01:39:37.589723+0000","last_clean":"2023-10-06T01:39:37.589723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:37.589723+0000","last_undegraded":"2023-10-06T01:39:37.589723+0000","last_fullsized":"2023-10-06T01:39:37.589723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536404+0000","last_change":"2023-10-06T01:39:39.534594+0000","last_active":"2023-10-06T01:39:39.536404+0000","last_peered":"2023-10-06T01:39:39.536404+0000","last_clean":"2023-10-06T01:39:39.536404+0000","last_became_active":"2023-10-06T01:39:39.534233+0000","last_became_peered":"2023-10-06T01:39:39.534233+0000","last_unstale":"2023-10-06T01:39:39.536404+0000","last_undegraded":"2023-10-06T01:39:39.536404+0000","last_fullsized":"2023-10-06T01:39:39.536404+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:43.913718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.525679+0000","last_change":"2023-10-06T01:39:38.626277+0000","last_active":"2023-10-06T01:39:39.525679+0000","last_peered":"2023-10-06T01:39:39.525679+0000","last_clean":"2023-10-06T01:39:39.525679+0000","last_became_active":"2023-10-06T01:39:38.625992+0000","last_became_peered":"2023-10-06T01:39:38.625992+0000","last_unstale":"2023-10-06T01:39:39.525679+0000","last_undegraded":"2023-10-06T01:39:39.525679+0000","last_fullsized":"2023-10-06T01:39:39.525679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:26.630294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.531082+0000","last_change":"2023-10-06T01:39:39.526088+0000","last_active":"2023-10-06T01:39:39.531082+0000","last_peered":"2023-10-06T01:39:39.531082+0000","last_clean":"2023-10-06T01:39:39.531082+0000","last_became_active":"2023-10-06T01:39:39.525757+0000","last_became_peered":"2023-10-06T01:39:39.525757+0000","last_unstale":"2023-10-06T01:39:39.531082+0000","last_undegraded":"2023-10-06T01:39:39.531082+0000","last_fullsized":"2023-10-06T01:39:39.531082+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:52.418744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"34'8","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.619531+0000","last_change":"2023-10-06T01:39:38.625180+0000","last_active":"2023-10-06T01:39:39.619531+0000","last_peered":"2023-10-06T01:39:39.619531+0000","last_clean":"2023-10-06T01:39:39.619531+0000","last_became_active":"2023-10-06T01:39:38.624889+0000","last_became_peered":"2023-10-06T01:39:38.624889+0000","last_unstale":"2023-10-06T01:39:39.619531+0000","last_undegraded":"2023-10-06T01:39:39.619531+0000","last_fullsized":"2023-10-06T01:39:39.619531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:22:20.164155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533562+0000","last_change":"2023-10-06T01:39:39.531326+0000","last_active":"2023-10-06T01:39:39.533562+0000","last_peered":"2023-10-06T01:39:39.533562+0000","last_clean":"2023-10-06T01:39:39.533562+0000","last_became_active":"2023-10-06T01:39:39.531097+0000","last_became_peered":"2023-10-06T01:39:39.531097+0000","last_unstale":"2023-10-06T01:39:39.533562+0000","last_undegraded":"2023-10-06T01:39:39.533562+0000","last_fullsized":"2023-10-06T01:39:39.533562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:46.119956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.619174+0000","last_change":"2023-10-06T01:39:38.627708+0000","last_active":"2023-10-06T01:39:39.619174+0000","last_peered":"2023-10-06T01:39:39.619174+0000","last_clean":"2023-10-06T01:39:39.619174+0000","last_became_active":"2023-10-06T01:39:38.627477+0000","last_became_peered":"2023-10-06T01:39:38.627477+0000","last_unstale":"2023-10-06T01:39:39.619174+0000","last_undegraded":"2023-10-06T01:39:39.619174+0000","last_fullsized":"2023-10-06T01:39:39.619174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:12.344668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535629+0000","last_change":"2023-10-06T01:39:39.527319+0000","last_active":"2023-10-06T01:39:39.535629+0000","last_peered":"2023-10-06T01:39:39.535629+0000","last_clean":"2023-10-06T01:39:39.535629+0000","last_became_active":"2023-10-06T01:39:39.527083+0000","last_became_peered":"2023-10-06T01:39:39.527083+0000","last_unstale":"2023-10-06T01:39:39.535629+0000","last_undegraded":"2023-10-06T01:39:39.535629+0000","last_fullsized":"2023-10-06T01:39:39.535629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:52.418744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.617094+0000","last_change":"2023-10-06T01:39:38.627207+0000","last_active":"2023-10-06T01:39:39.617094+0000","last_peered":"2023-10-06T01:39:39.617094+0000","last_clean":"2023-10-06T01:39:39.617094+0000","last_became_active":"2023-10-06T01:39:38.626943+0000","last_became_peered":"2023-10-06T01:39:38.626943+0000","last_unstale":"2023-10-06T01:39:39.617094+0000","last_undegraded":"2023-10-06T01:39:39.617094+0000","last_fullsized":"2023-10-06T01:39:39.617094+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:45.111092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536257+0000","last_change":"2023-10-06T01:39:39.533370+0000","last_active":"2023-10-06T01:39:39.536257+0000","last_peered":"2023-10-06T01:39:39.536257+0000","last_clean":"2023-10-06T01:39:39.536257+0000","last_became_active":"2023-10-06T01:39:39.532868+0000","last_became_peered":"2023-10-06T01:39:39.532868+0000","last_unstale":"2023-10-06T01:39:39.536257+0000","last_undegraded":"2023-10-06T01:39:39.536257+0000","last_fullsized":"2023-10-06T01:39:39.536257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:59.497040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.616717+0000","last_change":"2023-10-06T01:39:38.627502+0000","last_active":"2023-10-06T01:39:39.616717+0000","last_peered":"2023-10-06T01:39:39.616717+0000","last_clean":"2023-10-06T01:39:39.616717+0000","last_became_active":"2023-10-06T01:39:38.627231+0000","last_became_peered":"2023-10-06T01:39:38.627231+0000","last_unstale":"2023-10-06T01:39:39.616717+0000","last_undegraded":"2023-10-06T01:39:39.616717+0000","last_fullsized":"2023-10-06T01:39:39.616717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:12.414360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533124+0000","last_change":"2023-10-06T01:39:39.531931+0000","last_active":"2023-10-06T01:39:39.533124+0000","last_peered":"2023-10-06T01:39:39.533124+0000","last_clean":"2023-10-06T01:39:39.533124+0000","last_became_active":"2023-10-06T01:39:39.531631+0000","last_became_peered":"2023-10-06T01:39:39.531631+0000","last_unstale":"2023-10-06T01:39:39.533124+0000","last_undegraded":"2023-10-06T01:39:39.533124+0000","last_fullsized":"2023-10-06T01:39:39.533124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:50:32.520206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:37.589723+0000","last_change":"2023-10-06T01:39:37.589723+0000","last_active":"2023-10-06T01:39:37.589723+0000","last_peered":"2023-10-06T01:39:37.589723+0000","last_clean":"2023-10-06T01:39:37.589723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:37.589723+0000","last_undegraded":"2023-10-06T01:39:37.589723+0000","last_fullsized":"2023-10-06T01:39:37.589723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.538913+0000","last_change":"2023-10-06T01:39:39.535329+0000","last_active":"2023-10-06T01:39:39.538913+0000","last_peered":"2023-10-06T01:39:39.538913+0000","last_clean":"2023-10-06T01:39:39.538913+0000","last_became_active":"2023-10-06T01:39:39.534826+0000","last_became_peered":"2023-10-06T01:39:39.534826+0000","last_unstale":"2023-10-06T01:39:39.538913+0000","last_undegraded":"2023-10-06T01:39:39.538913+0000","last_fullsized":"2023-10-06T01:39:39.538913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:05:05.351196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.616288+0000","last_change":"2023-10-06T01:39:38.622188+0000","last_active":"2023-10-06T01:39:39.616288+0000","last_peered":"2023-10-06T01:39:39.616288+0000","last_clean":"2023-10-06T01:39:39.616288+0000","last_became_active":"2023-10-06T01:39:38.621909+0000","last_became_peered":"2023-10-06T01:39:38.621909+0000","last_unstale":"2023-10-06T01:39:39.616288+0000","last_undegraded":"2023-10-06T01:39:39.616288+0000","last_fullsized":"2023-10-06T01:39:39.616288+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:06.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.520646+0000","last_change":"2023-10-06T01:39:38.624450+0000","last_active":"2023-10-06T01:39:39.520646+0000","last_peered":"2023-10-06T01:39:39.520646+0000","last_clean":"2023-10-06T01:39:39.520646+0000","last_became_active":"2023-10-06T01:39:38.624218+0000","last_became_peered":"2023-10-06T01:39:38.624218+0000","last_unstale":"2023-10-06T01:39:39.520646+0000","last_undegraded":"2023-10-06T01:39:39.520646+0000","last_fullsized":"2023-10-06T01:39:39.520646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:26.630294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.537160+0000","last_change":"2023-10-06T01:39:39.530340+0000","last_active":"2023-10-06T01:39:39.537160+0000","last_peered":"2023-10-06T01:39:39.537160+0000","last_clean":"2023-10-06T01:39:39.537160+0000","last_became_active":"2023-10-06T01:39:39.530047+0000","last_became_peered":"2023-10-06T01:39:39.530047+0000","last_unstale":"2023-10-06T01:39:39.537160+0000","last_undegraded":"2023-10-06T01:39:39.537160+0000","last_fullsized":"2023-10-06T01:39:39.537160+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:41:55.235050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.518549+0000","last_change":"2023-10-06T01:39:38.630812+0000","last_active":"2023-10-06T01:39:39.518549+0000","last_peered":"2023-10-06T01:39:39.518549+0000","last_clean":"2023-10-06T01:39:39.518549+0000","last_became_active":"2023-10-06T01:39:38.630517+0000","last_became_peered":"2023-10-06T01:39:38.630517+0000","last_unstale":"2023-10-06T01:39:39.518549+0000","last_undegraded":"2023-10-06T01:39:39.518549+0000","last_fullsized":"2023-10-06T01:39:39.518549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:17.633353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532118+0000","last_change":"2023-10-06T01:39:39.528466+0000","last_active":"2023-10-06T01:39:39.532118+0000","last_peered":"2023-10-06T01:39:39.532118+0000","last_clean":"2023-10-06T01:39:39.532118+0000","last_became_active":"2023-10-06T01:39:39.528042+0000","last_became_peered":"2023-10-06T01:39:39.528042+0000","last_unstale":"2023-10-06T01:39:39.532118+0000","last_undegraded":"2023-10-06T01:39:39.532118+0000","last_fullsized":"2023-10-06T01:39:39.532118+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:06.076326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.521385+0000","last_change":"2023-10-06T01:39:38.623491+0000","last_active":"2023-10-06T01:39:39.521385+0000","last_peered":"2023-10-06T01:39:39.521385+0000","last_clean":"2023-10-06T01:39:39.521385+0000","last_became_active":"2023-10-06T01:39:38.623222+0000","last_became_peered":"2023-10-06T01:39:38.623222+0000","last_unstale":"2023-10-06T01:39:39.521385+0000","last_undegraded":"2023-10-06T01:39:39.521385+0000","last_fullsized":"2023-10-06T01:39:39.521385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:36:21.647390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:37.589723+0000","last_change":"2023-10-06T01:39:37.589723+0000","last_active":"2023-10-06T01:39:37.589723+0000","last_peered":"2023-10-06T01:39:37.589723+0000","last_clean":"2023-10-06T01:39:37.589723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:37.589723+0000","last_undegraded":"2023-10-06T01:39:37.589723+0000","last_fullsized":"2023-10-06T01:39:37.589723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T01:39:32.319570+0000","last_change":"2023-10-06T01:38:44.533111+0000","last_active":"2023-10-06T01:39:32.319570+0000","last_peered":"2023-10-06T01:39:32.319570+0000","last_clean":"2023-10-06T01:39:32.319570+0000","last_became_active":"2023-10-06T01:38:44.532838+0000","last_became_peered":"2023-10-06T01:38:44.532838+0000","last_unstale":"2023-10-06T01:39:32.319570+0000","last_undegraded":"2023-10-06T01:39:32.319570+0000","last_fullsized":"2023-10-06T01:39:32.319570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532512+0000","last_change":"2023-10-06T01:39:39.529973+0000","last_active":"2023-10-06T01:39:39.532512+0000","last_peered":"2023-10-06T01:39:39.532512+0000","last_clean":"2023-10-06T01:39:39.532512+0000","last_became_active":"2023-10-06T01:39:39.529739+0000","last_became_peered":"2023-10-06T01:39:39.529739+0000","last_unstale":"2023-10-06T01:39:39.532512+0000","last_undegraded":"2023-10-06T01:39:39.532512+0000","last_fullsized":"2023-10-06T01:39:39.532512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:41:55.235050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:37.589723+0000","last_change":"2023-10-06T01:39:37.589723+0000","last_active":"2023-10-06T01:39:37.589723+0000","last_peered":"2023-10-06T01:39:37.589723+0000","last_clean":"2023-10-06T01:39:37.589723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:37.589723+0000","last_undegraded":"2023-10-06T01:39:37.589723+0000","last_fullsized":"2023-10-06T01:39:37.589723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.520635+0000","last_change":"2023-10-06T01:38:44.533897+0000","last_active":"2023-10-06T01:39:39.520635+0000","last_peered":"2023-10-06T01:39:39.520635+0000","last_clean":"2023-10-06T01:39:39.520635+0000","last_became_active":"2023-10-06T01:38:44.533611+0000","last_became_peered":"2023-10-06T01:38:44.533611+0000","last_unstale":"2023-10-06T01:39:39.520635+0000","last_undegraded":"2023-10-06T01:39:39.520635+0000","last_fullsized":"2023-10-06T01:39:39.520635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:24.411408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.534892+0000","last_change":"2023-10-06T01:39:39.531616+0000","last_active":"2023-10-06T01:39:39.534892+0000","last_peered":"2023-10-06T01:39:39.534892+0000","last_clean":"2023-10-06T01:39:39.534892+0000","last_became_active":"2023-10-06T01:39:39.531337+0000","last_became_peered":"2023-10-06T01:39:39.531337+0000","last_unstale":"2023-10-06T01:39:39.534892+0000","last_undegraded":"2023-10-06T01:39:39.534892+0000","last_fullsized":"2023-10-06T01:39:39.534892+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:57.121167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T01:39:40.963716+0000","last_change":"2023-10-06T01:39:38.627842+0000","last_active":"2023-10-06T01:39:40.963716+0000","last_peered":"2023-10-06T01:39:40.963716+0000","last_clean":"2023-10-06T01:39:40.963716+0000","last_became_active":"2023-10-06T01:39:38.627581+0000","last_became_peered":"2023-10-06T01:39:38.627581+0000","last_unstale":"2023-10-06T01:39:40.963716+0000","last_undegraded":"2023-10-06T01:39:40.963716+0000","last_fullsized":"2023-10-06T01:39:40.963716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:45.908004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.520759+0000","last_change":"2023-10-06T01:38:45.307814+0000","last_active":"2023-10-06T01:39:39.520759+0000","last_peered":"2023-10-06T01:39:39.520759+0000","last_clean":"2023-10-06T01:39:39.520759+0000","last_became_active":"2023-10-06T01:38:45.307536+0000","last_became_peered":"2023-10-06T01:38:45.307536+0000","last_unstale":"2023-10-06T01:39:39.520759+0000","last_undegraded":"2023-10-06T01:39:39.520759+0000","last_fullsized":"2023-10-06T01:39:39.520759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:09.503713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.539176+0000","last_change":"2023-10-06T01:39:39.531658+0000","last_active":"2023-10-06T01:39:39.539176+0000","last_peered":"2023-10-06T01:39:39.539176+0000","last_clean":"2023-10-06T01:39:39.539176+0000","last_became_active":"2023-10-06T01:39:39.531262+0000","last_became_peered":"2023-10-06T01:39:39.531262+0000","last_unstale":"2023-10-06T01:39:39.539176+0000","last_undegraded":"2023-10-06T01:39:39.539176+0000","last_fullsized":"2023-10-06T01:39:39.539176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:43.467840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.518786+0000","last_change":"2023-10-06T01:39:38.626151+0000","last_active":"2023-10-06T01:39:39.518786+0000","last_peered":"2023-10-06T01:39:39.518786+0000","last_clean":"2023-10-06T01:39:39.518786+0000","last_became_active":"2023-10-06T01:39:38.625888+0000","last_became_peered":"2023-10-06T01:39:38.625888+0000","last_unstale":"2023-10-06T01:39:39.518786+0000","last_undegraded":"2023-10-06T01:39:39.518786+0000","last_fullsized":"2023-10-06T01:39:39.518786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:35.807335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.518659+0000","last_change":"2023-10-06T01:38:44.534507+0000","last_active":"2023-10-06T01:39:39.518659+0000","last_peered":"2023-10-06T01:39:39.518659+0000","last_clean":"2023-10-06T01:39:39.518659+0000","last_became_active":"2023-10-06T01:38:44.534191+0000","last_became_peered":"2023-10-06T01:38:44.534191+0000","last_unstale":"2023-10-06T01:39:39.518659+0000","last_undegraded":"2023-10-06T01:39:39.518659+0000","last_fullsized":"2023-10-06T01:39:39.518659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.519577+0000","last_change":"2023-10-06T01:38:40.115117+0000","last_active":"2023-10-06T01:39:39.519577+0000","last_peered":"2023-10-06T01:39:39.519577+0000","last_clean":"2023-10-06T01:39:39.519577+0000","last_became_active":"2023-10-06T01:38:40.114142+0000","last_became_peered":"2023-10-06T01:38:40.114142+0000","last_unstale":"2023-10-06T01:39:39.519577+0000","last_undegraded":"2023-10-06T01:39:39.519577+0000","last_fullsized":"2023-10-06T01:39:39.519577+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_clean_scrub_stamp":"2023-10-06T01:38:38.338797+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:52.870262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.623038+0000","last_change":"2023-10-06T01:39:38.628812+0000","last_active":"2023-10-06T01:39:39.623038+0000","last_peered":"2023-10-06T01:39:39.623038+0000","last_clean":"2023-10-06T01:39:39.623038+0000","last_became_active":"2023-10-06T01:39:38.628525+0000","last_became_peered":"2023-10-06T01:39:38.628525+0000","last_unstale":"2023-10-06T01:39:39.623038+0000","last_undegraded":"2023-10-06T01:39:39.623038+0000","last_fullsized":"2023-10-06T01:39:39.623038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:22.990841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.519641+0000","last_change":"2023-10-06T01:38:44.531831+0000","last_active":"2023-10-06T01:39:39.519641+0000","last_peered":"2023-10-06T01:39:39.519641+0000","last_clean":"2023-10-06T01:39:39.519641+0000","last_became_active":"2023-10-06T01:38:44.531496+0000","last_became_peered":"2023-10-06T01:38:44.531496+0000","last_unstale":"2023-10-06T01:39:39.519641+0000","last_undegraded":"2023-10-06T01:39:39.519641+0000","last_fullsized":"2023-10-06T01:39:39.519641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:28.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.525846+0000","last_change":"2023-10-06T01:39:38.626256+0000","last_active":"2023-10-06T01:39:39.525846+0000","last_peered":"2023-10-06T01:39:39.525846+0000","last_clean":"2023-10-06T01:39:39.525846+0000","last_became_active":"2023-10-06T01:39:38.625973+0000","last_became_peered":"2023-10-06T01:39:38.625973+0000","last_unstale":"2023-10-06T01:39:39.525846+0000","last_undegraded":"2023-10-06T01:39:39.525846+0000","last_fullsized":"2023-10-06T01:39:39.525846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:36:21.647390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.519166+0000","last_change":"2023-10-06T01:38:44.531335+0000","last_active":"2023-10-06T01:39:39.519166+0000","last_peered":"2023-10-06T01:39:39.519166+0000","last_clean":"2023-10-06T01:39:39.519166+0000","last_became_active":"2023-10-06T01:38:44.530966+0000","last_became_peered":"2023-10-06T01:38:44.530966+0000","last_unstale":"2023-10-06T01:39:39.519166+0000","last_undegraded":"2023-10-06T01:39:39.519166+0000","last_fullsized":"2023-10-06T01:39:39.519166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:33.926180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536339+0000","last_change":"2023-10-06T01:39:39.532663+0000","last_active":"2023-10-06T01:39:39.536339+0000","last_peered":"2023-10-06T01:39:39.536339+0000","last_clean":"2023-10-06T01:39:39.536339+0000","last_became_active":"2023-10-06T01:39:39.532435+0000","last_became_peered":"2023-10-06T01:39:39.532435+0000","last_unstale":"2023-10-06T01:39:39.536339+0000","last_undegraded":"2023-10-06T01:39:39.536339+0000","last_fullsized":"2023-10-06T01:39:39.536339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:23:15.510626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.529694+0000","last_change":"2023-10-06T01:39:38.623748+0000","last_active":"2023-10-06T01:39:39.529694+0000","last_peered":"2023-10-06T01:39:39.529694+0000","last_clean":"2023-10-06T01:39:39.529694+0000","last_became_active":"2023-10-06T01:39:38.623460+0000","last_became_peered":"2023-10-06T01:39:38.623460+0000","last_unstale":"2023-10-06T01:39:39.529694+0000","last_undegraded":"2023-10-06T01:39:39.529694+0000","last_fullsized":"2023-10-06T01:39:39.529694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:02:05.682135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T01:39:32.320639+0000","last_change":"2023-10-06T01:38:44.533582+0000","last_active":"2023-10-06T01:39:32.320639+0000","last_peered":"2023-10-06T01:39:32.320639+0000","last_clean":"2023-10-06T01:39:32.320639+0000","last_became_active":"2023-10-06T01:38:44.533324+0000","last_became_peered":"2023-10-06T01:38:44.533324+0000","last_unstale":"2023-10-06T01:39:32.320639+0000","last_undegraded":"2023-10-06T01:39:32.320639+0000","last_fullsized":"2023-10-06T01:39:32.320639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535058+0000","last_change":"2023-10-06T01:39:39.532149+0000","last_active":"2023-10-06T01:39:39.535058+0000","last_peered":"2023-10-06T01:39:39.535058+0000","last_clean":"2023-10-06T01:39:39.535058+0000","last_became_active":"2023-10-06T01:39:39.531891+0000","last_became_peered":"2023-10-06T01:39:39.531891+0000","last_unstale":"2023-10-06T01:39:39.535058+0000","last_undegraded":"2023-10-06T01:39:39.535058+0000","last_fullsized":"2023-10-06T01:39:39.535058+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:40.175833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.517261+0000","last_change":"2023-10-06T01:39:38.623722+0000","last_active":"2023-10-06T01:39:39.517261+0000","last_peered":"2023-10-06T01:39:39.517261+0000","last_clean":"2023-10-06T01:39:39.517261+0000","last_became_active":"2023-10-06T01:39:38.623425+0000","last_became_peered":"2023-10-06T01:39:38.623425+0000","last_unstale":"2023-10-06T01:39:39.517261+0000","last_undegraded":"2023-10-06T01:39:39.517261+0000","last_fullsized":"2023-10-06T01:39:39.517261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:14.193205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.526690+0000","last_change":"2023-10-06T01:38:44.533765+0000","last_active":"2023-10-06T01:39:39.526690+0000","last_peered":"2023-10-06T01:39:39.526690+0000","last_clean":"2023-10-06T01:39:39.526690+0000","last_became_active":"2023-10-06T01:38:44.533406+0000","last_became_peered":"2023-10-06T01:38:44.533406+0000","last_unstale":"2023-10-06T01:39:39.526690+0000","last_undegraded":"2023-10-06T01:39:39.526690+0000","last_fullsized":"2023-10-06T01:39:39.526690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":50,"acting":50,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298272,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073568,"statfs":{"total":96636764160,"available":96331333632,"internally_reserved":0,"allocated":1007616,"data_stored":753061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.70099999999999996}]},{"osd":1,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.73599999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.75700000000000001}]},{"osd":3,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.77900000000000003}]},{"osd":4,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.46400000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.54500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":401408,"data_stored":161641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.495},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.55100000000000005}]},{"osd":1,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.46000000000000002}]},{"osd":2,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.39600000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.56699999999999995}]},{"osd":4,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.34899999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.52900000000000003}]},{"osd":7,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.432}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074212,"statfs":{"total":96636764160,"available":96331993088,"internally_reserved":0,"allocated":348160,"data_stored":134556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.378}]},{"osd":2,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":0.33700000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.29299999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.41599999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.54200000000000004}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.46400000000000002}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.48199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073632,"statfs":{"total":96636764160,"available":96331399168,"internally_reserved":0,"allocated":942080,"data_stored":724924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":401408,"data_stored":161157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.34599999999999997}]},{"osd":1,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.39300000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.77500000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.748}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.82299999999999995}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.67100000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":413696,"data_stored":162657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.313},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.22800000000000001}]},{"osd":1,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.372}]},{"osd":2,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.35199999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.621}]},{"osd":5,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.49199999999999999}]},{"osd":6,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.55500000000000005}]},{"osd":7,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.67300000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297684,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074156,"statfs":{"total":96636764160,"available":96331935744,"internally_reserved":0,"allocated":405504,"data_stored":161663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.4289999999999998,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.52700000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":4.2270000000000003,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.2789999999999999,"5min":4.2789999999999999,"15min":4.2789999999999999},"last":0.46700000000000003}]},{"osd":2,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":12.359,"5min":12.359,"15min":12.359},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":12.326000000000001,"5min":12.326000000000001,"15min":12.326000000000001},"last":0.67800000000000005}]},{"osd":3,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":3.448,"5min":3.448,"15min":3.448},"last":0.57999999999999996},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":12.282,"5min":12.282,"15min":12.282},"last":0.504}]},{"osd":5,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.64500000000000002}]},{"osd":6,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.623}]},{"osd":7,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.66200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297684,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074156,"statfs":{"total":96636764160,"available":96331935744,"internally_reserved":0,"allocated":405504,"data_stored":161199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.439},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.66400000000000003}]},{"osd":1,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.53700000000000003}]},{"osd":2,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.65300000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.41199999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.69999999999999996}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.63100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:39:43.670 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:39:43.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.816+0000 7facce165700 1 Processor -- start 2023-10-06T01:39:43.817 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.816+0000 7facce165700 1 -- start start 2023-10-06T01:39:43.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.817+0000 7facce165700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7facc80a8d00 0x7facc80cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:43.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.817+0000 7facce165700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7facc80a90d0 0x7facc806de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:43.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.817+0000 7facce165700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facc80aeee0 con 0x7facc806e380 2023-10-06T01:39:43.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.817+0000 7facce165700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc806e820 con 0x7facc80a90d0 2023-10-06T01:39:43.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.817+0000 7facce165700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facc80ae680 con 0x7facc80a8d00 2023-10-06T01:39:43.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.817+0000 7facc6ffd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7facc80a90d0 0x7facc806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:43.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.817+0000 7facc7fff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7facc806e380 0x7facc80cc420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:43366/0 (socket says 172.21.15.69:43366) 2023-10-06T01:39:43.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.817+0000 7facc6ffd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7facc80a90d0 0x7facc806de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58778/0 (socket says 172.21.15.69:58778) 2023-10-06T01:39:43.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.817+0000 7facc7fff700 1 -- 172.21.15.69:0/610584364 learned_addr learned my addr 172.21.15.69:0/610584364 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:43.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.818+0000 7facc77fe700 1 --2- 172.21.15.69:0/610584364 >> v2:172.21.15.88:3300/0 conn(0x7facc80a8d00 0x7facc80cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:43.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.818+0000 7facc6ffd700 1 -- 172.21.15.69:0/610584364 >> v2:172.21.15.88:3300/0 conn(0x7facc80a8d00 msgr2=0x7facc80cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:43.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.818+0000 7facc6ffd700 1 --2- 172.21.15.69:0/610584364 >> v2:172.21.15.88:3300/0 conn(0x7facc80a8d00 0x7facc80cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:43.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.818+0000 7facc6ffd700 1 -- 172.21.15.69:0/610584364 >> v1:172.21.15.69:6789/0 conn(0x7facc806e380 legacy=0x7facc80cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:43.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.818+0000 7facc6ffd700 1 -- 172.21.15.69:0/610584364 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc80cf490 con 0x7facc80a90d0 2023-10-06T01:39:43.820 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.818+0000 7facc67fc700 1 -- 172.21.15.69:0/610584364 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 206427023 0 0) 0x7facc80aeee0 con 0x7facc806e380 2023-10-06T01:39:43.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.818+0000 7facc77fe700 1 --2- 172.21.15.69:0/610584364 >> v2:172.21.15.88:3300/0 conn(0x7facc80a8d00 0x7facc80cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:43.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.818+0000 7facc6ffd700 1 --2- 172.21.15.69:0/610584364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facc80a90d0 0x7facc806de40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7facbc0098d0 tx=0x7facbc009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63eff892afca680 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:43.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.818+0000 7facc67fc700 1 -- 172.21.15.69:0/610584364 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc009e70 con 0x7facc80a90d0 2023-10-06T01:39:43.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.818+0000 7facc67fc700 1 -- 172.21.15.69:0/610584364 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facbc005c10 con 0x7facc80a90d0 2023-10-06T01:39:43.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.818+0000 7facc67fc700 1 -- 172.21.15.69:0/610584364 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facbc00b610 con 0x7facc80a90d0 2023-10-06T01:39:43.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.818+0000 7facce165700 1 -- 172.21.15.69:0/610584364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facc80a90d0 msgr2=0x7facc806de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:43.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.818+0000 7facce165700 1 --2- 172.21.15.69:0/610584364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facc80a90d0 0x7facc806de40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7facbc0098d0 tx=0x7facbc009120 comp rx=0 tx=0).stop 2023-10-06T01:39:43.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.818+0000 7facce165700 1 -- 172.21.15.69:0/610584364 shutdown_connections 2023-10-06T01:39:43.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.818+0000 7facce165700 1 --2- 172.21.15.69:0/610584364 >> v2:172.21.15.88:3300/0 conn(0x7facc80a8d00 0x7facc80cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:43.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.818+0000 7facce165700 1 --2- 172.21.15.69:0/610584364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facc80a90d0 0x7facc806de40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:43.821 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.818+0000 7facce165700 1 -- 172.21.15.69:0/610584364 >> 172.21.15.69:0/610584364 conn(0x7facc806ce80 msgr2=0x7facc80ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:43.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.819+0000 7facce165700 1 -- 172.21.15.69:0/610584364 shutdown_connections 2023-10-06T01:39:43.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.819+0000 7facce165700 1 -- 172.21.15.69:0/610584364 wait complete. 2023-10-06T01:39:43.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.820+0000 7facce165700 1 Processor -- start 2023-10-06T01:39:43.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.820+0000 7facce165700 1 -- start start 2023-10-06T01:39:43.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.820+0000 7facce165700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facc806e380 0x7facc815f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:43.824 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.820+0000 7facce165700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7facc80a8d00 0x7facc815fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:43.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.820+0000 7facce165700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7facc80a90d0 0x7facc80b3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:43.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.820+0000 7facce165700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc81574a0 con 0x7facc806e380 2023-10-06T01:39:43.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.821+0000 7facce165700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facc815ff70 con 0x7facc80a90d0 2023-10-06T01:39:43.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.821+0000 7facce165700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facc815f6c0 con 0x7facc80a8d00 2023-10-06T01:39:43.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.821+0000 7facc77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facc806e380 0x7facc815f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:43.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.821+0000 7facc77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facc806e380 0x7facc815f070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58792/0 (socket says 172.21.15.69:58792) 2023-10-06T01:39:43.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.821+0000 7facc77fe700 1 -- 172.21.15.69:0/3240541959 learned_addr learned my addr 172.21.15.69:0/3240541959 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:43.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.821+0000 7facc7fff700 1 --2- 172.21.15.69:0/3240541959 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7facc80a90d0 0x7facc80b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:43.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.821+0000 7facc6ffd700 1 --2- 172.21.15.69:0/3240541959 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7facc80a8d00 0x7facc815fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:43.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.821+0000 7facc77fe700 1 -- 172.21.15.69:0/3240541959 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7facc80a8d00 msgr2=0x7facc815fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:43.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.821+0000 7facc77fe700 1 --2- 172.21.15.69:0/3240541959 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7facc80a8d00 0x7facc815fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:43.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.821+0000 7facc77fe700 1 -- 172.21.15.69:0/3240541959 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7facc80a90d0 msgr2=0x7facc80b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:43.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.821+0000 7facc77fe700 1 --2- 172.21.15.69:0/3240541959 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7facc80a90d0 0x7facc80b3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:43.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.821+0000 7facc77fe700 1 -- 172.21.15.69:0/3240541959 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facbc0093c0 con 0x7facc806e380 2023-10-06T01:39:43.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.821+0000 7facc77fe700 1 --2- 172.21.15.69:0/3240541959 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facc806e380 0x7facc815f070 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7facb800a520 tx=0x7facb8007960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:43.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.821+0000 7facaf7fe700 1 -- 172.21.15.69:0/3240541959 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb8008590 con 0x7facc806e380 2023-10-06T01:39:43.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.821+0000 7facaf7fe700 1 -- 172.21.15.69:0/3240541959 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb80086f0 con 0x7facc806e380 2023-10-06T01:39:43.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.821+0000 7facaf7fe700 1 -- 172.21.15.69:0/3240541959 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb8008a90 con 0x7facc806e380 2023-10-06T01:39:43.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.821+0000 7facce165700 1 -- 172.21.15.69:0/3240541959 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facc816a5d0 con 0x7facc806e380 2023-10-06T01:39:43.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.821+0000 7facce165700 1 -- 172.21.15.69:0/3240541959 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facc8169fa0 con 0x7facc806e380 2023-10-06T01:39:43.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.822+0000 7facce165700 1 -- 172.21.15.69:0/3240541959 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facc816aaf0 con 0x7facc806e380 2023-10-06T01:39:43.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.822+0000 7facaf7fe700 1 -- 172.21.15.69:0/3240541959 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7facb8014410 con 0x7facc806e380 2023-10-06T01:39:43.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.823+0000 7facaf7fe700 1 --2- 172.21.15.69:0/3240541959 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7facb4066f30 0x7facb40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:43.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.823+0000 7facaf7fe700 1 -- 172.21.15.69:0/3240541959 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7facb8085310 con 0x7facc806e380 2023-10-06T01:39:43.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.823+0000 7facc6ffd700 1 --2- 172.21.15.69:0/3240541959 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7facb4066f30 0x7facb40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:43.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.823+0000 7facc6ffd700 1 --2- 172.21.15.69:0/3240541959 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7facb4066f30 0x7facb40693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7facbc009160 tx=0x7facbc016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:43.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:43.827+0000 7facaf7fe700 1 -- 172.21.15.69:0/3240541959 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7facb8052420 con 0x7facc806e380 2023-10-06T01:39:44.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.005+0000 7facce165700 1 -- 172.21.15.69:0/3240541959 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7facc816a2d0 con 0x7facb4066f30 2023-10-06T01:39:44.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.013+0000 7facaf7fe700 1 -- 172.21.15.69:0/3240541959 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+304423 (secure 0 0 0) 0x7facc816a2d0 con 0x7facb4066f30 2023-10-06T01:39:44.017 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:44.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.016+0000 7facce165700 1 -- 172.21.15.69:0/3240541959 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7facb4066f30 msgr2=0x7facb40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:44.019 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.016+0000 7facce165700 1 --2- 172.21.15.69:0/3240541959 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7facb4066f30 0x7facb40693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7facbc009160 tx=0x7facbc016000 comp rx=0 tx=0).stop 2023-10-06T01:39:44.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.016+0000 7facce165700 1 -- 172.21.15.69:0/3240541959 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facc806e380 msgr2=0x7facc815f070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:44.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.016+0000 7facce165700 1 --2- 172.21.15.69:0/3240541959 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facc806e380 0x7facc815f070 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7facb800a520 tx=0x7facb8007960 comp rx=0 tx=0).stop 2023-10-06T01:39:44.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.016+0000 7facce165700 1 -- 172.21.15.69:0/3240541959 shutdown_connections 2023-10-06T01:39:44.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.016+0000 7facce165700 1 --2- 172.21.15.69:0/3240541959 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7facb4066f30 0x7facb40693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:44.020 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.016+0000 7facce165700 1 --2- 172.21.15.69:0/3240541959 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7facc80a90d0 0x7facc80b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:44.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.016+0000 7facce165700 1 --2- 172.21.15.69:0/3240541959 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7facc806e380 0x7facc815f070 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:44.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.016+0000 7facce165700 1 --2- 172.21.15.69:0/3240541959 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7facc80a8d00 0x7facc815fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:44.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.016+0000 7facce165700 1 -- 172.21.15.69:0/3240541959 >> 172.21.15.69:0/3240541959 conn(0x7facc806ce80 msgr2=0x7facc80af370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:44.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.016+0000 7facce165700 1 -- 172.21.15.69:0/3240541959 shutdown_connections 2023-10-06T01:39:44.021 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.016+0000 7facce165700 1 -- 172.21.15.69:0/3240541959 wait complete. 2023-10-06T01:39:44.021 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-10-06T01:39:44.028 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2023-10-06T01:39:42.271146+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":201,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":168,"acting":168,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":148,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382528,"kb_used_data":4224,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592192,"statfs":{"total":773094113280,"available":770654404608,"internally_reserved":0,"allocated":4325376,"data_stored":2420858,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.670350"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.531235+0000","last_change":"2023-10-06T01:39:39.526915+0000","last_active":"2023-10-06T01:39:39.531235+0000","last_peered":"2023-10-06T01:39:39.531235+0000","last_clean":"2023-10-06T01:39:39.531235+0000","last_became_active":"2023-10-06T01:39:39.526686+0000","last_became_peered":"2023-10-06T01:39:39.526686+0000","last_unstale":"2023-10-06T01:39:39.531235+0000","last_undegraded":"2023-10-06T01:39:39.531235+0000","last_fullsized":"2023-10-06T01:39:39.531235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:07:20.141113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.527522+0000","last_change":"2023-10-06T01:39:39.524003+0000","last_active":"2023-10-06T01:39:39.527522+0000","last_peered":"2023-10-06T01:39:39.527522+0000","last_clean":"2023-10-06T01:39:39.527522+0000","last_became_active":"2023-10-06T01:39:39.523726+0000","last_became_peered":"2023-10-06T01:39:39.523726+0000","last_unstale":"2023-10-06T01:39:39.527522+0000","last_undegraded":"2023-10-06T01:39:39.527522+0000","last_fullsized":"2023-10-06T01:39:39.527522+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:40.175833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.539552+0000","last_change":"2023-10-06T01:39:39.538503+0000","last_active":"2023-10-06T01:39:39.539552+0000","last_peered":"2023-10-06T01:39:39.539552+0000","last_clean":"2023-10-06T01:39:39.539552+0000","last_became_active":"2023-10-06T01:39:39.538337+0000","last_became_peered":"2023-10-06T01:39:39.538337+0000","last_unstale":"2023-10-06T01:39:39.539552+0000","last_undegraded":"2023-10-06T01:39:39.539552+0000","last_fullsized":"2023-10-06T01:39:39.539552+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:13.353533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532785+0000","last_change":"2023-10-06T01:39:39.530772+0000","last_active":"2023-10-06T01:39:39.532785+0000","last_peered":"2023-10-06T01:39:39.532785+0000","last_clean":"2023-10-06T01:39:39.532785+0000","last_became_active":"2023-10-06T01:39:39.530517+0000","last_became_peered":"2023-10-06T01:39:39.530517+0000","last_unstale":"2023-10-06T01:39:39.532785+0000","last_undegraded":"2023-10-06T01:39:39.532785+0000","last_fullsized":"2023-10-06T01:39:39.532785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.642217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532800+0000","last_change":"2023-10-06T01:39:39.527585+0000","last_active":"2023-10-06T01:39:39.532800+0000","last_peered":"2023-10-06T01:39:39.532800+0000","last_clean":"2023-10-06T01:39:39.532800+0000","last_became_active":"2023-10-06T01:39:39.527217+0000","last_became_peered":"2023-10-06T01:39:39.527217+0000","last_unstale":"2023-10-06T01:39:39.532800+0000","last_undegraded":"2023-10-06T01:39:39.532800+0000","last_fullsized":"2023-10-06T01:39:39.532800+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:55.203229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533099+0000","last_change":"2023-10-06T01:39:39.530203+0000","last_active":"2023-10-06T01:39:39.533099+0000","last_peered":"2023-10-06T01:39:39.533099+0000","last_clean":"2023-10-06T01:39:39.533099+0000","last_became_active":"2023-10-06T01:39:39.529971+0000","last_became_peered":"2023-10-06T01:39:39.529971+0000","last_unstale":"2023-10-06T01:39:39.533099+0000","last_undegraded":"2023-10-06T01:39:39.533099+0000","last_fullsized":"2023-10-06T01:39:39.533099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:50:02.715525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541363+0000","last_change":"2023-10-06T01:39:39.533186+0000","last_active":"2023-10-06T01:39:39.541363+0000","last_peered":"2023-10-06T01:39:39.541363+0000","last_clean":"2023-10-06T01:39:39.541363+0000","last_became_active":"2023-10-06T01:39:39.532941+0000","last_became_peered":"2023-10-06T01:39:39.532941+0000","last_unstale":"2023-10-06T01:39:39.541363+0000","last_undegraded":"2023-10-06T01:39:39.541363+0000","last_fullsized":"2023-10-06T01:39:39.541363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:28.581592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541518+0000","last_change":"2023-10-06T01:39:39.537465+0000","last_active":"2023-10-06T01:39:39.541518+0000","last_peered":"2023-10-06T01:39:39.541518+0000","last_clean":"2023-10-06T01:39:39.541518+0000","last_became_active":"2023-10-06T01:39:39.537237+0000","last_became_peered":"2023-10-06T01:39:39.537237+0000","last_unstale":"2023-10-06T01:39:39.541518+0000","last_undegraded":"2023-10-06T01:39:39.541518+0000","last_fullsized":"2023-10-06T01:39:39.541518+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:43.913718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541368+0000","last_change":"2023-10-06T01:39:39.533041+0000","last_active":"2023-10-06T01:39:39.541368+0000","last_peered":"2023-10-06T01:39:39.541368+0000","last_clean":"2023-10-06T01:39:39.541368+0000","last_became_active":"2023-10-06T01:39:39.532764+0000","last_became_peered":"2023-10-06T01:39:39.532764+0000","last_unstale":"2023-10-06T01:39:39.541368+0000","last_undegraded":"2023-10-06T01:39:39.541368+0000","last_fullsized":"2023-10-06T01:39:39.541368+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:49.497096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541823+0000","last_change":"2023-10-06T01:39:39.539028+0000","last_active":"2023-10-06T01:39:39.541823+0000","last_peered":"2023-10-06T01:39:39.541823+0000","last_clean":"2023-10-06T01:39:39.541823+0000","last_became_active":"2023-10-06T01:39:39.538655+0000","last_became_peered":"2023-10-06T01:39:39.538655+0000","last_unstale":"2023-10-06T01:39:39.541823+0000","last_undegraded":"2023-10-06T01:39:39.541823+0000","last_fullsized":"2023-10-06T01:39:39.541823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:16.101682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.530715+0000","last_change":"2023-10-06T01:39:39.524232+0000","last_active":"2023-10-06T01:39:39.530715+0000","last_peered":"2023-10-06T01:39:39.530715+0000","last_clean":"2023-10-06T01:39:39.530715+0000","last_became_active":"2023-10-06T01:39:39.523956+0000","last_became_peered":"2023-10-06T01:39:39.523956+0000","last_unstale":"2023-10-06T01:39:39.530715+0000","last_undegraded":"2023-10-06T01:39:39.530715+0000","last_fullsized":"2023-10-06T01:39:39.530715+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:05:05.351196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535445+0000","last_change":"2023-10-06T01:39:39.531764+0000","last_active":"2023-10-06T01:39:39.535445+0000","last_peered":"2023-10-06T01:39:39.535445+0000","last_clean":"2023-10-06T01:39:39.535445+0000","last_became_active":"2023-10-06T01:39:39.531514+0000","last_became_peered":"2023-10-06T01:39:39.531514+0000","last_unstale":"2023-10-06T01:39:39.535445+0000","last_undegraded":"2023-10-06T01:39:39.535445+0000","last_fullsized":"2023-10-06T01:39:39.535445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:03.781047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536300+0000","last_change":"2023-10-06T01:39:39.534404+0000","last_active":"2023-10-06T01:39:39.536300+0000","last_peered":"2023-10-06T01:39:39.536300+0000","last_clean":"2023-10-06T01:39:39.536300+0000","last_became_active":"2023-10-06T01:39:39.533543+0000","last_became_peered":"2023-10-06T01:39:39.533543+0000","last_unstale":"2023-10-06T01:39:39.536300+0000","last_undegraded":"2023-10-06T01:39:39.536300+0000","last_fullsized":"2023-10-06T01:39:39.536300+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:49.497096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.538610+0000","last_change":"2023-10-06T01:39:39.532117+0000","last_active":"2023-10-06T01:39:39.538610+0000","last_peered":"2023-10-06T01:39:39.538610+0000","last_clean":"2023-10-06T01:39:39.538610+0000","last_became_active":"2023-10-06T01:39:39.531824+0000","last_became_peered":"2023-10-06T01:39:39.531824+0000","last_unstale":"2023-10-06T01:39:39.538610+0000","last_undegraded":"2023-10-06T01:39:39.538610+0000","last_fullsized":"2023-10-06T01:39:39.538610+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.642217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532043+0000","last_change":"2023-10-06T01:39:39.527764+0000","last_active":"2023-10-06T01:39:39.532043+0000","last_peered":"2023-10-06T01:39:39.532043+0000","last_clean":"2023-10-06T01:39:39.532043+0000","last_became_active":"2023-10-06T01:39:39.527017+0000","last_became_peered":"2023-10-06T01:39:39.527017+0000","last_unstale":"2023-10-06T01:39:39.532043+0000","last_undegraded":"2023-10-06T01:39:39.532043+0000","last_fullsized":"2023-10-06T01:39:39.532043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:36.816199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541320+0000","last_change":"2023-10-06T01:39:39.538515+0000","last_active":"2023-10-06T01:39:39.541320+0000","last_peered":"2023-10-06T01:39:39.541320+0000","last_clean":"2023-10-06T01:39:39.541320+0000","last_became_active":"2023-10-06T01:39:39.538214+0000","last_became_peered":"2023-10-06T01:39:39.538214+0000","last_unstale":"2023-10-06T01:39:39.541320+0000","last_undegraded":"2023-10-06T01:39:39.541320+0000","last_fullsized":"2023-10-06T01:39:39.541320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:50:32.520206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532460+0000","last_change":"2023-10-06T01:39:39.527312+0000","last_active":"2023-10-06T01:39:39.532460+0000","last_peered":"2023-10-06T01:39:39.532460+0000","last_clean":"2023-10-06T01:39:39.532460+0000","last_became_active":"2023-10-06T01:39:39.526997+0000","last_became_peered":"2023-10-06T01:39:39.526997+0000","last_unstale":"2023-10-06T01:39:39.532460+0000","last_undegraded":"2023-10-06T01:39:39.532460+0000","last_fullsized":"2023-10-06T01:39:39.532460+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:06.076326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.539115+0000","last_change":"2023-10-06T01:39:39.534940+0000","last_active":"2023-10-06T01:39:39.539115+0000","last_peered":"2023-10-06T01:39:39.539115+0000","last_clean":"2023-10-06T01:39:39.539115+0000","last_became_active":"2023-10-06T01:39:39.534650+0000","last_became_peered":"2023-10-06T01:39:39.534650+0000","last_unstale":"2023-10-06T01:39:39.539115+0000","last_undegraded":"2023-10-06T01:39:39.539115+0000","last_fullsized":"2023-10-06T01:39:39.539115+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:54.181909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535947+0000","last_change":"2023-10-06T01:39:39.534201+0000","last_active":"2023-10-06T01:39:39.535947+0000","last_peered":"2023-10-06T01:39:39.535947+0000","last_clean":"2023-10-06T01:39:39.535947+0000","last_became_active":"2023-10-06T01:39:39.533900+0000","last_became_peered":"2023-10-06T01:39:39.533900+0000","last_unstale":"2023-10-06T01:39:39.535947+0000","last_undegraded":"2023-10-06T01:39:39.535947+0000","last_fullsized":"2023-10-06T01:39:39.535947+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:36.108288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532873+0000","last_change":"2023-10-06T01:39:39.531717+0000","last_active":"2023-10-06T01:39:39.532873+0000","last_peered":"2023-10-06T01:39:39.532873+0000","last_clean":"2023-10-06T01:39:39.532873+0000","last_became_active":"2023-10-06T01:39:39.531485+0000","last_became_peered":"2023-10-06T01:39:39.531485+0000","last_unstale":"2023-10-06T01:39:39.532873+0000","last_undegraded":"2023-10-06T01:39:39.532873+0000","last_fullsized":"2023-10-06T01:39:39.532873+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:42.574061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533787+0000","last_change":"2023-10-06T01:39:39.528899+0000","last_active":"2023-10-06T01:39:39.533787+0000","last_peered":"2023-10-06T01:39:39.533787+0000","last_clean":"2023-10-06T01:39:39.533787+0000","last_became_active":"2023-10-06T01:39:39.528582+0000","last_became_peered":"2023-10-06T01:39:39.528582+0000","last_unstale":"2023-10-06T01:39:39.533787+0000","last_undegraded":"2023-10-06T01:39:39.533787+0000","last_fullsized":"2023-10-06T01:39:39.533787+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:23.534135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.539109+0000","last_change":"2023-10-06T01:39:39.536007+0000","last_active":"2023-10-06T01:39:39.539109+0000","last_peered":"2023-10-06T01:39:39.539109+0000","last_clean":"2023-10-06T01:39:39.539109+0000","last_became_active":"2023-10-06T01:39:39.533706+0000","last_became_peered":"2023-10-06T01:39:39.533706+0000","last_unstale":"2023-10-06T01:39:39.539109+0000","last_undegraded":"2023-10-06T01:39:39.539109+0000","last_fullsized":"2023-10-06T01:39:39.539109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:13.353533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535778+0000","last_change":"2023-10-06T01:39:39.529699+0000","last_active":"2023-10-06T01:39:39.535778+0000","last_peered":"2023-10-06T01:39:39.535778+0000","last_clean":"2023-10-06T01:39:39.535778+0000","last_became_active":"2023-10-06T01:39:39.529341+0000","last_became_peered":"2023-10-06T01:39:39.529341+0000","last_unstale":"2023-10-06T01:39:39.535778+0000","last_undegraded":"2023-10-06T01:39:39.535778+0000","last_fullsized":"2023-10-06T01:39:39.535778+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:51:05.439429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533050+0000","last_change":"2023-10-06T01:39:39.528443+0000","last_active":"2023-10-06T01:39:39.533050+0000","last_peered":"2023-10-06T01:39:39.533050+0000","last_clean":"2023-10-06T01:39:39.533050+0000","last_became_active":"2023-10-06T01:39:39.528008+0000","last_became_peered":"2023-10-06T01:39:39.528008+0000","last_unstale":"2023-10-06T01:39:39.533050+0000","last_undegraded":"2023-10-06T01:39:39.533050+0000","last_fullsized":"2023-10-06T01:39:39.533050+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:42.574061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.538139+0000","last_change":"2023-10-06T01:39:39.531595+0000","last_active":"2023-10-06T01:39:39.538139+0000","last_peered":"2023-10-06T01:39:39.538139+0000","last_clean":"2023-10-06T01:39:39.538139+0000","last_became_active":"2023-10-06T01:39:39.531416+0000","last_became_peered":"2023-10-06T01:39:39.531416+0000","last_unstale":"2023-10-06T01:39:39.538139+0000","last_undegraded":"2023-10-06T01:39:39.538139+0000","last_fullsized":"2023-10-06T01:39:39.538139+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:23.999705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535927+0000","last_change":"2023-10-06T01:39:39.533940+0000","last_active":"2023-10-06T01:39:39.535927+0000","last_peered":"2023-10-06T01:39:39.535927+0000","last_clean":"2023-10-06T01:39:39.535927+0000","last_became_active":"2023-10-06T01:39:39.533195+0000","last_became_peered":"2023-10-06T01:39:39.533195+0000","last_unstale":"2023-10-06T01:39:39.535927+0000","last_undegraded":"2023-10-06T01:39:39.535927+0000","last_fullsized":"2023-10-06T01:39:39.535927+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:55.203229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535010+0000","last_change":"2023-10-06T01:39:39.533042+0000","last_active":"2023-10-06T01:39:39.535010+0000","last_peered":"2023-10-06T01:39:39.535010+0000","last_clean":"2023-10-06T01:39:39.535010+0000","last_became_active":"2023-10-06T01:39:39.532433+0000","last_became_peered":"2023-10-06T01:39:39.532433+0000","last_unstale":"2023-10-06T01:39:39.535010+0000","last_undegraded":"2023-10-06T01:39:39.535010+0000","last_fullsized":"2023-10-06T01:39:39.535010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:51:05.439429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"34'4","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.616579+0000","last_change":"2023-10-06T01:39:38.626494+0000","last_active":"2023-10-06T01:39:39.616579+0000","last_peered":"2023-10-06T01:39:39.616579+0000","last_clean":"2023-10-06T01:39:39.616579+0000","last_became_active":"2023-10-06T01:39:38.625958+0000","last_became_peered":"2023-10-06T01:39:38.625958+0000","last_unstale":"2023-10-06T01:39:39.616579+0000","last_undegraded":"2023-10-06T01:39:39.616579+0000","last_fullsized":"2023-10-06T01:39:39.616579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:12.414360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:37.589723+0000","last_change":"2023-10-06T01:39:37.589723+0000","last_active":"2023-10-06T01:39:37.589723+0000","last_peered":"2023-10-06T01:39:37.589723+0000","last_clean":"2023-10-06T01:39:37.589723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:37.589723+0000","last_undegraded":"2023-10-06T01:39:37.589723+0000","last_fullsized":"2023-10-06T01:39:37.589723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541310+0000","last_change":"2023-10-06T01:39:39.535667+0000","last_active":"2023-10-06T01:39:39.541310+0000","last_peered":"2023-10-06T01:39:39.541310+0000","last_clean":"2023-10-06T01:39:39.541310+0000","last_became_active":"2023-10-06T01:39:39.535332+0000","last_became_peered":"2023-10-06T01:39:39.535332+0000","last_unstale":"2023-10-06T01:39:39.541310+0000","last_undegraded":"2023-10-06T01:39:39.541310+0000","last_fullsized":"2023-10-06T01:39:39.541310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:37.318580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:37.589723+0000","last_change":"2023-10-06T01:39:37.589723+0000","last_active":"2023-10-06T01:39:37.589723+0000","last_peered":"2023-10-06T01:39:37.589723+0000","last_clean":"2023-10-06T01:39:37.589723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:37.589723+0000","last_undegraded":"2023-10-06T01:39:37.589723+0000","last_fullsized":"2023-10-06T01:39:37.589723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533622+0000","last_change":"2023-10-06T01:39:39.531136+0000","last_active":"2023-10-06T01:39:39.533622+0000","last_peered":"2023-10-06T01:39:39.533622+0000","last_clean":"2023-10-06T01:39:39.533622+0000","last_became_active":"2023-10-06T01:39:39.530908+0000","last_became_peered":"2023-10-06T01:39:39.530908+0000","last_unstale":"2023-10-06T01:39:39.533622+0000","last_undegraded":"2023-10-06T01:39:39.533622+0000","last_fullsized":"2023-10-06T01:39:39.533622+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:26.799204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.616014+0000","last_change":"2023-10-06T01:39:38.623866+0000","last_active":"2023-10-06T01:39:39.616014+0000","last_peered":"2023-10-06T01:39:39.616014+0000","last_clean":"2023-10-06T01:39:39.616014+0000","last_became_active":"2023-10-06T01:39:38.623558+0000","last_became_peered":"2023-10-06T01:39:38.623558+0000","last_unstale":"2023-10-06T01:39:39.616014+0000","last_undegraded":"2023-10-06T01:39:39.616014+0000","last_fullsized":"2023-10-06T01:39:39.616014+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:19.711959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.615600+0000","last_change":"2023-10-06T01:39:38.624485+0000","last_active":"2023-10-06T01:39:39.615600+0000","last_peered":"2023-10-06T01:39:39.615600+0000","last_clean":"2023-10-06T01:39:39.615600+0000","last_became_active":"2023-10-06T01:39:38.624224+0000","last_became_peered":"2023-10-06T01:39:38.624224+0000","last_unstale":"2023-10-06T01:39:39.615600+0000","last_undegraded":"2023-10-06T01:39:39.615600+0000","last_fullsized":"2023-10-06T01:39:39.615600+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:41.565197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532780+0000","last_change":"2023-10-06T01:39:39.527154+0000","last_active":"2023-10-06T01:39:39.532780+0000","last_peered":"2023-10-06T01:39:39.532780+0000","last_clean":"2023-10-06T01:39:39.532780+0000","last_became_active":"2023-10-06T01:39:39.526851+0000","last_became_peered":"2023-10-06T01:39:39.526851+0000","last_unstale":"2023-10-06T01:39:39.532780+0000","last_undegraded":"2023-10-06T01:39:39.532780+0000","last_fullsized":"2023-10-06T01:39:39.532780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:40.175833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.616307+0000","last_change":"2023-10-06T01:39:38.625182+0000","last_active":"2023-10-06T01:39:39.616307+0000","last_peered":"2023-10-06T01:39:39.616307+0000","last_clean":"2023-10-06T01:39:39.616307+0000","last_became_active":"2023-10-06T01:39:38.624900+0000","last_became_peered":"2023-10-06T01:39:38.624900+0000","last_unstale":"2023-10-06T01:39:39.616307+0000","last_undegraded":"2023-10-06T01:39:39.616307+0000","last_fullsized":"2023-10-06T01:39:39.616307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:48.430978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536320+0000","last_change":"2023-10-06T01:39:39.532155+0000","last_active":"2023-10-06T01:39:39.536320+0000","last_peered":"2023-10-06T01:39:39.536320+0000","last_clean":"2023-10-06T01:39:39.536320+0000","last_became_active":"2023-10-06T01:39:39.531870+0000","last_became_peered":"2023-10-06T01:39:39.531870+0000","last_unstale":"2023-10-06T01:39:39.536320+0000","last_undegraded":"2023-10-06T01:39:39.536320+0000","last_fullsized":"2023-10-06T01:39:39.536320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:42.351468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:37.589723+0000","last_change":"2023-10-06T01:39:37.589723+0000","last_active":"2023-10-06T01:39:37.589723+0000","last_peered":"2023-10-06T01:39:37.589723+0000","last_clean":"2023-10-06T01:39:37.589723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:37.589723+0000","last_undegraded":"2023-10-06T01:39:37.589723+0000","last_fullsized":"2023-10-06T01:39:37.589723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532100+0000","last_change":"2023-10-06T01:39:39.528278+0000","last_active":"2023-10-06T01:39:39.532100+0000","last_peered":"2023-10-06T01:39:39.532100+0000","last_clean":"2023-10-06T01:39:39.532100+0000","last_became_active":"2023-10-06T01:39:39.527700+0000","last_became_peered":"2023-10-06T01:39:39.527700+0000","last_unstale":"2023-10-06T01:39:39.532100+0000","last_undegraded":"2023-10-06T01:39:39.532100+0000","last_fullsized":"2023-10-06T01:39:39.532100+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:28.581592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.529680+0000","last_change":"2023-10-06T01:39:38.630745+0000","last_active":"2023-10-06T01:39:39.529680+0000","last_peered":"2023-10-06T01:39:39.529680+0000","last_clean":"2023-10-06T01:39:39.529680+0000","last_became_active":"2023-10-06T01:39:38.630466+0000","last_became_peered":"2023-10-06T01:39:38.630466+0000","last_unstale":"2023-10-06T01:39:39.529680+0000","last_undegraded":"2023-10-06T01:39:39.529680+0000","last_fullsized":"2023-10-06T01:39:39.529680+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:30.512210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.539563+0000","last_change":"2023-10-06T01:39:39.538565+0000","last_active":"2023-10-06T01:39:39.539563+0000","last_peered":"2023-10-06T01:39:39.539563+0000","last_clean":"2023-10-06T01:39:39.539563+0000","last_became_active":"2023-10-06T01:39:39.538331+0000","last_became_peered":"2023-10-06T01:39:39.538331+0000","last_unstale":"2023-10-06T01:39:39.539563+0000","last_undegraded":"2023-10-06T01:39:39.539563+0000","last_fullsized":"2023-10-06T01:39:39.539563+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:23.999705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.517658+0000","last_change":"2023-10-06T01:39:38.628795+0000","last_active":"2023-10-06T01:39:39.517658+0000","last_peered":"2023-10-06T01:39:39.517658+0000","last_clean":"2023-10-06T01:39:39.517658+0000","last_became_active":"2023-10-06T01:39:38.628536+0000","last_became_peered":"2023-10-06T01:39:38.628536+0000","last_unstale":"2023-10-06T01:39:39.517658+0000","last_undegraded":"2023-10-06T01:39:39.517658+0000","last_fullsized":"2023-10-06T01:39:39.517658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:27.661354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536001+0000","last_change":"2023-10-06T01:39:39.534373+0000","last_active":"2023-10-06T01:39:39.536001+0000","last_peered":"2023-10-06T01:39:39.536001+0000","last_clean":"2023-10-06T01:39:39.536001+0000","last_became_active":"2023-10-06T01:39:39.533475+0000","last_became_peered":"2023-10-06T01:39:39.533475+0000","last_unstale":"2023-10-06T01:39:39.536001+0000","last_undegraded":"2023-10-06T01:39:39.536001+0000","last_fullsized":"2023-10-06T01:39:39.536001+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:44.243800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.521871+0000","last_change":"2023-10-06T01:39:38.628870+0000","last_active":"2023-10-06T01:39:39.521871+0000","last_peered":"2023-10-06T01:39:39.521871+0000","last_clean":"2023-10-06T01:39:39.521871+0000","last_became_active":"2023-10-06T01:39:38.628553+0000","last_became_peered":"2023-10-06T01:39:38.628553+0000","last_unstale":"2023-10-06T01:39:39.521871+0000","last_undegraded":"2023-10-06T01:39:39.521871+0000","last_fullsized":"2023-10-06T01:39:39.521871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:22.525270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"34'3","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.623127+0000","last_change":"2023-10-06T01:39:38.628825+0000","last_active":"2023-10-06T01:39:39.623127+0000","last_peered":"2023-10-06T01:39:39.623127+0000","last_clean":"2023-10-06T01:39:39.623127+0000","last_became_active":"2023-10-06T01:39:38.628517+0000","last_became_peered":"2023-10-06T01:39:38.628517+0000","last_unstale":"2023-10-06T01:39:39.623127+0000","last_undegraded":"2023-10-06T01:39:39.623127+0000","last_fullsized":"2023-10-06T01:39:39.623127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:50:31.511342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.538694+0000","last_change":"2023-10-06T01:39:39.534285+0000","last_active":"2023-10-06T01:39:39.538694+0000","last_peered":"2023-10-06T01:39:39.538694+0000","last_clean":"2023-10-06T01:39:39.538694+0000","last_became_active":"2023-10-06T01:39:39.534034+0000","last_became_peered":"2023-10-06T01:39:39.534034+0000","last_unstale":"2023-10-06T01:39:39.538694+0000","last_undegraded":"2023-10-06T01:39:39.538694+0000","last_fullsized":"2023-10-06T01:39:39.538694+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:19:39.808879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"34'6","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.618668+0000","last_change":"2023-10-06T01:39:38.622530+0000","last_active":"2023-10-06T01:39:39.618668+0000","last_peered":"2023-10-06T01:39:39.618668+0000","last_clean":"2023-10-06T01:39:39.618668+0000","last_became_active":"2023-10-06T01:39:38.622273+0000","last_became_peered":"2023-10-06T01:39:38.622273+0000","last_unstale":"2023-10-06T01:39:39.618668+0000","last_undegraded":"2023-10-06T01:39:39.618668+0000","last_fullsized":"2023-10-06T01:39:39.618668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:09.207989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.615312+0000","last_change":"2023-10-06T01:39:38.620186+0000","last_active":"2023-10-06T01:39:39.615312+0000","last_peered":"2023-10-06T01:39:39.615312+0000","last_clean":"2023-10-06T01:39:39.615312+0000","last_became_active":"2023-10-06T01:39:38.619533+0000","last_became_peered":"2023-10-06T01:39:38.619533+0000","last_unstale":"2023-10-06T01:39:39.615312+0000","last_undegraded":"2023-10-06T01:39:39.615312+0000","last_fullsized":"2023-10-06T01:39:39.615312+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:39.151951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.526690+0000","last_change":"2023-10-06T01:39:39.524124+0000","last_active":"2023-10-06T01:39:39.526690+0000","last_peered":"2023-10-06T01:39:39.526690+0000","last_clean":"2023-10-06T01:39:39.526690+0000","last_became_active":"2023-10-06T01:39:39.523937+0000","last_became_peered":"2023-10-06T01:39:39.523937+0000","last_unstale":"2023-10-06T01:39:39.526690+0000","last_undegraded":"2023-10-06T01:39:39.526690+0000","last_fullsized":"2023-10-06T01:39:39.526690+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:43.467840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:37.589723+0000","last_change":"2023-10-06T01:39:37.589723+0000","last_active":"2023-10-06T01:39:37.589723+0000","last_peered":"2023-10-06T01:39:37.589723+0000","last_clean":"2023-10-06T01:39:37.589723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:37.589723+0000","last_undegraded":"2023-10-06T01:39:37.589723+0000","last_fullsized":"2023-10-06T01:39:37.589723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536404+0000","last_change":"2023-10-06T01:39:39.534594+0000","last_active":"2023-10-06T01:39:39.536404+0000","last_peered":"2023-10-06T01:39:39.536404+0000","last_clean":"2023-10-06T01:39:39.536404+0000","last_became_active":"2023-10-06T01:39:39.534233+0000","last_became_peered":"2023-10-06T01:39:39.534233+0000","last_unstale":"2023-10-06T01:39:39.536404+0000","last_undegraded":"2023-10-06T01:39:39.536404+0000","last_fullsized":"2023-10-06T01:39:39.536404+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:43.913718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.525679+0000","last_change":"2023-10-06T01:39:38.626277+0000","last_active":"2023-10-06T01:39:39.525679+0000","last_peered":"2023-10-06T01:39:39.525679+0000","last_clean":"2023-10-06T01:39:39.525679+0000","last_became_active":"2023-10-06T01:39:38.625992+0000","last_became_peered":"2023-10-06T01:39:38.625992+0000","last_unstale":"2023-10-06T01:39:39.525679+0000","last_undegraded":"2023-10-06T01:39:39.525679+0000","last_fullsized":"2023-10-06T01:39:39.525679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:26.630294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.531082+0000","last_change":"2023-10-06T01:39:39.526088+0000","last_active":"2023-10-06T01:39:39.531082+0000","last_peered":"2023-10-06T01:39:39.531082+0000","last_clean":"2023-10-06T01:39:39.531082+0000","last_became_active":"2023-10-06T01:39:39.525757+0000","last_became_peered":"2023-10-06T01:39:39.525757+0000","last_unstale":"2023-10-06T01:39:39.531082+0000","last_undegraded":"2023-10-06T01:39:39.531082+0000","last_fullsized":"2023-10-06T01:39:39.531082+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:52.418744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"34'8","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.619531+0000","last_change":"2023-10-06T01:39:38.625180+0000","last_active":"2023-10-06T01:39:39.619531+0000","last_peered":"2023-10-06T01:39:39.619531+0000","last_clean":"2023-10-06T01:39:39.619531+0000","last_became_active":"2023-10-06T01:39:38.624889+0000","last_became_peered":"2023-10-06T01:39:38.624889+0000","last_unstale":"2023-10-06T01:39:39.619531+0000","last_undegraded":"2023-10-06T01:39:39.619531+0000","last_fullsized":"2023-10-06T01:39:39.619531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:22:20.164155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533562+0000","last_change":"2023-10-06T01:39:39.531326+0000","last_active":"2023-10-06T01:39:39.533562+0000","last_peered":"2023-10-06T01:39:39.533562+0000","last_clean":"2023-10-06T01:39:39.533562+0000","last_became_active":"2023-10-06T01:39:39.531097+0000","last_became_peered":"2023-10-06T01:39:39.531097+0000","last_unstale":"2023-10-06T01:39:39.533562+0000","last_undegraded":"2023-10-06T01:39:39.533562+0000","last_fullsized":"2023-10-06T01:39:39.533562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:46.119956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.619174+0000","last_change":"2023-10-06T01:39:38.627708+0000","last_active":"2023-10-06T01:39:39.619174+0000","last_peered":"2023-10-06T01:39:39.619174+0000","last_clean":"2023-10-06T01:39:39.619174+0000","last_became_active":"2023-10-06T01:39:38.627477+0000","last_became_peered":"2023-10-06T01:39:38.627477+0000","last_unstale":"2023-10-06T01:39:39.619174+0000","last_undegraded":"2023-10-06T01:39:39.619174+0000","last_fullsized":"2023-10-06T01:39:39.619174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:12.344668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535629+0000","last_change":"2023-10-06T01:39:39.527319+0000","last_active":"2023-10-06T01:39:39.535629+0000","last_peered":"2023-10-06T01:39:39.535629+0000","last_clean":"2023-10-06T01:39:39.535629+0000","last_became_active":"2023-10-06T01:39:39.527083+0000","last_became_peered":"2023-10-06T01:39:39.527083+0000","last_unstale":"2023-10-06T01:39:39.535629+0000","last_undegraded":"2023-10-06T01:39:39.535629+0000","last_fullsized":"2023-10-06T01:39:39.535629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:52.418744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.617094+0000","last_change":"2023-10-06T01:39:38.627207+0000","last_active":"2023-10-06T01:39:39.617094+0000","last_peered":"2023-10-06T01:39:39.617094+0000","last_clean":"2023-10-06T01:39:39.617094+0000","last_became_active":"2023-10-06T01:39:38.626943+0000","last_became_peered":"2023-10-06T01:39:38.626943+0000","last_unstale":"2023-10-06T01:39:39.617094+0000","last_undegraded":"2023-10-06T01:39:39.617094+0000","last_fullsized":"2023-10-06T01:39:39.617094+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:45.111092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536257+0000","last_change":"2023-10-06T01:39:39.533370+0000","last_active":"2023-10-06T01:39:39.536257+0000","last_peered":"2023-10-06T01:39:39.536257+0000","last_clean":"2023-10-06T01:39:39.536257+0000","last_became_active":"2023-10-06T01:39:39.532868+0000","last_became_peered":"2023-10-06T01:39:39.532868+0000","last_unstale":"2023-10-06T01:39:39.536257+0000","last_undegraded":"2023-10-06T01:39:39.536257+0000","last_fullsized":"2023-10-06T01:39:39.536257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:59.497040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.616717+0000","last_change":"2023-10-06T01:39:38.627502+0000","last_active":"2023-10-06T01:39:39.616717+0000","last_peered":"2023-10-06T01:39:39.616717+0000","last_clean":"2023-10-06T01:39:39.616717+0000","last_became_active":"2023-10-06T01:39:38.627231+0000","last_became_peered":"2023-10-06T01:39:38.627231+0000","last_unstale":"2023-10-06T01:39:39.616717+0000","last_undegraded":"2023-10-06T01:39:39.616717+0000","last_fullsized":"2023-10-06T01:39:39.616717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:12.414360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533124+0000","last_change":"2023-10-06T01:39:39.531931+0000","last_active":"2023-10-06T01:39:39.533124+0000","last_peered":"2023-10-06T01:39:39.533124+0000","last_clean":"2023-10-06T01:39:39.533124+0000","last_became_active":"2023-10-06T01:39:39.531631+0000","last_became_peered":"2023-10-06T01:39:39.531631+0000","last_unstale":"2023-10-06T01:39:39.533124+0000","last_undegraded":"2023-10-06T01:39:39.533124+0000","last_fullsized":"2023-10-06T01:39:39.533124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:50:32.520206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:37.589723+0000","last_change":"2023-10-06T01:39:37.589723+0000","last_active":"2023-10-06T01:39:37.589723+0000","last_peered":"2023-10-06T01:39:37.589723+0000","last_clean":"2023-10-06T01:39:37.589723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:37.589723+0000","last_undegraded":"2023-10-06T01:39:37.589723+0000","last_fullsized":"2023-10-06T01:39:37.589723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.538913+0000","last_change":"2023-10-06T01:39:39.535329+0000","last_active":"2023-10-06T01:39:39.538913+0000","last_peered":"2023-10-06T01:39:39.538913+0000","last_clean":"2023-10-06T01:39:39.538913+0000","last_became_active":"2023-10-06T01:39:39.534826+0000","last_became_peered":"2023-10-06T01:39:39.534826+0000","last_unstale":"2023-10-06T01:39:39.538913+0000","last_undegraded":"2023-10-06T01:39:39.538913+0000","last_fullsized":"2023-10-06T01:39:39.538913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:05:05.351196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.616288+0000","last_change":"2023-10-06T01:39:38.622188+0000","last_active":"2023-10-06T01:39:39.616288+0000","last_peered":"2023-10-06T01:39:39.616288+0000","last_clean":"2023-10-06T01:39:39.616288+0000","last_became_active":"2023-10-06T01:39:38.621909+0000","last_became_peered":"2023-10-06T01:39:38.621909+0000","last_unstale":"2023-10-06T01:39:39.616288+0000","last_undegraded":"2023-10-06T01:39:39.616288+0000","last_fullsized":"2023-10-06T01:39:39.616288+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:06.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.520646+0000","last_change":"2023-10-06T01:39:38.624450+0000","last_active":"2023-10-06T01:39:39.520646+0000","last_peered":"2023-10-06T01:39:39.520646+0000","last_clean":"2023-10-06T01:39:39.520646+0000","last_became_active":"2023-10-06T01:39:38.624218+0000","last_became_peered":"2023-10-06T01:39:38.624218+0000","last_unstale":"2023-10-06T01:39:39.520646+0000","last_undegraded":"2023-10-06T01:39:39.520646+0000","last_fullsized":"2023-10-06T01:39:39.520646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:26.630294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.537160+0000","last_change":"2023-10-06T01:39:39.530340+0000","last_active":"2023-10-06T01:39:39.537160+0000","last_peered":"2023-10-06T01:39:39.537160+0000","last_clean":"2023-10-06T01:39:39.537160+0000","last_became_active":"2023-10-06T01:39:39.530047+0000","last_became_peered":"2023-10-06T01:39:39.530047+0000","last_unstale":"2023-10-06T01:39:39.537160+0000","last_undegraded":"2023-10-06T01:39:39.537160+0000","last_fullsized":"2023-10-06T01:39:39.537160+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:41:55.235050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.518549+0000","last_change":"2023-10-06T01:39:38.630812+0000","last_active":"2023-10-06T01:39:39.518549+0000","last_peered":"2023-10-06T01:39:39.518549+0000","last_clean":"2023-10-06T01:39:39.518549+0000","last_became_active":"2023-10-06T01:39:38.630517+0000","last_became_peered":"2023-10-06T01:39:38.630517+0000","last_unstale":"2023-10-06T01:39:39.518549+0000","last_undegraded":"2023-10-06T01:39:39.518549+0000","last_fullsized":"2023-10-06T01:39:39.518549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:17.633353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532118+0000","last_change":"2023-10-06T01:39:39.528466+0000","last_active":"2023-10-06T01:39:39.532118+0000","last_peered":"2023-10-06T01:39:39.532118+0000","last_clean":"2023-10-06T01:39:39.532118+0000","last_became_active":"2023-10-06T01:39:39.528042+0000","last_became_peered":"2023-10-06T01:39:39.528042+0000","last_unstale":"2023-10-06T01:39:39.532118+0000","last_undegraded":"2023-10-06T01:39:39.532118+0000","last_fullsized":"2023-10-06T01:39:39.532118+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:06.076326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.521385+0000","last_change":"2023-10-06T01:39:38.623491+0000","last_active":"2023-10-06T01:39:39.521385+0000","last_peered":"2023-10-06T01:39:39.521385+0000","last_clean":"2023-10-06T01:39:39.521385+0000","last_became_active":"2023-10-06T01:39:38.623222+0000","last_became_peered":"2023-10-06T01:39:38.623222+0000","last_unstale":"2023-10-06T01:39:39.521385+0000","last_undegraded":"2023-10-06T01:39:39.521385+0000","last_fullsized":"2023-10-06T01:39:39.521385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:36:21.647390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:37.589723+0000","last_change":"2023-10-06T01:39:37.589723+0000","last_active":"2023-10-06T01:39:37.589723+0000","last_peered":"2023-10-06T01:39:37.589723+0000","last_clean":"2023-10-06T01:39:37.589723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:37.589723+0000","last_undegraded":"2023-10-06T01:39:37.589723+0000","last_fullsized":"2023-10-06T01:39:37.589723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T01:39:32.319570+0000","last_change":"2023-10-06T01:38:44.533111+0000","last_active":"2023-10-06T01:39:32.319570+0000","last_peered":"2023-10-06T01:39:32.319570+0000","last_clean":"2023-10-06T01:39:32.319570+0000","last_became_active":"2023-10-06T01:38:44.532838+0000","last_became_peered":"2023-10-06T01:38:44.532838+0000","last_unstale":"2023-10-06T01:39:32.319570+0000","last_undegraded":"2023-10-06T01:39:32.319570+0000","last_fullsized":"2023-10-06T01:39:32.319570+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532512+0000","last_change":"2023-10-06T01:39:39.529973+0000","last_active":"2023-10-06T01:39:39.532512+0000","last_peered":"2023-10-06T01:39:39.532512+0000","last_clean":"2023-10-06T01:39:39.532512+0000","last_became_active":"2023-10-06T01:39:39.529739+0000","last_became_peered":"2023-10-06T01:39:39.529739+0000","last_unstale":"2023-10-06T01:39:39.532512+0000","last_undegraded":"2023-10-06T01:39:39.532512+0000","last_fullsized":"2023-10-06T01:39:39.532512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:41:55.235050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:37.589723+0000","last_change":"2023-10-06T01:39:37.589723+0000","last_active":"2023-10-06T01:39:37.589723+0000","last_peered":"2023-10-06T01:39:37.589723+0000","last_clean":"2023-10-06T01:39:37.589723+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:37.589723+0000","last_undegraded":"2023-10-06T01:39:37.589723+0000","last_fullsized":"2023-10-06T01:39:37.589723+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.520635+0000","last_change":"2023-10-06T01:38:44.533897+0000","last_active":"2023-10-06T01:39:39.520635+0000","last_peered":"2023-10-06T01:39:39.520635+0000","last_clean":"2023-10-06T01:39:39.520635+0000","last_became_active":"2023-10-06T01:38:44.533611+0000","last_became_peered":"2023-10-06T01:38:44.533611+0000","last_unstale":"2023-10-06T01:39:39.520635+0000","last_undegraded":"2023-10-06T01:39:39.520635+0000","last_fullsized":"2023-10-06T01:39:39.520635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:24.411408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.534892+0000","last_change":"2023-10-06T01:39:39.531616+0000","last_active":"2023-10-06T01:39:39.534892+0000","last_peered":"2023-10-06T01:39:39.534892+0000","last_clean":"2023-10-06T01:39:39.534892+0000","last_became_active":"2023-10-06T01:39:39.531337+0000","last_became_peered":"2023-10-06T01:39:39.531337+0000","last_unstale":"2023-10-06T01:39:39.534892+0000","last_undegraded":"2023-10-06T01:39:39.534892+0000","last_fullsized":"2023-10-06T01:39:39.534892+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:57.121167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T01:39:40.963716+0000","last_change":"2023-10-06T01:39:38.627842+0000","last_active":"2023-10-06T01:39:40.963716+0000","last_peered":"2023-10-06T01:39:40.963716+0000","last_clean":"2023-10-06T01:39:40.963716+0000","last_became_active":"2023-10-06T01:39:38.627581+0000","last_became_peered":"2023-10-06T01:39:38.627581+0000","last_unstale":"2023-10-06T01:39:40.963716+0000","last_undegraded":"2023-10-06T01:39:40.963716+0000","last_fullsized":"2023-10-06T01:39:40.963716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:45.908004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.520759+0000","last_change":"2023-10-06T01:38:45.307814+0000","last_active":"2023-10-06T01:39:39.520759+0000","last_peered":"2023-10-06T01:39:39.520759+0000","last_clean":"2023-10-06T01:39:39.520759+0000","last_became_active":"2023-10-06T01:38:45.307536+0000","last_became_peered":"2023-10-06T01:38:45.307536+0000","last_unstale":"2023-10-06T01:39:39.520759+0000","last_undegraded":"2023-10-06T01:39:39.520759+0000","last_fullsized":"2023-10-06T01:39:39.520759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:09.503713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.539176+0000","last_change":"2023-10-06T01:39:39.531658+0000","last_active":"2023-10-06T01:39:39.539176+0000","last_peered":"2023-10-06T01:39:39.539176+0000","last_clean":"2023-10-06T01:39:39.539176+0000","last_became_active":"2023-10-06T01:39:39.531262+0000","last_became_peered":"2023-10-06T01:39:39.531262+0000","last_unstale":"2023-10-06T01:39:39.539176+0000","last_undegraded":"2023-10-06T01:39:39.539176+0000","last_fullsized":"2023-10-06T01:39:39.539176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:43.467840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.518786+0000","last_change":"2023-10-06T01:39:38.626151+0000","last_active":"2023-10-06T01:39:39.518786+0000","last_peered":"2023-10-06T01:39:39.518786+0000","last_clean":"2023-10-06T01:39:39.518786+0000","last_became_active":"2023-10-06T01:39:38.625888+0000","last_became_peered":"2023-10-06T01:39:38.625888+0000","last_unstale":"2023-10-06T01:39:39.518786+0000","last_undegraded":"2023-10-06T01:39:39.518786+0000","last_fullsized":"2023-10-06T01:39:39.518786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:35.807335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.518659+0000","last_change":"2023-10-06T01:38:44.534507+0000","last_active":"2023-10-06T01:39:39.518659+0000","last_peered":"2023-10-06T01:39:39.518659+0000","last_clean":"2023-10-06T01:39:39.518659+0000","last_became_active":"2023-10-06T01:38:44.534191+0000","last_became_peered":"2023-10-06T01:38:44.534191+0000","last_unstale":"2023-10-06T01:39:39.518659+0000","last_undegraded":"2023-10-06T01:39:39.518659+0000","last_fullsized":"2023-10-06T01:39:39.518659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.519577+0000","last_change":"2023-10-06T01:38:40.115117+0000","last_active":"2023-10-06T01:39:39.519577+0000","last_peered":"2023-10-06T01:39:39.519577+0000","last_clean":"2023-10-06T01:39:39.519577+0000","last_became_active":"2023-10-06T01:38:40.114142+0000","last_became_peered":"2023-10-06T01:38:40.114142+0000","last_unstale":"2023-10-06T01:39:39.519577+0000","last_undegraded":"2023-10-06T01:39:39.519577+0000","last_fullsized":"2023-10-06T01:39:39.519577+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_clean_scrub_stamp":"2023-10-06T01:38:38.338797+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:52.870262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.7","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.623038+0000","last_change":"2023-10-06T01:39:38.628812+0000","last_active":"2023-10-06T01:39:39.623038+0000","last_peered":"2023-10-06T01:39:39.623038+0000","last_clean":"2023-10-06T01:39:39.623038+0000","last_became_active":"2023-10-06T01:39:38.628525+0000","last_became_peered":"2023-10-06T01:39:38.628525+0000","last_unstale":"2023-10-06T01:39:39.623038+0000","last_undegraded":"2023-10-06T01:39:39.623038+0000","last_fullsized":"2023-10-06T01:39:39.623038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:22.990841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.519641+0000","last_change":"2023-10-06T01:38:44.531831+0000","last_active":"2023-10-06T01:39:39.519641+0000","last_peered":"2023-10-06T01:39:39.519641+0000","last_clean":"2023-10-06T01:39:39.519641+0000","last_became_active":"2023-10-06T01:38:44.531496+0000","last_became_peered":"2023-10-06T01:38:44.531496+0000","last_unstale":"2023-10-06T01:39:39.519641+0000","last_undegraded":"2023-10-06T01:39:39.519641+0000","last_fullsized":"2023-10-06T01:39:39.519641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:28.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-06T01:39:38.598587+0000","last_change":"2023-10-06T01:39:38.598587+0000","last_active":"2023-10-06T01:39:38.598587+0000","last_peered":"2023-10-06T01:39:38.598587+0000","last_clean":"2023-10-06T01:39:38.598587+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-06T01:39:38.598587+0000","last_undegraded":"2023-10-06T01:39:38.598587+0000","last_fullsized":"2023-10-06T01:39:38.598587+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.525846+0000","last_change":"2023-10-06T01:39:38.626256+0000","last_active":"2023-10-06T01:39:39.525846+0000","last_peered":"2023-10-06T01:39:39.525846+0000","last_clean":"2023-10-06T01:39:39.525846+0000","last_became_active":"2023-10-06T01:39:38.625973+0000","last_became_peered":"2023-10-06T01:39:38.625973+0000","last_unstale":"2023-10-06T01:39:39.525846+0000","last_undegraded":"2023-10-06T01:39:39.525846+0000","last_fullsized":"2023-10-06T01:39:39.525846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:36:21.647390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.519166+0000","last_change":"2023-10-06T01:38:44.531335+0000","last_active":"2023-10-06T01:39:39.519166+0000","last_peered":"2023-10-06T01:39:39.519166+0000","last_clean":"2023-10-06T01:39:39.519166+0000","last_became_active":"2023-10-06T01:38:44.530966+0000","last_became_peered":"2023-10-06T01:38:44.530966+0000","last_unstale":"2023-10-06T01:39:39.519166+0000","last_undegraded":"2023-10-06T01:39:39.519166+0000","last_fullsized":"2023-10-06T01:39:39.519166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:33.926180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536339+0000","last_change":"2023-10-06T01:39:39.532663+0000","last_active":"2023-10-06T01:39:39.536339+0000","last_peered":"2023-10-06T01:39:39.536339+0000","last_clean":"2023-10-06T01:39:39.536339+0000","last_became_active":"2023-10-06T01:39:39.532435+0000","last_became_peered":"2023-10-06T01:39:39.532435+0000","last_unstale":"2023-10-06T01:39:39.536339+0000","last_undegraded":"2023-10-06T01:39:39.536339+0000","last_fullsized":"2023-10-06T01:39:39.536339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:23:15.510626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.529694+0000","last_change":"2023-10-06T01:39:38.623748+0000","last_active":"2023-10-06T01:39:39.529694+0000","last_peered":"2023-10-06T01:39:39.529694+0000","last_clean":"2023-10-06T01:39:39.529694+0000","last_became_active":"2023-10-06T01:39:38.623460+0000","last_became_peered":"2023-10-06T01:39:38.623460+0000","last_unstale":"2023-10-06T01:39:39.529694+0000","last_undegraded":"2023-10-06T01:39:39.529694+0000","last_fullsized":"2023-10-06T01:39:39.529694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:02:05.682135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":17,"reported_epoch":27,"state":"active+clean","last_fresh":"2023-10-06T01:39:32.320639+0000","last_change":"2023-10-06T01:38:44.533582+0000","last_active":"2023-10-06T01:39:32.320639+0000","last_peered":"2023-10-06T01:39:32.320639+0000","last_clean":"2023-10-06T01:39:32.320639+0000","last_became_active":"2023-10-06T01:38:44.533324+0000","last_became_peered":"2023-10-06T01:38:44.533324+0000","last_unstale":"2023-10-06T01:39:32.320639+0000","last_undegraded":"2023-10-06T01:39:32.320639+0000","last_fullsized":"2023-10-06T01:39:32.320639+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535058+0000","last_change":"2023-10-06T01:39:39.532149+0000","last_active":"2023-10-06T01:39:39.535058+0000","last_peered":"2023-10-06T01:39:39.535058+0000","last_clean":"2023-10-06T01:39:39.535058+0000","last_became_active":"2023-10-06T01:39:39.531891+0000","last_became_peered":"2023-10-06T01:39:39.531891+0000","last_unstale":"2023-10-06T01:39:39.535058+0000","last_undegraded":"2023-10-06T01:39:39.535058+0000","last_fullsized":"2023-10-06T01:39:39.535058+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:40.175833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.517261+0000","last_change":"2023-10-06T01:39:38.623722+0000","last_active":"2023-10-06T01:39:39.517261+0000","last_peered":"2023-10-06T01:39:39.517261+0000","last_clean":"2023-10-06T01:39:39.517261+0000","last_became_active":"2023-10-06T01:39:38.623425+0000","last_became_peered":"2023-10-06T01:39:38.623425+0000","last_unstale":"2023-10-06T01:39:39.517261+0000","last_undegraded":"2023-10-06T01:39:39.517261+0000","last_fullsized":"2023-10-06T01:39:39.517261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:14.193205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.526690+0000","last_change":"2023-10-06T01:38:44.533765+0000","last_active":"2023-10-06T01:39:39.526690+0000","last_peered":"2023-10-06T01:39:39.526690+0000","last_clean":"2023-10-06T01:39:39.526690+0000","last_became_active":"2023-10-06T01:38:44.533406+0000","last_became_peered":"2023-10-06T01:38:44.533406+0000","last_unstale":"2023-10-06T01:39:39.526690+0000","last_undegraded":"2023-10-06T01:39:39.526690+0000","last_fullsized":"2023-10-06T01:39:39.526690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":6},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":4488,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":36,"ondisk_log_size":36,"up":50,"acting":50,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298272,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073568,"statfs":{"total":96636764160,"available":96331333632,"internally_reserved":0,"allocated":1007616,"data_stored":753061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.70099999999999996}]},{"osd":1,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.73599999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.75700000000000001}]},{"osd":3,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.77900000000000003}]},{"osd":4,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.46400000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.54500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":401408,"data_stored":161641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.495},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.55100000000000005}]},{"osd":1,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.46000000000000002}]},{"osd":2,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.39600000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.56699999999999995}]},{"osd":4,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.34899999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.52900000000000003}]},{"osd":7,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.432}]}]},{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297628,"kb_used_data":340,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074212,"statfs":{"total":96636764160,"available":96331993088,"internally_reserved":0,"allocated":348160,"data_stored":134556,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.378}]},{"osd":2,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":0.33700000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.29299999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.41599999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.54200000000000004}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.46400000000000002}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.48199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298208,"kb_used_data":920,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073632,"statfs":{"total":96636764160,"available":96331399168,"internally_reserved":0,"allocated":942080,"data_stored":724924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.19500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.246}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":401408,"data_stored":161157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.34599999999999997}]},{"osd":1,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.39300000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.77500000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.748}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.82299999999999995}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.67100000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":413696,"data_stored":162657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.313},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.22800000000000001}]},{"osd":1,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.372}]},{"osd":2,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.35199999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.621}]},{"osd":5,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.49199999999999999}]},{"osd":6,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.55500000000000005}]},{"osd":7,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.67300000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297684,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074156,"statfs":{"total":96636764160,"available":96331935744,"internally_reserved":0,"allocated":405504,"data_stored":161663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.4289999999999998,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.52700000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":4.2270000000000003,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.2789999999999999,"5min":4.2789999999999999,"15min":4.2789999999999999},"last":0.46700000000000003}]},{"osd":2,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":12.359,"5min":12.359,"15min":12.359},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":12.326000000000001,"5min":12.326000000000001,"15min":12.326000000000001},"last":0.67800000000000005}]},{"osd":3,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":3.448,"5min":3.448,"15min":3.448},"last":0.57999999999999996},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":12.282,"5min":12.282,"15min":12.282},"last":0.504}]},{"osd":5,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.64500000000000002}]},{"osd":6,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.623}]},{"osd":7,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.66200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297684,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074156,"statfs":{"total":96636764160,"available":96331935744,"internally_reserved":0,"allocated":405504,"data_stored":161199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.439},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.66400000000000003}]},{"osd":1,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.53700000000000003}]},{"osd":2,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.65300000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.41199999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.69999999999999996}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.63100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:39:44.035 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:39:44.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.183+0000 7fb02e238700 1 Processor -- start 2023-10-06T01:39:44.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.183+0000 7fb02e238700 1 -- start start 2023-10-06T01:39:44.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.184+0000 7fb02e238700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb0280cb5a0 0x7fb0280cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:44.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.184+0000 7fb02e238700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb02815a5d0 0x7fb028156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:44.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.184+0000 7fb02e238700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb02815ae40 con 0x7fb0280cd9e0 2023-10-06T01:39:44.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.184+0000 7fb02e238700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0280d13f0 con 0x7fb02815a5d0 2023-10-06T01:39:44.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.184+0000 7fb02e238700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb02815ab60 con 0x7fb0280cb5a0 2023-10-06T01:39:44.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.184+0000 7fb027fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb02815a5d0 0x7fb028156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:44.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.184+0000 7fb026ffd700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fb0280cd9e0 0x7fb028159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:43374/0 (socket says 172.21.15.69:43374) 2023-10-06T01:39:44.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.184+0000 7fb026ffd700 1 -- 172.21.15.69:0/2617460608 learned_addr learned my addr 172.21.15.69:0/2617460608 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:44.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.184+0000 7fb0277fe700 1 --2- 172.21.15.69:0/2617460608 >> v2:172.21.15.88:3300/0 conn(0x7fb0280cb5a0 0x7fb0280cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:44.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.184+0000 7fb027fff700 1 -- 172.21.15.69:0/2617460608 >> v2:172.21.15.88:3300/0 conn(0x7fb0280cb5a0 msgr2=0x7fb0280cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:44.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.184+0000 7fb027fff700 1 --2- 172.21.15.69:0/2617460608 >> v2:172.21.15.88:3300/0 conn(0x7fb0280cb5a0 0x7fb0280cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:44.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.184+0000 7fb027fff700 1 -- 172.21.15.69:0/2617460608 >> v1:172.21.15.69:6789/0 conn(0x7fb0280cd9e0 legacy=0x7fb028159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:44.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.184+0000 7fb027fff700 1 -- 172.21.15.69:0/2617460608 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0280ccf00 con 0x7fb02815a5d0 2023-10-06T01:39:44.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.184+0000 7fb027fff700 1 --2- 172.21.15.69:0/2617460608 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb02815a5d0 0x7fb028156e90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb020009e60 tx=0x7fb020009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43071ae802d3ca6a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:44.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.184+0000 7fb0267fc700 1 -- 172.21.15.69:0/2617460608 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02000e070 con 0x7fb02815a5d0 2023-10-06T01:39:44.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.184+0000 7fb0267fc700 1 -- 172.21.15.69:0/2617460608 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02000bb30 con 0x7fb02815a5d0 2023-10-06T01:39:44.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.184+0000 7fb0267fc700 1 -- 172.21.15.69:0/2617460608 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02000bed0 con 0x7fb02815a5d0 2023-10-06T01:39:44.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.185+0000 7fb02e238700 1 -- 172.21.15.69:0/2617460608 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb02815a5d0 msgr2=0x7fb028156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:44.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.185+0000 7fb02e238700 1 --2- 172.21.15.69:0/2617460608 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb02815a5d0 0x7fb028156e90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb020009e60 tx=0x7fb020009780 comp rx=0 tx=0).stop 2023-10-06T01:39:44.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.185+0000 7fb02e238700 1 -- 172.21.15.69:0/2617460608 shutdown_connections 2023-10-06T01:39:44.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.185+0000 7fb02e238700 1 --2- 172.21.15.69:0/2617460608 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb02815a5d0 0x7fb028156e90 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:44.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.185+0000 7fb02e238700 1 --2- 172.21.15.69:0/2617460608 >> v2:172.21.15.88:3300/0 conn(0x7fb0280cb5a0 0x7fb0280cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:44.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.185+0000 7fb02e238700 1 -- 172.21.15.69:0/2617460608 >> 172.21.15.69:0/2617460608 conn(0x7fb028070e30 msgr2=0x7fb0280d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:44.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.185+0000 7fb02e238700 1 -- 172.21.15.69:0/2617460608 shutdown_connections 2023-10-06T01:39:44.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.185+0000 7fb02e238700 1 -- 172.21.15.69:0/2617460608 wait complete. 2023-10-06T01:39:44.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.186+0000 7fb02e238700 1 Processor -- start 2023-10-06T01:39:44.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.186+0000 7fb02e238700 1 -- start start 2023-10-06T01:39:44.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.187+0000 7fb02e238700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0280cb5a0 0x7fb028150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:44.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.187+0000 7fb02e238700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0280cd9e0 0x7fb028150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:44.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.187+0000 7fb02e238700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb02815a5d0 0x7fb02815b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:44.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.187+0000 7fb02e238700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0280c89a0 con 0x7fb0280cb5a0 2023-10-06T01:39:44.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.187+0000 7fb02e238700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb028151810 con 0x7fb0280cd9e0 2023-10-06T01:39:44.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.187+0000 7fb02e238700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0280b5780 con 0x7fb02815a5d0 2023-10-06T01:39:44.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.187+0000 7fb0277fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0280cb5a0 0x7fb028150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:44.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.187+0000 7fb0277fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0280cb5a0 0x7fb028150ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58816/0 (socket says 172.21.15.69:58816) 2023-10-06T01:39:44.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.187+0000 7fb0277fe700 1 -- 172.21.15.69:0/2138474933 learned_addr learned my addr 172.21.15.69:0/2138474933 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:44.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.187+0000 7fb026ffd700 1 --2- 172.21.15.69:0/2138474933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0280cd9e0 0x7fb028150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:44.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.187+0000 7fb0277fe700 1 -- 172.21.15.69:0/2138474933 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb02815a5d0 msgr2=0x7fb02815b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:44.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.187+0000 7fb0277fe700 1 --2- 172.21.15.69:0/2138474933 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb02815a5d0 0x7fb02815b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:44.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.187+0000 7fb0277fe700 1 -- 172.21.15.69:0/2138474933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0280cd9e0 msgr2=0x7fb028150820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:44.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.187+0000 7fb0277fe700 1 --2- 172.21.15.69:0/2138474933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0280cd9e0 0x7fb028150820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:44.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.187+0000 7fb0277fe700 1 -- 172.21.15.69:0/2138474933 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb020009a20 con 0x7fb0280cb5a0 2023-10-06T01:39:44.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.188+0000 7fb0277fe700 1 --2- 172.21.15.69:0/2138474933 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0280cb5a0 0x7fb028150ff0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb01800d890 tx=0x7fb018008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:44.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.188+0000 7fb00f7fe700 1 -- 172.21.15.69:0/2138474933 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01800b600 con 0x7fb0280cb5a0 2023-10-06T01:39:44.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.188+0000 7fb00f7fe700 1 -- 172.21.15.69:0/2138474933 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01800b760 con 0x7fb0280cb5a0 2023-10-06T01:39:44.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.188+0000 7fb00f7fe700 1 -- 172.21.15.69:0/2138474933 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01800bae0 con 0x7fb0280cb5a0 2023-10-06T01:39:44.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.188+0000 7fb02e238700 1 -- 172.21.15.69:0/2138474933 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0280c8350 con 0x7fb0280cb5a0 2023-10-06T01:39:44.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.188+0000 7fb02e238700 1 -- 172.21.15.69:0/2138474933 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb028150d60 con 0x7fb0280cb5a0 2023-10-06T01:39:44.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.189+0000 7fb02e238700 1 -- 172.21.15.69:0/2138474933 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0280c81a0 con 0x7fb0280cb5a0 2023-10-06T01:39:44.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.189+0000 7fb00f7fe700 1 -- 172.21.15.69:0/2138474933 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb01801e460 con 0x7fb0280cb5a0 2023-10-06T01:39:44.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.189+0000 7fb00f7fe700 1 --2- 172.21.15.69:0/2138474933 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb014066f30 0x7fb0140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:44.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.189+0000 7fb00f7fe700 1 -- 172.21.15.69:0/2138474933 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb018084d70 con 0x7fb0280cb5a0 2023-10-06T01:39:44.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.190+0000 7fb026ffd700 1 --2- 172.21.15.69:0/2138474933 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb014066f30 0x7fb0140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:44.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.190+0000 7fb026ffd700 1 --2- 172.21.15.69:0/2138474933 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb014066f30 0x7fb0140693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb0280af3e0 tx=0x7fb01c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:44.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.194+0000 7fb00f7fe700 1 -- 172.21.15.69:0/2138474933 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb018051e80 con 0x7fb0280cb5a0 2023-10-06T01:39:44.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.372+0000 7fb02e238700 1 -- 172.21.15.69:0/2138474933 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb0280c8ae0 con 0x7fb014066f30 2023-10-06T01:39:44.380 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.380+0000 7fb00f7fe700 1 -- 172.21.15.69:0/2138474933 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310757 (secure 0 0 0) 0x7fb01c005900 con 0x7fb014066f30 2023-10-06T01:39:44.462 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:44.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.383+0000 7fb02e238700 1 -- 172.21.15.69:0/2138474933 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb014066f30 msgr2=0x7fb0140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:44.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.383+0000 7fb02e238700 1 --2- 172.21.15.69:0/2138474933 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb014066f30 0x7fb0140693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb0280af3e0 tx=0x7fb01c009040 comp rx=0 tx=0).stop 2023-10-06T01:39:44.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.383+0000 7fb02e238700 1 -- 172.21.15.69:0/2138474933 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0280cb5a0 msgr2=0x7fb028150ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:44.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.383+0000 7fb02e238700 1 --2- 172.21.15.69:0/2138474933 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0280cb5a0 0x7fb028150ff0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb01800d890 tx=0x7fb018008040 comp rx=0 tx=0).stop 2023-10-06T01:39:44.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.383+0000 7fb02e238700 1 -- 172.21.15.69:0/2138474933 shutdown_connections 2023-10-06T01:39:44.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.383+0000 7fb02e238700 1 --2- 172.21.15.69:0/2138474933 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb014066f30 0x7fb0140693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:44.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.383+0000 7fb02e238700 1 --2- 172.21.15.69:0/2138474933 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb02815a5d0 0x7fb02815b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:44.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.383+0000 7fb02e238700 1 --2- 172.21.15.69:0/2138474933 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb0280cb5a0 0x7fb028150ff0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:44.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.383+0000 7fb02e238700 1 --2- 172.21.15.69:0/2138474933 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb0280cd9e0 0x7fb028150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:44.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.383+0000 7fb02e238700 1 -- 172.21.15.69:0/2138474933 >> 172.21.15.69:0/2138474933 conn(0x7fb028070e30 msgr2=0x7fb028155cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:44.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.383+0000 7fb02e238700 1 -- 172.21.15.69:0/2138474933 shutdown_connections 2023-10-06T01:39:44.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.383+0000 7fb02e238700 1 -- 172.21.15.69:0/2138474933 wait complete. 2023-10-06T01:39:44.466 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-10-06T01:39:44.466 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2023-10-06T01:39:44.271517+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382632,"kb_used_data":4328,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592088,"statfs":{"total":773094113280,"available":770654298112,"internally_reserved":0,"allocated":4431872,"data_stored":2474044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000977"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.531235+0000","last_change":"2023-10-06T01:39:39.526915+0000","last_active":"2023-10-06T01:39:39.531235+0000","last_peered":"2023-10-06T01:39:39.531235+0000","last_clean":"2023-10-06T01:39:39.531235+0000","last_became_active":"2023-10-06T01:39:39.526686+0000","last_became_peered":"2023-10-06T01:39:39.526686+0000","last_unstale":"2023-10-06T01:39:39.531235+0000","last_undegraded":"2023-10-06T01:39:39.531235+0000","last_fullsized":"2023-10-06T01:39:39.531235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:07:20.141113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.527522+0000","last_change":"2023-10-06T01:39:39.524003+0000","last_active":"2023-10-06T01:39:39.527522+0000","last_peered":"2023-10-06T01:39:39.527522+0000","last_clean":"2023-10-06T01:39:39.527522+0000","last_became_active":"2023-10-06T01:39:39.523726+0000","last_became_peered":"2023-10-06T01:39:39.523726+0000","last_unstale":"2023-10-06T01:39:39.527522+0000","last_undegraded":"2023-10-06T01:39:39.527522+0000","last_fullsized":"2023-10-06T01:39:39.527522+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:40.175833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.534486+0000","last_change":"2023-10-06T01:39:39.530499+0000","last_active":"2023-10-06T01:39:39.534486+0000","last_peered":"2023-10-06T01:39:39.534486+0000","last_clean":"2023-10-06T01:39:39.534486+0000","last_became_active":"2023-10-06T01:39:39.530231+0000","last_became_peered":"2023-10-06T01:39:39.530231+0000","last_unstale":"2023-10-06T01:39:39.534486+0000","last_undegraded":"2023-10-06T01:39:39.534486+0000","last_fullsized":"2023-10-06T01:39:39.534486+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:49.497096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.539552+0000","last_change":"2023-10-06T01:39:39.538503+0000","last_active":"2023-10-06T01:39:39.539552+0000","last_peered":"2023-10-06T01:39:39.539552+0000","last_clean":"2023-10-06T01:39:39.539552+0000","last_became_active":"2023-10-06T01:39:39.538337+0000","last_became_peered":"2023-10-06T01:39:39.538337+0000","last_unstale":"2023-10-06T01:39:39.539552+0000","last_undegraded":"2023-10-06T01:39:39.539552+0000","last_fullsized":"2023-10-06T01:39:39.539552+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:13.353533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532785+0000","last_change":"2023-10-06T01:39:39.530772+0000","last_active":"2023-10-06T01:39:39.532785+0000","last_peered":"2023-10-06T01:39:39.532785+0000","last_clean":"2023-10-06T01:39:39.532785+0000","last_became_active":"2023-10-06T01:39:39.530517+0000","last_became_peered":"2023-10-06T01:39:39.530517+0000","last_unstale":"2023-10-06T01:39:39.532785+0000","last_undegraded":"2023-10-06T01:39:39.532785+0000","last_fullsized":"2023-10-06T01:39:39.532785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.642217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.525631+0000","last_change":"2023-10-06T01:39:39.524722+0000","last_active":"2023-10-06T01:39:39.525631+0000","last_peered":"2023-10-06T01:39:39.525631+0000","last_clean":"2023-10-06T01:39:39.525631+0000","last_became_active":"2023-10-06T01:39:39.524473+0000","last_became_peered":"2023-10-06T01:39:39.524473+0000","last_unstale":"2023-10-06T01:39:39.525631+0000","last_undegraded":"2023-10-06T01:39:39.525631+0000","last_fullsized":"2023-10-06T01:39:39.525631+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:57.121167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532800+0000","last_change":"2023-10-06T01:39:39.527585+0000","last_active":"2023-10-06T01:39:39.532800+0000","last_peered":"2023-10-06T01:39:39.532800+0000","last_clean":"2023-10-06T01:39:39.532800+0000","last_became_active":"2023-10-06T01:39:39.527217+0000","last_became_peered":"2023-10-06T01:39:39.527217+0000","last_unstale":"2023-10-06T01:39:39.532800+0000","last_undegraded":"2023-10-06T01:39:39.532800+0000","last_fullsized":"2023-10-06T01:39:39.532800+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:55.203229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533099+0000","last_change":"2023-10-06T01:39:39.530203+0000","last_active":"2023-10-06T01:39:39.533099+0000","last_peered":"2023-10-06T01:39:39.533099+0000","last_clean":"2023-10-06T01:39:39.533099+0000","last_became_active":"2023-10-06T01:39:39.529971+0000","last_became_peered":"2023-10-06T01:39:39.529971+0000","last_unstale":"2023-10-06T01:39:39.533099+0000","last_undegraded":"2023-10-06T01:39:39.533099+0000","last_fullsized":"2023-10-06T01:39:39.533099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:50:02.715525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535315+0000","last_change":"2023-10-06T01:39:39.533151+0000","last_active":"2023-10-06T01:39:39.535315+0000","last_peered":"2023-10-06T01:39:39.535315+0000","last_clean":"2023-10-06T01:39:39.535315+0000","last_became_active":"2023-10-06T01:39:39.532814+0000","last_became_peered":"2023-10-06T01:39:39.532814+0000","last_unstale":"2023-10-06T01:39:39.535315+0000","last_undegraded":"2023-10-06T01:39:39.535315+0000","last_fullsized":"2023-10-06T01:39:39.535315+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:44.243800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541363+0000","last_change":"2023-10-06T01:39:39.533186+0000","last_active":"2023-10-06T01:39:39.541363+0000","last_peered":"2023-10-06T01:39:39.541363+0000","last_clean":"2023-10-06T01:39:39.541363+0000","last_became_active":"2023-10-06T01:39:39.532941+0000","last_became_peered":"2023-10-06T01:39:39.532941+0000","last_unstale":"2023-10-06T01:39:39.541363+0000","last_undegraded":"2023-10-06T01:39:39.541363+0000","last_fullsized":"2023-10-06T01:39:39.541363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:28.581592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541518+0000","last_change":"2023-10-06T01:39:39.537465+0000","last_active":"2023-10-06T01:39:39.541518+0000","last_peered":"2023-10-06T01:39:39.541518+0000","last_clean":"2023-10-06T01:39:39.541518+0000","last_became_active":"2023-10-06T01:39:39.537237+0000","last_became_peered":"2023-10-06T01:39:39.537237+0000","last_unstale":"2023-10-06T01:39:39.541518+0000","last_undegraded":"2023-10-06T01:39:39.541518+0000","last_fullsized":"2023-10-06T01:39:39.541518+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:43.913718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.526385+0000","last_change":"2023-10-06T01:39:39.524109+0000","last_active":"2023-10-06T01:39:39.526385+0000","last_peered":"2023-10-06T01:39:39.526385+0000","last_clean":"2023-10-06T01:39:39.526385+0000","last_became_active":"2023-10-06T01:39:39.523845+0000","last_became_peered":"2023-10-06T01:39:39.523845+0000","last_unstale":"2023-10-06T01:39:39.526385+0000","last_undegraded":"2023-10-06T01:39:39.526385+0000","last_fullsized":"2023-10-06T01:39:39.526385+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:51:05.439429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541368+0000","last_change":"2023-10-06T01:39:39.533041+0000","last_active":"2023-10-06T01:39:39.541368+0000","last_peered":"2023-10-06T01:39:39.541368+0000","last_clean":"2023-10-06T01:39:39.541368+0000","last_became_active":"2023-10-06T01:39:39.532764+0000","last_became_peered":"2023-10-06T01:39:39.532764+0000","last_unstale":"2023-10-06T01:39:39.541368+0000","last_undegraded":"2023-10-06T01:39:39.541368+0000","last_fullsized":"2023-10-06T01:39:39.541368+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:49.497096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541823+0000","last_change":"2023-10-06T01:39:39.539028+0000","last_active":"2023-10-06T01:39:39.541823+0000","last_peered":"2023-10-06T01:39:39.541823+0000","last_clean":"2023-10-06T01:39:39.541823+0000","last_became_active":"2023-10-06T01:39:39.538655+0000","last_became_peered":"2023-10-06T01:39:39.538655+0000","last_unstale":"2023-10-06T01:39:39.541823+0000","last_undegraded":"2023-10-06T01:39:39.541823+0000","last_fullsized":"2023-10-06T01:39:39.541823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:16.101682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.530715+0000","last_change":"2023-10-06T01:39:39.524232+0000","last_active":"2023-10-06T01:39:39.530715+0000","last_peered":"2023-10-06T01:39:39.530715+0000","last_clean":"2023-10-06T01:39:39.530715+0000","last_became_active":"2023-10-06T01:39:39.523956+0000","last_became_peered":"2023-10-06T01:39:39.523956+0000","last_unstale":"2023-10-06T01:39:39.530715+0000","last_undegraded":"2023-10-06T01:39:39.530715+0000","last_fullsized":"2023-10-06T01:39:39.530715+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:05:05.351196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535445+0000","last_change":"2023-10-06T01:39:39.531764+0000","last_active":"2023-10-06T01:39:39.535445+0000","last_peered":"2023-10-06T01:39:39.535445+0000","last_clean":"2023-10-06T01:39:39.535445+0000","last_became_active":"2023-10-06T01:39:39.531514+0000","last_became_peered":"2023-10-06T01:39:39.531514+0000","last_unstale":"2023-10-06T01:39:39.535445+0000","last_undegraded":"2023-10-06T01:39:39.535445+0000","last_fullsized":"2023-10-06T01:39:39.535445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:03.781047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536300+0000","last_change":"2023-10-06T01:39:39.534404+0000","last_active":"2023-10-06T01:39:39.536300+0000","last_peered":"2023-10-06T01:39:39.536300+0000","last_clean":"2023-10-06T01:39:39.536300+0000","last_became_active":"2023-10-06T01:39:39.533543+0000","last_became_peered":"2023-10-06T01:39:39.533543+0000","last_unstale":"2023-10-06T01:39:39.536300+0000","last_undegraded":"2023-10-06T01:39:39.536300+0000","last_fullsized":"2023-10-06T01:39:39.536300+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:49.497096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.538610+0000","last_change":"2023-10-06T01:39:39.532117+0000","last_active":"2023-10-06T01:39:39.538610+0000","last_peered":"2023-10-06T01:39:39.538610+0000","last_clean":"2023-10-06T01:39:39.538610+0000","last_became_active":"2023-10-06T01:39:39.531824+0000","last_became_peered":"2023-10-06T01:39:39.531824+0000","last_unstale":"2023-10-06T01:39:39.538610+0000","last_undegraded":"2023-10-06T01:39:39.538610+0000","last_fullsized":"2023-10-06T01:39:39.538610+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.642217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532043+0000","last_change":"2023-10-06T01:39:39.527764+0000","last_active":"2023-10-06T01:39:39.532043+0000","last_peered":"2023-10-06T01:39:39.532043+0000","last_clean":"2023-10-06T01:39:39.532043+0000","last_became_active":"2023-10-06T01:39:39.527017+0000","last_became_peered":"2023-10-06T01:39:39.527017+0000","last_unstale":"2023-10-06T01:39:39.532043+0000","last_undegraded":"2023-10-06T01:39:39.532043+0000","last_fullsized":"2023-10-06T01:39:39.532043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:36.816199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541320+0000","last_change":"2023-10-06T01:39:39.538515+0000","last_active":"2023-10-06T01:39:39.541320+0000","last_peered":"2023-10-06T01:39:39.541320+0000","last_clean":"2023-10-06T01:39:39.541320+0000","last_became_active":"2023-10-06T01:39:39.538214+0000","last_became_peered":"2023-10-06T01:39:39.538214+0000","last_unstale":"2023-10-06T01:39:39.541320+0000","last_undegraded":"2023-10-06T01:39:39.541320+0000","last_fullsized":"2023-10-06T01:39:39.541320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:50:32.520206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532460+0000","last_change":"2023-10-06T01:39:39.527312+0000","last_active":"2023-10-06T01:39:39.532460+0000","last_peered":"2023-10-06T01:39:39.532460+0000","last_clean":"2023-10-06T01:39:39.532460+0000","last_became_active":"2023-10-06T01:39:39.526997+0000","last_became_peered":"2023-10-06T01:39:39.526997+0000","last_unstale":"2023-10-06T01:39:39.532460+0000","last_undegraded":"2023-10-06T01:39:39.532460+0000","last_fullsized":"2023-10-06T01:39:39.532460+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:06.076326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.539115+0000","last_change":"2023-10-06T01:39:39.534940+0000","last_active":"2023-10-06T01:39:39.539115+0000","last_peered":"2023-10-06T01:39:39.539115+0000","last_clean":"2023-10-06T01:39:39.539115+0000","last_became_active":"2023-10-06T01:39:39.534650+0000","last_became_peered":"2023-10-06T01:39:39.534650+0000","last_unstale":"2023-10-06T01:39:39.539115+0000","last_undegraded":"2023-10-06T01:39:39.539115+0000","last_fullsized":"2023-10-06T01:39:39.539115+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:54.181909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535947+0000","last_change":"2023-10-06T01:39:39.534201+0000","last_active":"2023-10-06T01:39:39.535947+0000","last_peered":"2023-10-06T01:39:39.535947+0000","last_clean":"2023-10-06T01:39:39.535947+0000","last_became_active":"2023-10-06T01:39:39.533900+0000","last_became_peered":"2023-10-06T01:39:39.533900+0000","last_unstale":"2023-10-06T01:39:39.535947+0000","last_undegraded":"2023-10-06T01:39:39.535947+0000","last_fullsized":"2023-10-06T01:39:39.535947+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:36.108288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532873+0000","last_change":"2023-10-06T01:39:39.531717+0000","last_active":"2023-10-06T01:39:39.532873+0000","last_peered":"2023-10-06T01:39:39.532873+0000","last_clean":"2023-10-06T01:39:39.532873+0000","last_became_active":"2023-10-06T01:39:39.531485+0000","last_became_peered":"2023-10-06T01:39:39.531485+0000","last_unstale":"2023-10-06T01:39:39.532873+0000","last_undegraded":"2023-10-06T01:39:39.532873+0000","last_fullsized":"2023-10-06T01:39:39.532873+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:42.574061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533787+0000","last_change":"2023-10-06T01:39:39.528899+0000","last_active":"2023-10-06T01:39:39.533787+0000","last_peered":"2023-10-06T01:39:39.533787+0000","last_clean":"2023-10-06T01:39:39.533787+0000","last_became_active":"2023-10-06T01:39:39.528582+0000","last_became_peered":"2023-10-06T01:39:39.528582+0000","last_unstale":"2023-10-06T01:39:39.533787+0000","last_undegraded":"2023-10-06T01:39:39.533787+0000","last_fullsized":"2023-10-06T01:39:39.533787+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:23.534135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532590+0000","last_change":"2023-10-06T01:39:39.531264+0000","last_active":"2023-10-06T01:39:39.532590+0000","last_peered":"2023-10-06T01:39:39.532590+0000","last_clean":"2023-10-06T01:39:39.532590+0000","last_became_active":"2023-10-06T01:39:39.531012+0000","last_became_peered":"2023-10-06T01:39:39.531012+0000","last_unstale":"2023-10-06T01:39:39.532590+0000","last_undegraded":"2023-10-06T01:39:39.532590+0000","last_fullsized":"2023-10-06T01:39:39.532590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:36.108288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.539109+0000","last_change":"2023-10-06T01:39:39.536007+0000","last_active":"2023-10-06T01:39:39.539109+0000","last_peered":"2023-10-06T01:39:39.539109+0000","last_clean":"2023-10-06T01:39:39.539109+0000","last_became_active":"2023-10-06T01:39:39.533706+0000","last_became_peered":"2023-10-06T01:39:39.533706+0000","last_unstale":"2023-10-06T01:39:39.539109+0000","last_undegraded":"2023-10-06T01:39:39.539109+0000","last_fullsized":"2023-10-06T01:39:39.539109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:13.353533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535778+0000","last_change":"2023-10-06T01:39:39.529699+0000","last_active":"2023-10-06T01:39:39.535778+0000","last_peered":"2023-10-06T01:39:39.535778+0000","last_clean":"2023-10-06T01:39:39.535778+0000","last_became_active":"2023-10-06T01:39:39.529341+0000","last_became_peered":"2023-10-06T01:39:39.529341+0000","last_unstale":"2023-10-06T01:39:39.535778+0000","last_undegraded":"2023-10-06T01:39:39.535778+0000","last_fullsized":"2023-10-06T01:39:39.535778+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:51:05.439429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533050+0000","last_change":"2023-10-06T01:39:39.528443+0000","last_active":"2023-10-06T01:39:39.533050+0000","last_peered":"2023-10-06T01:39:39.533050+0000","last_clean":"2023-10-06T01:39:39.533050+0000","last_became_active":"2023-10-06T01:39:39.528008+0000","last_became_peered":"2023-10-06T01:39:39.528008+0000","last_unstale":"2023-10-06T01:39:39.533050+0000","last_undegraded":"2023-10-06T01:39:39.533050+0000","last_fullsized":"2023-10-06T01:39:39.533050+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:42.574061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.538139+0000","last_change":"2023-10-06T01:39:39.531595+0000","last_active":"2023-10-06T01:39:39.538139+0000","last_peered":"2023-10-06T01:39:39.538139+0000","last_clean":"2023-10-06T01:39:39.538139+0000","last_became_active":"2023-10-06T01:39:39.531416+0000","last_became_peered":"2023-10-06T01:39:39.531416+0000","last_unstale":"2023-10-06T01:39:39.538139+0000","last_undegraded":"2023-10-06T01:39:39.538139+0000","last_fullsized":"2023-10-06T01:39:39.538139+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:23.999705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535927+0000","last_change":"2023-10-06T01:39:39.533940+0000","last_active":"2023-10-06T01:39:39.535927+0000","last_peered":"2023-10-06T01:39:39.535927+0000","last_clean":"2023-10-06T01:39:39.535927+0000","last_became_active":"2023-10-06T01:39:39.533195+0000","last_became_peered":"2023-10-06T01:39:39.533195+0000","last_unstale":"2023-10-06T01:39:39.535927+0000","last_undegraded":"2023-10-06T01:39:39.535927+0000","last_fullsized":"2023-10-06T01:39:39.535927+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:55.203229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533882+0000","last_change":"2023-10-06T01:39:39.532639+0000","last_active":"2023-10-06T01:39:39.533882+0000","last_peered":"2023-10-06T01:39:39.533882+0000","last_clean":"2023-10-06T01:39:39.533882+0000","last_became_active":"2023-10-06T01:39:39.532390+0000","last_became_peered":"2023-10-06T01:39:39.532390+0000","last_unstale":"2023-10-06T01:39:39.533882+0000","last_undegraded":"2023-10-06T01:39:39.533882+0000","last_fullsized":"2023-10-06T01:39:39.533882+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:27.975533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535010+0000","last_change":"2023-10-06T01:39:39.533042+0000","last_active":"2023-10-06T01:39:39.535010+0000","last_peered":"2023-10-06T01:39:39.535010+0000","last_clean":"2023-10-06T01:39:39.535010+0000","last_became_active":"2023-10-06T01:39:39.532433+0000","last_became_peered":"2023-10-06T01:39:39.532433+0000","last_unstale":"2023-10-06T01:39:39.535010+0000","last_undegraded":"2023-10-06T01:39:39.535010+0000","last_fullsized":"2023-10-06T01:39:39.535010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:51:05.439429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"34'4","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.616579+0000","last_change":"2023-10-06T01:39:38.626494+0000","last_active":"2023-10-06T01:39:39.616579+0000","last_peered":"2023-10-06T01:39:39.616579+0000","last_clean":"2023-10-06T01:39:39.616579+0000","last_became_active":"2023-10-06T01:39:38.625958+0000","last_became_peered":"2023-10-06T01:39:38.625958+0000","last_unstale":"2023-10-06T01:39:39.616579+0000","last_undegraded":"2023-10-06T01:39:39.616579+0000","last_fullsized":"2023-10-06T01:39:39.616579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:12.414360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532192+0000","last_change":"2023-10-06T01:39:39.530208+0000","last_active":"2023-10-06T01:39:39.532192+0000","last_peered":"2023-10-06T01:39:39.532192+0000","last_clean":"2023-10-06T01:39:39.532192+0000","last_became_active":"2023-10-06T01:39:39.529957+0000","last_became_peered":"2023-10-06T01:39:39.529957+0000","last_unstale":"2023-10-06T01:39:39.532192+0000","last_undegraded":"2023-10-06T01:39:39.532192+0000","last_fullsized":"2023-10-06T01:39:39.532192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:43.913718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.617188+0000","last_change":"2023-10-06T01:39:38.622143+0000","last_active":"2023-10-06T01:39:39.617188+0000","last_peered":"2023-10-06T01:39:39.617188+0000","last_clean":"2023-10-06T01:39:39.617188+0000","last_became_active":"2023-10-06T01:39:38.621871+0000","last_became_peered":"2023-10-06T01:39:38.621871+0000","last_unstale":"2023-10-06T01:39:39.617188+0000","last_undegraded":"2023-10-06T01:39:39.617188+0000","last_fullsized":"2023-10-06T01:39:39.617188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:50:31.511342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541310+0000","last_change":"2023-10-06T01:39:39.535667+0000","last_active":"2023-10-06T01:39:39.541310+0000","last_peered":"2023-10-06T01:39:39.541310+0000","last_clean":"2023-10-06T01:39:39.541310+0000","last_became_active":"2023-10-06T01:39:39.535332+0000","last_became_peered":"2023-10-06T01:39:39.535332+0000","last_unstale":"2023-10-06T01:39:39.541310+0000","last_undegraded":"2023-10-06T01:39:39.541310+0000","last_fullsized":"2023-10-06T01:39:39.541310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:37.318580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.615588+0000","last_change":"2023-10-06T01:39:38.623708+0000","last_active":"2023-10-06T01:39:39.615588+0000","last_peered":"2023-10-06T01:39:39.615588+0000","last_clean":"2023-10-06T01:39:39.615588+0000","last_became_active":"2023-10-06T01:39:38.623429+0000","last_became_peered":"2023-10-06T01:39:38.623429+0000","last_unstale":"2023-10-06T01:39:39.615588+0000","last_undegraded":"2023-10-06T01:39:39.615588+0000","last_fullsized":"2023-10-06T01:39:39.615588+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:50:31.511342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533622+0000","last_change":"2023-10-06T01:39:39.531136+0000","last_active":"2023-10-06T01:39:39.533622+0000","last_peered":"2023-10-06T01:39:39.533622+0000","last_clean":"2023-10-06T01:39:39.533622+0000","last_became_active":"2023-10-06T01:39:39.530908+0000","last_became_peered":"2023-10-06T01:39:39.530908+0000","last_unstale":"2023-10-06T01:39:39.533622+0000","last_undegraded":"2023-10-06T01:39:39.533622+0000","last_fullsized":"2023-10-06T01:39:39.533622+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:26.799204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.616014+0000","last_change":"2023-10-06T01:39:38.623866+0000","last_active":"2023-10-06T01:39:39.616014+0000","last_peered":"2023-10-06T01:39:39.616014+0000","last_clean":"2023-10-06T01:39:39.616014+0000","last_became_active":"2023-10-06T01:39:38.623558+0000","last_became_peered":"2023-10-06T01:39:38.623558+0000","last_unstale":"2023-10-06T01:39:39.616014+0000","last_undegraded":"2023-10-06T01:39:39.616014+0000","last_fullsized":"2023-10-06T01:39:39.616014+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:19.711959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.534019+0000","last_change":"2023-10-06T01:39:39.528895+0000","last_active":"2023-10-06T01:39:39.534019+0000","last_peered":"2023-10-06T01:39:39.534019+0000","last_clean":"2023-10-06T01:39:39.534019+0000","last_became_active":"2023-10-06T01:39:39.528628+0000","last_became_peered":"2023-10-06T01:39:39.528628+0000","last_unstale":"2023-10-06T01:39:39.534019+0000","last_undegraded":"2023-10-06T01:39:39.534019+0000","last_fullsized":"2023-10-06T01:39:39.534019+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:05:05.351196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.615600+0000","last_change":"2023-10-06T01:39:38.624485+0000","last_active":"2023-10-06T01:39:39.615600+0000","last_peered":"2023-10-06T01:39:39.615600+0000","last_clean":"2023-10-06T01:39:39.615600+0000","last_became_active":"2023-10-06T01:39:38.624224+0000","last_became_peered":"2023-10-06T01:39:38.624224+0000","last_unstale":"2023-10-06T01:39:39.615600+0000","last_undegraded":"2023-10-06T01:39:39.615600+0000","last_fullsized":"2023-10-06T01:39:39.615600+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:41.565197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532780+0000","last_change":"2023-10-06T01:39:39.527154+0000","last_active":"2023-10-06T01:39:39.532780+0000","last_peered":"2023-10-06T01:39:39.532780+0000","last_clean":"2023-10-06T01:39:39.532780+0000","last_became_active":"2023-10-06T01:39:39.526851+0000","last_became_peered":"2023-10-06T01:39:39.526851+0000","last_unstale":"2023-10-06T01:39:39.532780+0000","last_undegraded":"2023-10-06T01:39:39.532780+0000","last_fullsized":"2023-10-06T01:39:39.532780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:40.175833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.616307+0000","last_change":"2023-10-06T01:39:38.625182+0000","last_active":"2023-10-06T01:39:39.616307+0000","last_peered":"2023-10-06T01:39:39.616307+0000","last_clean":"2023-10-06T01:39:39.616307+0000","last_became_active":"2023-10-06T01:39:38.624900+0000","last_became_peered":"2023-10-06T01:39:38.624900+0000","last_unstale":"2023-10-06T01:39:39.616307+0000","last_undegraded":"2023-10-06T01:39:39.616307+0000","last_fullsized":"2023-10-06T01:39:39.616307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:48.430978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536320+0000","last_change":"2023-10-06T01:39:39.532155+0000","last_active":"2023-10-06T01:39:39.536320+0000","last_peered":"2023-10-06T01:39:39.536320+0000","last_clean":"2023-10-06T01:39:39.536320+0000","last_became_active":"2023-10-06T01:39:39.531870+0000","last_became_peered":"2023-10-06T01:39:39.531870+0000","last_unstale":"2023-10-06T01:39:39.536320+0000","last_undegraded":"2023-10-06T01:39:39.536320+0000","last_fullsized":"2023-10-06T01:39:39.536320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:42.351468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.522916+0000","last_change":"2023-10-06T01:39:38.622820+0000","last_active":"2023-10-06T01:39:39.522916+0000","last_peered":"2023-10-06T01:39:39.522916+0000","last_clean":"2023-10-06T01:39:39.522916+0000","last_became_active":"2023-10-06T01:39:38.622547+0000","last_became_peered":"2023-10-06T01:39:38.622547+0000","last_unstale":"2023-10-06T01:39:39.522916+0000","last_undegraded":"2023-10-06T01:39:39.522916+0000","last_fullsized":"2023-10-06T01:39:39.522916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:17.633353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532100+0000","last_change":"2023-10-06T01:39:39.528278+0000","last_active":"2023-10-06T01:39:39.532100+0000","last_peered":"2023-10-06T01:39:39.532100+0000","last_clean":"2023-10-06T01:39:39.532100+0000","last_became_active":"2023-10-06T01:39:39.527700+0000","last_became_peered":"2023-10-06T01:39:39.527700+0000","last_unstale":"2023-10-06T01:39:39.532100+0000","last_undegraded":"2023-10-06T01:39:39.532100+0000","last_fullsized":"2023-10-06T01:39:39.532100+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:28.581592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.529680+0000","last_change":"2023-10-06T01:39:38.630745+0000","last_active":"2023-10-06T01:39:39.529680+0000","last_peered":"2023-10-06T01:39:39.529680+0000","last_clean":"2023-10-06T01:39:39.529680+0000","last_became_active":"2023-10-06T01:39:38.630466+0000","last_became_peered":"2023-10-06T01:39:38.630466+0000","last_unstale":"2023-10-06T01:39:39.529680+0000","last_undegraded":"2023-10-06T01:39:39.529680+0000","last_fullsized":"2023-10-06T01:39:39.529680+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:30.512210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.539563+0000","last_change":"2023-10-06T01:39:39.538565+0000","last_active":"2023-10-06T01:39:39.539563+0000","last_peered":"2023-10-06T01:39:39.539563+0000","last_clean":"2023-10-06T01:39:39.539563+0000","last_became_active":"2023-10-06T01:39:39.538331+0000","last_became_peered":"2023-10-06T01:39:39.538331+0000","last_unstale":"2023-10-06T01:39:39.539563+0000","last_undegraded":"2023-10-06T01:39:39.539563+0000","last_fullsized":"2023-10-06T01:39:39.539563+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:23.999705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.517658+0000","last_change":"2023-10-06T01:39:38.628795+0000","last_active":"2023-10-06T01:39:39.517658+0000","last_peered":"2023-10-06T01:39:39.517658+0000","last_clean":"2023-10-06T01:39:39.517658+0000","last_became_active":"2023-10-06T01:39:38.628536+0000","last_became_peered":"2023-10-06T01:39:38.628536+0000","last_unstale":"2023-10-06T01:39:39.517658+0000","last_undegraded":"2023-10-06T01:39:39.517658+0000","last_fullsized":"2023-10-06T01:39:39.517658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:27.661354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536001+0000","last_change":"2023-10-06T01:39:39.534373+0000","last_active":"2023-10-06T01:39:39.536001+0000","last_peered":"2023-10-06T01:39:39.536001+0000","last_clean":"2023-10-06T01:39:39.536001+0000","last_became_active":"2023-10-06T01:39:39.533475+0000","last_became_peered":"2023-10-06T01:39:39.533475+0000","last_unstale":"2023-10-06T01:39:39.536001+0000","last_undegraded":"2023-10-06T01:39:39.536001+0000","last_fullsized":"2023-10-06T01:39:39.536001+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:44.243800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.521871+0000","last_change":"2023-10-06T01:39:38.628870+0000","last_active":"2023-10-06T01:39:39.521871+0000","last_peered":"2023-10-06T01:39:39.521871+0000","last_clean":"2023-10-06T01:39:39.521871+0000","last_became_active":"2023-10-06T01:39:38.628553+0000","last_became_peered":"2023-10-06T01:39:38.628553+0000","last_unstale":"2023-10-06T01:39:39.521871+0000","last_undegraded":"2023-10-06T01:39:39.521871+0000","last_fullsized":"2023-10-06T01:39:39.521871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:22.525270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533741+0000","last_change":"2023-10-06T01:39:39.528068+0000","last_active":"2023-10-06T01:39:39.533741+0000","last_peered":"2023-10-06T01:39:39.533741+0000","last_clean":"2023-10-06T01:39:39.533741+0000","last_became_active":"2023-10-06T01:39:39.527827+0000","last_became_peered":"2023-10-06T01:39:39.527827+0000","last_unstale":"2023-10-06T01:39:39.533741+0000","last_undegraded":"2023-10-06T01:39:39.533741+0000","last_fullsized":"2023-10-06T01:39:39.533741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:43.913718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"34'3","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.623127+0000","last_change":"2023-10-06T01:39:38.628825+0000","last_active":"2023-10-06T01:39:39.623127+0000","last_peered":"2023-10-06T01:39:39.623127+0000","last_clean":"2023-10-06T01:39:39.623127+0000","last_became_active":"2023-10-06T01:39:38.628517+0000","last_became_peered":"2023-10-06T01:39:38.628517+0000","last_unstale":"2023-10-06T01:39:39.623127+0000","last_undegraded":"2023-10-06T01:39:39.623127+0000","last_fullsized":"2023-10-06T01:39:39.623127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:50:31.511342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.538694+0000","last_change":"2023-10-06T01:39:39.534285+0000","last_active":"2023-10-06T01:39:39.538694+0000","last_peered":"2023-10-06T01:39:39.538694+0000","last_clean":"2023-10-06T01:39:39.538694+0000","last_became_active":"2023-10-06T01:39:39.534034+0000","last_became_peered":"2023-10-06T01:39:39.534034+0000","last_unstale":"2023-10-06T01:39:39.538694+0000","last_undegraded":"2023-10-06T01:39:39.538694+0000","last_fullsized":"2023-10-06T01:39:39.538694+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:19:39.808879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"34'6","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.618668+0000","last_change":"2023-10-06T01:39:38.622530+0000","last_active":"2023-10-06T01:39:39.618668+0000","last_peered":"2023-10-06T01:39:39.618668+0000","last_clean":"2023-10-06T01:39:39.618668+0000","last_became_active":"2023-10-06T01:39:38.622273+0000","last_became_peered":"2023-10-06T01:39:38.622273+0000","last_unstale":"2023-10-06T01:39:39.618668+0000","last_undegraded":"2023-10-06T01:39:39.618668+0000","last_fullsized":"2023-10-06T01:39:39.618668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:09.207989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535344+0000","last_change":"2023-10-06T01:39:39.533497+0000","last_active":"2023-10-06T01:39:39.535344+0000","last_peered":"2023-10-06T01:39:39.535344+0000","last_clean":"2023-10-06T01:39:39.535344+0000","last_became_active":"2023-10-06T01:39:39.533233+0000","last_became_peered":"2023-10-06T01:39:39.533233+0000","last_unstale":"2023-10-06T01:39:39.535344+0000","last_undegraded":"2023-10-06T01:39:39.535344+0000","last_fullsized":"2023-10-06T01:39:39.535344+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:55.203229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.615312+0000","last_change":"2023-10-06T01:39:38.620186+0000","last_active":"2023-10-06T01:39:39.615312+0000","last_peered":"2023-10-06T01:39:39.615312+0000","last_clean":"2023-10-06T01:39:39.615312+0000","last_became_active":"2023-10-06T01:39:38.619533+0000","last_became_peered":"2023-10-06T01:39:38.619533+0000","last_unstale":"2023-10-06T01:39:39.615312+0000","last_undegraded":"2023-10-06T01:39:39.615312+0000","last_fullsized":"2023-10-06T01:39:39.615312+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:39.151951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.526690+0000","last_change":"2023-10-06T01:39:39.524124+0000","last_active":"2023-10-06T01:39:39.526690+0000","last_peered":"2023-10-06T01:39:39.526690+0000","last_clean":"2023-10-06T01:39:39.526690+0000","last_became_active":"2023-10-06T01:39:39.523937+0000","last_became_peered":"2023-10-06T01:39:39.523937+0000","last_unstale":"2023-10-06T01:39:39.526690+0000","last_undegraded":"2023-10-06T01:39:39.526690+0000","last_fullsized":"2023-10-06T01:39:39.526690+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:43.467840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.522462+0000","last_change":"2023-10-06T01:39:38.622849+0000","last_active":"2023-10-06T01:39:39.522462+0000","last_peered":"2023-10-06T01:39:39.522462+0000","last_clean":"2023-10-06T01:39:39.522462+0000","last_became_active":"2023-10-06T01:39:38.622572+0000","last_became_peered":"2023-10-06T01:39:38.622572+0000","last_unstale":"2023-10-06T01:39:39.522462+0000","last_undegraded":"2023-10-06T01:39:39.522462+0000","last_fullsized":"2023-10-06T01:39:39.522462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:41.565197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536404+0000","last_change":"2023-10-06T01:39:39.534594+0000","last_active":"2023-10-06T01:39:39.536404+0000","last_peered":"2023-10-06T01:39:39.536404+0000","last_clean":"2023-10-06T01:39:39.536404+0000","last_became_active":"2023-10-06T01:39:39.534233+0000","last_became_peered":"2023-10-06T01:39:39.534233+0000","last_unstale":"2023-10-06T01:39:39.536404+0000","last_undegraded":"2023-10-06T01:39:39.536404+0000","last_fullsized":"2023-10-06T01:39:39.536404+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:43.913718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.525679+0000","last_change":"2023-10-06T01:39:38.626277+0000","last_active":"2023-10-06T01:39:39.525679+0000","last_peered":"2023-10-06T01:39:39.525679+0000","last_clean":"2023-10-06T01:39:39.525679+0000","last_became_active":"2023-10-06T01:39:38.625992+0000","last_became_peered":"2023-10-06T01:39:38.625992+0000","last_unstale":"2023-10-06T01:39:39.525679+0000","last_undegraded":"2023-10-06T01:39:39.525679+0000","last_fullsized":"2023-10-06T01:39:39.525679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:26.630294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.531082+0000","last_change":"2023-10-06T01:39:39.526088+0000","last_active":"2023-10-06T01:39:39.531082+0000","last_peered":"2023-10-06T01:39:39.531082+0000","last_clean":"2023-10-06T01:39:39.531082+0000","last_became_active":"2023-10-06T01:39:39.525757+0000","last_became_peered":"2023-10-06T01:39:39.525757+0000","last_unstale":"2023-10-06T01:39:39.531082+0000","last_undegraded":"2023-10-06T01:39:39.531082+0000","last_fullsized":"2023-10-06T01:39:39.531082+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:52.418744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"34'8","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.619531+0000","last_change":"2023-10-06T01:39:38.625180+0000","last_active":"2023-10-06T01:39:39.619531+0000","last_peered":"2023-10-06T01:39:39.619531+0000","last_clean":"2023-10-06T01:39:39.619531+0000","last_became_active":"2023-10-06T01:39:38.624889+0000","last_became_peered":"2023-10-06T01:39:38.624889+0000","last_unstale":"2023-10-06T01:39:39.619531+0000","last_undegraded":"2023-10-06T01:39:39.619531+0000","last_fullsized":"2023-10-06T01:39:39.619531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:22:20.164155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533562+0000","last_change":"2023-10-06T01:39:39.531326+0000","last_active":"2023-10-06T01:39:39.533562+0000","last_peered":"2023-10-06T01:39:39.533562+0000","last_clean":"2023-10-06T01:39:39.533562+0000","last_became_active":"2023-10-06T01:39:39.531097+0000","last_became_peered":"2023-10-06T01:39:39.531097+0000","last_unstale":"2023-10-06T01:39:39.533562+0000","last_undegraded":"2023-10-06T01:39:39.533562+0000","last_fullsized":"2023-10-06T01:39:39.533562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:46.119956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.619174+0000","last_change":"2023-10-06T01:39:38.627708+0000","last_active":"2023-10-06T01:39:39.619174+0000","last_peered":"2023-10-06T01:39:39.619174+0000","last_clean":"2023-10-06T01:39:39.619174+0000","last_became_active":"2023-10-06T01:39:38.627477+0000","last_became_peered":"2023-10-06T01:39:38.627477+0000","last_unstale":"2023-10-06T01:39:39.619174+0000","last_undegraded":"2023-10-06T01:39:39.619174+0000","last_fullsized":"2023-10-06T01:39:39.619174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:12.344668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535629+0000","last_change":"2023-10-06T01:39:39.527319+0000","last_active":"2023-10-06T01:39:39.535629+0000","last_peered":"2023-10-06T01:39:39.535629+0000","last_clean":"2023-10-06T01:39:39.535629+0000","last_became_active":"2023-10-06T01:39:39.527083+0000","last_became_peered":"2023-10-06T01:39:39.527083+0000","last_unstale":"2023-10-06T01:39:39.535629+0000","last_undegraded":"2023-10-06T01:39:39.535629+0000","last_fullsized":"2023-10-06T01:39:39.535629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:52.418744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.617094+0000","last_change":"2023-10-06T01:39:38.627207+0000","last_active":"2023-10-06T01:39:39.617094+0000","last_peered":"2023-10-06T01:39:39.617094+0000","last_clean":"2023-10-06T01:39:39.617094+0000","last_became_active":"2023-10-06T01:39:38.626943+0000","last_became_peered":"2023-10-06T01:39:38.626943+0000","last_unstale":"2023-10-06T01:39:39.617094+0000","last_undegraded":"2023-10-06T01:39:39.617094+0000","last_fullsized":"2023-10-06T01:39:39.617094+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:45.111092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536257+0000","last_change":"2023-10-06T01:39:39.533370+0000","last_active":"2023-10-06T01:39:39.536257+0000","last_peered":"2023-10-06T01:39:39.536257+0000","last_clean":"2023-10-06T01:39:39.536257+0000","last_became_active":"2023-10-06T01:39:39.532868+0000","last_became_peered":"2023-10-06T01:39:39.532868+0000","last_unstale":"2023-10-06T01:39:39.536257+0000","last_undegraded":"2023-10-06T01:39:39.536257+0000","last_fullsized":"2023-10-06T01:39:39.536257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:59.497040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.616717+0000","last_change":"2023-10-06T01:39:38.627502+0000","last_active":"2023-10-06T01:39:39.616717+0000","last_peered":"2023-10-06T01:39:39.616717+0000","last_clean":"2023-10-06T01:39:39.616717+0000","last_became_active":"2023-10-06T01:39:38.627231+0000","last_became_peered":"2023-10-06T01:39:38.627231+0000","last_unstale":"2023-10-06T01:39:39.616717+0000","last_undegraded":"2023-10-06T01:39:39.616717+0000","last_fullsized":"2023-10-06T01:39:39.616717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:12.414360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533124+0000","last_change":"2023-10-06T01:39:39.531931+0000","last_active":"2023-10-06T01:39:39.533124+0000","last_peered":"2023-10-06T01:39:39.533124+0000","last_clean":"2023-10-06T01:39:39.533124+0000","last_became_active":"2023-10-06T01:39:39.531631+0000","last_became_peered":"2023-10-06T01:39:39.531631+0000","last_unstale":"2023-10-06T01:39:39.533124+0000","last_undegraded":"2023-10-06T01:39:39.533124+0000","last_fullsized":"2023-10-06T01:39:39.533124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:50:32.520206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.522667+0000","last_change":"2023-10-06T01:39:38.623671+0000","last_active":"2023-10-06T01:39:39.522667+0000","last_peered":"2023-10-06T01:39:39.522667+0000","last_clean":"2023-10-06T01:39:39.522667+0000","last_became_active":"2023-10-06T01:39:38.623388+0000","last_became_peered":"2023-10-06T01:39:38.623388+0000","last_unstale":"2023-10-06T01:39:39.522667+0000","last_undegraded":"2023-10-06T01:39:39.522667+0000","last_fullsized":"2023-10-06T01:39:39.522667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:22.990841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.538913+0000","last_change":"2023-10-06T01:39:39.535329+0000","last_active":"2023-10-06T01:39:39.538913+0000","last_peered":"2023-10-06T01:39:39.538913+0000","last_clean":"2023-10-06T01:39:39.538913+0000","last_became_active":"2023-10-06T01:39:39.534826+0000","last_became_peered":"2023-10-06T01:39:39.534826+0000","last_unstale":"2023-10-06T01:39:39.538913+0000","last_undegraded":"2023-10-06T01:39:39.538913+0000","last_fullsized":"2023-10-06T01:39:39.538913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:05:05.351196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.616288+0000","last_change":"2023-10-06T01:39:38.622188+0000","last_active":"2023-10-06T01:39:39.616288+0000","last_peered":"2023-10-06T01:39:39.616288+0000","last_clean":"2023-10-06T01:39:39.616288+0000","last_became_active":"2023-10-06T01:39:38.621909+0000","last_became_peered":"2023-10-06T01:39:38.621909+0000","last_unstale":"2023-10-06T01:39:39.616288+0000","last_undegraded":"2023-10-06T01:39:39.616288+0000","last_fullsized":"2023-10-06T01:39:39.616288+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:06.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533769+0000","last_change":"2023-10-06T01:39:39.528119+0000","last_active":"2023-10-06T01:39:39.533769+0000","last_peered":"2023-10-06T01:39:39.533769+0000","last_clean":"2023-10-06T01:39:39.533769+0000","last_became_active":"2023-10-06T01:39:39.527867+0000","last_became_peered":"2023-10-06T01:39:39.527867+0000","last_unstale":"2023-10-06T01:39:39.533769+0000","last_undegraded":"2023-10-06T01:39:39.533769+0000","last_fullsized":"2023-10-06T01:39:39.533769+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:36.108288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.520646+0000","last_change":"2023-10-06T01:39:38.624450+0000","last_active":"2023-10-06T01:39:39.520646+0000","last_peered":"2023-10-06T01:39:39.520646+0000","last_clean":"2023-10-06T01:39:39.520646+0000","last_became_active":"2023-10-06T01:39:38.624218+0000","last_became_peered":"2023-10-06T01:39:38.624218+0000","last_unstale":"2023-10-06T01:39:39.520646+0000","last_undegraded":"2023-10-06T01:39:39.520646+0000","last_fullsized":"2023-10-06T01:39:39.520646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:26.630294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.537160+0000","last_change":"2023-10-06T01:39:39.530340+0000","last_active":"2023-10-06T01:39:39.537160+0000","last_peered":"2023-10-06T01:39:39.537160+0000","last_clean":"2023-10-06T01:39:39.537160+0000","last_became_active":"2023-10-06T01:39:39.530047+0000","last_became_peered":"2023-10-06T01:39:39.530047+0000","last_unstale":"2023-10-06T01:39:39.537160+0000","last_undegraded":"2023-10-06T01:39:39.537160+0000","last_fullsized":"2023-10-06T01:39:39.537160+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:41:55.235050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.518549+0000","last_change":"2023-10-06T01:39:38.630812+0000","last_active":"2023-10-06T01:39:39.518549+0000","last_peered":"2023-10-06T01:39:39.518549+0000","last_clean":"2023-10-06T01:39:39.518549+0000","last_became_active":"2023-10-06T01:39:38.630517+0000","last_became_peered":"2023-10-06T01:39:38.630517+0000","last_unstale":"2023-10-06T01:39:39.518549+0000","last_undegraded":"2023-10-06T01:39:39.518549+0000","last_fullsized":"2023-10-06T01:39:39.518549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:17.633353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532118+0000","last_change":"2023-10-06T01:39:39.528466+0000","last_active":"2023-10-06T01:39:39.532118+0000","last_peered":"2023-10-06T01:39:39.532118+0000","last_clean":"2023-10-06T01:39:39.532118+0000","last_became_active":"2023-10-06T01:39:39.528042+0000","last_became_peered":"2023-10-06T01:39:39.528042+0000","last_unstale":"2023-10-06T01:39:39.532118+0000","last_undegraded":"2023-10-06T01:39:39.532118+0000","last_fullsized":"2023-10-06T01:39:39.532118+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:06.076326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.521385+0000","last_change":"2023-10-06T01:39:38.623491+0000","last_active":"2023-10-06T01:39:39.521385+0000","last_peered":"2023-10-06T01:39:39.521385+0000","last_clean":"2023-10-06T01:39:39.521385+0000","last_became_active":"2023-10-06T01:39:38.623222+0000","last_became_peered":"2023-10-06T01:39:38.623222+0000","last_unstale":"2023-10-06T01:39:39.521385+0000","last_undegraded":"2023-10-06T01:39:39.521385+0000","last_fullsized":"2023-10-06T01:39:39.521385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:36:21.647390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.529353+0000","last_change":"2023-10-06T01:39:39.526770+0000","last_active":"2023-10-06T01:39:39.529353+0000","last_peered":"2023-10-06T01:39:39.529353+0000","last_clean":"2023-10-06T01:39:39.529353+0000","last_became_active":"2023-10-06T01:39:39.526572+0000","last_became_peered":"2023-10-06T01:39:39.526572+0000","last_unstale":"2023-10-06T01:39:39.529353+0000","last_undegraded":"2023-10-06T01:39:39.529353+0000","last_fullsized":"2023-10-06T01:39:39.529353+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:57.121167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.521627+0000","last_change":"2023-10-06T01:39:38.630658+0000","last_active":"2023-10-06T01:39:39.521627+0000","last_peered":"2023-10-06T01:39:39.521627+0000","last_clean":"2023-10-06T01:39:39.521627+0000","last_became_active":"2023-10-06T01:39:38.630360+0000","last_became_peered":"2023-10-06T01:39:38.630360+0000","last_unstale":"2023-10-06T01:39:39.521627+0000","last_undegraded":"2023-10-06T01:39:39.521627+0000","last_fullsized":"2023-10-06T01:39:39.521627+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:22.990841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.522743+0000","last_change":"2023-10-06T01:38:44.533111+0000","last_active":"2023-10-06T01:39:39.522743+0000","last_peered":"2023-10-06T01:39:39.522743+0000","last_clean":"2023-10-06T01:39:39.522743+0000","last_became_active":"2023-10-06T01:38:44.532838+0000","last_became_peered":"2023-10-06T01:38:44.532838+0000","last_unstale":"2023-10-06T01:39:39.522743+0000","last_undegraded":"2023-10-06T01:39:39.522743+0000","last_fullsized":"2023-10-06T01:39:39.522743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532512+0000","last_change":"2023-10-06T01:39:39.529973+0000","last_active":"2023-10-06T01:39:39.532512+0000","last_peered":"2023-10-06T01:39:39.532512+0000","last_clean":"2023-10-06T01:39:39.532512+0000","last_became_active":"2023-10-06T01:39:39.529739+0000","last_became_peered":"2023-10-06T01:39:39.529739+0000","last_unstale":"2023-10-06T01:39:39.532512+0000","last_undegraded":"2023-10-06T01:39:39.532512+0000","last_fullsized":"2023-10-06T01:39:39.532512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:41:55.235050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.519666+0000","last_change":"2023-10-06T01:39:38.623882+0000","last_active":"2023-10-06T01:39:39.519666+0000","last_peered":"2023-10-06T01:39:39.519666+0000","last_clean":"2023-10-06T01:39:39.519666+0000","last_became_active":"2023-10-06T01:39:38.623583+0000","last_became_peered":"2023-10-06T01:39:38.623583+0000","last_unstale":"2023-10-06T01:39:39.519666+0000","last_undegraded":"2023-10-06T01:39:39.519666+0000","last_fullsized":"2023-10-06T01:39:39.519666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:41.565197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.520635+0000","last_change":"2023-10-06T01:38:44.533897+0000","last_active":"2023-10-06T01:39:39.520635+0000","last_peered":"2023-10-06T01:39:39.520635+0000","last_clean":"2023-10-06T01:39:39.520635+0000","last_became_active":"2023-10-06T01:38:44.533611+0000","last_became_peered":"2023-10-06T01:38:44.533611+0000","last_unstale":"2023-10-06T01:39:39.520635+0000","last_undegraded":"2023-10-06T01:39:39.520635+0000","last_fullsized":"2023-10-06T01:39:39.520635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:24.411408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.534892+0000","last_change":"2023-10-06T01:39:39.531616+0000","last_active":"2023-10-06T01:39:39.534892+0000","last_peered":"2023-10-06T01:39:39.534892+0000","last_clean":"2023-10-06T01:39:39.534892+0000","last_became_active":"2023-10-06T01:39:39.531337+0000","last_became_peered":"2023-10-06T01:39:39.531337+0000","last_unstale":"2023-10-06T01:39:39.534892+0000","last_undegraded":"2023-10-06T01:39:39.534892+0000","last_fullsized":"2023-10-06T01:39:39.534892+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:57.121167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T01:39:40.963716+0000","last_change":"2023-10-06T01:39:38.627842+0000","last_active":"2023-10-06T01:39:40.963716+0000","last_peered":"2023-10-06T01:39:40.963716+0000","last_clean":"2023-10-06T01:39:40.963716+0000","last_became_active":"2023-10-06T01:39:38.627581+0000","last_became_peered":"2023-10-06T01:39:38.627581+0000","last_unstale":"2023-10-06T01:39:40.963716+0000","last_undegraded":"2023-10-06T01:39:40.963716+0000","last_fullsized":"2023-10-06T01:39:40.963716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:45.908004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.520759+0000","last_change":"2023-10-06T01:38:45.307814+0000","last_active":"2023-10-06T01:39:39.520759+0000","last_peered":"2023-10-06T01:39:39.520759+0000","last_clean":"2023-10-06T01:39:39.520759+0000","last_became_active":"2023-10-06T01:38:45.307536+0000","last_became_peered":"2023-10-06T01:38:45.307536+0000","last_unstale":"2023-10-06T01:39:39.520759+0000","last_undegraded":"2023-10-06T01:39:39.520759+0000","last_fullsized":"2023-10-06T01:39:39.520759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:09.503713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.539176+0000","last_change":"2023-10-06T01:39:39.531658+0000","last_active":"2023-10-06T01:39:39.539176+0000","last_peered":"2023-10-06T01:39:39.539176+0000","last_clean":"2023-10-06T01:39:39.539176+0000","last_became_active":"2023-10-06T01:39:39.531262+0000","last_became_peered":"2023-10-06T01:39:39.531262+0000","last_unstale":"2023-10-06T01:39:39.539176+0000","last_undegraded":"2023-10-06T01:39:39.539176+0000","last_fullsized":"2023-10-06T01:39:39.539176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:43.467840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.518786+0000","last_change":"2023-10-06T01:39:38.626151+0000","last_active":"2023-10-06T01:39:39.518786+0000","last_peered":"2023-10-06T01:39:39.518786+0000","last_clean":"2023-10-06T01:39:39.518786+0000","last_became_active":"2023-10-06T01:39:38.625888+0000","last_became_peered":"2023-10-06T01:39:38.625888+0000","last_unstale":"2023-10-06T01:39:39.518786+0000","last_undegraded":"2023-10-06T01:39:39.518786+0000","last_fullsized":"2023-10-06T01:39:39.518786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:35.807335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.518659+0000","last_change":"2023-10-06T01:38:44.534507+0000","last_active":"2023-10-06T01:39:39.518659+0000","last_peered":"2023-10-06T01:39:39.518659+0000","last_clean":"2023-10-06T01:39:39.518659+0000","last_became_active":"2023-10-06T01:38:44.534191+0000","last_became_peered":"2023-10-06T01:38:44.534191+0000","last_unstale":"2023-10-06T01:39:39.518659+0000","last_undegraded":"2023-10-06T01:39:39.518659+0000","last_fullsized":"2023-10-06T01:39:39.518659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.519577+0000","last_change":"2023-10-06T01:38:40.115117+0000","last_active":"2023-10-06T01:39:39.519577+0000","last_peered":"2023-10-06T01:39:39.519577+0000","last_clean":"2023-10-06T01:39:39.519577+0000","last_became_active":"2023-10-06T01:38:40.114142+0000","last_became_peered":"2023-10-06T01:38:40.114142+0000","last_unstale":"2023-10-06T01:39:39.519577+0000","last_undegraded":"2023-10-06T01:39:39.519577+0000","last_fullsized":"2023-10-06T01:39:39.519577+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_clean_scrub_stamp":"2023-10-06T01:38:38.338797+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:52.870262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532184+0000","last_change":"2023-10-06T01:39:39.530879+0000","last_active":"2023-10-06T01:39:39.532184+0000","last_peered":"2023-10-06T01:39:39.532184+0000","last_clean":"2023-10-06T01:39:39.532184+0000","last_became_active":"2023-10-06T01:39:39.530619+0000","last_became_peered":"2023-10-06T01:39:39.530619+0000","last_unstale":"2023-10-06T01:39:39.532184+0000","last_undegraded":"2023-10-06T01:39:39.532184+0000","last_fullsized":"2023-10-06T01:39:39.532184+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:03.781047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.623038+0000","last_change":"2023-10-06T01:39:38.628812+0000","last_active":"2023-10-06T01:39:39.623038+0000","last_peered":"2023-10-06T01:39:39.623038+0000","last_clean":"2023-10-06T01:39:39.623038+0000","last_became_active":"2023-10-06T01:39:38.628525+0000","last_became_peered":"2023-10-06T01:39:38.628525+0000","last_unstale":"2023-10-06T01:39:39.623038+0000","last_undegraded":"2023-10-06T01:39:39.623038+0000","last_fullsized":"2023-10-06T01:39:39.623038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:22.990841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.519641+0000","last_change":"2023-10-06T01:38:44.531831+0000","last_active":"2023-10-06T01:39:39.519641+0000","last_peered":"2023-10-06T01:39:39.519641+0000","last_clean":"2023-10-06T01:39:39.519641+0000","last_became_active":"2023-10-06T01:38:44.531496+0000","last_became_peered":"2023-10-06T01:38:44.531496+0000","last_unstale":"2023-10-06T01:39:39.519641+0000","last_undegraded":"2023-10-06T01:39:39.519641+0000","last_fullsized":"2023-10-06T01:39:39.519641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:28.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.531992+0000","last_change":"2023-10-06T01:39:39.529184+0000","last_active":"2023-10-06T01:39:39.531992+0000","last_peered":"2023-10-06T01:39:39.531992+0000","last_clean":"2023-10-06T01:39:39.531992+0000","last_became_active":"2023-10-06T01:39:39.528937+0000","last_became_peered":"2023-10-06T01:39:39.528937+0000","last_unstale":"2023-10-06T01:39:39.531992+0000","last_undegraded":"2023-10-06T01:39:39.531992+0000","last_fullsized":"2023-10-06T01:39:39.531992+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:53.326821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.525846+0000","last_change":"2023-10-06T01:39:38.626256+0000","last_active":"2023-10-06T01:39:39.525846+0000","last_peered":"2023-10-06T01:39:39.525846+0000","last_clean":"2023-10-06T01:39:39.525846+0000","last_became_active":"2023-10-06T01:39:38.625973+0000","last_became_peered":"2023-10-06T01:39:38.625973+0000","last_unstale":"2023-10-06T01:39:39.525846+0000","last_undegraded":"2023-10-06T01:39:39.525846+0000","last_fullsized":"2023-10-06T01:39:39.525846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:36:21.647390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.519166+0000","last_change":"2023-10-06T01:38:44.531335+0000","last_active":"2023-10-06T01:39:39.519166+0000","last_peered":"2023-10-06T01:39:39.519166+0000","last_clean":"2023-10-06T01:39:39.519166+0000","last_became_active":"2023-10-06T01:38:44.530966+0000","last_became_peered":"2023-10-06T01:38:44.530966+0000","last_unstale":"2023-10-06T01:39:39.519166+0000","last_undegraded":"2023-10-06T01:39:39.519166+0000","last_fullsized":"2023-10-06T01:39:39.519166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:33.926180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536339+0000","last_change":"2023-10-06T01:39:39.532663+0000","last_active":"2023-10-06T01:39:39.536339+0000","last_peered":"2023-10-06T01:39:39.536339+0000","last_clean":"2023-10-06T01:39:39.536339+0000","last_became_active":"2023-10-06T01:39:39.532435+0000","last_became_peered":"2023-10-06T01:39:39.532435+0000","last_unstale":"2023-10-06T01:39:39.536339+0000","last_undegraded":"2023-10-06T01:39:39.536339+0000","last_fullsized":"2023-10-06T01:39:39.536339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:23:15.510626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.529694+0000","last_change":"2023-10-06T01:39:38.623748+0000","last_active":"2023-10-06T01:39:39.529694+0000","last_peered":"2023-10-06T01:39:39.529694+0000","last_clean":"2023-10-06T01:39:39.529694+0000","last_became_active":"2023-10-06T01:39:38.623460+0000","last_became_peered":"2023-10-06T01:39:38.623460+0000","last_unstale":"2023-10-06T01:39:39.529694+0000","last_undegraded":"2023-10-06T01:39:39.529694+0000","last_fullsized":"2023-10-06T01:39:39.529694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:02:05.682135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.522622+0000","last_change":"2023-10-06T01:38:44.533582+0000","last_active":"2023-10-06T01:39:39.522622+0000","last_peered":"2023-10-06T01:39:39.522622+0000","last_clean":"2023-10-06T01:39:39.522622+0000","last_became_active":"2023-10-06T01:38:44.533324+0000","last_became_peered":"2023-10-06T01:38:44.533324+0000","last_unstale":"2023-10-06T01:39:39.522622+0000","last_undegraded":"2023-10-06T01:39:39.522622+0000","last_fullsized":"2023-10-06T01:39:39.522622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535058+0000","last_change":"2023-10-06T01:39:39.532149+0000","last_active":"2023-10-06T01:39:39.535058+0000","last_peered":"2023-10-06T01:39:39.535058+0000","last_clean":"2023-10-06T01:39:39.535058+0000","last_became_active":"2023-10-06T01:39:39.531891+0000","last_became_peered":"2023-10-06T01:39:39.531891+0000","last_unstale":"2023-10-06T01:39:39.535058+0000","last_undegraded":"2023-10-06T01:39:39.535058+0000","last_fullsized":"2023-10-06T01:39:39.535058+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:40.175833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.517261+0000","last_change":"2023-10-06T01:39:38.623722+0000","last_active":"2023-10-06T01:39:39.517261+0000","last_peered":"2023-10-06T01:39:39.517261+0000","last_clean":"2023-10-06T01:39:39.517261+0000","last_became_active":"2023-10-06T01:39:38.623425+0000","last_became_peered":"2023-10-06T01:39:38.623425+0000","last_unstale":"2023-10-06T01:39:39.517261+0000","last_undegraded":"2023-10-06T01:39:39.517261+0000","last_fullsized":"2023-10-06T01:39:39.517261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:14.193205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.526690+0000","last_change":"2023-10-06T01:38:44.533765+0000","last_active":"2023-10-06T01:39:39.526690+0000","last_peered":"2023-10-06T01:39:39.526690+0000","last_clean":"2023-10-06T01:39:39.526690+0000","last_became_active":"2023-10-06T01:38:44.533406+0000","last_became_peered":"2023-10-06T01:38:44.533406+0000","last_unstale":"2023-10-06T01:39:39.526690+0000","last_undegraded":"2023-10-06T01:39:39.526690+0000","last_fullsized":"2023-10-06T01:39:39.526690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298272,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073568,"statfs":{"total":96636764160,"available":96331333632,"internally_reserved":0,"allocated":1007616,"data_stored":753061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.70099999999999996}]},{"osd":1,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.73599999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.75700000000000001}]},{"osd":3,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.77900000000000003}]},{"osd":4,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.46400000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.54500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":401408,"data_stored":161641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.495},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.55100000000000005}]},{"osd":1,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.46000000000000002}]},{"osd":2,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.39600000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.56699999999999995}]},{"osd":4,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.34899999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.52900000000000003}]},{"osd":7,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.432}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":401408,"data_stored":161177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.378}]},{"osd":2,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":0.33700000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.29299999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.41599999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.54200000000000004}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.46400000000000002}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.48199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298260,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073580,"statfs":{"total":96636764160,"available":96331345920,"internally_reserved":0,"allocated":995328,"data_stored":751489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"last":0.29899999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.27700000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.307}]},{"osd":4,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.45100000000000001}]},{"osd":5,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.49099999999999999}]},{"osd":6,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.435},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.46000000000000002}]},{"osd":7,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.504},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.39600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":401408,"data_stored":161157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.34599999999999997}]},{"osd":1,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.39300000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.77500000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.748}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.82299999999999995}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.67100000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":413696,"data_stored":162657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.313},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.22800000000000001}]},{"osd":1,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.372}]},{"osd":2,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.35199999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.621}]},{"osd":5,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.49199999999999999}]},{"osd":6,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.55500000000000005}]},{"osd":7,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.67300000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297684,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074156,"statfs":{"total":96636764160,"available":96331935744,"internally_reserved":0,"allocated":405504,"data_stored":161663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.4289999999999998,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.52700000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":4.2270000000000003,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.2789999999999999,"5min":4.2789999999999999,"15min":4.2789999999999999},"last":0.46700000000000003}]},{"osd":2,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":12.359,"5min":12.359,"15min":12.359},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":12.326000000000001,"5min":12.326000000000001,"15min":12.326000000000001},"last":0.67800000000000005}]},{"osd":3,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":3.448,"5min":3.448,"15min":3.448},"last":0.57999999999999996},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":12.282,"5min":12.282,"15min":12.282},"last":0.504}]},{"osd":5,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.64500000000000002}]},{"osd":6,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.623}]},{"osd":7,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.66200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297684,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074156,"statfs":{"total":96636764160,"available":96331935744,"internally_reserved":0,"allocated":405504,"data_stored":161199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.439},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.66400000000000003}]},{"osd":1,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.53700000000000003}]},{"osd":2,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.65300000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.41199999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.69999999999999996}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.63100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:39:44.474 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-06T01:39:44.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.588+0000 7fd9e5fc6700 1 Processor -- start 2023-10-06T01:39:44.589 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.588+0000 7fd9e5fc6700 1 -- start start 2023-10-06T01:39:44.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.589+0000 7fd9e5fc6700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9e00cb970 0x7fd9e0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:44.591 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.589+0000 7fd9e5fc6700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd9e015a400 0x7fd9e0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:44.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.589+0000 7fd9e5fc6700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9e015ae40 con 0x7fd9e00cb5a0 2023-10-06T01:39:44.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.589+0000 7fd9e5fc6700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9e00ce0f0 con 0x7fd9e015a400 2023-10-06T01:39:44.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.589+0000 7fd9e5fc6700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e00cbde0 con 0x7fd9e00cb970 2023-10-06T01:39:44.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.589+0000 7fd9dffff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd9e015a400 0x7fd9e0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:44.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.589+0000 7fd9dffff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd9e015a400 0x7fd9e0156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58828/0 (socket says 172.21.15.69:58828) 2023-10-06T01:39:44.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.589+0000 7fd9dffff700 1 -- 172.21.15.69:0/1939024444 learned_addr learned my addr 172.21.15.69:0/1939024444 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:44.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.590+0000 7fd9deffd700 1 --2- 172.21.15.69:0/1939024444 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9e00cb970 0x7fd9e0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:44.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.590+0000 7fd9dffff700 1 -- 172.21.15.69:0/1939024444 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9e00cb970 msgr2=0x7fd9e0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:44.592 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.590+0000 7fd9dffff700 1 --2- 172.21.15.69:0/1939024444 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9e00cb970 0x7fd9e0159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:44.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.590+0000 7fd9dffff700 1 -- 172.21.15.69:0/1939024444 >> v1:172.21.15.88:6789/0 conn(0x7fd9e00cb5a0 legacy=0x7fd9e00cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:44.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.590+0000 7fd9dffff700 1 -- 172.21.15.69:0/1939024444 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9e015ab60 con 0x7fd9e015a400 2023-10-06T01:39:44.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.590+0000 7fd9dffff700 1 --2- 172.21.15.69:0/1939024444 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9e015a400 0x7fd9e0156e90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd9d80099e0 tx=0x7fd9d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed9d7aefc571dd99 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:44.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.590+0000 7fd9de7fc700 1 -- 172.21.15.69:0/1939024444 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d800b7e0 con 0x7fd9e015a400 2023-10-06T01:39:44.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.590+0000 7fd9de7fc700 1 -- 172.21.15.69:0/1939024444 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d800b940 con 0x7fd9e015a400 2023-10-06T01:39:44.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.590+0000 7fd9de7fc700 1 -- 172.21.15.69:0/1939024444 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d800bce0 con 0x7fd9e015a400 2023-10-06T01:39:44.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.590+0000 7fd9e5fc6700 1 -- 172.21.15.69:0/1939024444 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9e015a400 msgr2=0x7fd9e0156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:44.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.590+0000 7fd9e5fc6700 1 --2- 172.21.15.69:0/1939024444 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9e015a400 0x7fd9e0156e90 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd9d80099e0 tx=0x7fd9d8009250 comp rx=0 tx=0).stop 2023-10-06T01:39:44.593 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.590+0000 7fd9e5fc6700 1 -- 172.21.15.69:0/1939024444 shutdown_connections 2023-10-06T01:39:44.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.590+0000 7fd9e5fc6700 1 --2- 172.21.15.69:0/1939024444 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9e015a400 0x7fd9e0156e90 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:44.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.590+0000 7fd9e5fc6700 1 --2- 172.21.15.69:0/1939024444 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9e00cb970 0x7fd9e0159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:44.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.590+0000 7fd9e5fc6700 1 -- 172.21.15.69:0/1939024444 >> 172.21.15.69:0/1939024444 conn(0x7fd9e0070e30 msgr2=0x7fd9e00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:44.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.591+0000 7fd9e5fc6700 1 -- 172.21.15.69:0/1939024444 shutdown_connections 2023-10-06T01:39:44.594 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.591+0000 7fd9e5fc6700 1 -- 172.21.15.69:0/1939024444 wait complete. 2023-10-06T01:39:44.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.592+0000 7fd9e5fc6700 1 Processor -- start 2023-10-06T01:39:44.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.592+0000 7fd9e5fc6700 1 -- start start 2023-10-06T01:39:44.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.592+0000 7fd9e5fc6700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9e00cb5a0 0x7fd9e015db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:44.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.592+0000 7fd9e5fc6700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9e00cb970 0x7fd9e00c78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:44.597 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.592+0000 7fd9e5fc6700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9e015a400 0x7fd9e0156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:44.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.592+0000 7fd9e5fc6700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e00c80f0 con 0x7fd9e00cb5a0 2023-10-06T01:39:44.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.592+0000 7fd9e5fc6700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e00c7e20 con 0x7fd9e015a400 2023-10-06T01:39:44.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.592+0000 7fd9e5fc6700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9e0154290 con 0x7fd9e00cb970 2023-10-06T01:39:44.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.593+0000 7fd9df7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9e00cb5a0 0x7fd9e015db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:44.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.593+0000 7fd9df7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9e00cb5a0 0x7fd9e015db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58844/0 (socket says 172.21.15.69:58844) 2023-10-06T01:39:44.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.593+0000 7fd9df7fe700 1 -- 172.21.15.69:0/2569704585 learned_addr learned my addr 172.21.15.69:0/2569704585 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:44.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.593+0000 7fd9dffff700 1 --2- 172.21.15.69:0/2569704585 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9e015a400 0x7fd9e0156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:44.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.593+0000 7fd9df7fe700 1 -- 172.21.15.69:0/2569704585 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9e00cb970 msgr2=0x7fd9e00c78e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:44.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.593+0000 7fd9df7fe700 1 --2- 172.21.15.69:0/2569704585 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9e00cb970 0x7fd9e00c78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:44.598 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.593+0000 7fd9df7fe700 1 -- 172.21.15.69:0/2569704585 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9e015a400 msgr2=0x7fd9e0156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:44.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.593+0000 7fd9df7fe700 1 --2- 172.21.15.69:0/2569704585 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9e015a400 0x7fd9e0156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:44.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.593+0000 7fd9df7fe700 1 -- 172.21.15.69:0/2569704585 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9d80094f0 con 0x7fd9e00cb5a0 2023-10-06T01:39:44.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.593+0000 7fd9df7fe700 1 --2- 172.21.15.69:0/2569704585 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9e00cb5a0 0x7fd9e015db10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000bc30 tx=0x7fd9d0009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:44.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.593+0000 7fd9c77fe700 1 -- 172.21.15.69:0/2569704585 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d000c9b0 con 0x7fd9e00cb5a0 2023-10-06T01:39:44.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.593+0000 7fd9c77fe700 1 -- 172.21.15.69:0/2569704585 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9d000cb50 con 0x7fd9e00cb5a0 2023-10-06T01:39:44.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.593+0000 7fd9e5fc6700 1 -- 172.21.15.69:0/2569704585 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9e0154570 con 0x7fd9e00cb5a0 2023-10-06T01:39:44.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.593+0000 7fd9c77fe700 1 -- 172.21.15.69:0/2569704585 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9d0014410 con 0x7fd9e00cb5a0 2023-10-06T01:39:44.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.593+0000 7fd9e5fc6700 1 -- 172.21.15.69:0/2569704585 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9e0154b30 con 0x7fd9e00cb5a0 2023-10-06T01:39:44.599 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.594+0000 7fd9e5fc6700 1 -- 172.21.15.69:0/2569704585 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e004c3c0 con 0x7fd9e00cb5a0 2023-10-06T01:39:44.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.595+0000 7fd9c77fe700 1 -- 172.21.15.69:0/2569704585 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd9d0014800 con 0x7fd9e00cb5a0 2023-10-06T01:39:44.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.595+0000 7fd9c77fe700 1 --2- 172.21.15.69:0/2569704585 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd9cc066f30 0x7fd9cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:44.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.595+0000 7fd9deffd700 1 --2- 172.21.15.69:0/2569704585 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd9cc066f30 0x7fd9cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:44.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.595+0000 7fd9c77fe700 1 -- 172.21.15.69:0/2569704585 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fd9d00847b0 con 0x7fd9e00cb5a0 2023-10-06T01:39:44.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.595+0000 7fd9deffd700 1 --2- 172.21.15.69:0/2569704585 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd9cc066f30 0x7fd9cc0693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd9e006d960 tx=0x7fd9d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:44.600 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.599+0000 7fd9c77fe700 1 -- 172.21.15.69:0/2569704585 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd9d004c5a0 con 0x7fd9e00cb5a0 2023-10-06T01:39:44.861 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.861+0000 7fd9e5fc6700 1 -- 172.21.15.69:0/2569704585 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd9e00b2a10 con 0x7fd9e00cb5a0 2023-10-06T01:39:44.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.861+0000 7fd9c77fe700 1 -- 172.21.15.69:0/2569704585 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1564 (secure 0 0 0) 0x7fd9d00518c0 con 0x7fd9e00cb5a0 2023-10-06T01:39:44.862 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:44.862 INFO:teuthology.orchestra.run.smithi069.stdout:{"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":80,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":35,"num_osds":8,"num_up_osds":8,"osd_up_since":1696556316,"num_in_osds":8,"osd_in_since":1696556307,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592674,"bytes_used":2439815168,"bytes_avail":770654298112,"bytes_total":773094113280,"write_bytes_sec":2218,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":17,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":5037}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2023-10-06T01:39:38.270584+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-06T01:39:44.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.864+0000 7fd9e5fc6700 1 -- 172.21.15.69:0/2569704585 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd9cc066f30 msgr2=0x7fd9cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:44.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.864+0000 7fd9e5fc6700 1 --2- 172.21.15.69:0/2569704585 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd9cc066f30 0x7fd9cc0693e0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd9e006d960 tx=0x7fd9d4008040 comp rx=0 tx=0).stop 2023-10-06T01:39:44.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.864+0000 7fd9e5fc6700 1 -- 172.21.15.69:0/2569704585 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9e00cb5a0 msgr2=0x7fd9e015db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:44.864 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.864+0000 7fd9e5fc6700 1 --2- 172.21.15.69:0/2569704585 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9e00cb5a0 0x7fd9e015db10 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000bc30 tx=0x7fd9d0009820 comp rx=0 tx=0).stop 2023-10-06T01:39:44.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.864+0000 7fd9e5fc6700 1 -- 172.21.15.69:0/2569704585 shutdown_connections 2023-10-06T01:39:44.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.864+0000 7fd9e5fc6700 1 --2- 172.21.15.69:0/2569704585 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd9cc066f30 0x7fd9cc0693e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:44.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.864+0000 7fd9e5fc6700 1 --2- 172.21.15.69:0/2569704585 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd9e015a400 0x7fd9e0156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:44.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.864+0000 7fd9e5fc6700 1 --2- 172.21.15.69:0/2569704585 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd9e00cb5a0 0x7fd9e015db10 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:44.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.864+0000 7fd9e5fc6700 1 --2- 172.21.15.69:0/2569704585 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd9e00cb970 0x7fd9e00c78e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:44.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.864+0000 7fd9e5fc6700 1 -- 172.21.15.69:0/2569704585 >> 172.21.15.69:0/2569704585 conn(0x7fd9e0070e30 msgr2=0x7fd9e00b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:44.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.864+0000 7fd9e5fc6700 1 -- 172.21.15.69:0/2569704585 shutdown_connections 2023-10-06T01:39:44.865 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.864+0000 7fd9e5fc6700 1 -- 172.21.15.69:0/2569704585 wait complete. 2023-10-06T01:39:44.876 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-06T01:39:44.876 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:39:44.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.991+0000 7f8dadc46700 1 Processor -- start 2023-10-06T01:39:44.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.991+0000 7f8dadc46700 1 -- start start 2023-10-06T01:39:44.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.992+0000 7f8dadc46700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f8da80cb5a0 0x7f8da80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:44.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.992+0000 7f8dadc46700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8da80cd9e0 0x7f8da8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:44.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.992+0000 7f8dadc46700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8da815ae40 con 0x7f8da815a400 2023-10-06T01:39:44.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.992+0000 7f8dadc46700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8da80d13f0 con 0x7f8da80cb5a0 2023-10-06T01:39:44.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.992+0000 7f8dadc46700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8da815ab60 con 0x7f8da80cd9e0 2023-10-06T01:39:44.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.992+0000 7f8da7fff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f8da815a400 0x7f8da8156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:43388/0 (socket says 172.21.15.69:43388) 2023-10-06T01:39:44.994 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.992+0000 7f8da77fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f8da80cb5a0 0x7f8da80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:44.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.992+0000 7f8da7fff700 1 -- 172.21.15.69:0/3525996565 learned_addr learned my addr 172.21.15.69:0/3525996565 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:44.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.992+0000 7f8da6ffd700 1 --2- 172.21.15.69:0/3525996565 >> v2:172.21.15.88:3300/0 conn(0x7f8da80cd9e0 0x7f8da8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:44.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.992+0000 7f8da77fe700 1 -- 172.21.15.69:0/3525996565 >> v2:172.21.15.88:3300/0 conn(0x7f8da80cd9e0 msgr2=0x7f8da8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:44.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.992+0000 7f8da77fe700 1 --2- 172.21.15.69:0/3525996565 >> v2:172.21.15.88:3300/0 conn(0x7f8da80cd9e0 0x7f8da8159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:44.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.992+0000 7f8da77fe700 1 -- 172.21.15.69:0/3525996565 >> v1:172.21.15.69:6789/0 conn(0x7f8da815a400 legacy=0x7f8da8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:44.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.992+0000 7f8da67fc700 1 -- 172.21.15.69:0/3525996565 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1524346547 0 0) 0x7f8da815ae40 con 0x7f8da815a400 2023-10-06T01:39:44.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.992+0000 7f8da77fe700 1 -- 172.21.15.69:0/3525996565 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8da80ccf00 con 0x7f8da80cb5a0 2023-10-06T01:39:44.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.993+0000 7f8da77fe700 1 --2- 172.21.15.69:0/3525996565 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8da80cb5a0 0x7f8da80cb970 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8d98009e60 tx=0x7f8d98009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f3858157b5d2a73 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:44.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.993+0000 7f8da67fc700 1 -- 172.21.15.69:0/3525996565 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d9800e070 con 0x7f8da80cb5a0 2023-10-06T01:39:44.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.993+0000 7f8da67fc700 1 -- 172.21.15.69:0/3525996565 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d9800bbf0 con 0x7f8da80cb5a0 2023-10-06T01:39:44.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.993+0000 7f8da67fc700 1 -- 172.21.15.69:0/3525996565 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d98012430 con 0x7f8da80cb5a0 2023-10-06T01:39:44.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.993+0000 7f8dadc46700 1 -- 172.21.15.69:0/3525996565 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8da80cb5a0 msgr2=0x7f8da80cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:44.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.993+0000 7f8dadc46700 1 --2- 172.21.15.69:0/3525996565 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8da80cb5a0 0x7f8da80cb970 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f8d98009e60 tx=0x7f8d98009780 comp rx=0 tx=0).stop 2023-10-06T01:39:44.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.993+0000 7f8dadc46700 1 -- 172.21.15.69:0/3525996565 shutdown_connections 2023-10-06T01:39:44.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.993+0000 7f8dadc46700 1 --2- 172.21.15.69:0/3525996565 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8da80cb5a0 0x7f8da80cb970 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:44.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.993+0000 7f8dadc46700 1 --2- 172.21.15.69:0/3525996565 >> v2:172.21.15.88:3300/0 conn(0x7f8da80cd9e0 0x7f8da8159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:44.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.993+0000 7f8dadc46700 1 -- 172.21.15.69:0/3525996565 >> 172.21.15.69:0/3525996565 conn(0x7f8da8070e30 msgr2=0x7f8da80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:44.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.993+0000 7f8dadc46700 1 -- 172.21.15.69:0/3525996565 shutdown_connections 2023-10-06T01:39:44.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.993+0000 7f8dadc46700 1 -- 172.21.15.69:0/3525996565 wait complete. 2023-10-06T01:39:44.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.995+0000 7f8dadc46700 1 Processor -- start 2023-10-06T01:39:44.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.995+0000 7f8dadc46700 1 -- start start 2023-10-06T01:39:45.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.995+0000 7f8dadc46700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8da80cb5a0 0x7f8da81533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:45.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.995+0000 7f8dadc46700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8da80cd9e0 0x7f8da8157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:45.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.995+0000 7f8dadc46700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8da815a400 0x7f8da80c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:45.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.995+0000 7f8dadc46700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da80c6e50 con 0x7f8da80cb5a0 2023-10-06T01:39:45.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.995+0000 7f8dadc46700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da81597f0 con 0x7f8da80cd9e0 2023-10-06T01:39:45.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.995+0000 7f8dadc46700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8da8152f20 con 0x7f8da815a400 2023-10-06T01:39:45.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.995+0000 7f8da77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8da80cb5a0 0x7f8da81533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:45.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.995+0000 7f8da77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8da80cb5a0 0x7f8da81533b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58870/0 (socket says 172.21.15.69:58870) 2023-10-06T01:39:45.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.995+0000 7f8da77fe700 1 -- 172.21.15.69:0/3138647106 learned_addr learned my addr 172.21.15.69:0/3138647106 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:45.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.996+0000 7f8da7fff700 1 --2- 172.21.15.69:0/3138647106 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8da815a400 0x7f8da80c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:45.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.996+0000 7f8da6ffd700 1 --2- 172.21.15.69:0/3138647106 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8da80cd9e0 0x7f8da8157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:45.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.996+0000 7f8da77fe700 1 -- 172.21.15.69:0/3138647106 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8da815a400 msgr2=0x7f8da80c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:45.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.996+0000 7f8da77fe700 1 --2- 172.21.15.69:0/3138647106 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8da815a400 0x7f8da80c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:45.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.996+0000 7f8da77fe700 1 -- 172.21.15.69:0/3138647106 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8da80cd9e0 msgr2=0x7f8da8157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:45.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.996+0000 7f8da77fe700 1 --2- 172.21.15.69:0/3138647106 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8da80cd9e0 0x7f8da8157830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:45.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.996+0000 7f8da77fe700 1 -- 172.21.15.69:0/3138647106 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d98009a20 con 0x7f8da80cb5a0 2023-10-06T01:39:45.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.996+0000 7f8da77fe700 1 --2- 172.21.15.69:0/3138647106 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8da80cb5a0 0x7f8da81533b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8da806ea60 tx=0x7f8d98019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:45.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.996+0000 7f8d8f7fe700 1 -- 172.21.15.69:0/3138647106 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d98012e60 con 0x7f8da80cb5a0 2023-10-06T01:39:45.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.996+0000 7f8d8f7fe700 1 -- 172.21.15.69:0/3138647106 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d98027470 con 0x7f8da80cb5a0 2023-10-06T01:39:45.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.996+0000 7f8d8f7fe700 1 -- 172.21.15.69:0/3138647106 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d98027830 con 0x7f8da80cb5a0 2023-10-06T01:39:45.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.996+0000 7f8dadc46700 1 -- 172.21.15.69:0/3138647106 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da8152310 con 0x7f8da80cb5a0 2023-10-06T01:39:45.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.996+0000 7f8dadc46700 1 -- 172.21.15.69:0/3138647106 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da81528d0 con 0x7f8da80cb5a0 2023-10-06T01:39:45.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.997+0000 7f8dadc46700 1 -- 172.21.15.69:0/3138647106 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8da8153200 con 0x7f8da80cb5a0 2023-10-06T01:39:45.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.997+0000 7f8d8f7fe700 1 -- 172.21.15.69:0/3138647106 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d98024070 con 0x7f8da80cb5a0 2023-10-06T01:39:45.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.998+0000 7f8d8f7fe700 1 --2- 172.21.15.69:0/3138647106 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8d94066f30 0x7f8d940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:45.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.998+0000 7f8d8f7fe700 1 -- 172.21.15.69:0/3138647106 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8d98086dd0 con 0x7f8da80cb5a0 2023-10-06T01:39:45.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.998+0000 7f8da6ffd700 1 --2- 172.21.15.69:0/3138647106 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8d94066f30 0x7f8d940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:45.003 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:44.998+0000 7f8da6ffd700 1 --2- 172.21.15.69:0/3138647106 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8d94066f30 0x7f8d940693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8da8160030 tx=0x7f8d9c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:45.004 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:45.002+0000 7f8d8f7fe700 1 -- 172.21.15.69:0/3138647106 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d98053ee0 con 0x7f8da80cb5a0 2023-10-06T01:39:45.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:45.183+0000 7f8dadc46700 1 -- 172.21.15.69:0/3138647106 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8da804c3c0 con 0x7f8d94066f30 2023-10-06T01:39:45.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:45.191+0000 7f8d8f7fe700 1 -- 172.21.15.69:0/3138647106 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310757 (secure 0 0 0) 0x7f8da804c3c0 con 0x7f8d94066f30 2023-10-06T01:39:45.195 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:45.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:45.194+0000 7f8dadc46700 1 -- 172.21.15.69:0/3138647106 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8d94066f30 msgr2=0x7f8d940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:45.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:45.194+0000 7f8dadc46700 1 --2- 172.21.15.69:0/3138647106 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8d94066f30 0x7f8d940693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8da8160030 tx=0x7f8d9c008040 comp rx=0 tx=0).stop 2023-10-06T01:39:45.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:45.194+0000 7f8dadc46700 1 -- 172.21.15.69:0/3138647106 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8da80cb5a0 msgr2=0x7f8da81533b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:45.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:45.194+0000 7f8dadc46700 1 --2- 172.21.15.69:0/3138647106 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8da80cb5a0 0x7f8da81533b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f8da806ea60 tx=0x7f8d98019000 comp rx=0 tx=0).stop 2023-10-06T01:39:45.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:45.194+0000 7f8dadc46700 1 -- 172.21.15.69:0/3138647106 shutdown_connections 2023-10-06T01:39:45.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:45.194+0000 7f8dadc46700 1 --2- 172.21.15.69:0/3138647106 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8d94066f30 0x7f8d940693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:45.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:45.194+0000 7f8dadc46700 1 --2- 172.21.15.69:0/3138647106 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8da815a400 0x7f8da80c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:45.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:45.194+0000 7f8dadc46700 1 --2- 172.21.15.69:0/3138647106 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8da80cb5a0 0x7f8da81533b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:45.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:45.194+0000 7f8dadc46700 1 --2- 172.21.15.69:0/3138647106 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8da80cd9e0 0x7f8da8157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:45.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:45.194+0000 7f8dadc46700 1 -- 172.21.15.69:0/3138647106 >> 172.21.15.69:0/3138647106 conn(0x7f8da8070e30 msgr2=0x7f8da8154a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:45.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:45.195+0000 7f8dadc46700 1 -- 172.21.15.69:0/3138647106 shutdown_connections 2023-10-06T01:39:45.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:45.195+0000 7f8dadc46700 1 -- 172.21.15.69:0/3138647106 wait complete. 2023-10-06T01:39:45.199 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-10-06T01:39:45.207 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":62,"stamp":"2023-10-06T01:39:44.271517+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":168,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382632,"kb_used_data":4328,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592088,"statfs":{"total":773094113280,"available":770654298112,"internally_reserved":0,"allocated":4431872,"data_stored":2474044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000977"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.531235+0000","last_change":"2023-10-06T01:39:39.526915+0000","last_active":"2023-10-06T01:39:39.531235+0000","last_peered":"2023-10-06T01:39:39.531235+0000","last_clean":"2023-10-06T01:39:39.531235+0000","last_became_active":"2023-10-06T01:39:39.526686+0000","last_became_peered":"2023-10-06T01:39:39.526686+0000","last_unstale":"2023-10-06T01:39:39.531235+0000","last_undegraded":"2023-10-06T01:39:39.531235+0000","last_fullsized":"2023-10-06T01:39:39.531235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:07:20.141113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.527522+0000","last_change":"2023-10-06T01:39:39.524003+0000","last_active":"2023-10-06T01:39:39.527522+0000","last_peered":"2023-10-06T01:39:39.527522+0000","last_clean":"2023-10-06T01:39:39.527522+0000","last_became_active":"2023-10-06T01:39:39.523726+0000","last_became_peered":"2023-10-06T01:39:39.523726+0000","last_unstale":"2023-10-06T01:39:39.527522+0000","last_undegraded":"2023-10-06T01:39:39.527522+0000","last_fullsized":"2023-10-06T01:39:39.527522+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:40.175833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.534486+0000","last_change":"2023-10-06T01:39:39.530499+0000","last_active":"2023-10-06T01:39:39.534486+0000","last_peered":"2023-10-06T01:39:39.534486+0000","last_clean":"2023-10-06T01:39:39.534486+0000","last_became_active":"2023-10-06T01:39:39.530231+0000","last_became_peered":"2023-10-06T01:39:39.530231+0000","last_unstale":"2023-10-06T01:39:39.534486+0000","last_undegraded":"2023-10-06T01:39:39.534486+0000","last_fullsized":"2023-10-06T01:39:39.534486+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:49.497096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.539552+0000","last_change":"2023-10-06T01:39:39.538503+0000","last_active":"2023-10-06T01:39:39.539552+0000","last_peered":"2023-10-06T01:39:39.539552+0000","last_clean":"2023-10-06T01:39:39.539552+0000","last_became_active":"2023-10-06T01:39:39.538337+0000","last_became_peered":"2023-10-06T01:39:39.538337+0000","last_unstale":"2023-10-06T01:39:39.539552+0000","last_undegraded":"2023-10-06T01:39:39.539552+0000","last_fullsized":"2023-10-06T01:39:39.539552+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:13.353533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532785+0000","last_change":"2023-10-06T01:39:39.530772+0000","last_active":"2023-10-06T01:39:39.532785+0000","last_peered":"2023-10-06T01:39:39.532785+0000","last_clean":"2023-10-06T01:39:39.532785+0000","last_became_active":"2023-10-06T01:39:39.530517+0000","last_became_peered":"2023-10-06T01:39:39.530517+0000","last_unstale":"2023-10-06T01:39:39.532785+0000","last_undegraded":"2023-10-06T01:39:39.532785+0000","last_fullsized":"2023-10-06T01:39:39.532785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.642217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.525631+0000","last_change":"2023-10-06T01:39:39.524722+0000","last_active":"2023-10-06T01:39:39.525631+0000","last_peered":"2023-10-06T01:39:39.525631+0000","last_clean":"2023-10-06T01:39:39.525631+0000","last_became_active":"2023-10-06T01:39:39.524473+0000","last_became_peered":"2023-10-06T01:39:39.524473+0000","last_unstale":"2023-10-06T01:39:39.525631+0000","last_undegraded":"2023-10-06T01:39:39.525631+0000","last_fullsized":"2023-10-06T01:39:39.525631+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:57.121167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532800+0000","last_change":"2023-10-06T01:39:39.527585+0000","last_active":"2023-10-06T01:39:39.532800+0000","last_peered":"2023-10-06T01:39:39.532800+0000","last_clean":"2023-10-06T01:39:39.532800+0000","last_became_active":"2023-10-06T01:39:39.527217+0000","last_became_peered":"2023-10-06T01:39:39.527217+0000","last_unstale":"2023-10-06T01:39:39.532800+0000","last_undegraded":"2023-10-06T01:39:39.532800+0000","last_fullsized":"2023-10-06T01:39:39.532800+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:55.203229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533099+0000","last_change":"2023-10-06T01:39:39.530203+0000","last_active":"2023-10-06T01:39:39.533099+0000","last_peered":"2023-10-06T01:39:39.533099+0000","last_clean":"2023-10-06T01:39:39.533099+0000","last_became_active":"2023-10-06T01:39:39.529971+0000","last_became_peered":"2023-10-06T01:39:39.529971+0000","last_unstale":"2023-10-06T01:39:39.533099+0000","last_undegraded":"2023-10-06T01:39:39.533099+0000","last_fullsized":"2023-10-06T01:39:39.533099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:50:02.715525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535315+0000","last_change":"2023-10-06T01:39:39.533151+0000","last_active":"2023-10-06T01:39:39.535315+0000","last_peered":"2023-10-06T01:39:39.535315+0000","last_clean":"2023-10-06T01:39:39.535315+0000","last_became_active":"2023-10-06T01:39:39.532814+0000","last_became_peered":"2023-10-06T01:39:39.532814+0000","last_unstale":"2023-10-06T01:39:39.535315+0000","last_undegraded":"2023-10-06T01:39:39.535315+0000","last_fullsized":"2023-10-06T01:39:39.535315+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:44.243800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541363+0000","last_change":"2023-10-06T01:39:39.533186+0000","last_active":"2023-10-06T01:39:39.541363+0000","last_peered":"2023-10-06T01:39:39.541363+0000","last_clean":"2023-10-06T01:39:39.541363+0000","last_became_active":"2023-10-06T01:39:39.532941+0000","last_became_peered":"2023-10-06T01:39:39.532941+0000","last_unstale":"2023-10-06T01:39:39.541363+0000","last_undegraded":"2023-10-06T01:39:39.541363+0000","last_fullsized":"2023-10-06T01:39:39.541363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:28.581592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541518+0000","last_change":"2023-10-06T01:39:39.537465+0000","last_active":"2023-10-06T01:39:39.541518+0000","last_peered":"2023-10-06T01:39:39.541518+0000","last_clean":"2023-10-06T01:39:39.541518+0000","last_became_active":"2023-10-06T01:39:39.537237+0000","last_became_peered":"2023-10-06T01:39:39.537237+0000","last_unstale":"2023-10-06T01:39:39.541518+0000","last_undegraded":"2023-10-06T01:39:39.541518+0000","last_fullsized":"2023-10-06T01:39:39.541518+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:43.913718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.526385+0000","last_change":"2023-10-06T01:39:39.524109+0000","last_active":"2023-10-06T01:39:39.526385+0000","last_peered":"2023-10-06T01:39:39.526385+0000","last_clean":"2023-10-06T01:39:39.526385+0000","last_became_active":"2023-10-06T01:39:39.523845+0000","last_became_peered":"2023-10-06T01:39:39.523845+0000","last_unstale":"2023-10-06T01:39:39.526385+0000","last_undegraded":"2023-10-06T01:39:39.526385+0000","last_fullsized":"2023-10-06T01:39:39.526385+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:51:05.439429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541368+0000","last_change":"2023-10-06T01:39:39.533041+0000","last_active":"2023-10-06T01:39:39.541368+0000","last_peered":"2023-10-06T01:39:39.541368+0000","last_clean":"2023-10-06T01:39:39.541368+0000","last_became_active":"2023-10-06T01:39:39.532764+0000","last_became_peered":"2023-10-06T01:39:39.532764+0000","last_unstale":"2023-10-06T01:39:39.541368+0000","last_undegraded":"2023-10-06T01:39:39.541368+0000","last_fullsized":"2023-10-06T01:39:39.541368+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:49.497096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541823+0000","last_change":"2023-10-06T01:39:39.539028+0000","last_active":"2023-10-06T01:39:39.541823+0000","last_peered":"2023-10-06T01:39:39.541823+0000","last_clean":"2023-10-06T01:39:39.541823+0000","last_became_active":"2023-10-06T01:39:39.538655+0000","last_became_peered":"2023-10-06T01:39:39.538655+0000","last_unstale":"2023-10-06T01:39:39.541823+0000","last_undegraded":"2023-10-06T01:39:39.541823+0000","last_fullsized":"2023-10-06T01:39:39.541823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:16.101682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.530715+0000","last_change":"2023-10-06T01:39:39.524232+0000","last_active":"2023-10-06T01:39:39.530715+0000","last_peered":"2023-10-06T01:39:39.530715+0000","last_clean":"2023-10-06T01:39:39.530715+0000","last_became_active":"2023-10-06T01:39:39.523956+0000","last_became_peered":"2023-10-06T01:39:39.523956+0000","last_unstale":"2023-10-06T01:39:39.530715+0000","last_undegraded":"2023-10-06T01:39:39.530715+0000","last_fullsized":"2023-10-06T01:39:39.530715+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:05:05.351196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535445+0000","last_change":"2023-10-06T01:39:39.531764+0000","last_active":"2023-10-06T01:39:39.535445+0000","last_peered":"2023-10-06T01:39:39.535445+0000","last_clean":"2023-10-06T01:39:39.535445+0000","last_became_active":"2023-10-06T01:39:39.531514+0000","last_became_peered":"2023-10-06T01:39:39.531514+0000","last_unstale":"2023-10-06T01:39:39.535445+0000","last_undegraded":"2023-10-06T01:39:39.535445+0000","last_fullsized":"2023-10-06T01:39:39.535445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:03.781047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536300+0000","last_change":"2023-10-06T01:39:39.534404+0000","last_active":"2023-10-06T01:39:39.536300+0000","last_peered":"2023-10-06T01:39:39.536300+0000","last_clean":"2023-10-06T01:39:39.536300+0000","last_became_active":"2023-10-06T01:39:39.533543+0000","last_became_peered":"2023-10-06T01:39:39.533543+0000","last_unstale":"2023-10-06T01:39:39.536300+0000","last_undegraded":"2023-10-06T01:39:39.536300+0000","last_fullsized":"2023-10-06T01:39:39.536300+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:49.497096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.538610+0000","last_change":"2023-10-06T01:39:39.532117+0000","last_active":"2023-10-06T01:39:39.538610+0000","last_peered":"2023-10-06T01:39:39.538610+0000","last_clean":"2023-10-06T01:39:39.538610+0000","last_became_active":"2023-10-06T01:39:39.531824+0000","last_became_peered":"2023-10-06T01:39:39.531824+0000","last_unstale":"2023-10-06T01:39:39.538610+0000","last_undegraded":"2023-10-06T01:39:39.538610+0000","last_fullsized":"2023-10-06T01:39:39.538610+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.642217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532043+0000","last_change":"2023-10-06T01:39:39.527764+0000","last_active":"2023-10-06T01:39:39.532043+0000","last_peered":"2023-10-06T01:39:39.532043+0000","last_clean":"2023-10-06T01:39:39.532043+0000","last_became_active":"2023-10-06T01:39:39.527017+0000","last_became_peered":"2023-10-06T01:39:39.527017+0000","last_unstale":"2023-10-06T01:39:39.532043+0000","last_undegraded":"2023-10-06T01:39:39.532043+0000","last_fullsized":"2023-10-06T01:39:39.532043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:36.816199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541320+0000","last_change":"2023-10-06T01:39:39.538515+0000","last_active":"2023-10-06T01:39:39.541320+0000","last_peered":"2023-10-06T01:39:39.541320+0000","last_clean":"2023-10-06T01:39:39.541320+0000","last_became_active":"2023-10-06T01:39:39.538214+0000","last_became_peered":"2023-10-06T01:39:39.538214+0000","last_unstale":"2023-10-06T01:39:39.541320+0000","last_undegraded":"2023-10-06T01:39:39.541320+0000","last_fullsized":"2023-10-06T01:39:39.541320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:50:32.520206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532460+0000","last_change":"2023-10-06T01:39:39.527312+0000","last_active":"2023-10-06T01:39:39.532460+0000","last_peered":"2023-10-06T01:39:39.532460+0000","last_clean":"2023-10-06T01:39:39.532460+0000","last_became_active":"2023-10-06T01:39:39.526997+0000","last_became_peered":"2023-10-06T01:39:39.526997+0000","last_unstale":"2023-10-06T01:39:39.532460+0000","last_undegraded":"2023-10-06T01:39:39.532460+0000","last_fullsized":"2023-10-06T01:39:39.532460+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:06.076326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.539115+0000","last_change":"2023-10-06T01:39:39.534940+0000","last_active":"2023-10-06T01:39:39.539115+0000","last_peered":"2023-10-06T01:39:39.539115+0000","last_clean":"2023-10-06T01:39:39.539115+0000","last_became_active":"2023-10-06T01:39:39.534650+0000","last_became_peered":"2023-10-06T01:39:39.534650+0000","last_unstale":"2023-10-06T01:39:39.539115+0000","last_undegraded":"2023-10-06T01:39:39.539115+0000","last_fullsized":"2023-10-06T01:39:39.539115+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:54.181909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535947+0000","last_change":"2023-10-06T01:39:39.534201+0000","last_active":"2023-10-06T01:39:39.535947+0000","last_peered":"2023-10-06T01:39:39.535947+0000","last_clean":"2023-10-06T01:39:39.535947+0000","last_became_active":"2023-10-06T01:39:39.533900+0000","last_became_peered":"2023-10-06T01:39:39.533900+0000","last_unstale":"2023-10-06T01:39:39.535947+0000","last_undegraded":"2023-10-06T01:39:39.535947+0000","last_fullsized":"2023-10-06T01:39:39.535947+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:36.108288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532873+0000","last_change":"2023-10-06T01:39:39.531717+0000","last_active":"2023-10-06T01:39:39.532873+0000","last_peered":"2023-10-06T01:39:39.532873+0000","last_clean":"2023-10-06T01:39:39.532873+0000","last_became_active":"2023-10-06T01:39:39.531485+0000","last_became_peered":"2023-10-06T01:39:39.531485+0000","last_unstale":"2023-10-06T01:39:39.532873+0000","last_undegraded":"2023-10-06T01:39:39.532873+0000","last_fullsized":"2023-10-06T01:39:39.532873+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:42.574061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533787+0000","last_change":"2023-10-06T01:39:39.528899+0000","last_active":"2023-10-06T01:39:39.533787+0000","last_peered":"2023-10-06T01:39:39.533787+0000","last_clean":"2023-10-06T01:39:39.533787+0000","last_became_active":"2023-10-06T01:39:39.528582+0000","last_became_peered":"2023-10-06T01:39:39.528582+0000","last_unstale":"2023-10-06T01:39:39.533787+0000","last_undegraded":"2023-10-06T01:39:39.533787+0000","last_fullsized":"2023-10-06T01:39:39.533787+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:23.534135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532590+0000","last_change":"2023-10-06T01:39:39.531264+0000","last_active":"2023-10-06T01:39:39.532590+0000","last_peered":"2023-10-06T01:39:39.532590+0000","last_clean":"2023-10-06T01:39:39.532590+0000","last_became_active":"2023-10-06T01:39:39.531012+0000","last_became_peered":"2023-10-06T01:39:39.531012+0000","last_unstale":"2023-10-06T01:39:39.532590+0000","last_undegraded":"2023-10-06T01:39:39.532590+0000","last_fullsized":"2023-10-06T01:39:39.532590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:36.108288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.539109+0000","last_change":"2023-10-06T01:39:39.536007+0000","last_active":"2023-10-06T01:39:39.539109+0000","last_peered":"2023-10-06T01:39:39.539109+0000","last_clean":"2023-10-06T01:39:39.539109+0000","last_became_active":"2023-10-06T01:39:39.533706+0000","last_became_peered":"2023-10-06T01:39:39.533706+0000","last_unstale":"2023-10-06T01:39:39.539109+0000","last_undegraded":"2023-10-06T01:39:39.539109+0000","last_fullsized":"2023-10-06T01:39:39.539109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:13.353533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535778+0000","last_change":"2023-10-06T01:39:39.529699+0000","last_active":"2023-10-06T01:39:39.535778+0000","last_peered":"2023-10-06T01:39:39.535778+0000","last_clean":"2023-10-06T01:39:39.535778+0000","last_became_active":"2023-10-06T01:39:39.529341+0000","last_became_peered":"2023-10-06T01:39:39.529341+0000","last_unstale":"2023-10-06T01:39:39.535778+0000","last_undegraded":"2023-10-06T01:39:39.535778+0000","last_fullsized":"2023-10-06T01:39:39.535778+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:51:05.439429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533050+0000","last_change":"2023-10-06T01:39:39.528443+0000","last_active":"2023-10-06T01:39:39.533050+0000","last_peered":"2023-10-06T01:39:39.533050+0000","last_clean":"2023-10-06T01:39:39.533050+0000","last_became_active":"2023-10-06T01:39:39.528008+0000","last_became_peered":"2023-10-06T01:39:39.528008+0000","last_unstale":"2023-10-06T01:39:39.533050+0000","last_undegraded":"2023-10-06T01:39:39.533050+0000","last_fullsized":"2023-10-06T01:39:39.533050+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:42.574061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.538139+0000","last_change":"2023-10-06T01:39:39.531595+0000","last_active":"2023-10-06T01:39:39.538139+0000","last_peered":"2023-10-06T01:39:39.538139+0000","last_clean":"2023-10-06T01:39:39.538139+0000","last_became_active":"2023-10-06T01:39:39.531416+0000","last_became_peered":"2023-10-06T01:39:39.531416+0000","last_unstale":"2023-10-06T01:39:39.538139+0000","last_undegraded":"2023-10-06T01:39:39.538139+0000","last_fullsized":"2023-10-06T01:39:39.538139+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:23.999705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535927+0000","last_change":"2023-10-06T01:39:39.533940+0000","last_active":"2023-10-06T01:39:39.535927+0000","last_peered":"2023-10-06T01:39:39.535927+0000","last_clean":"2023-10-06T01:39:39.535927+0000","last_became_active":"2023-10-06T01:39:39.533195+0000","last_became_peered":"2023-10-06T01:39:39.533195+0000","last_unstale":"2023-10-06T01:39:39.535927+0000","last_undegraded":"2023-10-06T01:39:39.535927+0000","last_fullsized":"2023-10-06T01:39:39.535927+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:55.203229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533882+0000","last_change":"2023-10-06T01:39:39.532639+0000","last_active":"2023-10-06T01:39:39.533882+0000","last_peered":"2023-10-06T01:39:39.533882+0000","last_clean":"2023-10-06T01:39:39.533882+0000","last_became_active":"2023-10-06T01:39:39.532390+0000","last_became_peered":"2023-10-06T01:39:39.532390+0000","last_unstale":"2023-10-06T01:39:39.533882+0000","last_undegraded":"2023-10-06T01:39:39.533882+0000","last_fullsized":"2023-10-06T01:39:39.533882+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:27.975533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535010+0000","last_change":"2023-10-06T01:39:39.533042+0000","last_active":"2023-10-06T01:39:39.535010+0000","last_peered":"2023-10-06T01:39:39.535010+0000","last_clean":"2023-10-06T01:39:39.535010+0000","last_became_active":"2023-10-06T01:39:39.532433+0000","last_became_peered":"2023-10-06T01:39:39.532433+0000","last_unstale":"2023-10-06T01:39:39.535010+0000","last_undegraded":"2023-10-06T01:39:39.535010+0000","last_fullsized":"2023-10-06T01:39:39.535010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:51:05.439429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"34'4","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.616579+0000","last_change":"2023-10-06T01:39:38.626494+0000","last_active":"2023-10-06T01:39:39.616579+0000","last_peered":"2023-10-06T01:39:39.616579+0000","last_clean":"2023-10-06T01:39:39.616579+0000","last_became_active":"2023-10-06T01:39:38.625958+0000","last_became_peered":"2023-10-06T01:39:38.625958+0000","last_unstale":"2023-10-06T01:39:39.616579+0000","last_undegraded":"2023-10-06T01:39:39.616579+0000","last_fullsized":"2023-10-06T01:39:39.616579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:12.414360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532192+0000","last_change":"2023-10-06T01:39:39.530208+0000","last_active":"2023-10-06T01:39:39.532192+0000","last_peered":"2023-10-06T01:39:39.532192+0000","last_clean":"2023-10-06T01:39:39.532192+0000","last_became_active":"2023-10-06T01:39:39.529957+0000","last_became_peered":"2023-10-06T01:39:39.529957+0000","last_unstale":"2023-10-06T01:39:39.532192+0000","last_undegraded":"2023-10-06T01:39:39.532192+0000","last_fullsized":"2023-10-06T01:39:39.532192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:43.913718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.617188+0000","last_change":"2023-10-06T01:39:38.622143+0000","last_active":"2023-10-06T01:39:39.617188+0000","last_peered":"2023-10-06T01:39:39.617188+0000","last_clean":"2023-10-06T01:39:39.617188+0000","last_became_active":"2023-10-06T01:39:38.621871+0000","last_became_peered":"2023-10-06T01:39:38.621871+0000","last_unstale":"2023-10-06T01:39:39.617188+0000","last_undegraded":"2023-10-06T01:39:39.617188+0000","last_fullsized":"2023-10-06T01:39:39.617188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:50:31.511342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541310+0000","last_change":"2023-10-06T01:39:39.535667+0000","last_active":"2023-10-06T01:39:39.541310+0000","last_peered":"2023-10-06T01:39:39.541310+0000","last_clean":"2023-10-06T01:39:39.541310+0000","last_became_active":"2023-10-06T01:39:39.535332+0000","last_became_peered":"2023-10-06T01:39:39.535332+0000","last_unstale":"2023-10-06T01:39:39.541310+0000","last_undegraded":"2023-10-06T01:39:39.541310+0000","last_fullsized":"2023-10-06T01:39:39.541310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:37.318580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.615588+0000","last_change":"2023-10-06T01:39:38.623708+0000","last_active":"2023-10-06T01:39:39.615588+0000","last_peered":"2023-10-06T01:39:39.615588+0000","last_clean":"2023-10-06T01:39:39.615588+0000","last_became_active":"2023-10-06T01:39:38.623429+0000","last_became_peered":"2023-10-06T01:39:38.623429+0000","last_unstale":"2023-10-06T01:39:39.615588+0000","last_undegraded":"2023-10-06T01:39:39.615588+0000","last_fullsized":"2023-10-06T01:39:39.615588+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:50:31.511342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533622+0000","last_change":"2023-10-06T01:39:39.531136+0000","last_active":"2023-10-06T01:39:39.533622+0000","last_peered":"2023-10-06T01:39:39.533622+0000","last_clean":"2023-10-06T01:39:39.533622+0000","last_became_active":"2023-10-06T01:39:39.530908+0000","last_became_peered":"2023-10-06T01:39:39.530908+0000","last_unstale":"2023-10-06T01:39:39.533622+0000","last_undegraded":"2023-10-06T01:39:39.533622+0000","last_fullsized":"2023-10-06T01:39:39.533622+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:26.799204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.616014+0000","last_change":"2023-10-06T01:39:38.623866+0000","last_active":"2023-10-06T01:39:39.616014+0000","last_peered":"2023-10-06T01:39:39.616014+0000","last_clean":"2023-10-06T01:39:39.616014+0000","last_became_active":"2023-10-06T01:39:38.623558+0000","last_became_peered":"2023-10-06T01:39:38.623558+0000","last_unstale":"2023-10-06T01:39:39.616014+0000","last_undegraded":"2023-10-06T01:39:39.616014+0000","last_fullsized":"2023-10-06T01:39:39.616014+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:19.711959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.534019+0000","last_change":"2023-10-06T01:39:39.528895+0000","last_active":"2023-10-06T01:39:39.534019+0000","last_peered":"2023-10-06T01:39:39.534019+0000","last_clean":"2023-10-06T01:39:39.534019+0000","last_became_active":"2023-10-06T01:39:39.528628+0000","last_became_peered":"2023-10-06T01:39:39.528628+0000","last_unstale":"2023-10-06T01:39:39.534019+0000","last_undegraded":"2023-10-06T01:39:39.534019+0000","last_fullsized":"2023-10-06T01:39:39.534019+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:05:05.351196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.615600+0000","last_change":"2023-10-06T01:39:38.624485+0000","last_active":"2023-10-06T01:39:39.615600+0000","last_peered":"2023-10-06T01:39:39.615600+0000","last_clean":"2023-10-06T01:39:39.615600+0000","last_became_active":"2023-10-06T01:39:38.624224+0000","last_became_peered":"2023-10-06T01:39:38.624224+0000","last_unstale":"2023-10-06T01:39:39.615600+0000","last_undegraded":"2023-10-06T01:39:39.615600+0000","last_fullsized":"2023-10-06T01:39:39.615600+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:41.565197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532780+0000","last_change":"2023-10-06T01:39:39.527154+0000","last_active":"2023-10-06T01:39:39.532780+0000","last_peered":"2023-10-06T01:39:39.532780+0000","last_clean":"2023-10-06T01:39:39.532780+0000","last_became_active":"2023-10-06T01:39:39.526851+0000","last_became_peered":"2023-10-06T01:39:39.526851+0000","last_unstale":"2023-10-06T01:39:39.532780+0000","last_undegraded":"2023-10-06T01:39:39.532780+0000","last_fullsized":"2023-10-06T01:39:39.532780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:40.175833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.616307+0000","last_change":"2023-10-06T01:39:38.625182+0000","last_active":"2023-10-06T01:39:39.616307+0000","last_peered":"2023-10-06T01:39:39.616307+0000","last_clean":"2023-10-06T01:39:39.616307+0000","last_became_active":"2023-10-06T01:39:38.624900+0000","last_became_peered":"2023-10-06T01:39:38.624900+0000","last_unstale":"2023-10-06T01:39:39.616307+0000","last_undegraded":"2023-10-06T01:39:39.616307+0000","last_fullsized":"2023-10-06T01:39:39.616307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:48.430978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536320+0000","last_change":"2023-10-06T01:39:39.532155+0000","last_active":"2023-10-06T01:39:39.536320+0000","last_peered":"2023-10-06T01:39:39.536320+0000","last_clean":"2023-10-06T01:39:39.536320+0000","last_became_active":"2023-10-06T01:39:39.531870+0000","last_became_peered":"2023-10-06T01:39:39.531870+0000","last_unstale":"2023-10-06T01:39:39.536320+0000","last_undegraded":"2023-10-06T01:39:39.536320+0000","last_fullsized":"2023-10-06T01:39:39.536320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:42.351468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.522916+0000","last_change":"2023-10-06T01:39:38.622820+0000","last_active":"2023-10-06T01:39:39.522916+0000","last_peered":"2023-10-06T01:39:39.522916+0000","last_clean":"2023-10-06T01:39:39.522916+0000","last_became_active":"2023-10-06T01:39:38.622547+0000","last_became_peered":"2023-10-06T01:39:38.622547+0000","last_unstale":"2023-10-06T01:39:39.522916+0000","last_undegraded":"2023-10-06T01:39:39.522916+0000","last_fullsized":"2023-10-06T01:39:39.522916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:17.633353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532100+0000","last_change":"2023-10-06T01:39:39.528278+0000","last_active":"2023-10-06T01:39:39.532100+0000","last_peered":"2023-10-06T01:39:39.532100+0000","last_clean":"2023-10-06T01:39:39.532100+0000","last_became_active":"2023-10-06T01:39:39.527700+0000","last_became_peered":"2023-10-06T01:39:39.527700+0000","last_unstale":"2023-10-06T01:39:39.532100+0000","last_undegraded":"2023-10-06T01:39:39.532100+0000","last_fullsized":"2023-10-06T01:39:39.532100+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:28.581592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.529680+0000","last_change":"2023-10-06T01:39:38.630745+0000","last_active":"2023-10-06T01:39:39.529680+0000","last_peered":"2023-10-06T01:39:39.529680+0000","last_clean":"2023-10-06T01:39:39.529680+0000","last_became_active":"2023-10-06T01:39:38.630466+0000","last_became_peered":"2023-10-06T01:39:38.630466+0000","last_unstale":"2023-10-06T01:39:39.529680+0000","last_undegraded":"2023-10-06T01:39:39.529680+0000","last_fullsized":"2023-10-06T01:39:39.529680+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:30.512210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.539563+0000","last_change":"2023-10-06T01:39:39.538565+0000","last_active":"2023-10-06T01:39:39.539563+0000","last_peered":"2023-10-06T01:39:39.539563+0000","last_clean":"2023-10-06T01:39:39.539563+0000","last_became_active":"2023-10-06T01:39:39.538331+0000","last_became_peered":"2023-10-06T01:39:39.538331+0000","last_unstale":"2023-10-06T01:39:39.539563+0000","last_undegraded":"2023-10-06T01:39:39.539563+0000","last_fullsized":"2023-10-06T01:39:39.539563+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:23.999705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.517658+0000","last_change":"2023-10-06T01:39:38.628795+0000","last_active":"2023-10-06T01:39:39.517658+0000","last_peered":"2023-10-06T01:39:39.517658+0000","last_clean":"2023-10-06T01:39:39.517658+0000","last_became_active":"2023-10-06T01:39:38.628536+0000","last_became_peered":"2023-10-06T01:39:38.628536+0000","last_unstale":"2023-10-06T01:39:39.517658+0000","last_undegraded":"2023-10-06T01:39:39.517658+0000","last_fullsized":"2023-10-06T01:39:39.517658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:27.661354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536001+0000","last_change":"2023-10-06T01:39:39.534373+0000","last_active":"2023-10-06T01:39:39.536001+0000","last_peered":"2023-10-06T01:39:39.536001+0000","last_clean":"2023-10-06T01:39:39.536001+0000","last_became_active":"2023-10-06T01:39:39.533475+0000","last_became_peered":"2023-10-06T01:39:39.533475+0000","last_unstale":"2023-10-06T01:39:39.536001+0000","last_undegraded":"2023-10-06T01:39:39.536001+0000","last_fullsized":"2023-10-06T01:39:39.536001+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:44.243800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.521871+0000","last_change":"2023-10-06T01:39:38.628870+0000","last_active":"2023-10-06T01:39:39.521871+0000","last_peered":"2023-10-06T01:39:39.521871+0000","last_clean":"2023-10-06T01:39:39.521871+0000","last_became_active":"2023-10-06T01:39:38.628553+0000","last_became_peered":"2023-10-06T01:39:38.628553+0000","last_unstale":"2023-10-06T01:39:39.521871+0000","last_undegraded":"2023-10-06T01:39:39.521871+0000","last_fullsized":"2023-10-06T01:39:39.521871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:22.525270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533741+0000","last_change":"2023-10-06T01:39:39.528068+0000","last_active":"2023-10-06T01:39:39.533741+0000","last_peered":"2023-10-06T01:39:39.533741+0000","last_clean":"2023-10-06T01:39:39.533741+0000","last_became_active":"2023-10-06T01:39:39.527827+0000","last_became_peered":"2023-10-06T01:39:39.527827+0000","last_unstale":"2023-10-06T01:39:39.533741+0000","last_undegraded":"2023-10-06T01:39:39.533741+0000","last_fullsized":"2023-10-06T01:39:39.533741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:43.913718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"34'3","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.623127+0000","last_change":"2023-10-06T01:39:38.628825+0000","last_active":"2023-10-06T01:39:39.623127+0000","last_peered":"2023-10-06T01:39:39.623127+0000","last_clean":"2023-10-06T01:39:39.623127+0000","last_became_active":"2023-10-06T01:39:38.628517+0000","last_became_peered":"2023-10-06T01:39:38.628517+0000","last_unstale":"2023-10-06T01:39:39.623127+0000","last_undegraded":"2023-10-06T01:39:39.623127+0000","last_fullsized":"2023-10-06T01:39:39.623127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:50:31.511342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.538694+0000","last_change":"2023-10-06T01:39:39.534285+0000","last_active":"2023-10-06T01:39:39.538694+0000","last_peered":"2023-10-06T01:39:39.538694+0000","last_clean":"2023-10-06T01:39:39.538694+0000","last_became_active":"2023-10-06T01:39:39.534034+0000","last_became_peered":"2023-10-06T01:39:39.534034+0000","last_unstale":"2023-10-06T01:39:39.538694+0000","last_undegraded":"2023-10-06T01:39:39.538694+0000","last_fullsized":"2023-10-06T01:39:39.538694+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:19:39.808879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"34'6","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.618668+0000","last_change":"2023-10-06T01:39:38.622530+0000","last_active":"2023-10-06T01:39:39.618668+0000","last_peered":"2023-10-06T01:39:39.618668+0000","last_clean":"2023-10-06T01:39:39.618668+0000","last_became_active":"2023-10-06T01:39:38.622273+0000","last_became_peered":"2023-10-06T01:39:38.622273+0000","last_unstale":"2023-10-06T01:39:39.618668+0000","last_undegraded":"2023-10-06T01:39:39.618668+0000","last_fullsized":"2023-10-06T01:39:39.618668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:09.207989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535344+0000","last_change":"2023-10-06T01:39:39.533497+0000","last_active":"2023-10-06T01:39:39.535344+0000","last_peered":"2023-10-06T01:39:39.535344+0000","last_clean":"2023-10-06T01:39:39.535344+0000","last_became_active":"2023-10-06T01:39:39.533233+0000","last_became_peered":"2023-10-06T01:39:39.533233+0000","last_unstale":"2023-10-06T01:39:39.535344+0000","last_undegraded":"2023-10-06T01:39:39.535344+0000","last_fullsized":"2023-10-06T01:39:39.535344+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:55.203229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.615312+0000","last_change":"2023-10-06T01:39:38.620186+0000","last_active":"2023-10-06T01:39:39.615312+0000","last_peered":"2023-10-06T01:39:39.615312+0000","last_clean":"2023-10-06T01:39:39.615312+0000","last_became_active":"2023-10-06T01:39:38.619533+0000","last_became_peered":"2023-10-06T01:39:38.619533+0000","last_unstale":"2023-10-06T01:39:39.615312+0000","last_undegraded":"2023-10-06T01:39:39.615312+0000","last_fullsized":"2023-10-06T01:39:39.615312+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:39.151951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.526690+0000","last_change":"2023-10-06T01:39:39.524124+0000","last_active":"2023-10-06T01:39:39.526690+0000","last_peered":"2023-10-06T01:39:39.526690+0000","last_clean":"2023-10-06T01:39:39.526690+0000","last_became_active":"2023-10-06T01:39:39.523937+0000","last_became_peered":"2023-10-06T01:39:39.523937+0000","last_unstale":"2023-10-06T01:39:39.526690+0000","last_undegraded":"2023-10-06T01:39:39.526690+0000","last_fullsized":"2023-10-06T01:39:39.526690+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:43.467840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.522462+0000","last_change":"2023-10-06T01:39:38.622849+0000","last_active":"2023-10-06T01:39:39.522462+0000","last_peered":"2023-10-06T01:39:39.522462+0000","last_clean":"2023-10-06T01:39:39.522462+0000","last_became_active":"2023-10-06T01:39:38.622572+0000","last_became_peered":"2023-10-06T01:39:38.622572+0000","last_unstale":"2023-10-06T01:39:39.522462+0000","last_undegraded":"2023-10-06T01:39:39.522462+0000","last_fullsized":"2023-10-06T01:39:39.522462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:41.565197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536404+0000","last_change":"2023-10-06T01:39:39.534594+0000","last_active":"2023-10-06T01:39:39.536404+0000","last_peered":"2023-10-06T01:39:39.536404+0000","last_clean":"2023-10-06T01:39:39.536404+0000","last_became_active":"2023-10-06T01:39:39.534233+0000","last_became_peered":"2023-10-06T01:39:39.534233+0000","last_unstale":"2023-10-06T01:39:39.536404+0000","last_undegraded":"2023-10-06T01:39:39.536404+0000","last_fullsized":"2023-10-06T01:39:39.536404+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:43.913718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.525679+0000","last_change":"2023-10-06T01:39:38.626277+0000","last_active":"2023-10-06T01:39:39.525679+0000","last_peered":"2023-10-06T01:39:39.525679+0000","last_clean":"2023-10-06T01:39:39.525679+0000","last_became_active":"2023-10-06T01:39:38.625992+0000","last_became_peered":"2023-10-06T01:39:38.625992+0000","last_unstale":"2023-10-06T01:39:39.525679+0000","last_undegraded":"2023-10-06T01:39:39.525679+0000","last_fullsized":"2023-10-06T01:39:39.525679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:26.630294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.531082+0000","last_change":"2023-10-06T01:39:39.526088+0000","last_active":"2023-10-06T01:39:39.531082+0000","last_peered":"2023-10-06T01:39:39.531082+0000","last_clean":"2023-10-06T01:39:39.531082+0000","last_became_active":"2023-10-06T01:39:39.525757+0000","last_became_peered":"2023-10-06T01:39:39.525757+0000","last_unstale":"2023-10-06T01:39:39.531082+0000","last_undegraded":"2023-10-06T01:39:39.531082+0000","last_fullsized":"2023-10-06T01:39:39.531082+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:52.418744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"34'8","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.619531+0000","last_change":"2023-10-06T01:39:38.625180+0000","last_active":"2023-10-06T01:39:39.619531+0000","last_peered":"2023-10-06T01:39:39.619531+0000","last_clean":"2023-10-06T01:39:39.619531+0000","last_became_active":"2023-10-06T01:39:38.624889+0000","last_became_peered":"2023-10-06T01:39:38.624889+0000","last_unstale":"2023-10-06T01:39:39.619531+0000","last_undegraded":"2023-10-06T01:39:39.619531+0000","last_fullsized":"2023-10-06T01:39:39.619531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:22:20.164155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533562+0000","last_change":"2023-10-06T01:39:39.531326+0000","last_active":"2023-10-06T01:39:39.533562+0000","last_peered":"2023-10-06T01:39:39.533562+0000","last_clean":"2023-10-06T01:39:39.533562+0000","last_became_active":"2023-10-06T01:39:39.531097+0000","last_became_peered":"2023-10-06T01:39:39.531097+0000","last_unstale":"2023-10-06T01:39:39.533562+0000","last_undegraded":"2023-10-06T01:39:39.533562+0000","last_fullsized":"2023-10-06T01:39:39.533562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:46.119956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.619174+0000","last_change":"2023-10-06T01:39:38.627708+0000","last_active":"2023-10-06T01:39:39.619174+0000","last_peered":"2023-10-06T01:39:39.619174+0000","last_clean":"2023-10-06T01:39:39.619174+0000","last_became_active":"2023-10-06T01:39:38.627477+0000","last_became_peered":"2023-10-06T01:39:38.627477+0000","last_unstale":"2023-10-06T01:39:39.619174+0000","last_undegraded":"2023-10-06T01:39:39.619174+0000","last_fullsized":"2023-10-06T01:39:39.619174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:12.344668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535629+0000","last_change":"2023-10-06T01:39:39.527319+0000","last_active":"2023-10-06T01:39:39.535629+0000","last_peered":"2023-10-06T01:39:39.535629+0000","last_clean":"2023-10-06T01:39:39.535629+0000","last_became_active":"2023-10-06T01:39:39.527083+0000","last_became_peered":"2023-10-06T01:39:39.527083+0000","last_unstale":"2023-10-06T01:39:39.535629+0000","last_undegraded":"2023-10-06T01:39:39.535629+0000","last_fullsized":"2023-10-06T01:39:39.535629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:52.418744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.617094+0000","last_change":"2023-10-06T01:39:38.627207+0000","last_active":"2023-10-06T01:39:39.617094+0000","last_peered":"2023-10-06T01:39:39.617094+0000","last_clean":"2023-10-06T01:39:39.617094+0000","last_became_active":"2023-10-06T01:39:38.626943+0000","last_became_peered":"2023-10-06T01:39:38.626943+0000","last_unstale":"2023-10-06T01:39:39.617094+0000","last_undegraded":"2023-10-06T01:39:39.617094+0000","last_fullsized":"2023-10-06T01:39:39.617094+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:45.111092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536257+0000","last_change":"2023-10-06T01:39:39.533370+0000","last_active":"2023-10-06T01:39:39.536257+0000","last_peered":"2023-10-06T01:39:39.536257+0000","last_clean":"2023-10-06T01:39:39.536257+0000","last_became_active":"2023-10-06T01:39:39.532868+0000","last_became_peered":"2023-10-06T01:39:39.532868+0000","last_unstale":"2023-10-06T01:39:39.536257+0000","last_undegraded":"2023-10-06T01:39:39.536257+0000","last_fullsized":"2023-10-06T01:39:39.536257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:59.497040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.616717+0000","last_change":"2023-10-06T01:39:38.627502+0000","last_active":"2023-10-06T01:39:39.616717+0000","last_peered":"2023-10-06T01:39:39.616717+0000","last_clean":"2023-10-06T01:39:39.616717+0000","last_became_active":"2023-10-06T01:39:38.627231+0000","last_became_peered":"2023-10-06T01:39:38.627231+0000","last_unstale":"2023-10-06T01:39:39.616717+0000","last_undegraded":"2023-10-06T01:39:39.616717+0000","last_fullsized":"2023-10-06T01:39:39.616717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:12.414360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533124+0000","last_change":"2023-10-06T01:39:39.531931+0000","last_active":"2023-10-06T01:39:39.533124+0000","last_peered":"2023-10-06T01:39:39.533124+0000","last_clean":"2023-10-06T01:39:39.533124+0000","last_became_active":"2023-10-06T01:39:39.531631+0000","last_became_peered":"2023-10-06T01:39:39.531631+0000","last_unstale":"2023-10-06T01:39:39.533124+0000","last_undegraded":"2023-10-06T01:39:39.533124+0000","last_fullsized":"2023-10-06T01:39:39.533124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:50:32.520206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.522667+0000","last_change":"2023-10-06T01:39:38.623671+0000","last_active":"2023-10-06T01:39:39.522667+0000","last_peered":"2023-10-06T01:39:39.522667+0000","last_clean":"2023-10-06T01:39:39.522667+0000","last_became_active":"2023-10-06T01:39:38.623388+0000","last_became_peered":"2023-10-06T01:39:38.623388+0000","last_unstale":"2023-10-06T01:39:39.522667+0000","last_undegraded":"2023-10-06T01:39:39.522667+0000","last_fullsized":"2023-10-06T01:39:39.522667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:22.990841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.538913+0000","last_change":"2023-10-06T01:39:39.535329+0000","last_active":"2023-10-06T01:39:39.538913+0000","last_peered":"2023-10-06T01:39:39.538913+0000","last_clean":"2023-10-06T01:39:39.538913+0000","last_became_active":"2023-10-06T01:39:39.534826+0000","last_became_peered":"2023-10-06T01:39:39.534826+0000","last_unstale":"2023-10-06T01:39:39.538913+0000","last_undegraded":"2023-10-06T01:39:39.538913+0000","last_fullsized":"2023-10-06T01:39:39.538913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:05:05.351196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.616288+0000","last_change":"2023-10-06T01:39:38.622188+0000","last_active":"2023-10-06T01:39:39.616288+0000","last_peered":"2023-10-06T01:39:39.616288+0000","last_clean":"2023-10-06T01:39:39.616288+0000","last_became_active":"2023-10-06T01:39:38.621909+0000","last_became_peered":"2023-10-06T01:39:38.621909+0000","last_unstale":"2023-10-06T01:39:39.616288+0000","last_undegraded":"2023-10-06T01:39:39.616288+0000","last_fullsized":"2023-10-06T01:39:39.616288+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:06.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533769+0000","last_change":"2023-10-06T01:39:39.528119+0000","last_active":"2023-10-06T01:39:39.533769+0000","last_peered":"2023-10-06T01:39:39.533769+0000","last_clean":"2023-10-06T01:39:39.533769+0000","last_became_active":"2023-10-06T01:39:39.527867+0000","last_became_peered":"2023-10-06T01:39:39.527867+0000","last_unstale":"2023-10-06T01:39:39.533769+0000","last_undegraded":"2023-10-06T01:39:39.533769+0000","last_fullsized":"2023-10-06T01:39:39.533769+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:36.108288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.520646+0000","last_change":"2023-10-06T01:39:38.624450+0000","last_active":"2023-10-06T01:39:39.520646+0000","last_peered":"2023-10-06T01:39:39.520646+0000","last_clean":"2023-10-06T01:39:39.520646+0000","last_became_active":"2023-10-06T01:39:38.624218+0000","last_became_peered":"2023-10-06T01:39:38.624218+0000","last_unstale":"2023-10-06T01:39:39.520646+0000","last_undegraded":"2023-10-06T01:39:39.520646+0000","last_fullsized":"2023-10-06T01:39:39.520646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:26.630294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.537160+0000","last_change":"2023-10-06T01:39:39.530340+0000","last_active":"2023-10-06T01:39:39.537160+0000","last_peered":"2023-10-06T01:39:39.537160+0000","last_clean":"2023-10-06T01:39:39.537160+0000","last_became_active":"2023-10-06T01:39:39.530047+0000","last_became_peered":"2023-10-06T01:39:39.530047+0000","last_unstale":"2023-10-06T01:39:39.537160+0000","last_undegraded":"2023-10-06T01:39:39.537160+0000","last_fullsized":"2023-10-06T01:39:39.537160+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:41:55.235050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.518549+0000","last_change":"2023-10-06T01:39:38.630812+0000","last_active":"2023-10-06T01:39:39.518549+0000","last_peered":"2023-10-06T01:39:39.518549+0000","last_clean":"2023-10-06T01:39:39.518549+0000","last_became_active":"2023-10-06T01:39:38.630517+0000","last_became_peered":"2023-10-06T01:39:38.630517+0000","last_unstale":"2023-10-06T01:39:39.518549+0000","last_undegraded":"2023-10-06T01:39:39.518549+0000","last_fullsized":"2023-10-06T01:39:39.518549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:17.633353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532118+0000","last_change":"2023-10-06T01:39:39.528466+0000","last_active":"2023-10-06T01:39:39.532118+0000","last_peered":"2023-10-06T01:39:39.532118+0000","last_clean":"2023-10-06T01:39:39.532118+0000","last_became_active":"2023-10-06T01:39:39.528042+0000","last_became_peered":"2023-10-06T01:39:39.528042+0000","last_unstale":"2023-10-06T01:39:39.532118+0000","last_undegraded":"2023-10-06T01:39:39.532118+0000","last_fullsized":"2023-10-06T01:39:39.532118+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:06.076326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.521385+0000","last_change":"2023-10-06T01:39:38.623491+0000","last_active":"2023-10-06T01:39:39.521385+0000","last_peered":"2023-10-06T01:39:39.521385+0000","last_clean":"2023-10-06T01:39:39.521385+0000","last_became_active":"2023-10-06T01:39:38.623222+0000","last_became_peered":"2023-10-06T01:39:38.623222+0000","last_unstale":"2023-10-06T01:39:39.521385+0000","last_undegraded":"2023-10-06T01:39:39.521385+0000","last_fullsized":"2023-10-06T01:39:39.521385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:36:21.647390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.529353+0000","last_change":"2023-10-06T01:39:39.526770+0000","last_active":"2023-10-06T01:39:39.529353+0000","last_peered":"2023-10-06T01:39:39.529353+0000","last_clean":"2023-10-06T01:39:39.529353+0000","last_became_active":"2023-10-06T01:39:39.526572+0000","last_became_peered":"2023-10-06T01:39:39.526572+0000","last_unstale":"2023-10-06T01:39:39.529353+0000","last_undegraded":"2023-10-06T01:39:39.529353+0000","last_fullsized":"2023-10-06T01:39:39.529353+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:57.121167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.521627+0000","last_change":"2023-10-06T01:39:38.630658+0000","last_active":"2023-10-06T01:39:39.521627+0000","last_peered":"2023-10-06T01:39:39.521627+0000","last_clean":"2023-10-06T01:39:39.521627+0000","last_became_active":"2023-10-06T01:39:38.630360+0000","last_became_peered":"2023-10-06T01:39:38.630360+0000","last_unstale":"2023-10-06T01:39:39.521627+0000","last_undegraded":"2023-10-06T01:39:39.521627+0000","last_fullsized":"2023-10-06T01:39:39.521627+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:22.990841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.522743+0000","last_change":"2023-10-06T01:38:44.533111+0000","last_active":"2023-10-06T01:39:39.522743+0000","last_peered":"2023-10-06T01:39:39.522743+0000","last_clean":"2023-10-06T01:39:39.522743+0000","last_became_active":"2023-10-06T01:38:44.532838+0000","last_became_peered":"2023-10-06T01:38:44.532838+0000","last_unstale":"2023-10-06T01:39:39.522743+0000","last_undegraded":"2023-10-06T01:39:39.522743+0000","last_fullsized":"2023-10-06T01:39:39.522743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532512+0000","last_change":"2023-10-06T01:39:39.529973+0000","last_active":"2023-10-06T01:39:39.532512+0000","last_peered":"2023-10-06T01:39:39.532512+0000","last_clean":"2023-10-06T01:39:39.532512+0000","last_became_active":"2023-10-06T01:39:39.529739+0000","last_became_peered":"2023-10-06T01:39:39.529739+0000","last_unstale":"2023-10-06T01:39:39.532512+0000","last_undegraded":"2023-10-06T01:39:39.532512+0000","last_fullsized":"2023-10-06T01:39:39.532512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:41:55.235050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.519666+0000","last_change":"2023-10-06T01:39:38.623882+0000","last_active":"2023-10-06T01:39:39.519666+0000","last_peered":"2023-10-06T01:39:39.519666+0000","last_clean":"2023-10-06T01:39:39.519666+0000","last_became_active":"2023-10-06T01:39:38.623583+0000","last_became_peered":"2023-10-06T01:39:38.623583+0000","last_unstale":"2023-10-06T01:39:39.519666+0000","last_undegraded":"2023-10-06T01:39:39.519666+0000","last_fullsized":"2023-10-06T01:39:39.519666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:41.565197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.520635+0000","last_change":"2023-10-06T01:38:44.533897+0000","last_active":"2023-10-06T01:39:39.520635+0000","last_peered":"2023-10-06T01:39:39.520635+0000","last_clean":"2023-10-06T01:39:39.520635+0000","last_became_active":"2023-10-06T01:38:44.533611+0000","last_became_peered":"2023-10-06T01:38:44.533611+0000","last_unstale":"2023-10-06T01:39:39.520635+0000","last_undegraded":"2023-10-06T01:39:39.520635+0000","last_fullsized":"2023-10-06T01:39:39.520635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:24.411408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.534892+0000","last_change":"2023-10-06T01:39:39.531616+0000","last_active":"2023-10-06T01:39:39.534892+0000","last_peered":"2023-10-06T01:39:39.534892+0000","last_clean":"2023-10-06T01:39:39.534892+0000","last_became_active":"2023-10-06T01:39:39.531337+0000","last_became_peered":"2023-10-06T01:39:39.531337+0000","last_unstale":"2023-10-06T01:39:39.534892+0000","last_undegraded":"2023-10-06T01:39:39.534892+0000","last_fullsized":"2023-10-06T01:39:39.534892+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:57.121167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T01:39:40.963716+0000","last_change":"2023-10-06T01:39:38.627842+0000","last_active":"2023-10-06T01:39:40.963716+0000","last_peered":"2023-10-06T01:39:40.963716+0000","last_clean":"2023-10-06T01:39:40.963716+0000","last_became_active":"2023-10-06T01:39:38.627581+0000","last_became_peered":"2023-10-06T01:39:38.627581+0000","last_unstale":"2023-10-06T01:39:40.963716+0000","last_undegraded":"2023-10-06T01:39:40.963716+0000","last_fullsized":"2023-10-06T01:39:40.963716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:45.908004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.520759+0000","last_change":"2023-10-06T01:38:45.307814+0000","last_active":"2023-10-06T01:39:39.520759+0000","last_peered":"2023-10-06T01:39:39.520759+0000","last_clean":"2023-10-06T01:39:39.520759+0000","last_became_active":"2023-10-06T01:38:45.307536+0000","last_became_peered":"2023-10-06T01:38:45.307536+0000","last_unstale":"2023-10-06T01:39:39.520759+0000","last_undegraded":"2023-10-06T01:39:39.520759+0000","last_fullsized":"2023-10-06T01:39:39.520759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:09.503713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.539176+0000","last_change":"2023-10-06T01:39:39.531658+0000","last_active":"2023-10-06T01:39:39.539176+0000","last_peered":"2023-10-06T01:39:39.539176+0000","last_clean":"2023-10-06T01:39:39.539176+0000","last_became_active":"2023-10-06T01:39:39.531262+0000","last_became_peered":"2023-10-06T01:39:39.531262+0000","last_unstale":"2023-10-06T01:39:39.539176+0000","last_undegraded":"2023-10-06T01:39:39.539176+0000","last_fullsized":"2023-10-06T01:39:39.539176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:43.467840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.518786+0000","last_change":"2023-10-06T01:39:38.626151+0000","last_active":"2023-10-06T01:39:39.518786+0000","last_peered":"2023-10-06T01:39:39.518786+0000","last_clean":"2023-10-06T01:39:39.518786+0000","last_became_active":"2023-10-06T01:39:38.625888+0000","last_became_peered":"2023-10-06T01:39:38.625888+0000","last_unstale":"2023-10-06T01:39:39.518786+0000","last_undegraded":"2023-10-06T01:39:39.518786+0000","last_fullsized":"2023-10-06T01:39:39.518786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:35.807335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.518659+0000","last_change":"2023-10-06T01:38:44.534507+0000","last_active":"2023-10-06T01:39:39.518659+0000","last_peered":"2023-10-06T01:39:39.518659+0000","last_clean":"2023-10-06T01:39:39.518659+0000","last_became_active":"2023-10-06T01:38:44.534191+0000","last_became_peered":"2023-10-06T01:38:44.534191+0000","last_unstale":"2023-10-06T01:39:39.518659+0000","last_undegraded":"2023-10-06T01:39:39.518659+0000","last_fullsized":"2023-10-06T01:39:39.518659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.519577+0000","last_change":"2023-10-06T01:38:40.115117+0000","last_active":"2023-10-06T01:39:39.519577+0000","last_peered":"2023-10-06T01:39:39.519577+0000","last_clean":"2023-10-06T01:39:39.519577+0000","last_became_active":"2023-10-06T01:38:40.114142+0000","last_became_peered":"2023-10-06T01:38:40.114142+0000","last_unstale":"2023-10-06T01:39:39.519577+0000","last_undegraded":"2023-10-06T01:39:39.519577+0000","last_fullsized":"2023-10-06T01:39:39.519577+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_clean_scrub_stamp":"2023-10-06T01:38:38.338797+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:52.870262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532184+0000","last_change":"2023-10-06T01:39:39.530879+0000","last_active":"2023-10-06T01:39:39.532184+0000","last_peered":"2023-10-06T01:39:39.532184+0000","last_clean":"2023-10-06T01:39:39.532184+0000","last_became_active":"2023-10-06T01:39:39.530619+0000","last_became_peered":"2023-10-06T01:39:39.530619+0000","last_unstale":"2023-10-06T01:39:39.532184+0000","last_undegraded":"2023-10-06T01:39:39.532184+0000","last_fullsized":"2023-10-06T01:39:39.532184+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:03.781047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.623038+0000","last_change":"2023-10-06T01:39:38.628812+0000","last_active":"2023-10-06T01:39:39.623038+0000","last_peered":"2023-10-06T01:39:39.623038+0000","last_clean":"2023-10-06T01:39:39.623038+0000","last_became_active":"2023-10-06T01:39:38.628525+0000","last_became_peered":"2023-10-06T01:39:38.628525+0000","last_unstale":"2023-10-06T01:39:39.623038+0000","last_undegraded":"2023-10-06T01:39:39.623038+0000","last_fullsized":"2023-10-06T01:39:39.623038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:22.990841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.519641+0000","last_change":"2023-10-06T01:38:44.531831+0000","last_active":"2023-10-06T01:39:39.519641+0000","last_peered":"2023-10-06T01:39:39.519641+0000","last_clean":"2023-10-06T01:39:39.519641+0000","last_became_active":"2023-10-06T01:38:44.531496+0000","last_became_peered":"2023-10-06T01:38:44.531496+0000","last_unstale":"2023-10-06T01:39:39.519641+0000","last_undegraded":"2023-10-06T01:39:39.519641+0000","last_fullsized":"2023-10-06T01:39:39.519641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:28.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.531992+0000","last_change":"2023-10-06T01:39:39.529184+0000","last_active":"2023-10-06T01:39:39.531992+0000","last_peered":"2023-10-06T01:39:39.531992+0000","last_clean":"2023-10-06T01:39:39.531992+0000","last_became_active":"2023-10-06T01:39:39.528937+0000","last_became_peered":"2023-10-06T01:39:39.528937+0000","last_unstale":"2023-10-06T01:39:39.531992+0000","last_undegraded":"2023-10-06T01:39:39.531992+0000","last_fullsized":"2023-10-06T01:39:39.531992+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:53.326821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.525846+0000","last_change":"2023-10-06T01:39:38.626256+0000","last_active":"2023-10-06T01:39:39.525846+0000","last_peered":"2023-10-06T01:39:39.525846+0000","last_clean":"2023-10-06T01:39:39.525846+0000","last_became_active":"2023-10-06T01:39:38.625973+0000","last_became_peered":"2023-10-06T01:39:38.625973+0000","last_unstale":"2023-10-06T01:39:39.525846+0000","last_undegraded":"2023-10-06T01:39:39.525846+0000","last_fullsized":"2023-10-06T01:39:39.525846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:36:21.647390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.519166+0000","last_change":"2023-10-06T01:38:44.531335+0000","last_active":"2023-10-06T01:39:39.519166+0000","last_peered":"2023-10-06T01:39:39.519166+0000","last_clean":"2023-10-06T01:39:39.519166+0000","last_became_active":"2023-10-06T01:38:44.530966+0000","last_became_peered":"2023-10-06T01:38:44.530966+0000","last_unstale":"2023-10-06T01:39:39.519166+0000","last_undegraded":"2023-10-06T01:39:39.519166+0000","last_fullsized":"2023-10-06T01:39:39.519166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:33.926180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536339+0000","last_change":"2023-10-06T01:39:39.532663+0000","last_active":"2023-10-06T01:39:39.536339+0000","last_peered":"2023-10-06T01:39:39.536339+0000","last_clean":"2023-10-06T01:39:39.536339+0000","last_became_active":"2023-10-06T01:39:39.532435+0000","last_became_peered":"2023-10-06T01:39:39.532435+0000","last_unstale":"2023-10-06T01:39:39.536339+0000","last_undegraded":"2023-10-06T01:39:39.536339+0000","last_fullsized":"2023-10-06T01:39:39.536339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:23:15.510626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.529694+0000","last_change":"2023-10-06T01:39:38.623748+0000","last_active":"2023-10-06T01:39:39.529694+0000","last_peered":"2023-10-06T01:39:39.529694+0000","last_clean":"2023-10-06T01:39:39.529694+0000","last_became_active":"2023-10-06T01:39:38.623460+0000","last_became_peered":"2023-10-06T01:39:38.623460+0000","last_unstale":"2023-10-06T01:39:39.529694+0000","last_undegraded":"2023-10-06T01:39:39.529694+0000","last_fullsized":"2023-10-06T01:39:39.529694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:02:05.682135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.522622+0000","last_change":"2023-10-06T01:38:44.533582+0000","last_active":"2023-10-06T01:39:39.522622+0000","last_peered":"2023-10-06T01:39:39.522622+0000","last_clean":"2023-10-06T01:39:39.522622+0000","last_became_active":"2023-10-06T01:38:44.533324+0000","last_became_peered":"2023-10-06T01:38:44.533324+0000","last_unstale":"2023-10-06T01:39:39.522622+0000","last_undegraded":"2023-10-06T01:39:39.522622+0000","last_fullsized":"2023-10-06T01:39:39.522622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535058+0000","last_change":"2023-10-06T01:39:39.532149+0000","last_active":"2023-10-06T01:39:39.535058+0000","last_peered":"2023-10-06T01:39:39.535058+0000","last_clean":"2023-10-06T01:39:39.535058+0000","last_became_active":"2023-10-06T01:39:39.531891+0000","last_became_peered":"2023-10-06T01:39:39.531891+0000","last_unstale":"2023-10-06T01:39:39.535058+0000","last_undegraded":"2023-10-06T01:39:39.535058+0000","last_fullsized":"2023-10-06T01:39:39.535058+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:40.175833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.517261+0000","last_change":"2023-10-06T01:39:38.623722+0000","last_active":"2023-10-06T01:39:39.517261+0000","last_peered":"2023-10-06T01:39:39.517261+0000","last_clean":"2023-10-06T01:39:39.517261+0000","last_became_active":"2023-10-06T01:39:38.623425+0000","last_became_peered":"2023-10-06T01:39:38.623425+0000","last_unstale":"2023-10-06T01:39:39.517261+0000","last_undegraded":"2023-10-06T01:39:39.517261+0000","last_fullsized":"2023-10-06T01:39:39.517261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:14.193205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.526690+0000","last_change":"2023-10-06T01:38:44.533765+0000","last_active":"2023-10-06T01:39:39.526690+0000","last_peered":"2023-10-06T01:39:39.526690+0000","last_clean":"2023-10-06T01:39:39.526690+0000","last_became_active":"2023-10-06T01:38:44.533406+0000","last_became_peered":"2023-10-06T01:38:44.533406+0000","last_unstale":"2023-10-06T01:39:39.526690+0000","last_undegraded":"2023-10-06T01:39:39.526690+0000","last_fullsized":"2023-10-06T01:39:39.526690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298272,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073568,"statfs":{"total":96636764160,"available":96331333632,"internally_reserved":0,"allocated":1007616,"data_stored":753061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.70099999999999996}]},{"osd":1,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.73599999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.65600000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.75700000000000001}]},{"osd":3,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.77900000000000003}]},{"osd":4,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.46400000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.56799999999999995}]},{"osd":6,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.54500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574866,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":401408,"data_stored":161641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.495},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.55100000000000005}]},{"osd":1,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.46000000000000002}]},{"osd":2,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.39600000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.56699999999999995}]},{"osd":4,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.34899999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.52900000000000003}]},{"osd":7,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.432}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":401408,"data_stored":161177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.378}]},{"osd":2,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.25900000000000001},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":0.33700000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.29299999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.41599999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.54200000000000004}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.46400000000000002}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.48199999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298260,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073580,"statfs":{"total":96636764160,"available":96331345920,"internally_reserved":0,"allocated":995328,"data_stored":751489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"last":0.29899999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.27700000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.26000000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.307}]},{"osd":4,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.45100000000000001}]},{"osd":5,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.49099999999999999}]},{"osd":6,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.435},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.46000000000000002}]},{"osd":7,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.504},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.39600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":401408,"data_stored":161157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.34599999999999997}]},{"osd":1,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.39300000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.40100000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.77500000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.748}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.82299999999999995}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.67100000000000004}]}]},{"osd":3,"up_from":13,"seq":55834574865,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":413696,"data_stored":162657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.313},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.22800000000000001}]},{"osd":1,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.372}]},{"osd":2,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.35199999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.621}]},{"osd":5,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.49199999999999999}]},{"osd":6,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.55500000000000005}]},{"osd":7,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.67300000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574865,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297684,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074156,"statfs":{"total":96636764160,"available":96331935744,"internally_reserved":0,"allocated":405504,"data_stored":161663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.4289999999999998,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.52700000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":4.2270000000000003,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.2789999999999999,"5min":4.2789999999999999,"15min":4.2789999999999999},"last":0.46700000000000003}]},{"osd":2,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":12.359,"5min":12.359,"15min":12.359},"last":0.55300000000000005},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":12.326000000000001,"5min":12.326000000000001,"15min":12.326000000000001},"last":0.67800000000000005}]},{"osd":3,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":3.448,"5min":3.448,"15min":3.448},"last":0.57999999999999996},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":12.282,"5min":12.282,"15min":12.282},"last":0.504}]},{"osd":5,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.64500000000000002}]},{"osd":6,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.623}]},{"osd":7,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.66200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297684,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074156,"statfs":{"total":96636764160,"available":96331935744,"internally_reserved":0,"allocated":405504,"data_stored":161199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.439},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.66400000000000003}]},{"osd":1,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.53700000000000003}]},{"osd":2,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.65300000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.51600000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.41199999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.69999999999999996}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.63100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:39:48.214 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:39:48.343 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.343+0000 7f2cb05b4700 1 Processor -- start 2023-10-06T01:39:48.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.343+0000 7f2cb05b4700 1 -- start start 2023-10-06T01:39:48.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.344+0000 7f2cb05b4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f2ca80cb5a0 0x7f2ca80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:48.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.344+0000 7f2cb05b4700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca815ae40 con 0x7f2ca80cd9e0 2023-10-06T01:39:48.344 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.344+0000 7f2cb05b4700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ca815ab60 con 0x7f2ca815a5d0 2023-10-06T01:39:48.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.344+0000 7f2cb05b4700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ca80d13f0 con 0x7f2ca80cb5a0 2023-10-06T01:39:48.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.344+0000 7f2cadb4f700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f2ca80cd9e0 0x7f2ca8159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:55038/0 (socket says 172.21.15.69:55038) 2023-10-06T01:39:48.345 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.344+0000 7f2cadb4f700 1 -- 172.21.15.69:0/2182055031 learned_addr learned my addr 172.21.15.69:0/2182055031 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:48.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.345+0000 7f2cae350700 1 --2- 172.21.15.69:0/2182055031 >> v2:172.21.15.88:3300/0 conn(0x7f2ca80cb5a0 0x7f2ca80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:48.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.345+0000 7f2cad34e700 1 -- 172.21.15.69:0/2182055031 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2935194401 0 0) 0x7f2ca815ae40 con 0x7f2ca80cd9e0 2023-10-06T01:39:48.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.345+0000 7f2cad34e700 1 -- 172.21.15.69:0/2182055031 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c90003570 con 0x7f2ca80cd9e0 2023-10-06T01:39:48.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.345+0000 7f2cad34e700 1 -- 172.21.15.69:0/2182055031 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3310270934 0 0) 0x7f2c90003570 con 0x7f2ca80cd9e0 2023-10-06T01:39:48.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.345+0000 7f2cad34e700 1 -- 172.21.15.69:0/2182055031 >> v2:172.21.15.88:3300/0 conn(0x7f2ca80cb5a0 msgr2=0x7f2ca80cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:48.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.345+0000 7f2cad34e700 1 --2- 172.21.15.69:0/2182055031 >> v2:172.21.15.88:3300/0 conn(0x7f2ca80cb5a0 0x7f2ca80cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:48.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.345+0000 7f2cad34e700 1 -- 172.21.15.69:0/2182055031 >> v1:172.21.15.88:6789/0 conn(0x7f2ca815a5d0 legacy=0x7f2ca8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:48.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.345+0000 7f2cad34e700 1 -- 172.21.15.69:0/2182055031 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca80ccf00 con 0x7f2ca80cd9e0 2023-10-06T01:39:48.348 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.345+0000 7f2cad34e700 1 -- 172.21.15.69:0/2182055031 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f2c9c001470 con 0x7f2ca80cd9e0 2023-10-06T01:39:48.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.345+0000 7f2cad34e700 1 -- 172.21.15.69:0/2182055031 >> v1:172.21.15.69:6789/0 conn(0x7f2ca80cd9e0 legacy=0x7f2ca8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:48.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.345+0000 7f2cad34e700 1 --2- 172.21.15.69:0/2182055031 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2c90003a60 0x7f2c90003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:48.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.345+0000 7f2cad34e700 1 --2- 172.21.15.69:0/2182055031 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2c90004810 0x7f2c90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:48.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.345+0000 7f2cad34e700 1 --2- 172.21.15.69:0/2182055031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c900051c0 0x7f2c9000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:48.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.345+0000 7f2cad34e700 1 -- 172.21.15.69:0/2182055031 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9000c0a0 con 0x7f2c90003a60 2023-10-06T01:39:48.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.345+0000 7f2cad34e700 1 -- 172.21.15.69:0/2182055031 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9000c210 con 0x7f2c900051c0 2023-10-06T01:39:48.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.345+0000 7f2cad34e700 1 -- 172.21.15.69:0/2182055031 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c9000c3d0 con 0x7f2c90004810 2023-10-06T01:39:48.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.345+0000 7f2cae350700 1 --2- 172.21.15.69:0/2182055031 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2c90003a60 0x7f2c90003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:48.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.345+0000 7f2cadb4f700 1 --2- 172.21.15.69:0/2182055031 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2c90004810 0x7f2c90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:48.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.345+0000 7f2caeb51700 1 --2- 172.21.15.69:0/2182055031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c900051c0 0x7f2c9000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:48.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.345+0000 7f2cae350700 1 -- 172.21.15.69:0/2182055031 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2c90004810 msgr2=0x7f2c90004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:48.349 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.345+0000 7f2cae350700 1 --2- 172.21.15.69:0/2182055031 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2c90004810 0x7f2c90004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:48.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.345+0000 7f2cae350700 1 -- 172.21.15.69:0/2182055031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c900051c0 msgr2=0x7f2c9000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:48.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.345+0000 7f2cae350700 1 --2- 172.21.15.69:0/2182055031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c900051c0 0x7f2c9000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:48.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.345+0000 7f2cae350700 1 -- 172.21.15.69:0/2182055031 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c90003570 con 0x7f2c90003a60 2023-10-06T01:39:48.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.345+0000 7f2caeb51700 1 -- 172.21.15.69:0/2182055031 reap_dead start 2023-10-06T01:39:48.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.345+0000 7f2cadb4f700 1 --2- 172.21.15.69:0/2182055031 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2c90004810 0x7f2c90004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:48.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.346+0000 7f2cae350700 1 --2- 172.21.15.69:0/2182055031 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2c90003a60 0x7f2c90003e70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2c9800e210 tx=0x7f2c9800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c03e12315549d27 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:48.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.346+0000 7f2cad34e700 1 -- 172.21.15.69:0/2182055031 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9800eac0 con 0x7f2c90003a60 2023-10-06T01:39:48.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.346+0000 7f2cad34e700 1 -- 172.21.15.69:0/2182055031 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c9800f040 con 0x7f2c90003a60 2023-10-06T01:39:48.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.346+0000 7f2cad34e700 1 -- 172.21.15.69:0/2182055031 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c9800ee70 con 0x7f2c90003a60 2023-10-06T01:39:48.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.346+0000 7f2cb05b4700 1 -- 172.21.15.69:0/2182055031 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2c90003a60 msgr2=0x7f2c90003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:48.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.346+0000 7f2cb05b4700 1 --2- 172.21.15.69:0/2182055031 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2c90003a60 0x7f2c90003e70 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f2c9800e210 tx=0x7f2c9800b040 comp rx=0 tx=0).stop 2023-10-06T01:39:48.350 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.346+0000 7f2cb05b4700 1 -- 172.21.15.69:0/2182055031 shutdown_connections 2023-10-06T01:39:48.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.346+0000 7f2cb05b4700 1 --2- 172.21.15.69:0/2182055031 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2c90003a60 0x7f2c90003e70 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:48.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.346+0000 7f2cb05b4700 1 -- 172.21.15.69:0/2182055031 >> 172.21.15.69:0/2182055031 conn(0x7f2ca8070e30 msgr2=0x7f2ca80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:48.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.346+0000 7f2cb05b4700 1 -- 172.21.15.69:0/2182055031 shutdown_connections 2023-10-06T01:39:48.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.346+0000 7f2cb05b4700 1 -- 172.21.15.69:0/2182055031 wait complete. 2023-10-06T01:39:48.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.347+0000 7f2cb05b4700 1 Processor -- start 2023-10-06T01:39:48.351 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.347+0000 7f2cb05b4700 1 -- start start 2023-10-06T01:39:48.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.348+0000 7f2cb05b4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c90003a60 0x7f2ca80b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:48.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.348+0000 7f2cb05b4700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ca815cd00 0x7f2ca81513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:48.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.348+0000 7f2cb05b4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ca80b4d30 0x7f2ca8152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:48.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.348+0000 7f2cb05b4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca80b48a0 con 0x7f2ca80b4d30 2023-10-06T01:39:48.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.348+0000 7f2cb05b4700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca80b39f0 con 0x7f2c90003a60 2023-10-06T01:39:48.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.348+0000 7f2cb05b4700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ca80b3c90 con 0x7f2ca815cd00 2023-10-06T01:39:48.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.348+0000 7f2caeb51700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ca80b4d30 0x7f2ca8152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:48.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.348+0000 7f2caeb51700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ca80b4d30 0x7f2ca8152d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49982/0 (socket says 172.21.15.69:49982) 2023-10-06T01:39:48.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.348+0000 7f2caeb51700 1 -- 172.21.15.69:0/932844719 learned_addr learned my addr 172.21.15.69:0/932844719 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:48.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.348+0000 7f2cae350700 1 --2- 172.21.15.69:0/932844719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c90003a60 0x7f2ca80b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:48.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.348+0000 7f2cadb4f700 1 --2- 172.21.15.69:0/932844719 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ca815cd00 0x7f2ca81513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:48.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.348+0000 7f2caeb51700 1 -- 172.21.15.69:0/932844719 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ca815cd00 msgr2=0x7f2ca81513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:48.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.349+0000 7f2caeb51700 1 --2- 172.21.15.69:0/932844719 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ca815cd00 0x7f2ca81513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:48.354 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.349+0000 7f2caeb51700 1 -- 172.21.15.69:0/932844719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c90003a60 msgr2=0x7f2ca80b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:48.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.349+0000 7f2caeb51700 1 --2- 172.21.15.69:0/932844719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c90003a60 0x7f2ca80b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:48.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.349+0000 7f2caeb51700 1 -- 172.21.15.69:0/932844719 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca80b3f70 con 0x7f2ca80b4d30 2023-10-06T01:39:48.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.349+0000 7f2cadb4f700 1 --2- 172.21.15.69:0/932844719 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ca815cd00 0x7f2ca81513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:48.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.349+0000 7f2caeb51700 1 --2- 172.21.15.69:0/932844719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ca80b4d30 0x7f2ca8152d40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80ccdc0 tx=0x7f2ca0009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:48.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.349+0000 7f2ca67fc700 1 -- 172.21.15.69:0/932844719 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0013420 con 0x7f2ca80b4d30 2023-10-06T01:39:48.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.349+0000 7f2ca67fc700 1 -- 172.21.15.69:0/932844719 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ca00135a0 con 0x7f2ca80b4d30 2023-10-06T01:39:48.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.349+0000 7f2cb05b4700 1 -- 172.21.15.69:0/932844719 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ca80b4250 con 0x7f2ca80b4d30 2023-10-06T01:39:48.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.349+0000 7f2ca67fc700 1 -- 172.21.15.69:0/932844719 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ca0013960 con 0x7f2ca80b4d30 2023-10-06T01:39:48.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.349+0000 7f2cb05b4700 1 -- 172.21.15.69:0/932844719 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ca8151920 con 0x7f2ca80b4d30 2023-10-06T01:39:48.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.350+0000 7f2cb05b4700 1 -- 172.21.15.69:0/932844719 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ca80b4a10 con 0x7f2ca80b4d30 2023-10-06T01:39:48.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.350+0000 7f2ca67fc700 1 -- 172.21.15.69:0/932844719 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ca0013d10 con 0x7f2ca80b4d30 2023-10-06T01:39:48.355 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.351+0000 7f2ca67fc700 1 --2- 172.21.15.69:0/932844719 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2c94066f30 0x7f2c940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:48.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.351+0000 7f2ca67fc700 1 -- 172.21.15.69:0/932844719 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2ca0084380 con 0x7f2ca80b4d30 2023-10-06T01:39:48.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.351+0000 7f2cae350700 1 --2- 172.21.15.69:0/932844719 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2c94066f30 0x7f2c940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:48.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.351+0000 7f2cae350700 1 --2- 172.21.15.69:0/932844719 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2c94066f30 0x7f2c940693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2c9800afd0 tx=0x7f2c9801a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:48.356 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.355+0000 7f2ca67fc700 1 -- 172.21.15.69:0/932844719 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ca0051490 con 0x7f2ca80b4d30 2023-10-06T01:39:48.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.533+0000 7f2cb05b4700 1 -- 172.21.15.69:0/932844719 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2ca804c3c0 con 0x7f2c94066f30 2023-10-06T01:39:48.541 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.541+0000 7f2ca67fc700 1 -- 172.21.15.69:0/932844719 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+310589 (secure 0 0 0) 0x7f2ca804c3c0 con 0x7f2c94066f30 2023-10-06T01:39:48.545 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:48.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.545+0000 7f2cb05b4700 1 -- 172.21.15.69:0/932844719 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2c94066f30 msgr2=0x7f2c940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:48.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.545+0000 7f2cb05b4700 1 --2- 172.21.15.69:0/932844719 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2c94066f30 0x7f2c940693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2c9800afd0 tx=0x7f2c9801a000 comp rx=0 tx=0).stop 2023-10-06T01:39:48.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.545+0000 7f2cb05b4700 1 -- 172.21.15.69:0/932844719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ca80b4d30 msgr2=0x7f2ca8152d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:48.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.545+0000 7f2cb05b4700 1 --2- 172.21.15.69:0/932844719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ca80b4d30 0x7f2ca8152d40 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f2ca80ccdc0 tx=0x7f2ca0009040 comp rx=0 tx=0).stop 2023-10-06T01:39:48.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.545+0000 7f2cb05b4700 1 -- 172.21.15.69:0/932844719 shutdown_connections 2023-10-06T01:39:48.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.545+0000 7f2cb05b4700 1 --2- 172.21.15.69:0/932844719 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2c94066f30 0x7f2c940693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:48.548 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.545+0000 7f2cb05b4700 1 --2- 172.21.15.69:0/932844719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ca80b4d30 0x7f2ca8152d40 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:48.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.545+0000 7f2cb05b4700 1 --2- 172.21.15.69:0/932844719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2c90003a60 0x7f2ca80b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:48.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.545+0000 7f2cb05b4700 1 --2- 172.21.15.69:0/932844719 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2ca815cd00 0x7f2ca81513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:48.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.545+0000 7f2cb05b4700 1 -- 172.21.15.69:0/932844719 >> 172.21.15.69:0/932844719 conn(0x7f2ca8070e30 msgr2=0x7f2ca80c6aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:48.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.545+0000 7f2cb05b4700 1 -- 172.21.15.69:0/932844719 shutdown_connections 2023-10-06T01:39:48.549 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.545+0000 7f2cb05b4700 1 -- 172.21.15.69:0/932844719 wait complete. 2023-10-06T01:39:48.549 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-10-06T01:39:48.557 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":64,"stamp":"2023-10-06T01:39:48.272260+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382632,"kb_used_data":4328,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592088,"statfs":{"total":773094113280,"available":770654298112,"internally_reserved":0,"allocated":4431872,"data_stored":2474044,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.756664"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.531235+0000","last_change":"2023-10-06T01:39:39.526915+0000","last_active":"2023-10-06T01:39:39.531235+0000","last_peered":"2023-10-06T01:39:39.531235+0000","last_clean":"2023-10-06T01:39:39.531235+0000","last_became_active":"2023-10-06T01:39:39.526686+0000","last_became_peered":"2023-10-06T01:39:39.526686+0000","last_unstale":"2023-10-06T01:39:39.531235+0000","last_undegraded":"2023-10-06T01:39:39.531235+0000","last_fullsized":"2023-10-06T01:39:39.531235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:07:20.141113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.527522+0000","last_change":"2023-10-06T01:39:39.524003+0000","last_active":"2023-10-06T01:39:39.527522+0000","last_peered":"2023-10-06T01:39:39.527522+0000","last_clean":"2023-10-06T01:39:39.527522+0000","last_became_active":"2023-10-06T01:39:39.523726+0000","last_became_peered":"2023-10-06T01:39:39.523726+0000","last_unstale":"2023-10-06T01:39:39.527522+0000","last_undegraded":"2023-10-06T01:39:39.527522+0000","last_fullsized":"2023-10-06T01:39:39.527522+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:40.175833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.534486+0000","last_change":"2023-10-06T01:39:39.530499+0000","last_active":"2023-10-06T01:39:39.534486+0000","last_peered":"2023-10-06T01:39:39.534486+0000","last_clean":"2023-10-06T01:39:39.534486+0000","last_became_active":"2023-10-06T01:39:39.530231+0000","last_became_peered":"2023-10-06T01:39:39.530231+0000","last_unstale":"2023-10-06T01:39:39.534486+0000","last_undegraded":"2023-10-06T01:39:39.534486+0000","last_fullsized":"2023-10-06T01:39:39.534486+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:49.497096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.539552+0000","last_change":"2023-10-06T01:39:39.538503+0000","last_active":"2023-10-06T01:39:39.539552+0000","last_peered":"2023-10-06T01:39:39.539552+0000","last_clean":"2023-10-06T01:39:39.539552+0000","last_became_active":"2023-10-06T01:39:39.538337+0000","last_became_peered":"2023-10-06T01:39:39.538337+0000","last_unstale":"2023-10-06T01:39:39.539552+0000","last_undegraded":"2023-10-06T01:39:39.539552+0000","last_fullsized":"2023-10-06T01:39:39.539552+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:13.353533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532785+0000","last_change":"2023-10-06T01:39:39.530772+0000","last_active":"2023-10-06T01:39:39.532785+0000","last_peered":"2023-10-06T01:39:39.532785+0000","last_clean":"2023-10-06T01:39:39.532785+0000","last_became_active":"2023-10-06T01:39:39.530517+0000","last_became_peered":"2023-10-06T01:39:39.530517+0000","last_unstale":"2023-10-06T01:39:39.532785+0000","last_undegraded":"2023-10-06T01:39:39.532785+0000","last_fullsized":"2023-10-06T01:39:39.532785+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.642217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.525631+0000","last_change":"2023-10-06T01:39:39.524722+0000","last_active":"2023-10-06T01:39:39.525631+0000","last_peered":"2023-10-06T01:39:39.525631+0000","last_clean":"2023-10-06T01:39:39.525631+0000","last_became_active":"2023-10-06T01:39:39.524473+0000","last_became_peered":"2023-10-06T01:39:39.524473+0000","last_unstale":"2023-10-06T01:39:39.525631+0000","last_undegraded":"2023-10-06T01:39:39.525631+0000","last_fullsized":"2023-10-06T01:39:39.525631+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:57.121167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532800+0000","last_change":"2023-10-06T01:39:39.527585+0000","last_active":"2023-10-06T01:39:39.532800+0000","last_peered":"2023-10-06T01:39:39.532800+0000","last_clean":"2023-10-06T01:39:39.532800+0000","last_became_active":"2023-10-06T01:39:39.527217+0000","last_became_peered":"2023-10-06T01:39:39.527217+0000","last_unstale":"2023-10-06T01:39:39.532800+0000","last_undegraded":"2023-10-06T01:39:39.532800+0000","last_fullsized":"2023-10-06T01:39:39.532800+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:55.203229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533099+0000","last_change":"2023-10-06T01:39:39.530203+0000","last_active":"2023-10-06T01:39:39.533099+0000","last_peered":"2023-10-06T01:39:39.533099+0000","last_clean":"2023-10-06T01:39:39.533099+0000","last_became_active":"2023-10-06T01:39:39.529971+0000","last_became_peered":"2023-10-06T01:39:39.529971+0000","last_unstale":"2023-10-06T01:39:39.533099+0000","last_undegraded":"2023-10-06T01:39:39.533099+0000","last_fullsized":"2023-10-06T01:39:39.533099+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:50:02.715525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535315+0000","last_change":"2023-10-06T01:39:39.533151+0000","last_active":"2023-10-06T01:39:39.535315+0000","last_peered":"2023-10-06T01:39:39.535315+0000","last_clean":"2023-10-06T01:39:39.535315+0000","last_became_active":"2023-10-06T01:39:39.532814+0000","last_became_peered":"2023-10-06T01:39:39.532814+0000","last_unstale":"2023-10-06T01:39:39.535315+0000","last_undegraded":"2023-10-06T01:39:39.535315+0000","last_fullsized":"2023-10-06T01:39:39.535315+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:44.243800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541363+0000","last_change":"2023-10-06T01:39:39.533186+0000","last_active":"2023-10-06T01:39:39.541363+0000","last_peered":"2023-10-06T01:39:39.541363+0000","last_clean":"2023-10-06T01:39:39.541363+0000","last_became_active":"2023-10-06T01:39:39.532941+0000","last_became_peered":"2023-10-06T01:39:39.532941+0000","last_unstale":"2023-10-06T01:39:39.541363+0000","last_undegraded":"2023-10-06T01:39:39.541363+0000","last_fullsized":"2023-10-06T01:39:39.541363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:28.581592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541518+0000","last_change":"2023-10-06T01:39:39.537465+0000","last_active":"2023-10-06T01:39:39.541518+0000","last_peered":"2023-10-06T01:39:39.541518+0000","last_clean":"2023-10-06T01:39:39.541518+0000","last_became_active":"2023-10-06T01:39:39.537237+0000","last_became_peered":"2023-10-06T01:39:39.537237+0000","last_unstale":"2023-10-06T01:39:39.541518+0000","last_undegraded":"2023-10-06T01:39:39.541518+0000","last_fullsized":"2023-10-06T01:39:39.541518+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:43.913718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.526385+0000","last_change":"2023-10-06T01:39:39.524109+0000","last_active":"2023-10-06T01:39:39.526385+0000","last_peered":"2023-10-06T01:39:39.526385+0000","last_clean":"2023-10-06T01:39:39.526385+0000","last_became_active":"2023-10-06T01:39:39.523845+0000","last_became_peered":"2023-10-06T01:39:39.523845+0000","last_unstale":"2023-10-06T01:39:39.526385+0000","last_undegraded":"2023-10-06T01:39:39.526385+0000","last_fullsized":"2023-10-06T01:39:39.526385+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:51:05.439429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541368+0000","last_change":"2023-10-06T01:39:39.533041+0000","last_active":"2023-10-06T01:39:39.541368+0000","last_peered":"2023-10-06T01:39:39.541368+0000","last_clean":"2023-10-06T01:39:39.541368+0000","last_became_active":"2023-10-06T01:39:39.532764+0000","last_became_peered":"2023-10-06T01:39:39.532764+0000","last_unstale":"2023-10-06T01:39:39.541368+0000","last_undegraded":"2023-10-06T01:39:39.541368+0000","last_fullsized":"2023-10-06T01:39:39.541368+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:49.497096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541823+0000","last_change":"2023-10-06T01:39:39.539028+0000","last_active":"2023-10-06T01:39:39.541823+0000","last_peered":"2023-10-06T01:39:39.541823+0000","last_clean":"2023-10-06T01:39:39.541823+0000","last_became_active":"2023-10-06T01:39:39.538655+0000","last_became_peered":"2023-10-06T01:39:39.538655+0000","last_unstale":"2023-10-06T01:39:39.541823+0000","last_undegraded":"2023-10-06T01:39:39.541823+0000","last_fullsized":"2023-10-06T01:39:39.541823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:25:16.101682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.530715+0000","last_change":"2023-10-06T01:39:39.524232+0000","last_active":"2023-10-06T01:39:39.530715+0000","last_peered":"2023-10-06T01:39:39.530715+0000","last_clean":"2023-10-06T01:39:39.530715+0000","last_became_active":"2023-10-06T01:39:39.523956+0000","last_became_peered":"2023-10-06T01:39:39.523956+0000","last_unstale":"2023-10-06T01:39:39.530715+0000","last_undegraded":"2023-10-06T01:39:39.530715+0000","last_fullsized":"2023-10-06T01:39:39.530715+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:05:05.351196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535445+0000","last_change":"2023-10-06T01:39:39.531764+0000","last_active":"2023-10-06T01:39:39.535445+0000","last_peered":"2023-10-06T01:39:39.535445+0000","last_clean":"2023-10-06T01:39:39.535445+0000","last_became_active":"2023-10-06T01:39:39.531514+0000","last_became_peered":"2023-10-06T01:39:39.531514+0000","last_unstale":"2023-10-06T01:39:39.535445+0000","last_undegraded":"2023-10-06T01:39:39.535445+0000","last_fullsized":"2023-10-06T01:39:39.535445+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:03.781047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536300+0000","last_change":"2023-10-06T01:39:39.534404+0000","last_active":"2023-10-06T01:39:39.536300+0000","last_peered":"2023-10-06T01:39:39.536300+0000","last_clean":"2023-10-06T01:39:39.536300+0000","last_became_active":"2023-10-06T01:39:39.533543+0000","last_became_peered":"2023-10-06T01:39:39.533543+0000","last_unstale":"2023-10-06T01:39:39.536300+0000","last_undegraded":"2023-10-06T01:39:39.536300+0000","last_fullsized":"2023-10-06T01:39:39.536300+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:47:49.497096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.538610+0000","last_change":"2023-10-06T01:39:39.532117+0000","last_active":"2023-10-06T01:39:39.538610+0000","last_peered":"2023-10-06T01:39:39.538610+0000","last_clean":"2023-10-06T01:39:39.538610+0000","last_became_active":"2023-10-06T01:39:39.531824+0000","last_became_peered":"2023-10-06T01:39:39.531824+0000","last_unstale":"2023-10-06T01:39:39.538610+0000","last_undegraded":"2023-10-06T01:39:39.538610+0000","last_fullsized":"2023-10-06T01:39:39.538610+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:18.642217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532043+0000","last_change":"2023-10-06T01:39:39.527764+0000","last_active":"2023-10-06T01:39:39.532043+0000","last_peered":"2023-10-06T01:39:39.532043+0000","last_clean":"2023-10-06T01:39:39.532043+0000","last_became_active":"2023-10-06T01:39:39.527017+0000","last_became_peered":"2023-10-06T01:39:39.527017+0000","last_unstale":"2023-10-06T01:39:39.532043+0000","last_undegraded":"2023-10-06T01:39:39.532043+0000","last_fullsized":"2023-10-06T01:39:39.532043+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:36.816199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541320+0000","last_change":"2023-10-06T01:39:39.538515+0000","last_active":"2023-10-06T01:39:39.541320+0000","last_peered":"2023-10-06T01:39:39.541320+0000","last_clean":"2023-10-06T01:39:39.541320+0000","last_became_active":"2023-10-06T01:39:39.538214+0000","last_became_peered":"2023-10-06T01:39:39.538214+0000","last_unstale":"2023-10-06T01:39:39.541320+0000","last_undegraded":"2023-10-06T01:39:39.541320+0000","last_fullsized":"2023-10-06T01:39:39.541320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:50:32.520206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532460+0000","last_change":"2023-10-06T01:39:39.527312+0000","last_active":"2023-10-06T01:39:39.532460+0000","last_peered":"2023-10-06T01:39:39.532460+0000","last_clean":"2023-10-06T01:39:39.532460+0000","last_became_active":"2023-10-06T01:39:39.526997+0000","last_became_peered":"2023-10-06T01:39:39.526997+0000","last_unstale":"2023-10-06T01:39:39.532460+0000","last_undegraded":"2023-10-06T01:39:39.532460+0000","last_fullsized":"2023-10-06T01:39:39.532460+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:06.076326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.539115+0000","last_change":"2023-10-06T01:39:39.534940+0000","last_active":"2023-10-06T01:39:39.539115+0000","last_peered":"2023-10-06T01:39:39.539115+0000","last_clean":"2023-10-06T01:39:39.539115+0000","last_became_active":"2023-10-06T01:39:39.534650+0000","last_became_peered":"2023-10-06T01:39:39.534650+0000","last_unstale":"2023-10-06T01:39:39.539115+0000","last_undegraded":"2023-10-06T01:39:39.539115+0000","last_fullsized":"2023-10-06T01:39:39.539115+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:42:54.181909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535947+0000","last_change":"2023-10-06T01:39:39.534201+0000","last_active":"2023-10-06T01:39:39.535947+0000","last_peered":"2023-10-06T01:39:39.535947+0000","last_clean":"2023-10-06T01:39:39.535947+0000","last_became_active":"2023-10-06T01:39:39.533900+0000","last_became_peered":"2023-10-06T01:39:39.533900+0000","last_unstale":"2023-10-06T01:39:39.535947+0000","last_undegraded":"2023-10-06T01:39:39.535947+0000","last_fullsized":"2023-10-06T01:39:39.535947+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:36.108288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532873+0000","last_change":"2023-10-06T01:39:39.531717+0000","last_active":"2023-10-06T01:39:39.532873+0000","last_peered":"2023-10-06T01:39:39.532873+0000","last_clean":"2023-10-06T01:39:39.532873+0000","last_became_active":"2023-10-06T01:39:39.531485+0000","last_became_peered":"2023-10-06T01:39:39.531485+0000","last_unstale":"2023-10-06T01:39:39.532873+0000","last_undegraded":"2023-10-06T01:39:39.532873+0000","last_fullsized":"2023-10-06T01:39:39.532873+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:42.574061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533787+0000","last_change":"2023-10-06T01:39:39.528899+0000","last_active":"2023-10-06T01:39:39.533787+0000","last_peered":"2023-10-06T01:39:39.533787+0000","last_clean":"2023-10-06T01:39:39.533787+0000","last_became_active":"2023-10-06T01:39:39.528582+0000","last_became_peered":"2023-10-06T01:39:39.528582+0000","last_unstale":"2023-10-06T01:39:39.533787+0000","last_undegraded":"2023-10-06T01:39:39.533787+0000","last_fullsized":"2023-10-06T01:39:39.533787+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:23.534135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532590+0000","last_change":"2023-10-06T01:39:39.531264+0000","last_active":"2023-10-06T01:39:39.532590+0000","last_peered":"2023-10-06T01:39:39.532590+0000","last_clean":"2023-10-06T01:39:39.532590+0000","last_became_active":"2023-10-06T01:39:39.531012+0000","last_became_peered":"2023-10-06T01:39:39.531012+0000","last_unstale":"2023-10-06T01:39:39.532590+0000","last_undegraded":"2023-10-06T01:39:39.532590+0000","last_fullsized":"2023-10-06T01:39:39.532590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:36.108288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.539109+0000","last_change":"2023-10-06T01:39:39.536007+0000","last_active":"2023-10-06T01:39:39.539109+0000","last_peered":"2023-10-06T01:39:39.539109+0000","last_clean":"2023-10-06T01:39:39.539109+0000","last_became_active":"2023-10-06T01:39:39.533706+0000","last_became_peered":"2023-10-06T01:39:39.533706+0000","last_unstale":"2023-10-06T01:39:39.539109+0000","last_undegraded":"2023-10-06T01:39:39.539109+0000","last_fullsized":"2023-10-06T01:39:39.539109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:13.353533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535778+0000","last_change":"2023-10-06T01:39:39.529699+0000","last_active":"2023-10-06T01:39:39.535778+0000","last_peered":"2023-10-06T01:39:39.535778+0000","last_clean":"2023-10-06T01:39:39.535778+0000","last_became_active":"2023-10-06T01:39:39.529341+0000","last_became_peered":"2023-10-06T01:39:39.529341+0000","last_unstale":"2023-10-06T01:39:39.535778+0000","last_undegraded":"2023-10-06T01:39:39.535778+0000","last_fullsized":"2023-10-06T01:39:39.535778+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:51:05.439429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533050+0000","last_change":"2023-10-06T01:39:39.528443+0000","last_active":"2023-10-06T01:39:39.533050+0000","last_peered":"2023-10-06T01:39:39.533050+0000","last_clean":"2023-10-06T01:39:39.533050+0000","last_became_active":"2023-10-06T01:39:39.528008+0000","last_became_peered":"2023-10-06T01:39:39.528008+0000","last_unstale":"2023-10-06T01:39:39.533050+0000","last_undegraded":"2023-10-06T01:39:39.533050+0000","last_fullsized":"2023-10-06T01:39:39.533050+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:42.574061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.538139+0000","last_change":"2023-10-06T01:39:39.531595+0000","last_active":"2023-10-06T01:39:39.538139+0000","last_peered":"2023-10-06T01:39:39.538139+0000","last_clean":"2023-10-06T01:39:39.538139+0000","last_became_active":"2023-10-06T01:39:39.531416+0000","last_became_peered":"2023-10-06T01:39:39.531416+0000","last_unstale":"2023-10-06T01:39:39.538139+0000","last_undegraded":"2023-10-06T01:39:39.538139+0000","last_fullsized":"2023-10-06T01:39:39.538139+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:23.999705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535927+0000","last_change":"2023-10-06T01:39:39.533940+0000","last_active":"2023-10-06T01:39:39.535927+0000","last_peered":"2023-10-06T01:39:39.535927+0000","last_clean":"2023-10-06T01:39:39.535927+0000","last_became_active":"2023-10-06T01:39:39.533195+0000","last_became_peered":"2023-10-06T01:39:39.533195+0000","last_unstale":"2023-10-06T01:39:39.535927+0000","last_undegraded":"2023-10-06T01:39:39.535927+0000","last_fullsized":"2023-10-06T01:39:39.535927+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:55.203229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533882+0000","last_change":"2023-10-06T01:39:39.532639+0000","last_active":"2023-10-06T01:39:39.533882+0000","last_peered":"2023-10-06T01:39:39.533882+0000","last_clean":"2023-10-06T01:39:39.533882+0000","last_became_active":"2023-10-06T01:39:39.532390+0000","last_became_peered":"2023-10-06T01:39:39.532390+0000","last_unstale":"2023-10-06T01:39:39.533882+0000","last_undegraded":"2023-10-06T01:39:39.533882+0000","last_fullsized":"2023-10-06T01:39:39.533882+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:10:27.975533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535010+0000","last_change":"2023-10-06T01:39:39.533042+0000","last_active":"2023-10-06T01:39:39.535010+0000","last_peered":"2023-10-06T01:39:39.535010+0000","last_clean":"2023-10-06T01:39:39.535010+0000","last_became_active":"2023-10-06T01:39:39.532433+0000","last_became_peered":"2023-10-06T01:39:39.532433+0000","last_unstale":"2023-10-06T01:39:39.535010+0000","last_undegraded":"2023-10-06T01:39:39.535010+0000","last_fullsized":"2023-10-06T01:39:39.535010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:51:05.439429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"34'4","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.616579+0000","last_change":"2023-10-06T01:39:38.626494+0000","last_active":"2023-10-06T01:39:39.616579+0000","last_peered":"2023-10-06T01:39:39.616579+0000","last_clean":"2023-10-06T01:39:39.616579+0000","last_became_active":"2023-10-06T01:39:38.625958+0000","last_became_peered":"2023-10-06T01:39:38.625958+0000","last_unstale":"2023-10-06T01:39:39.616579+0000","last_undegraded":"2023-10-06T01:39:39.616579+0000","last_fullsized":"2023-10-06T01:39:39.616579+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:12.414360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532192+0000","last_change":"2023-10-06T01:39:39.530208+0000","last_active":"2023-10-06T01:39:39.532192+0000","last_peered":"2023-10-06T01:39:39.532192+0000","last_clean":"2023-10-06T01:39:39.532192+0000","last_became_active":"2023-10-06T01:39:39.529957+0000","last_became_peered":"2023-10-06T01:39:39.529957+0000","last_unstale":"2023-10-06T01:39:39.532192+0000","last_undegraded":"2023-10-06T01:39:39.532192+0000","last_fullsized":"2023-10-06T01:39:39.532192+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:43.913718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.617188+0000","last_change":"2023-10-06T01:39:38.622143+0000","last_active":"2023-10-06T01:39:39.617188+0000","last_peered":"2023-10-06T01:39:39.617188+0000","last_clean":"2023-10-06T01:39:39.617188+0000","last_became_active":"2023-10-06T01:39:38.621871+0000","last_became_peered":"2023-10-06T01:39:38.621871+0000","last_unstale":"2023-10-06T01:39:39.617188+0000","last_undegraded":"2023-10-06T01:39:39.617188+0000","last_fullsized":"2023-10-06T01:39:39.617188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:50:31.511342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.541310+0000","last_change":"2023-10-06T01:39:39.535667+0000","last_active":"2023-10-06T01:39:39.541310+0000","last_peered":"2023-10-06T01:39:39.541310+0000","last_clean":"2023-10-06T01:39:39.541310+0000","last_became_active":"2023-10-06T01:39:39.535332+0000","last_became_peered":"2023-10-06T01:39:39.535332+0000","last_unstale":"2023-10-06T01:39:39.541310+0000","last_undegraded":"2023-10-06T01:39:39.541310+0000","last_fullsized":"2023-10-06T01:39:39.541310+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:05:37.318580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.615588+0000","last_change":"2023-10-06T01:39:38.623708+0000","last_active":"2023-10-06T01:39:39.615588+0000","last_peered":"2023-10-06T01:39:39.615588+0000","last_clean":"2023-10-06T01:39:39.615588+0000","last_became_active":"2023-10-06T01:39:38.623429+0000","last_became_peered":"2023-10-06T01:39:38.623429+0000","last_unstale":"2023-10-06T01:39:39.615588+0000","last_undegraded":"2023-10-06T01:39:39.615588+0000","last_fullsized":"2023-10-06T01:39:39.615588+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:50:31.511342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533622+0000","last_change":"2023-10-06T01:39:39.531136+0000","last_active":"2023-10-06T01:39:39.533622+0000","last_peered":"2023-10-06T01:39:39.533622+0000","last_clean":"2023-10-06T01:39:39.533622+0000","last_became_active":"2023-10-06T01:39:39.530908+0000","last_became_peered":"2023-10-06T01:39:39.530908+0000","last_unstale":"2023-10-06T01:39:39.533622+0000","last_undegraded":"2023-10-06T01:39:39.533622+0000","last_fullsized":"2023-10-06T01:39:39.533622+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:25:26.799204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.616014+0000","last_change":"2023-10-06T01:39:38.623866+0000","last_active":"2023-10-06T01:39:39.616014+0000","last_peered":"2023-10-06T01:39:39.616014+0000","last_clean":"2023-10-06T01:39:39.616014+0000","last_became_active":"2023-10-06T01:39:38.623558+0000","last_became_peered":"2023-10-06T01:39:38.623558+0000","last_unstale":"2023-10-06T01:39:39.616014+0000","last_undegraded":"2023-10-06T01:39:39.616014+0000","last_fullsized":"2023-10-06T01:39:39.616014+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:36:19.711959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.534019+0000","last_change":"2023-10-06T01:39:39.528895+0000","last_active":"2023-10-06T01:39:39.534019+0000","last_peered":"2023-10-06T01:39:39.534019+0000","last_clean":"2023-10-06T01:39:39.534019+0000","last_became_active":"2023-10-06T01:39:39.528628+0000","last_became_peered":"2023-10-06T01:39:39.528628+0000","last_unstale":"2023-10-06T01:39:39.534019+0000","last_undegraded":"2023-10-06T01:39:39.534019+0000","last_fullsized":"2023-10-06T01:39:39.534019+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:05:05.351196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.615600+0000","last_change":"2023-10-06T01:39:38.624485+0000","last_active":"2023-10-06T01:39:39.615600+0000","last_peered":"2023-10-06T01:39:39.615600+0000","last_clean":"2023-10-06T01:39:39.615600+0000","last_became_active":"2023-10-06T01:39:38.624224+0000","last_became_peered":"2023-10-06T01:39:38.624224+0000","last_unstale":"2023-10-06T01:39:39.615600+0000","last_undegraded":"2023-10-06T01:39:39.615600+0000","last_fullsized":"2023-10-06T01:39:39.615600+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:41.565197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532780+0000","last_change":"2023-10-06T01:39:39.527154+0000","last_active":"2023-10-06T01:39:39.532780+0000","last_peered":"2023-10-06T01:39:39.532780+0000","last_clean":"2023-10-06T01:39:39.532780+0000","last_became_active":"2023-10-06T01:39:39.526851+0000","last_became_peered":"2023-10-06T01:39:39.526851+0000","last_unstale":"2023-10-06T01:39:39.532780+0000","last_undegraded":"2023-10-06T01:39:39.532780+0000","last_fullsized":"2023-10-06T01:39:39.532780+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:40.175833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.616307+0000","last_change":"2023-10-06T01:39:38.625182+0000","last_active":"2023-10-06T01:39:39.616307+0000","last_peered":"2023-10-06T01:39:39.616307+0000","last_clean":"2023-10-06T01:39:39.616307+0000","last_became_active":"2023-10-06T01:39:38.624900+0000","last_became_peered":"2023-10-06T01:39:38.624900+0000","last_unstale":"2023-10-06T01:39:39.616307+0000","last_undegraded":"2023-10-06T01:39:39.616307+0000","last_fullsized":"2023-10-06T01:39:39.616307+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:06:48.430978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536320+0000","last_change":"2023-10-06T01:39:39.532155+0000","last_active":"2023-10-06T01:39:39.536320+0000","last_peered":"2023-10-06T01:39:39.536320+0000","last_clean":"2023-10-06T01:39:39.536320+0000","last_became_active":"2023-10-06T01:39:39.531870+0000","last_became_peered":"2023-10-06T01:39:39.531870+0000","last_unstale":"2023-10-06T01:39:39.536320+0000","last_undegraded":"2023-10-06T01:39:39.536320+0000","last_fullsized":"2023-10-06T01:39:39.536320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:34:42.351468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.522916+0000","last_change":"2023-10-06T01:39:38.622820+0000","last_active":"2023-10-06T01:39:39.522916+0000","last_peered":"2023-10-06T01:39:39.522916+0000","last_clean":"2023-10-06T01:39:39.522916+0000","last_became_active":"2023-10-06T01:39:38.622547+0000","last_became_peered":"2023-10-06T01:39:38.622547+0000","last_unstale":"2023-10-06T01:39:39.522916+0000","last_undegraded":"2023-10-06T01:39:39.522916+0000","last_fullsized":"2023-10-06T01:39:39.522916+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:17.633353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532100+0000","last_change":"2023-10-06T01:39:39.528278+0000","last_active":"2023-10-06T01:39:39.532100+0000","last_peered":"2023-10-06T01:39:39.532100+0000","last_clean":"2023-10-06T01:39:39.532100+0000","last_became_active":"2023-10-06T01:39:39.527700+0000","last_became_peered":"2023-10-06T01:39:39.527700+0000","last_unstale":"2023-10-06T01:39:39.532100+0000","last_undegraded":"2023-10-06T01:39:39.532100+0000","last_fullsized":"2023-10-06T01:39:39.532100+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:18:28.581592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.529680+0000","last_change":"2023-10-06T01:39:38.630745+0000","last_active":"2023-10-06T01:39:39.529680+0000","last_peered":"2023-10-06T01:39:39.529680+0000","last_clean":"2023-10-06T01:39:39.529680+0000","last_became_active":"2023-10-06T01:39:38.630466+0000","last_became_peered":"2023-10-06T01:39:38.630466+0000","last_unstale":"2023-10-06T01:39:39.529680+0000","last_undegraded":"2023-10-06T01:39:39.529680+0000","last_fullsized":"2023-10-06T01:39:39.529680+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:30.512210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.539563+0000","last_change":"2023-10-06T01:39:39.538565+0000","last_active":"2023-10-06T01:39:39.539563+0000","last_peered":"2023-10-06T01:39:39.539563+0000","last_clean":"2023-10-06T01:39:39.539563+0000","last_became_active":"2023-10-06T01:39:39.538331+0000","last_became_peered":"2023-10-06T01:39:39.538331+0000","last_unstale":"2023-10-06T01:39:39.539563+0000","last_undegraded":"2023-10-06T01:39:39.539563+0000","last_fullsized":"2023-10-06T01:39:39.539563+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:23.999705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.517658+0000","last_change":"2023-10-06T01:39:38.628795+0000","last_active":"2023-10-06T01:39:39.517658+0000","last_peered":"2023-10-06T01:39:39.517658+0000","last_clean":"2023-10-06T01:39:39.517658+0000","last_became_active":"2023-10-06T01:39:38.628536+0000","last_became_peered":"2023-10-06T01:39:38.628536+0000","last_unstale":"2023-10-06T01:39:39.517658+0000","last_undegraded":"2023-10-06T01:39:39.517658+0000","last_fullsized":"2023-10-06T01:39:39.517658+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:51:27.661354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536001+0000","last_change":"2023-10-06T01:39:39.534373+0000","last_active":"2023-10-06T01:39:39.536001+0000","last_peered":"2023-10-06T01:39:39.536001+0000","last_clean":"2023-10-06T01:39:39.536001+0000","last_became_active":"2023-10-06T01:39:39.533475+0000","last_became_peered":"2023-10-06T01:39:39.533475+0000","last_unstale":"2023-10-06T01:39:39.536001+0000","last_undegraded":"2023-10-06T01:39:39.536001+0000","last_fullsized":"2023-10-06T01:39:39.536001+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:48:44.243800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.521871+0000","last_change":"2023-10-06T01:39:38.628870+0000","last_active":"2023-10-06T01:39:39.521871+0000","last_peered":"2023-10-06T01:39:39.521871+0000","last_clean":"2023-10-06T01:39:39.521871+0000","last_became_active":"2023-10-06T01:39:38.628553+0000","last_became_peered":"2023-10-06T01:39:38.628553+0000","last_unstale":"2023-10-06T01:39:39.521871+0000","last_undegraded":"2023-10-06T01:39:39.521871+0000","last_fullsized":"2023-10-06T01:39:39.521871+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:47:22.525270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533741+0000","last_change":"2023-10-06T01:39:39.528068+0000","last_active":"2023-10-06T01:39:39.533741+0000","last_peered":"2023-10-06T01:39:39.533741+0000","last_clean":"2023-10-06T01:39:39.533741+0000","last_became_active":"2023-10-06T01:39:39.527827+0000","last_became_peered":"2023-10-06T01:39:39.527827+0000","last_unstale":"2023-10-06T01:39:39.533741+0000","last_undegraded":"2023-10-06T01:39:39.533741+0000","last_fullsized":"2023-10-06T01:39:39.533741+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:43.913718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"34'3","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.623127+0000","last_change":"2023-10-06T01:39:38.628825+0000","last_active":"2023-10-06T01:39:39.623127+0000","last_peered":"2023-10-06T01:39:39.623127+0000","last_clean":"2023-10-06T01:39:39.623127+0000","last_became_active":"2023-10-06T01:39:38.628517+0000","last_became_peered":"2023-10-06T01:39:38.628517+0000","last_unstale":"2023-10-06T01:39:39.623127+0000","last_undegraded":"2023-10-06T01:39:39.623127+0000","last_fullsized":"2023-10-06T01:39:39.623127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:50:31.511342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.538694+0000","last_change":"2023-10-06T01:39:39.534285+0000","last_active":"2023-10-06T01:39:39.538694+0000","last_peered":"2023-10-06T01:39:39.538694+0000","last_clean":"2023-10-06T01:39:39.538694+0000","last_became_active":"2023-10-06T01:39:39.534034+0000","last_became_peered":"2023-10-06T01:39:39.534034+0000","last_unstale":"2023-10-06T01:39:39.538694+0000","last_undegraded":"2023-10-06T01:39:39.538694+0000","last_fullsized":"2023-10-06T01:39:39.538694+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:19:39.808879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"34'6","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.618668+0000","last_change":"2023-10-06T01:39:38.622530+0000","last_active":"2023-10-06T01:39:39.618668+0000","last_peered":"2023-10-06T01:39:39.618668+0000","last_clean":"2023-10-06T01:39:39.618668+0000","last_became_active":"2023-10-06T01:39:38.622273+0000","last_became_peered":"2023-10-06T01:39:38.622273+0000","last_unstale":"2023-10-06T01:39:39.618668+0000","last_undegraded":"2023-10-06T01:39:39.618668+0000","last_fullsized":"2023-10-06T01:39:39.618668+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:44:09.207989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535344+0000","last_change":"2023-10-06T01:39:39.533497+0000","last_active":"2023-10-06T01:39:39.535344+0000","last_peered":"2023-10-06T01:39:39.535344+0000","last_clean":"2023-10-06T01:39:39.535344+0000","last_became_active":"2023-10-06T01:39:39.533233+0000","last_became_peered":"2023-10-06T01:39:39.533233+0000","last_unstale":"2023-10-06T01:39:39.535344+0000","last_undegraded":"2023-10-06T01:39:39.535344+0000","last_fullsized":"2023-10-06T01:39:39.535344+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:13:55.203229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.615312+0000","last_change":"2023-10-06T01:39:38.620186+0000","last_active":"2023-10-06T01:39:39.615312+0000","last_peered":"2023-10-06T01:39:39.615312+0000","last_clean":"2023-10-06T01:39:39.615312+0000","last_became_active":"2023-10-06T01:39:38.619533+0000","last_became_peered":"2023-10-06T01:39:38.619533+0000","last_unstale":"2023-10-06T01:39:39.615312+0000","last_undegraded":"2023-10-06T01:39:39.615312+0000","last_fullsized":"2023-10-06T01:39:39.615312+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:01:39.151951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.526690+0000","last_change":"2023-10-06T01:39:39.524124+0000","last_active":"2023-10-06T01:39:39.526690+0000","last_peered":"2023-10-06T01:39:39.526690+0000","last_clean":"2023-10-06T01:39:39.526690+0000","last_became_active":"2023-10-06T01:39:39.523937+0000","last_became_peered":"2023-10-06T01:39:39.523937+0000","last_unstale":"2023-10-06T01:39:39.526690+0000","last_undegraded":"2023-10-06T01:39:39.526690+0000","last_fullsized":"2023-10-06T01:39:39.526690+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:43.467840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.522462+0000","last_change":"2023-10-06T01:39:38.622849+0000","last_active":"2023-10-06T01:39:39.522462+0000","last_peered":"2023-10-06T01:39:39.522462+0000","last_clean":"2023-10-06T01:39:39.522462+0000","last_became_active":"2023-10-06T01:39:38.622572+0000","last_became_peered":"2023-10-06T01:39:38.622572+0000","last_unstale":"2023-10-06T01:39:39.522462+0000","last_undegraded":"2023-10-06T01:39:39.522462+0000","last_fullsized":"2023-10-06T01:39:39.522462+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:41.565197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536404+0000","last_change":"2023-10-06T01:39:39.534594+0000","last_active":"2023-10-06T01:39:39.536404+0000","last_peered":"2023-10-06T01:39:39.536404+0000","last_clean":"2023-10-06T01:39:39.536404+0000","last_became_active":"2023-10-06T01:39:39.534233+0000","last_became_peered":"2023-10-06T01:39:39.534233+0000","last_unstale":"2023-10-06T01:39:39.536404+0000","last_undegraded":"2023-10-06T01:39:39.536404+0000","last_fullsized":"2023-10-06T01:39:39.536404+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:47:43.913718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.525679+0000","last_change":"2023-10-06T01:39:38.626277+0000","last_active":"2023-10-06T01:39:39.525679+0000","last_peered":"2023-10-06T01:39:39.525679+0000","last_clean":"2023-10-06T01:39:39.525679+0000","last_became_active":"2023-10-06T01:39:38.625992+0000","last_became_peered":"2023-10-06T01:39:38.625992+0000","last_unstale":"2023-10-06T01:39:39.525679+0000","last_undegraded":"2023-10-06T01:39:39.525679+0000","last_fullsized":"2023-10-06T01:39:39.525679+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:26.630294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.531082+0000","last_change":"2023-10-06T01:39:39.526088+0000","last_active":"2023-10-06T01:39:39.531082+0000","last_peered":"2023-10-06T01:39:39.531082+0000","last_clean":"2023-10-06T01:39:39.531082+0000","last_became_active":"2023-10-06T01:39:39.525757+0000","last_became_peered":"2023-10-06T01:39:39.525757+0000","last_unstale":"2023-10-06T01:39:39.531082+0000","last_undegraded":"2023-10-06T01:39:39.531082+0000","last_fullsized":"2023-10-06T01:39:39.531082+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:52.418744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"34'8","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.619531+0000","last_change":"2023-10-06T01:39:38.625180+0000","last_active":"2023-10-06T01:39:39.619531+0000","last_peered":"2023-10-06T01:39:39.619531+0000","last_clean":"2023-10-06T01:39:39.619531+0000","last_became_active":"2023-10-06T01:39:38.624889+0000","last_became_peered":"2023-10-06T01:39:38.624889+0000","last_unstale":"2023-10-06T01:39:39.619531+0000","last_undegraded":"2023-10-06T01:39:39.619531+0000","last_fullsized":"2023-10-06T01:39:39.619531+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:22:20.164155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533562+0000","last_change":"2023-10-06T01:39:39.531326+0000","last_active":"2023-10-06T01:39:39.533562+0000","last_peered":"2023-10-06T01:39:39.533562+0000","last_clean":"2023-10-06T01:39:39.533562+0000","last_became_active":"2023-10-06T01:39:39.531097+0000","last_became_peered":"2023-10-06T01:39:39.531097+0000","last_unstale":"2023-10-06T01:39:39.533562+0000","last_undegraded":"2023-10-06T01:39:39.533562+0000","last_fullsized":"2023-10-06T01:39:39.533562+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:46.119956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.619174+0000","last_change":"2023-10-06T01:39:38.627708+0000","last_active":"2023-10-06T01:39:39.619174+0000","last_peered":"2023-10-06T01:39:39.619174+0000","last_clean":"2023-10-06T01:39:39.619174+0000","last_became_active":"2023-10-06T01:39:38.627477+0000","last_became_peered":"2023-10-06T01:39:38.627477+0000","last_unstale":"2023-10-06T01:39:39.619174+0000","last_undegraded":"2023-10-06T01:39:39.619174+0000","last_fullsized":"2023-10-06T01:39:39.619174+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:52:12.344668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535629+0000","last_change":"2023-10-06T01:39:39.527319+0000","last_active":"2023-10-06T01:39:39.535629+0000","last_peered":"2023-10-06T01:39:39.535629+0000","last_clean":"2023-10-06T01:39:39.535629+0000","last_became_active":"2023-10-06T01:39:39.527083+0000","last_became_peered":"2023-10-06T01:39:39.527083+0000","last_unstale":"2023-10-06T01:39:39.535629+0000","last_undegraded":"2023-10-06T01:39:39.535629+0000","last_fullsized":"2023-10-06T01:39:39.535629+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:05:52.418744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.617094+0000","last_change":"2023-10-06T01:39:38.627207+0000","last_active":"2023-10-06T01:39:39.617094+0000","last_peered":"2023-10-06T01:39:39.617094+0000","last_clean":"2023-10-06T01:39:39.617094+0000","last_became_active":"2023-10-06T01:39:38.626943+0000","last_became_peered":"2023-10-06T01:39:38.626943+0000","last_unstale":"2023-10-06T01:39:39.617094+0000","last_undegraded":"2023-10-06T01:39:39.617094+0000","last_fullsized":"2023-10-06T01:39:39.617094+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:18:45.111092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536257+0000","last_change":"2023-10-06T01:39:39.533370+0000","last_active":"2023-10-06T01:39:39.536257+0000","last_peered":"2023-10-06T01:39:39.536257+0000","last_clean":"2023-10-06T01:39:39.536257+0000","last_became_active":"2023-10-06T01:39:39.532868+0000","last_became_peered":"2023-10-06T01:39:39.532868+0000","last_unstale":"2023-10-06T01:39:39.536257+0000","last_undegraded":"2023-10-06T01:39:39.536257+0000","last_fullsized":"2023-10-06T01:39:39.536257+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:50:59.497040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"34'1","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.616717+0000","last_change":"2023-10-06T01:39:38.627502+0000","last_active":"2023-10-06T01:39:39.616717+0000","last_peered":"2023-10-06T01:39:39.616717+0000","last_clean":"2023-10-06T01:39:39.616717+0000","last_became_active":"2023-10-06T01:39:38.627231+0000","last_became_peered":"2023-10-06T01:39:38.627231+0000","last_unstale":"2023-10-06T01:39:39.616717+0000","last_undegraded":"2023-10-06T01:39:39.616717+0000","last_fullsized":"2023-10-06T01:39:39.616717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:05:12.414360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533124+0000","last_change":"2023-10-06T01:39:39.531931+0000","last_active":"2023-10-06T01:39:39.533124+0000","last_peered":"2023-10-06T01:39:39.533124+0000","last_clean":"2023-10-06T01:39:39.533124+0000","last_became_active":"2023-10-06T01:39:39.531631+0000","last_became_peered":"2023-10-06T01:39:39.531631+0000","last_unstale":"2023-10-06T01:39:39.533124+0000","last_undegraded":"2023-10-06T01:39:39.533124+0000","last_fullsized":"2023-10-06T01:39:39.533124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:50:32.520206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.522667+0000","last_change":"2023-10-06T01:39:38.623671+0000","last_active":"2023-10-06T01:39:39.522667+0000","last_peered":"2023-10-06T01:39:39.522667+0000","last_clean":"2023-10-06T01:39:39.522667+0000","last_became_active":"2023-10-06T01:39:38.623388+0000","last_became_peered":"2023-10-06T01:39:38.623388+0000","last_unstale":"2023-10-06T01:39:39.522667+0000","last_undegraded":"2023-10-06T01:39:39.522667+0000","last_fullsized":"2023-10-06T01:39:39.522667+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:22.990841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.538913+0000","last_change":"2023-10-06T01:39:39.535329+0000","last_active":"2023-10-06T01:39:39.538913+0000","last_peered":"2023-10-06T01:39:39.538913+0000","last_clean":"2023-10-06T01:39:39.538913+0000","last_became_active":"2023-10-06T01:39:39.534826+0000","last_became_peered":"2023-10-06T01:39:39.534826+0000","last_unstale":"2023-10-06T01:39:39.538913+0000","last_undegraded":"2023-10-06T01:39:39.538913+0000","last_fullsized":"2023-10-06T01:39:39.538913+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:05:05.351196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.616288+0000","last_change":"2023-10-06T01:39:38.622188+0000","last_active":"2023-10-06T01:39:39.616288+0000","last_peered":"2023-10-06T01:39:39.616288+0000","last_clean":"2023-10-06T01:39:39.616288+0000","last_became_active":"2023-10-06T01:39:38.621909+0000","last_became_peered":"2023-10-06T01:39:38.621909+0000","last_unstale":"2023-10-06T01:39:39.616288+0000","last_undegraded":"2023-10-06T01:39:39.616288+0000","last_fullsized":"2023-10-06T01:39:39.616288+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:19:06.832652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.533769+0000","last_change":"2023-10-06T01:39:39.528119+0000","last_active":"2023-10-06T01:39:39.533769+0000","last_peered":"2023-10-06T01:39:39.533769+0000","last_clean":"2023-10-06T01:39:39.533769+0000","last_became_active":"2023-10-06T01:39:39.527867+0000","last_became_peered":"2023-10-06T01:39:39.527867+0000","last_unstale":"2023-10-06T01:39:39.533769+0000","last_undegraded":"2023-10-06T01:39:39.533769+0000","last_fullsized":"2023-10-06T01:39:39.533769+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:25:36.108288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.520646+0000","last_change":"2023-10-06T01:39:38.624450+0000","last_active":"2023-10-06T01:39:39.520646+0000","last_peered":"2023-10-06T01:39:39.520646+0000","last_clean":"2023-10-06T01:39:39.520646+0000","last_became_active":"2023-10-06T01:39:38.624218+0000","last_became_peered":"2023-10-06T01:39:38.624218+0000","last_unstale":"2023-10-06T01:39:39.520646+0000","last_undegraded":"2023-10-06T01:39:39.520646+0000","last_fullsized":"2023-10-06T01:39:39.520646+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:14:26.630294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.537160+0000","last_change":"2023-10-06T01:39:39.530340+0000","last_active":"2023-10-06T01:39:39.537160+0000","last_peered":"2023-10-06T01:39:39.537160+0000","last_clean":"2023-10-06T01:39:39.537160+0000","last_became_active":"2023-10-06T01:39:39.530047+0000","last_became_peered":"2023-10-06T01:39:39.530047+0000","last_unstale":"2023-10-06T01:39:39.537160+0000","last_undegraded":"2023-10-06T01:39:39.537160+0000","last_fullsized":"2023-10-06T01:39:39.537160+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:41:55.235050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.518549+0000","last_change":"2023-10-06T01:39:38.630812+0000","last_active":"2023-10-06T01:39:39.518549+0000","last_peered":"2023-10-06T01:39:39.518549+0000","last_clean":"2023-10-06T01:39:39.518549+0000","last_became_active":"2023-10-06T01:39:38.630517+0000","last_became_peered":"2023-10-06T01:39:38.630517+0000","last_unstale":"2023-10-06T01:39:39.518549+0000","last_undegraded":"2023-10-06T01:39:39.518549+0000","last_fullsized":"2023-10-06T01:39:39.518549+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:49:17.633353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532118+0000","last_change":"2023-10-06T01:39:39.528466+0000","last_active":"2023-10-06T01:39:39.532118+0000","last_peered":"2023-10-06T01:39:39.532118+0000","last_clean":"2023-10-06T01:39:39.532118+0000","last_became_active":"2023-10-06T01:39:39.528042+0000","last_became_peered":"2023-10-06T01:39:39.528042+0000","last_unstale":"2023-10-06T01:39:39.532118+0000","last_undegraded":"2023-10-06T01:39:39.532118+0000","last_fullsized":"2023-10-06T01:39:39.532118+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:09:06.076326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.521385+0000","last_change":"2023-10-06T01:39:38.623491+0000","last_active":"2023-10-06T01:39:39.521385+0000","last_peered":"2023-10-06T01:39:39.521385+0000","last_clean":"2023-10-06T01:39:39.521385+0000","last_became_active":"2023-10-06T01:39:38.623222+0000","last_became_peered":"2023-10-06T01:39:38.623222+0000","last_unstale":"2023-10-06T01:39:39.521385+0000","last_undegraded":"2023-10-06T01:39:39.521385+0000","last_fullsized":"2023-10-06T01:39:39.521385+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:36:21.647390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.529353+0000","last_change":"2023-10-06T01:39:39.526770+0000","last_active":"2023-10-06T01:39:39.529353+0000","last_peered":"2023-10-06T01:39:39.529353+0000","last_clean":"2023-10-06T01:39:39.529353+0000","last_became_active":"2023-10-06T01:39:39.526572+0000","last_became_peered":"2023-10-06T01:39:39.526572+0000","last_unstale":"2023-10-06T01:39:39.529353+0000","last_undegraded":"2023-10-06T01:39:39.529353+0000","last_fullsized":"2023-10-06T01:39:39.529353+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:57.121167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.521627+0000","last_change":"2023-10-06T01:39:38.630658+0000","last_active":"2023-10-06T01:39:39.521627+0000","last_peered":"2023-10-06T01:39:39.521627+0000","last_clean":"2023-10-06T01:39:39.521627+0000","last_became_active":"2023-10-06T01:39:38.630360+0000","last_became_peered":"2023-10-06T01:39:38.630360+0000","last_unstale":"2023-10-06T01:39:39.521627+0000","last_undegraded":"2023-10-06T01:39:39.521627+0000","last_fullsized":"2023-10-06T01:39:39.521627+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:22.990841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.522743+0000","last_change":"2023-10-06T01:38:44.533111+0000","last_active":"2023-10-06T01:39:39.522743+0000","last_peered":"2023-10-06T01:39:39.522743+0000","last_clean":"2023-10-06T01:39:39.522743+0000","last_became_active":"2023-10-06T01:38:44.532838+0000","last_became_peered":"2023-10-06T01:38:44.532838+0000","last_unstale":"2023-10-06T01:39:39.522743+0000","last_undegraded":"2023-10-06T01:39:39.522743+0000","last_fullsized":"2023-10-06T01:39:39.522743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532512+0000","last_change":"2023-10-06T01:39:39.529973+0000","last_active":"2023-10-06T01:39:39.532512+0000","last_peered":"2023-10-06T01:39:39.532512+0000","last_clean":"2023-10-06T01:39:39.532512+0000","last_became_active":"2023-10-06T01:39:39.529739+0000","last_became_peered":"2023-10-06T01:39:39.529739+0000","last_unstale":"2023-10-06T01:39:39.532512+0000","last_undegraded":"2023-10-06T01:39:39.532512+0000","last_fullsized":"2023-10-06T01:39:39.532512+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:41:55.235050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.519666+0000","last_change":"2023-10-06T01:39:38.623882+0000","last_active":"2023-10-06T01:39:39.519666+0000","last_peered":"2023-10-06T01:39:39.519666+0000","last_clean":"2023-10-06T01:39:39.519666+0000","last_became_active":"2023-10-06T01:39:38.623583+0000","last_became_peered":"2023-10-06T01:39:38.623583+0000","last_unstale":"2023-10-06T01:39:39.519666+0000","last_undegraded":"2023-10-06T01:39:39.519666+0000","last_fullsized":"2023-10-06T01:39:39.519666+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:41.565197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.520635+0000","last_change":"2023-10-06T01:38:44.533897+0000","last_active":"2023-10-06T01:39:39.520635+0000","last_peered":"2023-10-06T01:39:39.520635+0000","last_clean":"2023-10-06T01:39:39.520635+0000","last_became_active":"2023-10-06T01:38:44.533611+0000","last_became_peered":"2023-10-06T01:38:44.533611+0000","last_unstale":"2023-10-06T01:39:39.520635+0000","last_undegraded":"2023-10-06T01:39:39.520635+0000","last_fullsized":"2023-10-06T01:39:39.520635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:24.411408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.534892+0000","last_change":"2023-10-06T01:39:39.531616+0000","last_active":"2023-10-06T01:39:39.534892+0000","last_peered":"2023-10-06T01:39:39.534892+0000","last_clean":"2023-10-06T01:39:39.534892+0000","last_became_active":"2023-10-06T01:39:39.531337+0000","last_became_peered":"2023-10-06T01:39:39.531337+0000","last_unstale":"2023-10-06T01:39:39.534892+0000","last_undegraded":"2023-10-06T01:39:39.534892+0000","last_fullsized":"2023-10-06T01:39:39.534892+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:35:57.121167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"35'1","reported_seq":11,"reported_epoch":35,"state":"active+clean","last_fresh":"2023-10-06T01:39:40.963716+0000","last_change":"2023-10-06T01:39:38.627842+0000","last_active":"2023-10-06T01:39:40.963716+0000","last_peered":"2023-10-06T01:39:40.963716+0000","last_clean":"2023-10-06T01:39:40.963716+0000","last_became_active":"2023-10-06T01:39:38.627581+0000","last_became_peered":"2023-10-06T01:39:38.627581+0000","last_unstale":"2023-10-06T01:39:40.963716+0000","last_undegraded":"2023-10-06T01:39:40.963716+0000","last_fullsized":"2023-10-06T01:39:40.963716+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:54:45.908004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.520759+0000","last_change":"2023-10-06T01:38:45.307814+0000","last_active":"2023-10-06T01:39:39.520759+0000","last_peered":"2023-10-06T01:39:39.520759+0000","last_clean":"2023-10-06T01:39:39.520759+0000","last_became_active":"2023-10-06T01:38:45.307536+0000","last_became_peered":"2023-10-06T01:38:45.307536+0000","last_unstale":"2023-10-06T01:39:39.520759+0000","last_undegraded":"2023-10-06T01:39:39.520759+0000","last_fullsized":"2023-10-06T01:39:39.520759+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:09.503713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.539176+0000","last_change":"2023-10-06T01:39:39.531658+0000","last_active":"2023-10-06T01:39:39.539176+0000","last_peered":"2023-10-06T01:39:39.539176+0000","last_clean":"2023-10-06T01:39:39.539176+0000","last_became_active":"2023-10-06T01:39:39.531262+0000","last_became_peered":"2023-10-06T01:39:39.531262+0000","last_unstale":"2023-10-06T01:39:39.539176+0000","last_undegraded":"2023-10-06T01:39:39.539176+0000","last_fullsized":"2023-10-06T01:39:39.539176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:51:43.467840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.518786+0000","last_change":"2023-10-06T01:39:38.626151+0000","last_active":"2023-10-06T01:39:39.518786+0000","last_peered":"2023-10-06T01:39:39.518786+0000","last_clean":"2023-10-06T01:39:39.518786+0000","last_became_active":"2023-10-06T01:39:38.625888+0000","last_became_peered":"2023-10-06T01:39:38.625888+0000","last_unstale":"2023-10-06T01:39:39.518786+0000","last_undegraded":"2023-10-06T01:39:39.518786+0000","last_fullsized":"2023-10-06T01:39:39.518786+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:46:35.807335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.518659+0000","last_change":"2023-10-06T01:38:44.534507+0000","last_active":"2023-10-06T01:39:39.518659+0000","last_peered":"2023-10-06T01:39:39.518659+0000","last_clean":"2023-10-06T01:39:39.518659+0000","last_became_active":"2023-10-06T01:38:44.534191+0000","last_became_peered":"2023-10-06T01:38:44.534191+0000","last_unstale":"2023-10-06T01:39:39.518659+0000","last_undegraded":"2023-10-06T01:39:39.518659+0000","last_fullsized":"2023-10-06T01:39:39.518659+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":177,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.519577+0000","last_change":"2023-10-06T01:38:40.115117+0000","last_active":"2023-10-06T01:39:39.519577+0000","last_peered":"2023-10-06T01:39:39.519577+0000","last_clean":"2023-10-06T01:39:39.519577+0000","last_became_active":"2023-10-06T01:38:40.114142+0000","last_became_peered":"2023-10-06T01:38:40.114142+0000","last_unstale":"2023-10-06T01:39:39.519577+0000","last_undegraded":"2023-10-06T01:39:39.519577+0000","last_fullsized":"2023-10-06T01:39:39.519577+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_clean_scrub_stamp":"2023-10-06T01:38:38.338797+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:52.870262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.532184+0000","last_change":"2023-10-06T01:39:39.530879+0000","last_active":"2023-10-06T01:39:39.532184+0000","last_peered":"2023-10-06T01:39:39.532184+0000","last_clean":"2023-10-06T01:39:39.532184+0000","last_became_active":"2023-10-06T01:39:39.530619+0000","last_became_peered":"2023-10-06T01:39:39.530619+0000","last_unstale":"2023-10-06T01:39:39.532184+0000","last_undegraded":"2023-10-06T01:39:39.532184+0000","last_fullsized":"2023-10-06T01:39:39.532184+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T13:18:03.781047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"34'2","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.623038+0000","last_change":"2023-10-06T01:39:38.628812+0000","last_active":"2023-10-06T01:39:39.623038+0000","last_peered":"2023-10-06T01:39:39.623038+0000","last_clean":"2023-10-06T01:39:39.623038+0000","last_became_active":"2023-10-06T01:39:38.628525+0000","last_became_peered":"2023-10-06T01:39:38.628525+0000","last_unstale":"2023-10-06T01:39:39.623038+0000","last_undegraded":"2023-10-06T01:39:39.623038+0000","last_fullsized":"2023-10-06T01:39:39.623038+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T09:26:22.990841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.519641+0000","last_change":"2023-10-06T01:38:44.531831+0000","last_active":"2023-10-06T01:39:39.519641+0000","last_peered":"2023-10-06T01:39:39.519641+0000","last_clean":"2023-10-06T01:39:39.519641+0000","last_became_active":"2023-10-06T01:38:44.531496+0000","last_became_peered":"2023-10-06T01:38:44.531496+0000","last_unstale":"2023-10-06T01:39:39.519641+0000","last_undegraded":"2023-10-06T01:39:39.519641+0000","last_fullsized":"2023-10-06T01:39:39.519641+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:28.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.531992+0000","last_change":"2023-10-06T01:39:39.529184+0000","last_active":"2023-10-06T01:39:39.531992+0000","last_peered":"2023-10-06T01:39:39.531992+0000","last_clean":"2023-10-06T01:39:39.531992+0000","last_became_active":"2023-10-06T01:39:39.528937+0000","last_became_peered":"2023-10-06T01:39:39.528937+0000","last_unstale":"2023-10-06T01:39:39.531992+0000","last_undegraded":"2023-10-06T01:39:39.531992+0000","last_fullsized":"2023-10-06T01:39:39.531992+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:09:53.326821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.525846+0000","last_change":"2023-10-06T01:39:38.626256+0000","last_active":"2023-10-06T01:39:39.525846+0000","last_peered":"2023-10-06T01:39:39.525846+0000","last_clean":"2023-10-06T01:39:39.525846+0000","last_became_active":"2023-10-06T01:39:38.625973+0000","last_became_peered":"2023-10-06T01:39:38.625973+0000","last_unstale":"2023-10-06T01:39:39.525846+0000","last_undegraded":"2023-10-06T01:39:39.525846+0000","last_fullsized":"2023-10-06T01:39:39.525846+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T03:36:21.647390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.519166+0000","last_change":"2023-10-06T01:38:44.531335+0000","last_active":"2023-10-06T01:39:39.519166+0000","last_peered":"2023-10-06T01:39:39.519166+0000","last_clean":"2023-10-06T01:39:39.519166+0000","last_became_active":"2023-10-06T01:38:44.530966+0000","last_became_peered":"2023-10-06T01:38:44.530966+0000","last_unstale":"2023-10-06T01:39:39.519166+0000","last_undegraded":"2023-10-06T01:39:39.519166+0000","last_fullsized":"2023-10-06T01:39:39.519166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:33.926180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.536339+0000","last_change":"2023-10-06T01:39:39.532663+0000","last_active":"2023-10-06T01:39:39.536339+0000","last_peered":"2023-10-06T01:39:39.536339+0000","last_clean":"2023-10-06T01:39:39.536339+0000","last_became_active":"2023-10-06T01:39:39.532435+0000","last_became_peered":"2023-10-06T01:39:39.532435+0000","last_unstale":"2023-10-06T01:39:39.536339+0000","last_undegraded":"2023-10-06T01:39:39.536339+0000","last_fullsized":"2023-10-06T01:39:39.536339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T02:23:15.510626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.529694+0000","last_change":"2023-10-06T01:39:38.623748+0000","last_active":"2023-10-06T01:39:39.529694+0000","last_peered":"2023-10-06T01:39:39.529694+0000","last_clean":"2023-10-06T01:39:39.529694+0000","last_became_active":"2023-10-06T01:39:38.623460+0000","last_became_peered":"2023-10-06T01:39:38.623460+0000","last_unstale":"2023-10-06T01:39:39.529694+0000","last_undegraded":"2023-10-06T01:39:39.529694+0000","last_fullsized":"2023-10-06T01:39:39.529694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:02:05.682135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.522622+0000","last_change":"2023-10-06T01:38:44.533582+0000","last_active":"2023-10-06T01:39:39.522622+0000","last_peered":"2023-10-06T01:39:39.522622+0000","last_clean":"2023-10-06T01:39:39.522622+0000","last_became_active":"2023-10-06T01:38:44.533324+0000","last_became_peered":"2023-10-06T01:38:44.533324+0000","last_unstale":"2023-10-06T01:39:39.522622+0000","last_undegraded":"2023-10-06T01:39:39.522622+0000","last_fullsized":"2023-10-06T01:39:39.522622+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.535058+0000","last_change":"2023-10-06T01:39:39.532149+0000","last_active":"2023-10-06T01:39:39.535058+0000","last_peered":"2023-10-06T01:39:39.535058+0000","last_clean":"2023-10-06T01:39:39.535058+0000","last_became_active":"2023-10-06T01:39:39.531891+0000","last_became_peered":"2023-10-06T01:39:39.531891+0000","last_unstale":"2023-10-06T01:39:39.535058+0000","last_undegraded":"2023-10-06T01:39:39.535058+0000","last_fullsized":"2023-10-06T01:39:39.535058+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:38.598587+0000","last_clean_scrub_stamp":"2023-10-06T01:39:38.598587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:30:40.175833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.517261+0000","last_change":"2023-10-06T01:39:38.623722+0000","last_active":"2023-10-06T01:39:39.517261+0000","last_peered":"2023-10-06T01:39:39.517261+0000","last_clean":"2023-10-06T01:39:39.517261+0000","last_became_active":"2023-10-06T01:39:38.623425+0000","last_became_peered":"2023-10-06T01:39:38.623425+0000","last_unstale":"2023-10-06T01:39:39.517261+0000","last_undegraded":"2023-10-06T01:39:39.517261+0000","last_fullsized":"2023-10-06T01:39:39.517261+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:39:37.589723+0000","last_clean_scrub_stamp":"2023-10-06T01:39:37.589723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:52:14.193205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-10-06T01:39:39.526690+0000","last_change":"2023-10-06T01:38:44.533765+0000","last_active":"2023-10-06T01:39:39.526690+0000","last_peered":"2023-10-06T01:39:39.526690+0000","last_clean":"2023-10-06T01:39:39.526690+0000","last_became_active":"2023-10-06T01:38:44.533406+0000","last_became_peered":"2023-10-06T01:38:44.533406+0000","last_unstale":"2023-10-06T01:39:39.526690+0000","last_undegraded":"2023-10-06T01:39:39.526690+0000","last_fullsized":"2023-10-06T01:39:39.526690+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574866,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298272,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073568,"statfs":{"total":96636764160,"available":96331333632,"internally_reserved":0,"allocated":1007616,"data_stored":753061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.496},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.55500000000000005}]},{"osd":1,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.48299999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.61499999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.54300000000000004}]},{"osd":4,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.45200000000000001}]},{"osd":5,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.58799999999999997}]},{"osd":6,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.59899999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574867,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":401408,"data_stored":161641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.47599999999999998}]},{"osd":1,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.49399999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.438}]},{"osd":3,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.54900000000000004}]},{"osd":4,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.34999999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.378}]},{"osd":7,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.41999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":401408,"data_stored":161177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.248},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.34799999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":0.38500000000000001}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.33000000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.432}]},{"osd":5,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.42399999999999999}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.52500000000000002}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.443},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.495}]}]},{"osd":0,"up_from":13,"seq":55834574867,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298260,"kb_used_data":972,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073580,"statfs":{"total":96636764160,"available":96331345920,"internally_reserved":0,"allocated":995328,"data_stored":751489,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"last":0.29999999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.33800000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.316},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.32300000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.55300000000000005}]},{"osd":5,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.56299999999999994}]},{"osd":6,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.67500000000000004}]},{"osd":7,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.65200000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574867,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297680,"kb_used_data":392,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074160,"statfs":{"total":96636764160,"available":96331939840,"internally_reserved":0,"allocated":401408,"data_stored":161157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.309},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.33700000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.40300000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.374},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.36099999999999999}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.64500000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.627},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.55300000000000005}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.66300000000000003}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.58199999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297692,"kb_used_data":404,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074148,"statfs":{"total":96636764160,"available":96331927552,"internally_reserved":0,"allocated":413696,"data_stored":162657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.432},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.51800000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.54400000000000004}]},{"osd":2,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.57099999999999995}]},{"osd":4,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.64300000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.65100000000000002}]},{"osd":6,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.76500000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.748},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.73099999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297684,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074156,"statfs":{"total":96636764160,"available":96331935744,"internally_reserved":0,"allocated":405504,"data_stored":161663,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.4289999999999998,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.57899999999999996}]},{"osd":1,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":4.2270000000000003,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.2789999999999999,"5min":4.2789999999999999,"15min":4.2789999999999999},"last":0.70599999999999996}]},{"osd":2,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":12.359,"5min":12.359,"15min":12.359},"last":0.60699999999999998},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":12.326000000000001,"5min":12.326000000000001,"15min":12.326000000000001},"last":0.67000000000000004}]},{"osd":3,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":3.448,"5min":3.448,"15min":3.448},"last":0.65400000000000003},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":12.282,"5min":12.282,"15min":12.282},"last":0.56999999999999995}]},{"osd":5,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.54600000000000004}]},{"osd":6,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.438},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.47199999999999998}]},{"osd":7,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.50800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574865,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297684,"kb_used_data":396,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074156,"statfs":{"total":96636764160,"available":96331935744,"internally_reserved":0,"allocated":405504,"data_stored":161199,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.625},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.64900000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.55300000000000005}]},{"osd":2,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.73299999999999998}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.61199999999999999}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.379},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.45300000000000001}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.5},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.53600000000000003}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.56100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1570,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:39:48.568 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-06T01:39:48.568 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-06T01:39:48.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.718+0000 7f7a55eb8700 1 Processor -- start 2023-10-06T01:39:48.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.718+0000 7f7a55eb8700 1 -- start start 2023-10-06T01:39:48.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.719+0000 7f7a55eb8700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7a50159530 0x7f7a500ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:48.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.719+0000 7f7a55eb8700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7a5006dc70 0x7f7a50159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:48.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.719+0000 7f7a55eb8700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a500ccfd0 con 0x7f7a5006e0e0 2023-10-06T01:39:48.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.719+0000 7f7a55eb8700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a500cf0e0 con 0x7f7a50159530 2023-10-06T01:39:48.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.719+0000 7f7a55eb8700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5015a3d0 con 0x7f7a5006dc70 2023-10-06T01:39:48.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.719+0000 7f7a4f7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7a50159530 0x7f7a500ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:48.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.719+0000 7f7a4ffff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f7a5006e0e0 0x7f7a500cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:55042/0 (socket says 172.21.15.69:55042) 2023-10-06T01:39:48.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.719+0000 7f7a4ffff700 1 -- 172.21.15.69:0/323879769 learned_addr learned my addr 172.21.15.69:0/323879769 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:48.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.720+0000 7f7a4effd700 1 --2- 172.21.15.69:0/323879769 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7a5006dc70 0x7f7a50159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:48.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.720+0000 7f7a4f7fe700 1 -- 172.21.15.69:0/323879769 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7a5006dc70 msgr2=0x7f7a50159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:48.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.720+0000 7f7a4f7fe700 1 --2- 172.21.15.69:0/323879769 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7a5006dc70 0x7f7a50159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:48.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.720+0000 7f7a4f7fe700 1 -- 172.21.15.69:0/323879769 >> v1:172.21.15.69:6789/0 conn(0x7f7a5006e0e0 legacy=0x7f7a500cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:48.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.720+0000 7f7a4f7fe700 1 -- 172.21.15.69:0/323879769 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a5015a6b0 con 0x7f7a50159530 2023-10-06T01:39:48.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.720+0000 7f7a4e7fc700 1 -- 172.21.15.69:0/323879769 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 717511034 0 0) 0x7f7a500ccfd0 con 0x7f7a5006e0e0 2023-10-06T01:39:48.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.720+0000 7f7a4f7fe700 1 --2- 172.21.15.69:0/323879769 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a50159530 0x7f7a500ceba0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7a400098e0 tx=0x7f7a400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bfaf05c1f893f01 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:48.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.720+0000 7f7a4e7fc700 1 -- 172.21.15.69:0/323879769 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a40009e80 con 0x7f7a50159530 2023-10-06T01:39:48.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.720+0000 7f7a4e7fc700 1 -- 172.21.15.69:0/323879769 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4000b860 con 0x7f7a50159530 2023-10-06T01:39:48.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.720+0000 7f7a4e7fc700 1 -- 172.21.15.69:0/323879769 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4000bbe0 con 0x7f7a50159530 2023-10-06T01:39:48.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.720+0000 7f7a55eb8700 1 -- 172.21.15.69:0/323879769 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a50159530 msgr2=0x7f7a500ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:48.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.720+0000 7f7a55eb8700 1 --2- 172.21.15.69:0/323879769 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a50159530 0x7f7a500ceba0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7a400098e0 tx=0x7f7a400091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:48.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.720+0000 7f7a55eb8700 1 -- 172.21.15.69:0/323879769 shutdown_connections 2023-10-06T01:39:48.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.720+0000 7f7a55eb8700 1 --2- 172.21.15.69:0/323879769 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a50159530 0x7f7a500ceba0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:48.723 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.720+0000 7f7a55eb8700 1 --2- 172.21.15.69:0/323879769 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7a5006dc70 0x7f7a50159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:48.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.720+0000 7f7a55eb8700 1 -- 172.21.15.69:0/323879769 >> 172.21.15.69:0/323879769 conn(0x7f7a500703a0 msgr2=0x7f7a500707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:48.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.720+0000 7f7a55eb8700 1 -- 172.21.15.69:0/323879769 shutdown_connections 2023-10-06T01:39:48.724 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.720+0000 7f7a55eb8700 1 -- 172.21.15.69:0/323879769 wait complete. 2023-10-06T01:39:48.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.722+0000 7f7a55eb8700 1 Processor -- start 2023-10-06T01:39:48.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.722+0000 7f7a55eb8700 1 -- start start 2023-10-06T01:39:48.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.722+0000 7f7a55eb8700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7a5006dc70 0x7f7a500c8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:48.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.722+0000 7f7a55eb8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a5006e0e0 0x7f7a50152e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:48.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.722+0000 7f7a55eb8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a50159530 0x7f7a50155c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:48.727 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.722+0000 7f7a55eb8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a500b3480 con 0x7f7a50159530 2023-10-06T01:39:48.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.722+0000 7f7a55eb8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a500b4000 con 0x7f7a5006e0e0 2023-10-06T01:39:48.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.722+0000 7f7a55eb8700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a500b6490 con 0x7f7a5006dc70 2023-10-06T01:39:48.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.723+0000 7f7a4ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a50159530 0x7f7a50155c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:48.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.723+0000 7f7a4ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a50159530 0x7f7a50155c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49996/0 (socket says 172.21.15.69:49996) 2023-10-06T01:39:48.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.723+0000 7f7a4ffff700 1 -- 172.21.15.69:0/1701479139 learned_addr learned my addr 172.21.15.69:0/1701479139 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:48.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.723+0000 7f7a4f7fe700 1 --2- 172.21.15.69:0/1701479139 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7a5006dc70 0x7f7a500c8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:48.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.723+0000 7f7a4effd700 1 --2- 172.21.15.69:0/1701479139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a5006e0e0 0x7f7a50152e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:48.728 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.723+0000 7f7a4ffff700 1 -- 172.21.15.69:0/1701479139 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7a5006dc70 msgr2=0x7f7a500c8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:48.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.723+0000 7f7a4ffff700 1 --2- 172.21.15.69:0/1701479139 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7a5006dc70 0x7f7a500c8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:48.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.723+0000 7f7a4ffff700 1 -- 172.21.15.69:0/1701479139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a5006e0e0 msgr2=0x7f7a50152e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:48.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.723+0000 7f7a4ffff700 1 --2- 172.21.15.69:0/1701479139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a5006e0e0 0x7f7a50152e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:48.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.723+0000 7f7a4ffff700 1 -- 172.21.15.69:0/1701479139 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a40009420 con 0x7f7a50159530 2023-10-06T01:39:48.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.723+0000 7f7a4ffff700 1 --2- 172.21.15.69:0/1701479139 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a50159530 0x7f7a50155c40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800ccf0 tx=0x7f7a48001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:48.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.723+0000 7f7a377fe700 1 -- 172.21.15.69:0/1701479139 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4800a870 con 0x7f7a50159530 2023-10-06T01:39:48.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.723+0000 7f7a377fe700 1 -- 172.21.15.69:0/1701479139 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a4800a9d0 con 0x7f7a50159530 2023-10-06T01:39:48.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.723+0000 7f7a55eb8700 1 -- 172.21.15.69:0/1701479139 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a500b36d0 con 0x7f7a50159530 2023-10-06T01:39:48.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.723+0000 7f7a377fe700 1 -- 172.21.15.69:0/1701479139 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a4800ad90 con 0x7f7a50159530 2023-10-06T01:39:48.729 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.723+0000 7f7a55eb8700 1 -- 172.21.15.69:0/1701479139 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a500b3c90 con 0x7f7a50159530 2023-10-06T01:39:48.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.724+0000 7f7a55eb8700 1 -- 172.21.15.69:0/1701479139 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a5004c3c0 con 0x7f7a50159530 2023-10-06T01:39:48.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.725+0000 7f7a377fe700 1 -- 172.21.15.69:0/1701479139 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7a48007300 con 0x7f7a50159530 2023-10-06T01:39:48.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.725+0000 7f7a377fe700 1 --2- 172.21.15.69:0/1701479139 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7a3c066f30 0x7f7a3c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:48.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.725+0000 7f7a4f7fe700 1 --2- 172.21.15.69:0/1701479139 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7a3c066f30 0x7f7a3c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:48.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.725+0000 7f7a377fe700 1 -- 172.21.15.69:0/1701479139 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7a480848f0 con 0x7f7a50159530 2023-10-06T01:39:48.730 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.725+0000 7f7a4f7fe700 1 --2- 172.21.15.69:0/1701479139 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7a3c066f30 0x7f7a3c0693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7a400091e0 tx=0x7f7a40017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:48.731 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.729+0000 7f7a377fe700 1 -- 172.21.15.69:0/1701479139 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a48051a80 con 0x7f7a50159530 2023-10-06T01:39:48.837 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:39:48.839 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:39:48.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.991+0000 7f7a55eb8700 1 -- 172.21.15.69:0/1701479139 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f7a5015a990 con 0x7f7a50159530 2023-10-06T01:39:48.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.994+0000 7f7a377fe700 1 -- 172.21.15.69:0/1701479139 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) v1 ==== 190+0+0 (secure 0 0 0) 0x7f7a480550a0 con 0x7f7a50159530 2023-10-06T01:39:48.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.997+0000 7f7a55eb8700 1 -- 172.21.15.69:0/1701479139 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7a3c066f30 msgr2=0x7f7a3c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:48.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.997+0000 7f7a55eb8700 1 --2- 172.21.15.69:0/1701479139 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7a3c066f30 0x7f7a3c0693e0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7a400091e0 tx=0x7f7a40017000 comp rx=0 tx=0).stop 2023-10-06T01:39:48.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.997+0000 7f7a55eb8700 1 -- 172.21.15.69:0/1701479139 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a50159530 msgr2=0x7f7a50155c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:48.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.997+0000 7f7a55eb8700 1 --2- 172.21.15.69:0/1701479139 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a50159530 0x7f7a50155c40 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f7a4800ccf0 tx=0x7f7a48001a20 comp rx=0 tx=0).stop 2023-10-06T01:39:48.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.997+0000 7f7a55eb8700 1 -- 172.21.15.69:0/1701479139 shutdown_connections 2023-10-06T01:39:48.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.997+0000 7f7a55eb8700 1 --2- 172.21.15.69:0/1701479139 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7a3c066f30 0x7f7a3c0693e0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:48.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.997+0000 7f7a55eb8700 1 --2- 172.21.15.69:0/1701479139 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a50159530 0x7f7a50155c40 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:48.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.997+0000 7f7a55eb8700 1 --2- 172.21.15.69:0/1701479139 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7a5006dc70 0x7f7a500c8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:48.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.997+0000 7f7a55eb8700 1 --2- 172.21.15.69:0/1701479139 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7a5006e0e0 0x7f7a50152e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:48.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.997+0000 7f7a55eb8700 1 -- 172.21.15.69:0/1701479139 >> 172.21.15.69:0/1701479139 conn(0x7f7a500703a0 msgr2=0x7f7a50153c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:48.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.997+0000 7f7a55eb8700 1 -- 172.21.15.69:0/1701479139 shutdown_connections 2023-10-06T01:39:48.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:48.997+0000 7f7a55eb8700 1 -- 172.21.15.69:0/1701479139 wait complete. 2023-10-06T01:39:49.000 INFO:teuthology.orchestra.run.smithi069.stderr:updated caps for client.0 2023-10-06T01:39:49.009 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:39:49.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.122+0000 7f18c80be700 1 Processor -- start 2023-10-06T01:39:49.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.122+0000 7f18c80be700 1 -- start start 2023-10-06T01:39:49.125 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.123+0000 7f18c80be700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f18c013fcc0 0x7f18c0156af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.123+0000 7f18c80be700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f18c0070410 0x7f18c0160120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.123+0000 7f18c80be700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18c00c3a30 con 0x7f18c00c29b0 2023-10-06T01:39:49.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.123+0000 7f18c80be700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c00c2e20 con 0x7f18c0070410 2023-10-06T01:39:49.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.123+0000 7f18c80be700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18c00c3100 con 0x7f18c013fcc0 2023-10-06T01:39:49.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.123+0000 7f18c665b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f18c0070410 0x7f18c0160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:49.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.123+0000 7f18c5659700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f18c00c29b0 0x7f18c00c43a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:55044/0 (socket says 172.21.15.69:55044) 2023-10-06T01:39:49.126 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.124+0000 7f18c5659700 1 -- 172.21.15.69:0/725945042 learned_addr learned my addr 172.21.15.69:0/725945042 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:49.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.124+0000 7f18c5e5a700 1 --2- 172.21.15.69:0/725945042 >> v2:172.21.15.88:3300/0 conn(0x7f18c013fcc0 0x7f18c0156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:49.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.124+0000 7f18c665b700 1 -- 172.21.15.69:0/725945042 >> v2:172.21.15.88:3300/0 conn(0x7f18c013fcc0 msgr2=0x7f18c0156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:49.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.124+0000 7f18c665b700 1 --2- 172.21.15.69:0/725945042 >> v2:172.21.15.88:3300/0 conn(0x7f18c013fcc0 0x7f18c0156af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.124+0000 7f18c665b700 1 -- 172.21.15.69:0/725945042 >> v1:172.21.15.69:6789/0 conn(0x7f18c00c29b0 legacy=0x7f18c00c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:49.127 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.124+0000 7f18c665b700 1 -- 172.21.15.69:0/725945042 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c00c33e0 con 0x7f18c0070410 2023-10-06T01:39:49.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.124+0000 7f18c4e58700 1 -- 172.21.15.69:0/725945042 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 844633542 0 0) 0x7f18c00c3a30 con 0x7f18c00c29b0 2023-10-06T01:39:49.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.124+0000 7f18c665b700 1 --2- 172.21.15.69:0/725945042 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18c0070410 0x7f18c0160120 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f18c006e280 tx=0x7f18b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43cd8560c4aa3b8a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:49.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.124+0000 7f18c4e58700 1 -- 172.21.15.69:0/725945042 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b8011630 con 0x7f18c0070410 2023-10-06T01:39:49.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.124+0000 7f18c4e58700 1 -- 172.21.15.69:0/725945042 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b8011790 con 0x7f18c0070410 2023-10-06T01:39:49.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.124+0000 7f18c4e58700 1 -- 172.21.15.69:0/725945042 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b8011b30 con 0x7f18c0070410 2023-10-06T01:39:49.128 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.125+0000 7f18c80be700 1 -- 172.21.15.69:0/725945042 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18c0070410 msgr2=0x7f18c0160120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:49.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.125+0000 7f18c80be700 1 --2- 172.21.15.69:0/725945042 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18c0070410 0x7f18c0160120 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f18c006e280 tx=0x7f18b80091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.125+0000 7f18c80be700 1 -- 172.21.15.69:0/725945042 shutdown_connections 2023-10-06T01:39:49.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.125+0000 7f18c80be700 1 --2- 172.21.15.69:0/725945042 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18c0070410 0x7f18c0160120 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.125+0000 7f18c80be700 1 --2- 172.21.15.69:0/725945042 >> v2:172.21.15.88:3300/0 conn(0x7f18c013fcc0 0x7f18c0156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.125+0000 7f18c80be700 1 -- 172.21.15.69:0/725945042 >> 172.21.15.69:0/725945042 conn(0x7f18c00ccb60 msgr2=0x7f18c00ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:49.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.125+0000 7f18c80be700 1 -- 172.21.15.69:0/725945042 shutdown_connections 2023-10-06T01:39:49.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.125+0000 7f18c80be700 1 -- 172.21.15.69:0/725945042 wait complete. 2023-10-06T01:39:49.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.126+0000 7f18c80be700 1 Processor -- start 2023-10-06T01:39:49.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.126+0000 7f18c80be700 1 -- start start 2023-10-06T01:39:49.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.126+0000 7f18c80be700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18c0070410 0x7f18c012cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.126+0000 7f18c80be700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c00c29b0 0x7f18c00c7e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.126+0000 7f18c80be700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18c013fcc0 0x7f18c0157c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.127+0000 7f18c80be700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c01411e0 con 0x7f18c0070410 2023-10-06T01:39:49.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.127+0000 7f18c80be700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c01405d0 con 0x7f18c00c29b0 2023-10-06T01:39:49.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.127+0000 7f18c80be700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c01408b0 con 0x7f18c013fcc0 2023-10-06T01:39:49.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.127+0000 7f18c5e5a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18c0070410 0x7f18c012cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:49.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.127+0000 7f18c5e5a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18c0070410 0x7f18c012cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50016/0 (socket says 172.21.15.69:50016) 2023-10-06T01:39:49.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.127+0000 7f18c5e5a700 1 -- 172.21.15.69:0/2339642551 learned_addr learned my addr 172.21.15.69:0/2339642551 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:49.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.127+0000 7f18c5659700 1 --2- 172.21.15.69:0/2339642551 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c00c29b0 0x7f18c00c7e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:49.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.127+0000 7f18c5e5a700 1 -- 172.21.15.69:0/2339642551 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18c013fcc0 msgr2=0x7f18c0157c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:49.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.127+0000 7f18c665b700 1 --2- 172.21.15.69:0/2339642551 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18c013fcc0 0x7f18c0157c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:49.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.127+0000 7f18c5e5a700 1 --2- 172.21.15.69:0/2339642551 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18c013fcc0 0x7f18c0157c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.127+0000 7f18c5e5a700 1 -- 172.21.15.69:0/2339642551 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c00c29b0 msgr2=0x7f18c00c7e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:49.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.127+0000 7f18c5e5a700 1 --2- 172.21.15.69:0/2339642551 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c00c29b0 0x7f18c00c7e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.127+0000 7f18c5e5a700 1 -- 172.21.15.69:0/2339642551 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b8009420 con 0x7f18c0070410 2023-10-06T01:39:49.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.127+0000 7f18c5659700 1 --2- 172.21.15.69:0/2339642551 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c00c29b0 0x7f18c00c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:49.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.127+0000 7f18c5e5a700 1 --2- 172.21.15.69:0/2339642551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18c0070410 0x7f18c012cca0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f18b0009e50 tx=0x7f18b000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:49.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.127+0000 7f18bdffb700 1 -- 172.21.15.69:0/2339642551 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b000cc20 con 0x7f18c0070410 2023-10-06T01:39:49.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.127+0000 7f18bdffb700 1 -- 172.21.15.69:0/2339642551 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18b000f040 con 0x7f18c0070410 2023-10-06T01:39:49.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.127+0000 7f18c80be700 1 -- 172.21.15.69:0/2339642551 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18c0140b90 con 0x7f18c0070410 2023-10-06T01:39:49.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.127+0000 7f18bdffb700 1 -- 172.21.15.69:0/2339642551 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18b0014480 con 0x7f18c0070410 2023-10-06T01:39:49.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.127+0000 7f18c80be700 1 -- 172.21.15.69:0/2339642551 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18c00c83d0 con 0x7f18c0070410 2023-10-06T01:39:49.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.128+0000 7f18c80be700 1 -- 172.21.15.69:0/2339642551 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18c004c3c0 con 0x7f18c0070410 2023-10-06T01:39:49.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.129+0000 7f18bdffb700 1 -- 172.21.15.69:0/2339642551 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f18b00147f0 con 0x7f18c0070410 2023-10-06T01:39:49.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.129+0000 7f18bdffb700 1 --2- 172.21.15.69:0/2339642551 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f18ac066f30 0x7f18ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.129+0000 7f18bdffb700 1 -- 172.21.15.69:0/2339642551 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f18b00851a0 con 0x7f18c0070410 2023-10-06T01:39:49.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.129+0000 7f18c5659700 1 --2- 172.21.15.69:0/2339642551 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f18ac066f30 0x7f18ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:49.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.130+0000 7f18c5659700 1 --2- 172.21.15.69:0/2339642551 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f18ac066f30 0x7f18ac0693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f18c013da70 tx=0x7f18b4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:49.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.133+0000 7f18bdffb700 1 -- 172.21.15.69:0/2339642551 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18b0052210 con 0x7f18c0070410 2023-10-06T01:39:49.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.358+0000 7f18c80be700 1 -- 172.21.15.69:0/2339642551 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18c00c36c0 con 0x7f18c0070410 2023-10-06T01:39:49.359 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.359+0000 7f18bdffb700 1 -- 172.21.15.69:0/2339642551 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f18b0059e60 con 0x7f18c0070410 2023-10-06T01:39:49.359 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:49.359 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4837,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2963206981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":2963206981},{"type":"v1","addr":"172.21.15.88:6835","nonce":2963206981}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5028,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6836/1958085129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":1958085129},{"type":"v1","addr":"172.21.15.69:6836","nonce":1958085129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5031,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1745977228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6835","nonce":1745977228},{"type":"v1","addr":"172.21.15.69:6837","nonce":1745977228}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:39:38.993158+0000","modified":"2023-10-06T01:39:42.621141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5037},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5037":{"gid":5037,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6834/3221701951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3221701951},{"type":"v1","addr":"172.21.15.88:6834","nonce":3221701951}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T01:39:49.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.361+0000 7f18c80be700 1 -- 172.21.15.69:0/2339642551 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f18ac066f30 msgr2=0x7f18ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:49.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.361+0000 7f18c80be700 1 --2- 172.21.15.69:0/2339642551 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f18ac066f30 0x7f18ac0693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f18c013da70 tx=0x7f18b4009040 comp rx=0 tx=0).stop 2023-10-06T01:39:49.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.361+0000 7f18c80be700 1 -- 172.21.15.69:0/2339642551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18c0070410 msgr2=0x7f18c012cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:49.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.361+0000 7f18c80be700 1 --2- 172.21.15.69:0/2339642551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18c0070410 0x7f18c012cca0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f18b0009e50 tx=0x7f18b000b040 comp rx=0 tx=0).stop 2023-10-06T01:39:49.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.361+0000 7f18c80be700 1 -- 172.21.15.69:0/2339642551 shutdown_connections 2023-10-06T01:39:49.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.361+0000 7f18c80be700 1 --2- 172.21.15.69:0/2339642551 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f18ac066f30 0x7f18ac0693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.361+0000 7f18c80be700 1 --2- 172.21.15.69:0/2339642551 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f18c013fcc0 0x7f18c0157c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.361+0000 7f18c80be700 1 --2- 172.21.15.69:0/2339642551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18c0070410 0x7f18c012cca0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.361+0000 7f18c80be700 1 --2- 172.21.15.69:0/2339642551 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f18c00c29b0 0x7f18c00c7e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.361+0000 7f18c80be700 1 -- 172.21.15.69:0/2339642551 >> 172.21.15.69:0/2339642551 conn(0x7f18c00ccb60 msgr2=0x7f18c00ca1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:49.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.361+0000 7f18c80be700 1 -- 172.21.15.69:0/2339642551 shutdown_connections 2023-10-06T01:39:49.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.361+0000 7f18c80be700 1 -- 172.21.15.69:0/2339642551 wait complete. 2023-10-06T01:39:49.363 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 17 2023-10-06T01:39:49.776 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-06T01:39:38.993158+0000', 'modified': '2023-10-06T01:39:42.621141+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5037}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5037': {'gid': 5037, 'name': 'd', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.88:6834/3221701951', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.88:6832', 'nonce': 3221701951}, {'type': 'v1', 'addr': '172.21.15.88:6834', 'nonce': 3221701951}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-06T01:39:49.776 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-06T01:39:49.776 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-06T01:39:49.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.892+0000 7fb36ec3b700 1 Processor -- start 2023-10-06T01:39:49.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.892+0000 7fb36ec3b700 1 -- start start 2023-10-06T01:39:49.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.892+0000 7fb36ec3b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb3680cb5a0 0x7fb3680cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.892+0000 7fb36ec3b700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb36815ae40 con 0x7fb36815a5d0 2023-10-06T01:39:49.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.892+0000 7fb36ec3b700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb36815ab60 con 0x7fb3680cd9e0 2023-10-06T01:39:49.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.892+0000 7fb36ec3b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3680d13f0 con 0x7fb3680cb5a0 2023-10-06T01:39:49.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.893+0000 7fb36d1d8700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fb36815a5d0 0x7fb368156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:55054/0 (socket says 172.21.15.69:55054) 2023-10-06T01:39:49.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.893+0000 7fb36d1d8700 1 -- 172.21.15.69:0/1816263867 learned_addr learned my addr 172.21.15.69:0/1816263867 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:49.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.893+0000 7fb36c9d7700 1 --2- 172.21.15.69:0/1816263867 >> v2:172.21.15.88:3300/0 conn(0x7fb3680cb5a0 0x7fb3680cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:49.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.893+0000 7fb3677fe700 1 -- 172.21.15.69:0/1816263867 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3346769362 0 0) 0x7fb36815ae40 con 0x7fb36815a5d0 2023-10-06T01:39:49.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.893+0000 7fb3677fe700 1 -- 172.21.15.69:0/1816263867 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb354003570 con 0x7fb36815a5d0 2023-10-06T01:39:49.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.893+0000 7fb3677fe700 1 -- 172.21.15.69:0/1816263867 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3778542165 0 0) 0x7fb354003570 con 0x7fb36815a5d0 2023-10-06T01:39:49.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.893+0000 7fb3677fe700 1 -- 172.21.15.69:0/1816263867 >> v2:172.21.15.88:3300/0 conn(0x7fb3680cb5a0 msgr2=0x7fb3680cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:49.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.893+0000 7fb3677fe700 1 --2- 172.21.15.69:0/1816263867 >> v2:172.21.15.88:3300/0 conn(0x7fb3680cb5a0 0x7fb3680cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.893+0000 7fb3677fe700 1 -- 172.21.15.69:0/1816263867 >> v1:172.21.15.88:6789/0 conn(0x7fb3680cd9e0 legacy=0x7fb368159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:49.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.893+0000 7fb3677fe700 1 -- 172.21.15.69:0/1816263867 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3680ccf00 con 0x7fb36815a5d0 2023-10-06T01:39:49.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.893+0000 7fb3677fe700 1 -- 172.21.15.69:0/1816263867 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7fb360001470 con 0x7fb36815a5d0 2023-10-06T01:39:49.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.893+0000 7fb3677fe700 1 -- 172.21.15.69:0/1816263867 >> v1:172.21.15.69:6789/0 conn(0x7fb36815a5d0 legacy=0x7fb368156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:49.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.893+0000 7fb3677fe700 1 --2- 172.21.15.69:0/1816263867 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb354003a60 0x7fb354003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.893+0000 7fb3677fe700 1 --2- 172.21.15.69:0/1816263867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb354004810 0x7fb354004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.893+0000 7fb3677fe700 1 --2- 172.21.15.69:0/1816263867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3540051c0 0x7fb35400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.893+0000 7fb3677fe700 1 -- 172.21.15.69:0/1816263867 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35400c0a0 con 0x7fb3540051c0 2023-10-06T01:39:49.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.893+0000 7fb3677fe700 1 -- 172.21.15.69:0/1816263867 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35400c210 con 0x7fb354004810 2023-10-06T01:39:49.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.893+0000 7fb3677fe700 1 -- 172.21.15.69:0/1816263867 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb35400c3d0 con 0x7fb354003a60 2023-10-06T01:39:49.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.893+0000 7fb36d1d8700 1 --2- 172.21.15.69:0/1816263867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3540051c0 0x7fb35400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:49.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.893+0000 7fb367fff700 1 --2- 172.21.15.69:0/1816263867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb354004810 0x7fb354004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:49.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.893+0000 7fb36c9d7700 1 --2- 172.21.15.69:0/1816263867 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb354003a60 0x7fb354003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:49.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.894+0000 7fb36d1d8700 1 -- 172.21.15.69:0/1816263867 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb354003a60 msgr2=0x7fb354003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:49.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.894+0000 7fb36d1d8700 1 --2- 172.21.15.69:0/1816263867 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb354003a60 0x7fb354003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.894+0000 7fb36d1d8700 1 -- 172.21.15.69:0/1816263867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb354004810 msgr2=0x7fb354004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:49.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.894+0000 7fb36d1d8700 1 --2- 172.21.15.69:0/1816263867 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb354004810 0x7fb354004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.894+0000 7fb36d1d8700 1 -- 172.21.15.69:0/1816263867 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb354003570 con 0x7fb3540051c0 2023-10-06T01:39:49.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.894+0000 7fb36c9d7700 1 --2- 172.21.15.69:0/1816263867 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb354003a60 0x7fb354003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:49.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.894+0000 7fb36d1d8700 1 -- 172.21.15.69:0/1816263867 reap_dead start 2023-10-06T01:39:49.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.894+0000 7fb36d1d8700 1 --2- 172.21.15.69:0/1816263867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3540051c0 0x7fb35400ba60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb36000c3c0 tx=0x7fb360001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63ce386160779da8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:49.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.894+0000 7fb3677fe700 1 -- 172.21.15.69:0/1816263867 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36000cc90 con 0x7fb3540051c0 2023-10-06T01:39:49.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.894+0000 7fb3677fe700 1 -- 172.21.15.69:0/1816263867 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36000cdf0 con 0x7fb3540051c0 2023-10-06T01:39:49.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.894+0000 7fb3677fe700 1 -- 172.21.15.69:0/1816263867 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb360005b50 con 0x7fb3540051c0 2023-10-06T01:39:49.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.894+0000 7fb36ec3b700 1 -- 172.21.15.69:0/1816263867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3540051c0 msgr2=0x7fb35400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:49.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.894+0000 7fb36ec3b700 1 --2- 172.21.15.69:0/1816263867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3540051c0 0x7fb35400ba60 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fb36000c3c0 tx=0x7fb360001e50 comp rx=0 tx=0).stop 2023-10-06T01:39:49.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.894+0000 7fb36ec3b700 1 -- 172.21.15.69:0/1816263867 shutdown_connections 2023-10-06T01:39:49.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.894+0000 7fb36ec3b700 1 --2- 172.21.15.69:0/1816263867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3540051c0 0x7fb35400ba60 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.894+0000 7fb36ec3b700 1 -- 172.21.15.69:0/1816263867 >> 172.21.15.69:0/1816263867 conn(0x7fb368070e30 msgr2=0x7fb3680d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:49.899 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.895+0000 7fb36ec3b700 1 -- 172.21.15.69:0/1816263867 shutdown_connections 2023-10-06T01:39:49.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.895+0000 7fb36ec3b700 1 -- 172.21.15.69:0/1816263867 wait complete. 2023-10-06T01:39:49.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.896+0000 7fb36ec3b700 1 Processor -- start 2023-10-06T01:39:49.900 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.896+0000 7fb36ec3b700 1 -- start start 2023-10-06T01:39:49.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.896+0000 7fb36ec3b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3540051c0 0x7fb3680cf020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.896+0000 7fb36ec3b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb3680c8c50 0x7fb3680c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.896+0000 7fb36ec3b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3680b3dc0 0x7fb3680b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.896+0000 7fb36ec3b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680c7b70 con 0x7fb3680b3dc0 2023-10-06T01:39:49.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.896+0000 7fb36ec3b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680ca470 con 0x7fb3540051c0 2023-10-06T01:39:49.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.896+0000 7fb36ec3b700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680c9600 con 0x7fb3680c8c50 2023-10-06T01:39:49.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.897+0000 7fb36d1d8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3680b3dc0 0x7fb3680b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:49.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.897+0000 7fb36d1d8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3680b3dc0 0x7fb3680b4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50036/0 (socket says 172.21.15.69:50036) 2023-10-06T01:39:49.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.897+0000 7fb36d1d8700 1 -- 172.21.15.69:0/3514421670 learned_addr learned my addr 172.21.15.69:0/3514421670 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:49.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.897+0000 7fb367fff700 1 --2- 172.21.15.69:0/3514421670 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb3680c8c50 0x7fb3680c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:49.908 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.897+0000 7fb36d1d8700 1 -- 172.21.15.69:0/3514421670 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb3680c8c50 msgr2=0x7fb3680c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:49.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.897+0000 7fb36c9d7700 1 --2- 172.21.15.69:0/3514421670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3540051c0 0x7fb3680cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:49.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.897+0000 7fb36d1d8700 1 --2- 172.21.15.69:0/3514421670 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb3680c8c50 0x7fb3680c90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.897+0000 7fb36d1d8700 1 -- 172.21.15.69:0/3514421670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3540051c0 msgr2=0x7fb3680cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:49.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.897+0000 7fb36d1d8700 1 --2- 172.21.15.69:0/3514421670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3540051c0 0x7fb3680cf020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.897+0000 7fb36d1d8700 1 -- 172.21.15.69:0/3514421670 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3680c9860 con 0x7fb3680b3dc0 2023-10-06T01:39:49.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.897+0000 7fb36d1d8700 1 --2- 172.21.15.69:0/3514421670 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3680b3dc0 0x7fb3680b4240 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb3680cbeb0 tx=0x7fb360013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:49.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.897+0000 7fb364ff9700 1 -- 172.21.15.69:0/3514421670 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36000cc90 con 0x7fb3680b3dc0 2023-10-06T01:39:49.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.897+0000 7fb364ff9700 1 -- 172.21.15.69:0/3514421670 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb360001430 con 0x7fb3680b3dc0 2023-10-06T01:39:49.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.897+0000 7fb36ec3b700 1 -- 172.21.15.69:0/3514421670 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3680c9b40 con 0x7fb3680b3dc0 2023-10-06T01:39:49.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.897+0000 7fb364ff9700 1 -- 172.21.15.69:0/3514421670 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36001e480 con 0x7fb3680b3dc0 2023-10-06T01:39:49.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.897+0000 7fb36ec3b700 1 -- 172.21.15.69:0/3514421670 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3680ca100 con 0x7fb3680b3dc0 2023-10-06T01:39:49.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.898+0000 7fb364ff9700 1 -- 172.21.15.69:0/3514421670 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb36001e870 con 0x7fb3680b3dc0 2023-10-06T01:39:49.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.899+0000 7fb364ff9700 1 --2- 172.21.15.69:0/3514421670 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb348066f30 0x7fb3480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.899+0000 7fb364ff9700 1 -- 172.21.15.69:0/3514421670 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb3600856d0 con 0x7fb3680b3dc0 2023-10-06T01:39:49.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.899+0000 7fb36c9d7700 1 --2- 172.21.15.69:0/3514421670 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb348066f30 0x7fb3480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:49.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.899+0000 7fb36c9d7700 1 --2- 172.21.15.69:0/3514421670 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb348066f30 0x7fb3480693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb358003440 tx=0x7fb35800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:49.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.901+0000 7fb377f33b80 1 Processor -- start 2023-10-06T01:39:49.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.901+0000 7fb377f33b80 1 -- start start 2023-10-06T01:39:49.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.901+0000 7fb377f33b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282368840 0x556282368c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.901+0000 7fb377f33b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556282369cc0 0x5562823b86c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.901+0000 7fb377f33b80 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5562823b8c00 0x5562823b9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.901+0000 7fb377f33b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562822bfa70 con 0x556282368840 2023-10-06T01:39:49.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.901+0000 7fb377f33b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562822bd270 con 0x556282369cc0 2023-10-06T01:39:49.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.901+0000 7fb377f33b80 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562822b9060 con 0x5562823b8c00 2023-10-06T01:39:49.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.901+0000 7fb36c9d7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282368840 0x556282368c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:49.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.901+0000 7fb36c9d7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282368840 0x556282368c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50044/0 (socket says 172.21.15.69:50044) 2023-10-06T01:39:49.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.901+0000 7fb36c9d7700 1 -- 172.21.15.69:0/1885978645 learned_addr learned my addr 172.21.15.69:0/1885978645 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:49.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.902+0000 7fb367fff700 1 --2- 172.21.15.69:0/1885978645 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556282369cc0 0x5562823b86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:49.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.902+0000 7fb36d1d8700 1 --2- 172.21.15.69:0/1885978645 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5562823b8c00 0x5562823b9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:49.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.902+0000 7fb36c9d7700 1 -- 172.21.15.69:0/1885978645 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5562823b8c00 msgr2=0x5562823b9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:49.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.902+0000 7fb36c9d7700 1 --2- 172.21.15.69:0/1885978645 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5562823b8c00 0x5562823b9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.902+0000 7fb36c9d7700 1 -- 172.21.15.69:0/1885978645 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556282369cc0 msgr2=0x5562823b86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:49.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.902+0000 7fb36c9d7700 1 --2- 172.21.15.69:0/1885978645 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556282369cc0 0x5562823b86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.902+0000 7fb36c9d7700 1 -- 172.21.15.69:0/1885978645 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556282153270 con 0x556282368840 2023-10-06T01:39:49.911 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.902+0000 7fb36d1d8700 1 --2- 172.21.15.69:0/1885978645 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5562823b8c00 0x5562823b9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:49.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.902+0000 7fb36c9d7700 1 --2- 172.21.15.69:0/1885978645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282368840 0x556282368c10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb3580177b0 tx=0x7fb358018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f03b4b63cc97cf server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:49.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.902+0000 7fb35dffb700 1 -- 172.21.15.69:0/1885978645 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb35800e040 con 0x556282368840 2023-10-06T01:39:49.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.902+0000 7fb35dffb700 1 -- 172.21.15.69:0/1885978645 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35801b070 con 0x556282368840 2023-10-06T01:39:49.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.902+0000 7fb35dffb700 1 -- 172.21.15.69:0/1885978645 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb358015830 con 0x556282368840 2023-10-06T01:39:49.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.902+0000 7fb377f33b80 1 -- 172.21.15.69:0/1885978645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282368840 msgr2=0x556282368c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:49.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.902+0000 7fb377f33b80 1 --2- 172.21.15.69:0/1885978645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282368840 0x556282368c10 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb3580177b0 tx=0x7fb358018000 comp rx=0 tx=0).stop 2023-10-06T01:39:49.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.903+0000 7fb377f33b80 1 -- 172.21.15.69:0/1885978645 shutdown_connections 2023-10-06T01:39:49.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.903+0000 7fb377f33b80 1 --2- 172.21.15.69:0/1885978645 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x5562823b8c00 0x5562823b9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.903+0000 7fb377f33b80 1 --2- 172.21.15.69:0/1885978645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282368840 0x556282368c10 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.903+0000 7fb377f33b80 1 --2- 172.21.15.69:0/1885978645 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x556282369cc0 0x5562823b86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.903+0000 7fb377f33b80 1 -- 172.21.15.69:0/1885978645 >> 172.21.15.69:0/1885978645 conn(0x55628236a160 msgr2=0x55628236a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:49.912 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.903+0000 7fb377f33b80 1 -- 172.21.15.69:0/1885978645 shutdown_connections 2023-10-06T01:39:49.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.903+0000 7fb377f33b80 1 -- 172.21.15.69:0/1885978645 wait complete. 2023-10-06T01:39:49.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.903+0000 7fb377f33b80 1 -- start start 2023-10-06T01:39:49.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.903+0000 7fb377f33b80 1 Processor -- start 2023-10-06T01:39:49.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.904+0000 7fb377f33b80 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x556282368840 0x556282392cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.904+0000 7fb377f33b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282369cc0 0x5562823ab2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.904+0000 7fb377f33b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5562823b8c00 0x5562823ab810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.904+0000 7fb377f33b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x556282264890 con 0x556282369cc0 2023-10-06T01:39:49.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.904+0000 7fb377f33b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x55628227fea0 con 0x5562823b8c00 2023-10-06T01:39:49.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.904+0000 7fb377f33b80 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x55628213be30 con 0x556282368840 2023-10-06T01:39:49.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.904+0000 7fb377f33b80 10 client.0 _ll_register_callbacks cb 0x55628232be70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T01:39:49.913 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.904+0000 7fb367fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282369cc0 0x5562823ab2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:49.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.904+0000 7fb367fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282369cc0 0x5562823ab2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50050/0 (socket says 172.21.15.69:50050) 2023-10-06T01:39:49.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.904+0000 7fb367fff700 1 -- 172.21.15.69:0/2426018037 learned_addr learned my addr 172.21.15.69:0/2426018037 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:49.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.904+0000 7fb36c9d7700 1 --2- 172.21.15.69:0/2426018037 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x556282368840 0x556282392cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:49.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.904+0000 7fb36d1d8700 1 --2- 172.21.15.69:0/2426018037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5562823b8c00 0x5562823ab810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:49.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.904+0000 7fb367fff700 1 -- 172.21.15.69:0/2426018037 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x556282368840 msgr2=0x556282392cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:49.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.904+0000 7fb367fff700 1 --2- 172.21.15.69:0/2426018037 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x556282368840 0x556282392cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.904+0000 7fb367fff700 1 -- 172.21.15.69:0/2426018037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5562823b8c00 msgr2=0x5562823ab810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:49.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.904+0000 7fb367fff700 1 --2- 172.21.15.69:0/2426018037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5562823b8c00 0x5562823ab810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.905+0000 7fb367fff700 1 -- 172.21.15.69:0/2426018037 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb358017460 con 0x556282369cc0 2023-10-06T01:39:49.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.905+0000 7fb367fff700 1 --2- 172.21.15.69:0/2426018037 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282369cc0 0x5562823ab2d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb350003ec0 tx=0x7fb350009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6e0e3469154714 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:49.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.905+0000 7fb346ffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-10-06T01:39:49.914 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.905+0000 7fb346ffd700 1 -- 172.21.15.69:0/2426018037 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb350002d80 con 0x556282369cc0 2023-10-06T01:39:49.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.905+0000 7fb346ffd700 1 -- 172.21.15.69:0/2426018037 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb350016480 con 0x556282369cc0 2023-10-06T01:39:49.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.905+0000 7fb377f33b80 1 -- 172.21.15.69:0/2426018037 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55628235d940 con 0x556282369cc0 2023-10-06T01:39:49.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.905+0000 7fb346ffd700 1 -- 172.21.15.69:0/2426018037 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb350016850 con 0x556282369cc0 2023-10-06T01:39:49.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.905+0000 7fb377f33b80 10 client.5268 fetch_fsmap learned FSMap version 17 2023-10-06T01:39:49.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.905+0000 7fb377f33b80 1 -- 172.21.15.69:0/2426018037 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x5562820f5fe0 con 0x556282369cc0 2023-10-06T01:39:49.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.905+0000 7fb346ffd700 1 -- 172.21.15.69:0/2426018037 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55628235d940 con 0x556282369cc0 2023-10-06T01:39:49.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.905+0000 7fb346ffd700 1 -- 172.21.15.69:0/2426018037 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb3500169b0 con 0x556282369cc0 2023-10-06T01:39:49.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.905+0000 7fb377f33b80 10 client.5268 fetch_fsmap finished waiting for FSMap version 17 2023-10-06T01:39:49.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.905+0000 7fb377f33b80 10 client.5268 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T01:39:49.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.905+0000 7fb377f33b80 20 client.5268 populate_metadata read hostname 'smithi069' 2023-10-06T01:39:49.915 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.905+0000 7fb377f33b80 1 --2- 172.21.15.69:0/2426018037 >> [v2:172.21.15.88:6832/3221701951,v1:172.21.15.88:6834/3221701951] conn(0x5562823bf3f0 0x5562823bf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.905+0000 7fb377f33b80 4 client.5268 mds_command: new command op to 5037 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-06T01:39:49.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.905+0000 7fb377f33b80 1 -- 172.21.15.69:0/2426018037 --> [v2:172.21.15.88:6832/3221701951,v1:172.21.15.88:6834/3221701951] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55628233a870 con 0x5562823bf3f0 2023-10-06T01:39:49.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.905+0000 7fb36c9d7700 1 --2- 172.21.15.69:0/2426018037 >> [v2:172.21.15.88:6832/3221701951,v1:172.21.15.88:6834/3221701951] conn(0x5562823bf3f0 0x5562823bf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:49.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.906+0000 7fb346ffd700 10 client.5268 ms_handle_connect on v2:172.21.15.88:6832/3221701951 2023-10-06T01:39:49.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.906+0000 7fb36c9d7700 1 --2- 172.21.15.69:0/2426018037 >> [v2:172.21.15.88:6832/3221701951,v1:172.21.15.88:6834/3221701951] conn(0x5562823bf3f0 0x5562823bf7c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4993302b9634c97 server_cookie=407b09fa19ad1901 in_seq=0 out_seq=0 2023-10-06T01:39:49.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.907+0000 7fb346ffd700 1 -- 172.21.15.69:0/2426018037 <== mds.0 v2:172.21.15.88:6832/3221701951 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55628233a870 con 0x5562823bf3f0 2023-10-06T01:39:49.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.907+0000 7fb346ffd700 10 client.5268 handle_command_reply: tid=0 2023-10-06T01:39:49.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.907+0000 7fb377f33b80 1 client.5268 shutdown 2023-10-06T01:39:49.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.907+0000 7fb377f33b80 1 -- 172.21.15.69:0/2426018037 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282369cc0 msgr2=0x5562823ab2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:49.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.907+0000 7fb377f33b80 1 --2- 172.21.15.69:0/2426018037 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282369cc0 0x5562823ab2d0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb350003ec0 tx=0x7fb350009040 comp rx=0 tx=0).stop 2023-10-06T01:39:49.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.907+0000 7fb377f33b80 1 -- 172.21.15.69:0/2426018037 shutdown_connections 2023-10-06T01:39:49.916 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.907+0000 7fb377f33b80 1 --2- 172.21.15.69:0/2426018037 >> [v2:172.21.15.88:6832/3221701951,v1:172.21.15.88:6834/3221701951] conn(0x5562823bf3f0 0x5562823bf7c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.907+0000 7fb377f33b80 1 --2- 172.21.15.69:0/2426018037 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5562823b8c00 0x5562823ab810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.907+0000 7fb346ffd700 0 client.5268 ms_handle_reset on v2:172.21.15.88:6832/3221701951 2023-10-06T01:39:49.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.907+0000 7fb377f33b80 1 --2- 172.21.15.69:0/2426018037 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x556282368840 0x556282392cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.907+0000 7fb377f33b80 1 --2- 172.21.15.69:0/2426018037 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282369cc0 0x5562823ab2d0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.907+0000 7fb377f33b80 1 -- 172.21.15.69:0/2426018037 >> 172.21.15.69:0/2426018037 conn(0x55628236a160 msgr2=0x556282391a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:49.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.907+0000 7fb377f33b80 1 -- 172.21.15.69:0/2426018037 shutdown_connections 2023-10-06T01:39:49.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.907+0000 7fb377f33b80 1 -- 172.21.15.69:0/2426018037 wait complete. 2023-10-06T01:39:49.917 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.907+0000 7fb377f33b80 20 client.5268 trim_cache size 0 max 16384 2023-10-06T01:39:49.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.924+0000 7fb377f33b80 1 Processor -- start 2023-10-06T01:39:49.924 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.924+0000 7fb377f33b80 1 -- start start 2023-10-06T01:39:49.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.925+0000 7fb377f33b80 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x556282368840 0x55628236a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.925+0000 7fb377f33b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282369cc0 0x5562823c17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.925+0000 7fb377f33b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5562823b8c00 0x5562823c1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.925+0000 7fb377f33b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562823bee20 con 0x556282369cc0 2023-10-06T01:39:49.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.925+0000 7fb377f33b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562823ad960 con 0x5562823b8c00 2023-10-06T01:39:49.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.925+0000 7fb377f33b80 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x5562823411e0 con 0x556282368840 2023-10-06T01:39:49.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.925+0000 7fb367fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282369cc0 0x5562823c17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:49.927 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.925+0000 7fb367fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282369cc0 0x5562823c17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50054/0 (socket says 172.21.15.69:50054) 2023-10-06T01:39:49.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.925+0000 7fb367fff700 1 -- 172.21.15.69:0/1022042771 learned_addr learned my addr 172.21.15.69:0/1022042771 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:49.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.925+0000 7fb367fff700 1 -- 172.21.15.69:0/1022042771 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x556282368840 msgr2=0x55628236a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:49.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.925+0000 7fb367fff700 1 --2- 172.21.15.69:0/1022042771 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x556282368840 0x55628236a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.925+0000 7fb367fff700 1 -- 172.21.15.69:0/1022042771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5562823b8c00 msgr2=0x5562823c1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:49.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.925+0000 7fb367fff700 1 --2- 172.21.15.69:0/1022042771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5562823b8c00 0x5562823c1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.925+0000 7fb367fff700 1 -- 172.21.15.69:0/1022042771 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556282287780 con 0x556282369cc0 2023-10-06T01:39:49.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.925+0000 7fb367fff700 1 --2- 172.21.15.69:0/1022042771 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282369cc0 0x5562823c17d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb350003e90 tx=0x7fb35001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=520af8e8548c4776 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:49.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.925+0000 7fb35e7fc700 1 -- 172.21.15.69:0/1022042771 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb350016480 con 0x556282369cc0 2023-10-06T01:39:49.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.925+0000 7fb35e7fc700 1 -- 172.21.15.69:0/1022042771 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35002b070 con 0x556282369cc0 2023-10-06T01:39:49.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.925+0000 7fb35e7fc700 1 -- 172.21.15.69:0/1022042771 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb350002d80 con 0x556282369cc0 2023-10-06T01:39:49.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.926+0000 7fb377f33b80 1 -- 172.21.15.69:0/1022042771 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282369cc0 msgr2=0x5562823c17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:49.928 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.926+0000 7fb377f33b80 1 --2- 172.21.15.69:0/1022042771 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282369cc0 0x5562823c17d0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb350003e90 tx=0x7fb35001b000 comp rx=0 tx=0).stop 2023-10-06T01:39:49.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.926+0000 7fb377f33b80 1 -- 172.21.15.69:0/1022042771 shutdown_connections 2023-10-06T01:39:49.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.926+0000 7fb377f33b80 1 --2- 172.21.15.69:0/1022042771 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5562823b8c00 0x5562823c1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.926+0000 7fb377f33b80 1 --2- 172.21.15.69:0/1022042771 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x556282368840 0x55628236a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.926+0000 7fb377f33b80 1 --2- 172.21.15.69:0/1022042771 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282369cc0 0x5562823c17d0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.926+0000 7fb377f33b80 1 -- 172.21.15.69:0/1022042771 >> 172.21.15.69:0/1022042771 conn(0x55628236a160 msgr2=0x556282361280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:49.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.926+0000 7fb377f33b80 1 -- 172.21.15.69:0/1022042771 shutdown_connections 2023-10-06T01:39:49.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.926+0000 7fb377f33b80 1 -- 172.21.15.69:0/1022042771 wait complete. 2023-10-06T01:39:49.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.926+0000 7fb377f33b80 1 -- start start 2023-10-06T01:39:49.929 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.927+0000 7fb377f33b80 1 Processor -- start 2023-10-06T01:39:49.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.927+0000 7fb377f33b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282368840 0x5562824147b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.927+0000 7fb377f33b80 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x556282369cc0 0x5562823ac6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.927+0000 7fb377f33b80 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5562823b8c00 0x5562823acc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.927+0000 7fb377f33b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562823b4fc0 con 0x556282368840 2023-10-06T01:39:49.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.927+0000 7fb377f33b80 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x5562823b52a0 con 0x5562823b8c00 2023-10-06T01:39:49.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.927+0000 7fb377f33b80 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x556282414cf0 con 0x556282369cc0 2023-10-06T01:39:49.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.927+0000 7fb377f33b80 10 client.0 _ll_register_callbacks cb 0x55628232be70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-06T01:39:49.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.927+0000 7fb36c9d7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282368840 0x5562824147b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:49.933 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.928+0000 7fb36c9d7700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282368840 0x5562824147b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50066/0 (socket says 172.21.15.69:50066) 2023-10-06T01:39:49.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.928+0000 7fb36c9d7700 1 -- 172.21.15.69:0/1123035692 learned_addr learned my addr 172.21.15.69:0/1123035692 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:49.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.928+0000 7fb36c9d7700 1 -- 172.21.15.69:0/1123035692 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x556282369cc0 msgr2=0x5562823ac6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:49.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.928+0000 7fb36c9d7700 1 --2- 172.21.15.69:0/1123035692 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x556282369cc0 0x5562823ac6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.928+0000 7fb36c9d7700 1 -- 172.21.15.69:0/1123035692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5562823b8c00 msgr2=0x5562823acc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:49.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.928+0000 7fb36c9d7700 1 --2- 172.21.15.69:0/1123035692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5562823b8c00 0x5562823acc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.928+0000 7fb36c9d7700 1 -- 172.21.15.69:0/1123035692 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5562820f5fe0 con 0x556282368840 2023-10-06T01:39:49.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.928+0000 7fb36c9d7700 1 --2- 172.21.15.69:0/1123035692 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282368840 0x5562824147b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb358017780 tx=0x7fb358034250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4342a8488d981f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:49.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.928+0000 7fb346ffd700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2023-10-06T01:39:49.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.928+0000 7fb346ffd700 1 -- 172.21.15.69:0/1123035692 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb358031070 con 0x556282368840 2023-10-06T01:39:49.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.928+0000 7fb346ffd700 1 -- 172.21.15.69:0/1123035692 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb358038c30 con 0x556282368840 2023-10-06T01:39:49.934 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.928+0000 7fb377f33b80 1 -- 172.21.15.69:0/1123035692 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb35801b070 con 0x556282368840 2023-10-06T01:39:49.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.928+0000 7fb346ffd700 1 -- 172.21.15.69:0/1123035692 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb35800e040 con 0x556282368840 2023-10-06T01:39:49.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.928+0000 7fb377f33b80 10 client.5274 fetch_fsmap learned FSMap version 17 2023-10-06T01:39:49.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.928+0000 7fb377f33b80 1 -- 172.21.15.69:0/1123035692 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x55628226e470 con 0x556282368840 2023-10-06T01:39:49.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.928+0000 7fb346ffd700 1 -- 172.21.15.69:0/1123035692 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb35801b070 con 0x556282368840 2023-10-06T01:39:49.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.928+0000 7fb346ffd700 1 -- 172.21.15.69:0/1123035692 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 17) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb358022440 con 0x556282368840 2023-10-06T01:39:49.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.928+0000 7fb377f33b80 10 client.5274 fetch_fsmap finished waiting for FSMap version 17 2023-10-06T01:39:49.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.928+0000 7fb377f33b80 10 client.5274 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-06T01:39:49.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.928+0000 7fb377f33b80 20 client.5274 populate_metadata read hostname 'smithi069' 2023-10-06T01:39:49.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.928+0000 7fb377f33b80 1 --2- 172.21.15.69:0/1123035692 >> [v2:172.21.15.88:6832/3221701951,v1:172.21.15.88:6834/3221701951] conn(0x5562823b7860 0x5562823b7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:49.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.928+0000 7fb377f33b80 4 client.5274 mds_command: new command op to 5037 tid=0[{"prefix": "status"}] 2023-10-06T01:39:49.935 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.928+0000 7fb377f33b80 1 -- 172.21.15.69:0/1123035692 --> [v2:172.21.15.88:6832/3221701951,v1:172.21.15.88:6834/3221701951] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55628225be00 con 0x5562823b7860 2023-10-06T01:39:49.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.929+0000 7fb367fff700 1 --2- 172.21.15.69:0/1123035692 >> [v2:172.21.15.88:6832/3221701951,v1:172.21.15.88:6834/3221701951] conn(0x5562823b7860 0x5562823b7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:49.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.929+0000 7fb346ffd700 10 client.5274 ms_handle_connect on v2:172.21.15.88:6832/3221701951 2023-10-06T01:39:49.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.929+0000 7fb367fff700 1 --2- 172.21.15.69:0/1123035692 >> [v2:172.21.15.88:6832/3221701951,v1:172.21.15.88:6834/3221701951] conn(0x5562823b7860 0x5562823b7c30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1e4f136b39ff4a1 server_cookie=ae349ecbc87b0ada in_seq=0 out_seq=0 2023-10-06T01:39:49.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.929+0000 7fb346ffd700 1 -- 172.21.15.69:0/1123035692 <== mds.0 v2:172.21.15.88:6832/3221701951 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x55628225be00 con 0x5562823b7860 2023-10-06T01:39:49.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.929+0000 7fb346ffd700 10 client.5274 handle_command_reply: tid=0 2023-10-06T01:39:49.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.929+0000 7fb377f33b80 1 client.5274 shutdown 2023-10-06T01:39:49.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.929+0000 7fb377f33b80 1 -- 172.21.15.69:0/1123035692 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282368840 msgr2=0x5562824147b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:49.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.929+0000 7fb377f33b80 1 --2- 172.21.15.69:0/1123035692 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282368840 0x5562824147b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb358017780 tx=0x7fb358034250 comp rx=0 tx=0).stop 2023-10-06T01:39:49.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.929+0000 7fb377f33b80 1 -- 172.21.15.69:0/1123035692 shutdown_connections 2023-10-06T01:39:49.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.929+0000 7fb377f33b80 1 --2- 172.21.15.69:0/1123035692 >> [v2:172.21.15.88:6832/3221701951,v1:172.21.15.88:6834/3221701951] conn(0x5562823b7860 0x5562823b7c30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.936 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.929+0000 7fb377f33b80 1 --2- 172.21.15.69:0/1123035692 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x5562823b8c00 0x5562823acc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.929+0000 7fb377f33b80 1 --2- 172.21.15.69:0/1123035692 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556282368840 0x5562824147b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.929+0000 7fb346ffd700 0 client.5274 ms_handle_reset on v2:172.21.15.88:6832/3221701951 2023-10-06T01:39:49.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.929+0000 7fb377f33b80 1 --2- 172.21.15.69:0/1123035692 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x556282369cc0 0x5562823ac6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.929+0000 7fb377f33b80 1 -- 172.21.15.69:0/1123035692 >> 172.21.15.69:0/1123035692 conn(0x55628236a160 msgr2=0x5562823c17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:49.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.929+0000 7fb377f33b80 1 -- 172.21.15.69:0/1123035692 shutdown_connections 2023-10-06T01:39:49.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.929+0000 7fb377f33b80 1 -- 172.21.15.69:0/1123035692 wait complete. 2023-10-06T01:39:49.937 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.930+0000 7fb377f33b80 20 client.5274 trim_cache size 0 max 16384 2023-10-06T01:39:49.937 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-10-06T01:39:49.937 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6", 2023-10-06T01:39:49.938 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 0, 2023-10-06T01:39:49.938 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 5037, 2023-10-06T01:39:49.938 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2023-10-06T01:39:49.938 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2023-10-06T01:39:49.938 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2023-10-06T01:39:49.938 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 10.321680009, 2023-10-06T01:39:49.938 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 17, 2023-10-06T01:39:49.938 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 35, 2023-10-06T01:39:49.938 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 35, 2023-10-06T01:39:49.938 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 18.201651382000001 2023-10-06T01:39:49.939 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-10-06T01:39:49.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.930+0000 7fb36ec3b700 1 -- 172.21.15.69:0/3514421670 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb348066f30 msgr2=0x7fb3480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:49.939 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.930+0000 7fb36ec3b700 1 --2- 172.21.15.69:0/3514421670 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb348066f30 0x7fb3480693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb358003440 tx=0x7fb35800b040 comp rx=0 tx=0).stop 2023-10-06T01:39:49.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.930+0000 7fb36ec3b700 1 -- 172.21.15.69:0/3514421670 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3680b3dc0 msgr2=0x7fb3680b4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:49.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.930+0000 7fb36ec3b700 1 --2- 172.21.15.69:0/3514421670 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3680b3dc0 0x7fb3680b4240 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fb3680cbeb0 tx=0x7fb360013000 comp rx=0 tx=0).stop 2023-10-06T01:39:49.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.930+0000 7fb36ec3b700 1 -- 172.21.15.69:0/3514421670 shutdown_connections 2023-10-06T01:39:49.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.930+0000 7fb36ec3b700 1 --2- 172.21.15.69:0/3514421670 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb348066f30 0x7fb3480693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.930+0000 7fb36ec3b700 1 --2- 172.21.15.69:0/3514421670 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb3680b3dc0 0x7fb3680b4240 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.930+0000 7fb36ec3b700 1 --2- 172.21.15.69:0/3514421670 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb3540051c0 0x7fb3680cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.930+0000 7fb36ec3b700 1 --2- 172.21.15.69:0/3514421670 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb3680c8c50 0x7fb3680c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:49.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.930+0000 7fb36ec3b700 1 -- 172.21.15.69:0/3514421670 >> 172.21.15.69:0/3514421670 conn(0x7fb368070e30 msgr2=0x7fb368155c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:49.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.930+0000 7fb36ec3b700 1 -- 172.21.15.69:0/3514421670 shutdown_connections 2023-10-06T01:39:49.940 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:49.930+0000 7fb36ec3b700 1 -- 172.21.15.69:0/3514421670 wait complete. 2023-10-06T01:39:49.942 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T01:39:50.055 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.055+0000 7f8014e58700 1 Processor -- start 2023-10-06T01:39:50.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.055+0000 7f8014e58700 1 -- start start 2023-10-06T01:39:50.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.056+0000 7f8014e58700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f80100cb970 0x7f8010159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:50.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.056+0000 7f8014e58700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f801015a400 0x7f8010156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:50.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.056+0000 7f8014e58700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f801015ae40 con 0x7f80100cb5a0 2023-10-06T01:39:50.058 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.056+0000 7f8014e58700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80100ce0f0 con 0x7f80100cb970 2023-10-06T01:39:50.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.056+0000 7f8014e58700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80100d13f0 con 0x7f801015a400 2023-10-06T01:39:50.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.056+0000 7f800dd9b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f80100cb970 0x7f8010159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:50.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.056+0000 7f800dd9b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f80100cb970 0x7f8010159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50082/0 (socket says 172.21.15.69:50082) 2023-10-06T01:39:50.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.056+0000 7f800e59c700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f80100cb5a0 0x7f80100cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:55056/0 (socket says 172.21.15.69:55056) 2023-10-06T01:39:50.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.056+0000 7f800dd9b700 1 -- 172.21.15.69:0/1812319200 learned_addr learned my addr 172.21.15.69:0/1812319200 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:50.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.056+0000 7f800ed9d700 1 --2- 172.21.15.69:0/1812319200 >> v2:172.21.15.88:3300/0 conn(0x7f801015a400 0x7f8010156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:50.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.056+0000 7f800dd9b700 1 -- 172.21.15.69:0/1812319200 >> v2:172.21.15.88:3300/0 conn(0x7f801015a400 msgr2=0x7f8010156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:50.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.056+0000 7f800dd9b700 1 --2- 172.21.15.69:0/1812319200 >> v2:172.21.15.88:3300/0 conn(0x7f801015a400 0x7f8010156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:50.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.056+0000 7f800dd9b700 1 -- 172.21.15.69:0/1812319200 >> v1:172.21.15.69:6789/0 conn(0x7f80100cb5a0 legacy=0x7f80100cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:50.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.057+0000 7f800dd9b700 1 -- 172.21.15.69:0/1812319200 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f801015ab60 con 0x7f80100cb970 2023-10-06T01:39:50.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.057+0000 7f800d59a700 1 -- 172.21.15.69:0/1812319200 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901929095 0 0) 0x7f801015ae40 con 0x7f80100cb5a0 2023-10-06T01:39:50.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.057+0000 7f800dd9b700 1 --2- 172.21.15.69:0/1812319200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80100cb970 0x7f8010159ec0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f80100ccdf0 tx=0x7f7ff8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c28cc43a451dbed0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:50.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.057+0000 7f800d59a700 1 -- 172.21.15.69:0/1812319200 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff800b860 con 0x7f80100cb970 2023-10-06T01:39:50.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.057+0000 7f800d59a700 1 -- 172.21.15.69:0/1812319200 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff800b9c0 con 0x7f80100cb970 2023-10-06T01:39:50.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.057+0000 7f800d59a700 1 -- 172.21.15.69:0/1812319200 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff800bd60 con 0x7f80100cb970 2023-10-06T01:39:50.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.057+0000 7f8014e58700 1 -- 172.21.15.69:0/1812319200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80100cb970 msgr2=0x7f8010159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:50.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.057+0000 7f8014e58700 1 --2- 172.21.15.69:0/1812319200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80100cb970 0x7f8010159ec0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f80100ccdf0 tx=0x7f7ff8009250 comp rx=0 tx=0).stop 2023-10-06T01:39:50.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.057+0000 7f8014e58700 1 -- 172.21.15.69:0/1812319200 shutdown_connections 2023-10-06T01:39:50.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.057+0000 7f8014e58700 1 --2- 172.21.15.69:0/1812319200 >> v2:172.21.15.88:3300/0 conn(0x7f801015a400 0x7f8010156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:50.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.057+0000 7f8014e58700 1 --2- 172.21.15.69:0/1812319200 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80100cb970 0x7f8010159ec0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:50.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.057+0000 7f8014e58700 1 -- 172.21.15.69:0/1812319200 >> 172.21.15.69:0/1812319200 conn(0x7f8010070e30 msgr2=0x7f80100d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:50.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.057+0000 7f8014e58700 1 -- 172.21.15.69:0/1812319200 shutdown_connections 2023-10-06T01:39:50.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.058+0000 7f8014e58700 1 -- 172.21.15.69:0/1812319200 wait complete. 2023-10-06T01:39:50.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.059+0000 7f8014e58700 1 Processor -- start 2023-10-06T01:39:50.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.059+0000 7f8014e58700 1 -- start start 2023-10-06T01:39:50.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.059+0000 7f8014e58700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80100cb5a0 0x7f80100ca150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:50.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.059+0000 7f8014e58700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80100cb970 0x7f801015b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:50.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.059+0000 7f8014e58700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801015a400 0x7f80101513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:50.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.059+0000 7f8014e58700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801015c440 con 0x7f80100cb970 2023-10-06T01:39:50.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.059+0000 7f8014e58700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f801015b5b0 con 0x7f801015a400 2023-10-06T01:39:50.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.059+0000 7f8014e58700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f801015b830 con 0x7f80100cb5a0 2023-10-06T01:39:50.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.059+0000 7f800dd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80100cb970 0x7f801015b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:50.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.059+0000 7f800dd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80100cb970 0x7f801015b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50094/0 (socket says 172.21.15.69:50094) 2023-10-06T01:39:50.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.059+0000 7f800dd9b700 1 -- 172.21.15.69:0/3226836701 learned_addr learned my addr 172.21.15.69:0/3226836701 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:50.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.059+0000 7f800e59c700 1 --2- 172.21.15.69:0/3226836701 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80100cb5a0 0x7f80100ca150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:50.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.060+0000 7f800ed9d700 1 --2- 172.21.15.69:0/3226836701 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801015a400 0x7f80101513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:50.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.060+0000 7f800dd9b700 1 -- 172.21.15.69:0/3226836701 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80100cb5a0 msgr2=0x7f80100ca150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:50.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.060+0000 7f800dd9b700 1 --2- 172.21.15.69:0/3226836701 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80100cb5a0 0x7f80100ca150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:50.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.060+0000 7f800dd9b700 1 -- 172.21.15.69:0/3226836701 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801015a400 msgr2=0x7f80101513e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:50.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.060+0000 7f800dd9b700 1 --2- 172.21.15.69:0/3226836701 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801015a400 0x7f80101513e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:50.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.060+0000 7f800dd9b700 1 -- 172.21.15.69:0/3226836701 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff80094f0 con 0x7f80100cb970 2023-10-06T01:39:50.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.060+0000 7f800ed9d700 1 --2- 172.21.15.69:0/3226836701 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801015a400 0x7f80101513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:50.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.060+0000 7f800dd9b700 1 --2- 172.21.15.69:0/3226836701 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80100cb970 0x7f801015b070 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8006f50 tx=0x7f7ff8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:50.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.060+0000 7f80067fc700 1 -- 172.21.15.69:0/3226836701 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff8024440 con 0x7f80100cb970 2023-10-06T01:39:50.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.060+0000 7f80067fc700 1 -- 172.21.15.69:0/3226836701 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff80245e0 con 0x7f80100cb970 2023-10-06T01:39:50.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.060+0000 7f8014e58700 1 -- 172.21.15.69:0/3226836701 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f801015bb10 con 0x7f80100cb970 2023-10-06T01:39:50.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.060+0000 7f80067fc700 1 -- 172.21.15.69:0/3226836701 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff80249a0 con 0x7f80100cb970 2023-10-06T01:39:50.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.060+0000 7f8014e58700 1 -- 172.21.15.69:0/3226836701 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f801015c0d0 con 0x7f80100cb970 2023-10-06T01:39:50.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.061+0000 7f8014e58700 1 -- 172.21.15.69:0/3226836701 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f801004c3c0 con 0x7f80100cb970 2023-10-06T01:39:50.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.062+0000 7f80067fc700 1 -- 172.21.15.69:0/3226836701 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7ff8024d50 con 0x7f80100cb970 2023-10-06T01:39:50.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.062+0000 7f80067fc700 1 --2- 172.21.15.69:0/3226836701 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7ff0066f30 0x7f7ff00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:50.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.062+0000 7f80067fc700 1 -- 172.21.15.69:0/3226836701 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f7ff80861d0 con 0x7f80100cb970 2023-10-06T01:39:50.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.062+0000 7f800e59c700 1 --2- 172.21.15.69:0/3226836701 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7ff0066f30 0x7f7ff00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:50.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.062+0000 7f800e59c700 1 --2- 172.21.15.69:0/3226836701 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7ff0066f30 0x7f7ff00693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8000001560 tx=0x7f8000001b00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:50.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.066+0000 7f80067fc700 1 -- 172.21.15.69:0/3226836701 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ff80532e0 con 0x7f80100cb970 2023-10-06T01:39:50.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.293+0000 7f8014e58700 1 -- 172.21.15.69:0/3226836701 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f80100ccf00 con 0x7f80100cb970 2023-10-06T01:39:50.293 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.293+0000 7f80067fc700 1 -- 172.21.15.69:0/3226836701 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7ff8056900 con 0x7f80100cb970 2023-10-06T01:39:50.294 INFO:teuthology.orchestra.run.smithi069.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T01:39:50.295 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.295+0000 7f8014e58700 1 -- 172.21.15.69:0/3226836701 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7ff0066f30 msgr2=0x7f7ff00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:50.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.295+0000 7f8014e58700 1 --2- 172.21.15.69:0/3226836701 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7ff0066f30 0x7f7ff00693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8000001560 tx=0x7f8000001b00 comp rx=0 tx=0).stop 2023-10-06T01:39:50.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.295+0000 7f8014e58700 1 -- 172.21.15.69:0/3226836701 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80100cb970 msgr2=0x7f801015b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:50.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.295+0000 7f8014e58700 1 --2- 172.21.15.69:0/3226836701 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80100cb970 0x7f801015b070 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8006f50 tx=0x7f7ff8017000 comp rx=0 tx=0).stop 2023-10-06T01:39:50.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.295+0000 7f8014e58700 1 -- 172.21.15.69:0/3226836701 shutdown_connections 2023-10-06T01:39:50.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.295+0000 7f8014e58700 1 --2- 172.21.15.69:0/3226836701 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7ff0066f30 0x7f7ff00693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:50.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.295+0000 7f8014e58700 1 --2- 172.21.15.69:0/3226836701 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f801015a400 0x7f80101513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:50.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.295+0000 7f8014e58700 1 --2- 172.21.15.69:0/3226836701 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f80100cb5a0 0x7f80100ca150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:50.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.295+0000 7f8014e58700 1 --2- 172.21.15.69:0/3226836701 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80100cb970 0x7f801015b070 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:50.296 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.295+0000 7f8014e58700 1 -- 172.21.15.69:0/3226836701 >> 172.21.15.69:0/3226836701 conn(0x7f8010070e30 msgr2=0x7f80100b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:50.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.295+0000 7f8014e58700 1 -- 172.21.15.69:0/3226836701 shutdown_connections 2023-10-06T01:39:50.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:50.295+0000 7f8014e58700 1 -- 172.21.15.69:0/3226836701 wait complete. 2023-10-06T01:39:50.307 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T01:39:50.307 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T01:39:50.307 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi069.front.sepia.ceph.com 2023-10-06T01:39:50.307 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-06T01:39:50.307 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-06T01:39:50.307 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T01:39:50.307 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T01:39:50.308 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T01:39:50.308 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T01:39:50.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:50.308 DEBUG:teuthology.orchestra.run.smithi069:> ip addr 2023-10-06T01:39:50.323 INFO:teuthology.orchestra.run.smithi069.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:39:50.323 INFO:teuthology.orchestra.run.smithi069.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:39:50.324 INFO:teuthology.orchestra.run.smithi069.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:39:50.324 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:50.324 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 ::1/128 scope host 2023-10-06T01:39:50.324 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:50.324 INFO:teuthology.orchestra.run.smithi069.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:39:50.325 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c2 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:50.325 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f0 2023-10-06T01:39:50.325 INFO:teuthology.orchestra.run.smithi069.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:39:50.326 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c3 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:50.326 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f1 2023-10-06T01:39:50.326 INFO:teuthology.orchestra.run.smithi069.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:39:50.326 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:36 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:50.326 INFO:teuthology.orchestra.run.smithi069.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T01:39:50.327 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:37 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:50.327 INFO:teuthology.orchestra.run.smithi069.stdout: inet 172.21.15.69/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T01:39:50.327 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft 42443sec preferred_lft 42443sec 2023-10-06T01:39:50.327 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::ec4:7aff:fe8f:d737/64 scope link 2023-10-06T01:39:50.327 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:50.328 INFO:teuthology.orchestra.run.smithi069.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T01:39:50.328 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 06:72:8e:36:69:38 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:50.328 INFO:teuthology.orchestra.run.smithi069.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T01:39:50.328 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:50.328 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::1803:a1ff:fe9b:457b/64 scope link 2023-10-06T01:39:50.329 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:50.329 INFO:teuthology.orchestra.run.smithi069.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T01:39:50.329 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 06:72:8e:36:69:38 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T01:39:50.329 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::472:8eff:fe36:6938/64 scope link 2023-10-06T01:39:50.329 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:50.330 INFO:teuthology.orchestra.run.smithi069.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T01:39:50.330 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether fe:67:53:20:82:e1 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T01:39:50.330 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::fc67:53ff:fe20:82e1/64 scope link 2023-10-06T01:39:50.330 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:50.331 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:50.331 DEBUG:teuthology.orchestra.run.smithi069:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T01:39:50.386 INFO:teuthology.orchestra.run.smithi069.stdout:1 2023-10-06T01:39:50.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:50.388 DEBUG:teuthology.orchestra.run.smithi069:> route 2023-10-06T01:39:50.444 INFO:teuthology.orchestra.run.smithi069.stdout:Kernel IP routing table 2023-10-06T01:39:50.445 INFO:teuthology.orchestra.run.smithi069.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T01:39:50.445 INFO:teuthology.orchestra.run.smithi069.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T01:39:50.445 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T01:39:50.445 INFO:teuthology.orchestra.run.smithi069.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T01:39:50.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:50.445 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec bash -c ' 2023-10-06T01:39:50.445 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2023-10-06T01:39:50.446 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T01:39:50.446 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T01:39:50.446 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T01:39:50.446 DEBUG:teuthology.orchestra.run.smithi069:> ') 2023-10-06T01:39:50.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:50.545 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2023-10-06T01:39:50.559 INFO:teuthology.orchestra.run.smithi069.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T01:39:50.559 INFO:teuthology.orchestra.run.smithi069.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T01:39:50.560 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-06T01:39:50.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:50.560 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set brx.0 up 2023-10-06T01:39:50.624 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:39:50.624 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-06T01:39:50.679 INFO:teuthology.orchestra.run.smithi069.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-06T01:39:50.679 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:39:50.679 DEBUG:teuthology.orchestra.run.smithi069:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-06T01:39:50.734 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2023-10-06T01:39:50.734 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T01:39:50.735 DEBUG:teuthology.orchestra.run.smithi069:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T01:39:50.813 INFO:teuthology.orchestra.run.smithi069.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T01:39:50.814 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T01:39:50.832 INFO:teuthology.orchestra.run.smithi069.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T01:39:50.832 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T01:39:50.832 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: resolved to: "172.21.15.69:3300,172.21.15.88:3300,172.21.15.88:3301" 2023-10-06T01:39:50.833 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: trying mount with new device syntax: 0@c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6.cephfs=/ 2023-10-06T01:39:50.833 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.69:3300/172.21.15.88:3300/172.21.15.88:3301" will pass to kernel 2023-10-06T01:39:50.833 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T01:39:50.833 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T01:39:50.833 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T01:39:50.855 INFO:teuthology.orchestra.run.smithi069.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T01:39:50.855 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T01:39:50.855 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: resolved to: "172.21.15.69:3300,172.21.15.88:3300,172.21.15.88:3301" 2023-10-06T01:39:50.855 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: trying mount with new device syntax: 0@c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6.cephfs=/ 2023-10-06T01:39:50.856 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.69:3300/172.21.15.88:3300/172.21.15.88:3301" will pass to kernel 2023-10-06T01:39:50.856 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T01:39:50.856 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T01:39:50.856 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T01:39:50.856 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: resolved to: "172.21.15.69:6789,172.21.15.88:6789,172.21.15.88:6790" 2023-10-06T01:39:50.856 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.69:6789,172.21.15.88:6789,172.21.15.88:6790:/ 2023-10-06T01:39:50.856 INFO:teuthology.orchestra.run.smithi069.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,key=0,mds_namespace=cephfs,fsid=c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6" will pass to kernel 2023-10-06T01:39:50.857 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T01:39:50.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:50.857 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-06T01:39:50.923 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-06T01:39:51.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.077+0000 7f243180e700 1 Processor -- start 2023-10-06T01:39:51.077 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.077+0000 7f243180e700 1 -- start start 2023-10-06T01:39:51.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.077+0000 7f243180e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f242c155b70 0x7f242c0b0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:51.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.077+0000 7f243180e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f242c0add80 0x7f242c0b0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:51.079 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.077+0000 7f243180e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f242c157510 con 0x7f242c159940 2023-10-06T01:39:51.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.077+0000 7f243180e700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f242c0cd120 con 0x7f242c0add80 2023-10-06T01:39:51.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.077+0000 7f243180e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242c0ae2f0 con 0x7f242c155b70 2023-10-06T01:39:51.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.078+0000 7f242a7fc700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f242c0add80 0x7f242c0b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:51.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.078+0000 7f242a7fc700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f242c0add80 0x7f242c0b0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50096/0 (socket says 172.21.15.69:50096) 2023-10-06T01:39:51.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.078+0000 7f242a7fc700 1 -- 172.21.15.69:0/1243681936 learned_addr learned my addr 172.21.15.69:0/1243681936 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:51.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.078+0000 7f242affd700 1 --2- 172.21.15.69:0/1243681936 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f242c155b70 0x7f242c0b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:51.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.078+0000 7f242a7fc700 1 -- 172.21.15.69:0/1243681936 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f242c155b70 msgr2=0x7f242c0b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:51.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.078+0000 7f242a7fc700 1 --2- 172.21.15.69:0/1243681936 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f242c155b70 0x7f242c0b0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:51.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.078+0000 7f242a7fc700 1 -- 172.21.15.69:0/1243681936 >> v1:172.21.15.88:6789/0 conn(0x7f242c159940 legacy=0x7f242c0cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:51.080 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.078+0000 7f242a7fc700 1 -- 172.21.15.69:0/1243681936 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f242c0ae5d0 con 0x7f242c0add80 2023-10-06T01:39:51.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.078+0000 7f242affd700 1 --2- 172.21.15.69:0/1243681936 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f242c155b70 0x7f242c0b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:51.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.078+0000 7f242a7fc700 1 --2- 172.21.15.69:0/1243681936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f242c0add80 0x7f242c0b0740 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f24200099b0 tx=0x7f2420009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8796b5b6d08f40e0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:51.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.078+0000 7f2429ffb700 1 -- 172.21.15.69:0/1243681936 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242000b820 con 0x7f242c0add80 2023-10-06T01:39:51.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.078+0000 7f2429ffb700 1 -- 172.21.15.69:0/1243681936 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f242000b980 con 0x7f242c0add80 2023-10-06T01:39:51.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.078+0000 7f2429ffb700 1 -- 172.21.15.69:0/1243681936 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f242000bd20 con 0x7f242c0add80 2023-10-06T01:39:51.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.079+0000 7f243180e700 1 -- 172.21.15.69:0/1243681936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f242c0add80 msgr2=0x7f242c0b0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:51.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.079+0000 7f243180e700 1 --2- 172.21.15.69:0/1243681936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f242c0add80 0x7f242c0b0740 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f24200099b0 tx=0x7f2420009250 comp rx=0 tx=0).stop 2023-10-06T01:39:51.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.079+0000 7f243180e700 1 -- 172.21.15.69:0/1243681936 shutdown_connections 2023-10-06T01:39:51.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.079+0000 7f243180e700 1 --2- 172.21.15.69:0/1243681936 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f242c155b70 0x7f242c0b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:51.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.079+0000 7f243180e700 1 --2- 172.21.15.69:0/1243681936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f242c0add80 0x7f242c0b0740 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:51.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.079+0000 7f243180e700 1 -- 172.21.15.69:0/1243681936 >> 172.21.15.69:0/1243681936 conn(0x7f242c06d170 msgr2=0x7f242c0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:51.081 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.079+0000 7f243180e700 1 -- 172.21.15.69:0/1243681936 shutdown_connections 2023-10-06T01:39:51.082 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.079+0000 7f243180e700 1 -- 172.21.15.69:0/1243681936 wait complete. 2023-10-06T01:39:51.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.080+0000 7f243180e700 1 Processor -- start 2023-10-06T01:39:51.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.080+0000 7f243180e700 1 -- start start 2023-10-06T01:39:51.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.081+0000 7f243180e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f242c0add80 0x7f242c14cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:51.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.081+0000 7f243180e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f242c155b70 0x7f242c0a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:51.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.081+0000 7f243180e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f242c159940 0x7f242c149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:51.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.081+0000 7f243180e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242c167b00 con 0x7f242c159940 2023-10-06T01:39:51.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.081+0000 7f243180e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f242c167da0 con 0x7f242c155b70 2023-10-06T01:39:51.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.081+0000 7f243180e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f242c0a5bd0 con 0x7f242c0add80 2023-10-06T01:39:51.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.081+0000 7f242b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f242c159940 0x7f242c149f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:51.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.081+0000 7f242b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f242c159940 0x7f242c149f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50108/0 (socket says 172.21.15.69:50108) 2023-10-06T01:39:51.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.081+0000 7f242b7fe700 1 -- 172.21.15.69:0/1391062923 learned_addr learned my addr 172.21.15.69:0/1391062923 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:51.085 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.081+0000 7f242a7fc700 1 --2- 172.21.15.69:0/1391062923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f242c155b70 0x7f242c0a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:51.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.081+0000 7f242affd700 1 --2- 172.21.15.69:0/1391062923 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f242c0add80 0x7f242c14cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:51.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.081+0000 7f242b7fe700 1 -- 172.21.15.69:0/1391062923 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f242c0add80 msgr2=0x7f242c14cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:51.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.081+0000 7f242b7fe700 1 --2- 172.21.15.69:0/1391062923 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f242c0add80 0x7f242c14cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:51.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.081+0000 7f242b7fe700 1 -- 172.21.15.69:0/1391062923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f242c155b70 msgr2=0x7f242c0a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:51.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.081+0000 7f242b7fe700 1 --2- 172.21.15.69:0/1391062923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f242c155b70 0x7f242c0a54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:51.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.081+0000 7f242b7fe700 1 -- 172.21.15.69:0/1391062923 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24200094f0 con 0x7f242c159940 2023-10-06T01:39:51.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.081+0000 7f242affd700 1 --2- 172.21.15.69:0/1391062923 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f242c0add80 0x7f242c14cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:51.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.081+0000 7f242b7fe700 1 --2- 172.21.15.69:0/1391062923 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f242c159940 0x7f242c149f00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f241c00c5b0 tx=0x7f241c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:51.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.081+0000 7f2412ffd700 1 -- 172.21.15.69:0/1391062923 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c011590 con 0x7f242c159940 2023-10-06T01:39:51.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.081+0000 7f2412ffd700 1 -- 172.21.15.69:0/1391062923 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241c011710 con 0x7f242c159940 2023-10-06T01:39:51.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.081+0000 7f243180e700 1 -- 172.21.15.69:0/1391062923 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f242c0a5eb0 con 0x7f242c159940 2023-10-06T01:39:51.086 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.081+0000 7f2412ffd700 1 -- 172.21.15.69:0/1391062923 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c011ad0 con 0x7f242c159940 2023-10-06T01:39:51.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.081+0000 7f243180e700 1 -- 172.21.15.69:0/1391062923 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f242c14a440 con 0x7f242c159940 2023-10-06T01:39:51.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.082+0000 7f243180e700 1 -- 172.21.15.69:0/1391062923 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f242c0a63d0 con 0x7f242c159940 2023-10-06T01:39:51.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.083+0000 7f2412ffd700 1 -- 172.21.15.69:0/1391062923 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f241c01c460 con 0x7f242c159940 2023-10-06T01:39:51.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.083+0000 7f2412ffd700 1 --2- 172.21.15.69:0/1391062923 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2418066f30 0x7f24180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:51.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.083+0000 7f2412ffd700 1 -- 172.21.15.69:0/1391062923 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f241c084290 con 0x7f242c159940 2023-10-06T01:39:51.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.083+0000 7f242affd700 1 --2- 172.21.15.69:0/1391062923 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2418066f30 0x7f24180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:51.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.084+0000 7f242affd700 1 --2- 172.21.15.69:0/1391062923 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2418066f30 0x7f24180693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f242400e4c0 tx=0x7f2424007700 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:51.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.087+0000 7f2412ffd700 1 -- 172.21.15.69:0/1391062923 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f242c0a63d0 con 0x7f242c159940 2023-10-06T01:39:51.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.315+0000 7f243180e700 1 -- 172.21.15.69:0/1391062923 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f242c0a63d0 con 0x7f242c159940 2023-10-06T01:39:51.316 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.316+0000 7f2412ffd700 1 -- 172.21.15.69:0/1391062923 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7f242c0a63d0 con 0x7f242c159940 2023-10-06T01:39:51.316 INFO:teuthology.orchestra.run.smithi069.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-06T01:39:51.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.318+0000 7f243180e700 1 -- 172.21.15.69:0/1391062923 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2418066f30 msgr2=0x7f24180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:51.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.318+0000 7f243180e700 1 --2- 172.21.15.69:0/1391062923 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2418066f30 0x7f24180693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f242400e4c0 tx=0x7f2424007700 comp rx=0 tx=0).stop 2023-10-06T01:39:51.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.318+0000 7f243180e700 1 -- 172.21.15.69:0/1391062923 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f242c159940 msgr2=0x7f242c149f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:51.318 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.318+0000 7f243180e700 1 --2- 172.21.15.69:0/1391062923 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f242c159940 0x7f242c149f00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f241c00c5b0 tx=0x7f241c007f60 comp rx=0 tx=0).stop 2023-10-06T01:39:51.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.318+0000 7f243180e700 1 -- 172.21.15.69:0/1391062923 shutdown_connections 2023-10-06T01:39:51.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.318+0000 7f243180e700 1 --2- 172.21.15.69:0/1391062923 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f2418066f30 0x7f24180693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:51.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.318+0000 7f243180e700 1 --2- 172.21.15.69:0/1391062923 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f242c159940 0x7f242c149f00 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:51.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.318+0000 7f243180e700 1 --2- 172.21.15.69:0/1391062923 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f242c0add80 0x7f242c14cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:51.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.318+0000 7f243180e700 1 --2- 172.21.15.69:0/1391062923 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f242c155b70 0x7f242c0a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:51.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.318+0000 7f243180e700 1 -- 172.21.15.69:0/1391062923 >> 172.21.15.69:0/1391062923 conn(0x7f242c06d170 msgr2=0x7f242c06b090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:51.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.318+0000 7f243180e700 1 -- 172.21.15.69:0/1391062923 shutdown_connections 2023-10-06T01:39:51.319 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:51.318+0000 7f243180e700 1 -- 172.21.15.69:0/1391062923 wait complete. 2023-10-06T01:39:51.330 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-06T01:39:51.330 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-06T01:39:51.330 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi088.front.sepia.ceph.com 2023-10-06T01:39:51.331 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-06T01:39:51.331 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-06T01:39:51.331 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-06T01:39:51.331 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-06T01:39:51.331 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-06T01:39:51.331 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T01:39:51.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:51.332 DEBUG:teuthology.orchestra.run.smithi088:> ip addr 2023-10-06T01:39:51.351 INFO:teuthology.orchestra.run.smithi088.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-06T01:39:51.351 INFO:teuthology.orchestra.run.smithi088.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-06T01:39:51.351 INFO:teuthology.orchestra.run.smithi088.stdout: inet 127.0.0.1/8 scope host lo 2023-10-06T01:39:51.352 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:51.352 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 ::1/128 scope host 2023-10-06T01:39:51.352 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:51.352 INFO:teuthology.orchestra.run.smithi088.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:39:51.352 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f0 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:51.352 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f0 2023-10-06T01:39:51.352 INFO:teuthology.orchestra.run.smithi088.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:39:51.352 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:d8:a8:f1 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:51.352 INFO:teuthology.orchestra.run.smithi088.stdout: altname enp7s0f1 2023-10-06T01:39:51.352 INFO:teuthology.orchestra.run.smithi088.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-06T01:39:51.352 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2c brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:51.352 INFO:teuthology.orchestra.run.smithi088.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-06T01:39:51.353 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 0c:c4:7a:8f:d4:2d brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:51.353 INFO:teuthology.orchestra.run.smithi088.stdout: inet 172.21.15.88/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-10-06T01:39:51.353 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft 42453sec preferred_lft 42453sec 2023-10-06T01:39:51.353 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2023-10-06T01:39:51.353 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:51.353 INFO:teuthology.orchestra.run.smithi088.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-06T01:39:51.353 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 1a:09:ff:88:37:78 brd ff:ff:ff:ff:ff:ff 2023-10-06T01:39:51.353 INFO:teuthology.orchestra.run.smithi088.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-06T01:39:51.353 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:51.354 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::a4bf:d5ff:feec:cd89/64 scope link 2023-10-06T01:39:51.354 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:51.354 INFO:teuthology.orchestra.run.smithi088.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T01:39:51.354 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether aa:11:25:2a:8f:74 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T01:39:51.354 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::a811:25ff:fe2a:8f74/64 scope link 2023-10-06T01:39:51.354 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:51.354 INFO:teuthology.orchestra.run.smithi088.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-06T01:39:51.354 INFO:teuthology.orchestra.run.smithi088.stdout: link/ether 1a:09:ff:88:37:78 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T01:39:51.354 INFO:teuthology.orchestra.run.smithi088.stdout: inet6 fe80::1809:ffff:fe88:3778/64 scope link 2023-10-06T01:39:51.354 INFO:teuthology.orchestra.run.smithi088.stdout: valid_lft forever preferred_lft forever 2023-10-06T01:39:51.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:51.355 DEBUG:teuthology.orchestra.run.smithi088:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-06T01:39:51.420 INFO:teuthology.orchestra.run.smithi088.stdout:1 2023-10-06T01:39:51.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:51.422 DEBUG:teuthology.orchestra.run.smithi088:> route 2023-10-06T01:39:51.481 INFO:teuthology.orchestra.run.smithi088.stdout:Kernel IP routing table 2023-10-06T01:39:51.482 INFO:teuthology.orchestra.run.smithi088.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-06T01:39:51.482 INFO:teuthology.orchestra.run.smithi088.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-10-06T01:39:51.482 INFO:teuthology.orchestra.run.smithi088.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-10-06T01:39:51.482 INFO:teuthology.orchestra.run.smithi088.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-06T01:39:51.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:51.482 DEBUG:teuthology.orchestra.run.smithi088:> (cd / && exec bash -c ' 2023-10-06T01:39:51.483 DEBUG:teuthology.orchestra.run.smithi088:> set -e 2023-10-06T01:39:51.483 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-10-06T01:39:51.483 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-10-06T01:39:51.483 DEBUG:teuthology.orchestra.run.smithi088:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-10-06T01:39:51.483 DEBUG:teuthology.orchestra.run.smithi088:> ') 2023-10-06T01:39:51.588 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:51.588 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-10-06T01:39:51.603 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T01:39:51.603 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T01:39:51.603 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-06T01:39:51.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:51.603 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link set brx.0 up 2023-10-06T01:39:51.669 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:39:51.669 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-06T01:39:51.723 INFO:teuthology.orchestra.run.smithi088.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-06T01:39:51.723 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-06T01:39:51.724 DEBUG:teuthology.orchestra.run.smithi088:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-06T01:39:51.778 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2023-10-06T01:39:51.778 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-06T01:39:51.778 DEBUG:teuthology.orchestra.run.smithi088:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T01:39:51.858 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T01:39:51.858 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T01:39:51.876 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T01:39:51.877 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T01:39:51.877 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: resolved to: "172.21.15.69:3300,172.21.15.88:3300,172.21.15.88:3301" 2023-10-06T01:39:51.877 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: trying mount with new device syntax: 1@c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6.cephfs=/ 2023-10-06T01:39:51.877 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.69:3300/172.21.15.88:3300/172.21.15.88:3301" will pass to kernel 2023-10-06T01:39:51.877 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T01:39:51.877 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T01:39:51.877 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T01:39:51.901 INFO:teuthology.orchestra.run.smithi088.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2023-10-06T01:39:51.901 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2023-10-06T01:39:51.901 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: resolved to: "172.21.15.69:3300,172.21.15.88:3300,172.21.15.88:3301" 2023-10-06T01:39:51.901 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: trying mount with new device syntax: 1@c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6.cephfs=/ 2023-10-06T01:39:51.902 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.69:3300/172.21.15.88:3300/172.21.15.88:3301" will pass to kernel 2023-10-06T01:39:51.902 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: v2 mount support check returned 2 2023-10-06T01:39:51.902 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: kernel does not support v2 syntax 2023-10-06T01:39:51.902 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-06T01:39:51.902 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: resolved to: "172.21.15.69:6789,172.21.15.88:6789,172.21.15.88:6790" 2023-10-06T01:39:51.902 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.69:6789,172.21.15.88:6789,172.21.15.88:6790:/ 2023-10-06T01:39:51.902 INFO:teuthology.orchestra.run.smithi088.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,key=1,mds_namespace=cephfs,fsid=c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6" will pass to kernel 2023-10-06T01:39:51.903 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-06T01:39:51.903 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:51.904 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-06T01:39:51.968 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-06T01:39:52.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.087+0000 7f584b722700 1 Processor -- start 2023-10-06T01:39:52.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.087+0000 7f584b722700 1 -- start start 2023-10-06T01:39:52.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.088+0000 7f584b722700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5844159ca0 0x7f58440cc960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:52.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.088+0000 7f584b722700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5844068710 0x7f58440c44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:52.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.088+0000 7f584b722700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58440cc4d0 con 0x7f58441598d0 2023-10-06T01:39:52.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.088+0000 7f584b722700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58440cb6d0 con 0x7f5844159ca0 2023-10-06T01:39:52.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.088+0000 7f584b722700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58440cb8c0 con 0x7f5844068710 2023-10-06T01:39:52.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.088+0000 7f5848cbd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5844159ca0 0x7f58440cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:52.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.088+0000 7f58494be700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f58441598d0 0x7f58440cafc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:55062/0 (socket says 172.21.15.69:55062) 2023-10-06T01:39:52.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.088+0000 7f58494be700 1 -- 172.21.15.69:0/1474441308 learned_addr learned my addr 172.21.15.69:0/1474441308 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:52.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.089+0000 7f5848cbd700 1 -- 172.21.15.69:0/1474441308 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5844068710 msgr2=0x7f58440c44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:52.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.089+0000 7f5848cbd700 1 --2- 172.21.15.69:0/1474441308 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5844068710 0x7f58440c44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:52.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.089+0000 7f5848cbd700 1 -- 172.21.15.69:0/1474441308 >> v1:172.21.15.69:6789/0 conn(0x7f58441598d0 legacy=0x7f58440cafc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:52.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.089+0000 7f5848cbd700 1 -- 172.21.15.69:0/1474441308 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58440cbba0 con 0x7f5844159ca0 2023-10-06T01:39:52.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.089+0000 7f5843fff700 1 -- 172.21.15.69:0/1474441308 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3533796771 0 0) 0x7f58440cc4d0 con 0x7f58441598d0 2023-10-06T01:39:52.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.089+0000 7f5848cbd700 1 --2- 172.21.15.69:0/1474441308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5844159ca0 0x7f58440cc960 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f58380098e0 tx=0x7f58380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdbf2a61cbf5c9dd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:52.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.089+0000 7f5843fff700 1 -- 172.21.15.69:0/1474441308 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5838009e80 con 0x7f5844159ca0 2023-10-06T01:39:52.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.089+0000 7f5843fff700 1 -- 172.21.15.69:0/1474441308 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583800b860 con 0x7f5844159ca0 2023-10-06T01:39:52.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.089+0000 7f5843fff700 1 -- 172.21.15.69:0/1474441308 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f583800bbe0 con 0x7f5844159ca0 2023-10-06T01:39:52.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.089+0000 7f584b722700 1 -- 172.21.15.69:0/1474441308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5844159ca0 msgr2=0x7f58440cc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:52.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.089+0000 7f584b722700 1 --2- 172.21.15.69:0/1474441308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5844159ca0 0x7f58440cc960 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f58380098e0 tx=0x7f58380091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:52.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.089+0000 7f584b722700 1 -- 172.21.15.69:0/1474441308 shutdown_connections 2023-10-06T01:39:52.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.089+0000 7f584b722700 1 --2- 172.21.15.69:0/1474441308 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5844068710 0x7f58440c44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:52.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.089+0000 7f584b722700 1 --2- 172.21.15.69:0/1474441308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5844159ca0 0x7f58440cc960 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:52.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.089+0000 7f584b722700 1 -- 172.21.15.69:0/1474441308 >> 172.21.15.69:0/1474441308 conn(0x7f58440cde40 msgr2=0x7f58440c9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:52.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.090+0000 7f584b722700 1 -- 172.21.15.69:0/1474441308 shutdown_connections 2023-10-06T01:39:52.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.090+0000 7f584b722700 1 -- 172.21.15.69:0/1474441308 wait complete. 2023-10-06T01:39:52.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.091+0000 7f584b722700 1 Processor -- start 2023-10-06T01:39:52.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.091+0000 7f584b722700 1 -- start start 2023-10-06T01:39:52.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.091+0000 7f584b722700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5844068710 0x7f58440c5db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:52.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.091+0000 7f584b722700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58441598d0 0x7f584414bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:52.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.091+0000 7f584b722700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5844159ca0 0x7f5844157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:52.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.092+0000 7f584b722700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58440c72a0 con 0x7f58441598d0 2023-10-06T01:39:52.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.092+0000 7f584b722700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58440c6690 con 0x7f5844068710 2023-10-06T01:39:52.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.092+0000 7f584b722700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58440c6970 con 0x7f5844159ca0 2023-10-06T01:39:52.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.092+0000 7f5848cbd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58441598d0 0x7f584414bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:52.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.092+0000 7f5848cbd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58441598d0 0x7f584414bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50124/0 (socket says 172.21.15.69:50124) 2023-10-06T01:39:52.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.092+0000 7f5848cbd700 1 -- 172.21.15.69:0/854777438 learned_addr learned my addr 172.21.15.69:0/854777438 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:52.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.092+0000 7f5849cbf700 1 --2- 172.21.15.69:0/854777438 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5844159ca0 0x7f5844157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:52.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.092+0000 7f5848cbd700 1 -- 172.21.15.69:0/854777438 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5844159ca0 msgr2=0x7f5844157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:52.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.092+0000 7f5848cbd700 1 --2- 172.21.15.69:0/854777438 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5844159ca0 0x7f5844157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:52.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.092+0000 7f5848cbd700 1 -- 172.21.15.69:0/854777438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5844068710 msgr2=0x7f58440c5db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:52.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.092+0000 7f5848cbd700 1 --2- 172.21.15.69:0/854777438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5844068710 0x7f58440c5db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:52.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.092+0000 7f5848cbd700 1 -- 172.21.15.69:0/854777438 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5838009420 con 0x7f58441598d0 2023-10-06T01:39:52.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.092+0000 7f5848cbd700 1 --2- 172.21.15.69:0/854777438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58441598d0 0x7f584414bdd0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f584406a480 tx=0x7f5838017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:52.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.092+0000 7f58417fa700 1 -- 172.21.15.69:0/854777438 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5838021070 con 0x7f58441598d0 2023-10-06T01:39:52.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.092+0000 7f58417fa700 1 -- 172.21.15.69:0/854777438 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f583800bb50 con 0x7f58441598d0 2023-10-06T01:39:52.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.092+0000 7f584b722700 1 -- 172.21.15.69:0/854777438 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58440c6c50 con 0x7f58441598d0 2023-10-06T01:39:52.098 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.092+0000 7f58417fa700 1 -- 172.21.15.69:0/854777438 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5838027650 con 0x7f58441598d0 2023-10-06T01:39:52.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.092+0000 7f584b722700 1 -- 172.21.15.69:0/854777438 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58440c62f0 con 0x7f58441598d0 2023-10-06T01:39:52.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.093+0000 7f584b722700 1 -- 172.21.15.69:0/854777438 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f584404c3c0 con 0x7f58441598d0 2023-10-06T01:39:52.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.094+0000 7f58417fa700 1 -- 172.21.15.69:0/854777438 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5838025070 con 0x7f58441598d0 2023-10-06T01:39:52.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.094+0000 7f58417fa700 1 --2- 172.21.15.69:0/854777438 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5830066f30 0x7f58300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:52.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.094+0000 7f58417fa700 1 -- 172.21.15.69:0/854777438 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5838087b80 con 0x7f58441598d0 2023-10-06T01:39:52.099 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.094+0000 7f58494be700 1 --2- 172.21.15.69:0/854777438 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5830066f30 0x7f58300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:52.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.094+0000 7f58494be700 1 --2- 172.21.15.69:0/854777438 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5830066f30 0x7f58300693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f583c001560 tx=0x7f583c0016c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:52.100 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.098+0000 7f58417fa700 1 -- 172.21.15.69:0/854777438 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5838054c90 con 0x7f58441598d0 2023-10-06T01:39:52.322 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.322+0000 7f584b722700 1 -- 172.21.15.69:0/854777438 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f58440cbe80 con 0x7f58441598d0 2023-10-06T01:39:52.652 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.652+0000 7f58417fa700 1 -- 172.21.15.69:0/854777438 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v18) v1 ==== 136+0+0 (secure 0 0 0) 0x7f58380582b0 con 0x7f58441598d0 2023-10-06T01:39:52.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.654+0000 7f584b722700 1 -- 172.21.15.69:0/854777438 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5830066f30 msgr2=0x7f58300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:52.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.654+0000 7f584b722700 1 --2- 172.21.15.69:0/854777438 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5830066f30 0x7f58300693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f583c001560 tx=0x7f583c0016c0 comp rx=0 tx=0).stop 2023-10-06T01:39:52.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.654+0000 7f584b722700 1 -- 172.21.15.69:0/854777438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58441598d0 msgr2=0x7f584414bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:52.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.654+0000 7f584b722700 1 --2- 172.21.15.69:0/854777438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58441598d0 0x7f584414bdd0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f584406a480 tx=0x7f5838017000 comp rx=0 tx=0).stop 2023-10-06T01:39:52.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.654+0000 7f584b722700 1 -- 172.21.15.69:0/854777438 shutdown_connections 2023-10-06T01:39:52.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.654+0000 7f584b722700 1 --2- 172.21.15.69:0/854777438 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5830066f30 0x7f58300693e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:52.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.654+0000 7f584b722700 1 --2- 172.21.15.69:0/854777438 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5844159ca0 0x7f5844157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:52.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.654+0000 7f584b722700 1 --2- 172.21.15.69:0/854777438 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5844068710 0x7f58440c5db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:52.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.654+0000 7f584b722700 1 --2- 172.21.15.69:0/854777438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58441598d0 0x7f584414bdd0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:52.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.654+0000 7f584b722700 1 -- 172.21.15.69:0/854777438 >> 172.21.15.69:0/854777438 conn(0x7f58440cde40 msgr2=0x7f5844068b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:52.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.654+0000 7f584b722700 1 -- 172.21.15.69:0/854777438 shutdown_connections 2023-10-06T01:39:52.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.654+0000 7f584b722700 1 -- 172.21.15.69:0/854777438 wait complete. 2023-10-06T01:39:52.669 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-06T01:39:52.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.786+0000 7f71bc7b3700 1 Processor -- start 2023-10-06T01:39:52.786 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.786+0000 7f71bc7b3700 1 -- start start 2023-10-06T01:39:52.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.787+0000 7f71bc7b3700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71b40cb970 0x7f71b4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:52.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.787+0000 7f71bc7b3700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f71b415a400 0x7f71b4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:52.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.787+0000 7f71bc7b3700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71b415ae40 con 0x7f71b40cb5a0 2023-10-06T01:39:52.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.787+0000 7f71bc7b3700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71b40ce0f0 con 0x7f71b415a400 2023-10-06T01:39:52.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.787+0000 7f71bc7b3700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b40cbde0 con 0x7f71b40cb970 2023-10-06T01:39:52.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.787+0000 7f71bad50700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f71b415a400 0x7f71b4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:52.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.787+0000 7f71bad50700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f71b415a400 0x7f71b4156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50134/0 (socket says 172.21.15.69:50134) 2023-10-06T01:39:52.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.787+0000 7f71bad50700 1 -- 172.21.15.69:0/1759644897 learned_addr learned my addr 172.21.15.69:0/1759644897 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:52.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.787+0000 7f71b9d4e700 1 --2- 172.21.15.69:0/1759644897 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71b40cb970 0x7f71b4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:52.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.787+0000 7f71bad50700 1 -- 172.21.15.69:0/1759644897 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71b40cb970 msgr2=0x7f71b4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:52.789 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.787+0000 7f71bad50700 1 --2- 172.21.15.69:0/1759644897 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71b40cb970 0x7f71b4159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:52.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.787+0000 7f71bad50700 1 -- 172.21.15.69:0/1759644897 >> v1:172.21.15.88:6789/0 conn(0x7f71b40cb5a0 legacy=0x7f71b40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:52.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.787+0000 7f71bad50700 1 -- 172.21.15.69:0/1759644897 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b415ab60 con 0x7f71b415a400 2023-10-06T01:39:52.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.787+0000 7f71bad50700 1 --2- 172.21.15.69:0/1759644897 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71b415a400 0x7f71b4156e90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f71ac009f50 tx=0x7f71ac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6f2a11b0a96af0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:52.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.787+0000 7f71b954d700 1 -- 172.21.15.69:0/1759644897 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac00e070 con 0x7f71b415a400 2023-10-06T01:39:52.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.788+0000 7f71b954d700 1 -- 172.21.15.69:0/1759644897 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71ac00b9c0 con 0x7f71b415a400 2023-10-06T01:39:52.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.788+0000 7f71b954d700 1 -- 172.21.15.69:0/1759644897 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71ac0092e0 con 0x7f71b415a400 2023-10-06T01:39:52.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.788+0000 7f71bc7b3700 1 -- 172.21.15.69:0/1759644897 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71b415a400 msgr2=0x7f71b4156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:52.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.788+0000 7f71bc7b3700 1 --2- 172.21.15.69:0/1759644897 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71b415a400 0x7f71b4156e90 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f71ac009f50 tx=0x7f71ac009840 comp rx=0 tx=0).stop 2023-10-06T01:39:52.790 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.788+0000 7f71bc7b3700 1 -- 172.21.15.69:0/1759644897 shutdown_connections 2023-10-06T01:39:52.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.788+0000 7f71bc7b3700 1 --2- 172.21.15.69:0/1759644897 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71b415a400 0x7f71b4156e90 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:52.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.788+0000 7f71bc7b3700 1 --2- 172.21.15.69:0/1759644897 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71b40cb970 0x7f71b4159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:52.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.788+0000 7f71bc7b3700 1 -- 172.21.15.69:0/1759644897 >> 172.21.15.69:0/1759644897 conn(0x7f71b4070e30 msgr2=0x7f71b40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:52.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.788+0000 7f71bc7b3700 1 -- 172.21.15.69:0/1759644897 shutdown_connections 2023-10-06T01:39:52.791 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.788+0000 7f71bc7b3700 1 -- 172.21.15.69:0/1759644897 wait complete. 2023-10-06T01:39:52.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.789+0000 7f71bc7b3700 1 Processor -- start 2023-10-06T01:39:52.793 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.789+0000 7f71bc7b3700 1 -- start start 2023-10-06T01:39:52.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.790+0000 7f71bc7b3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71b40cb5a0 0x7f71b40b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:52.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.790+0000 7f71bc7b3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71b40cb970 0x7f71b416a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:52.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.790+0000 7f71bc7b3700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71b415a400 0x7f71b40c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:52.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.790+0000 7f71bc7b3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b40b5950 con 0x7f71b40cb970 2023-10-06T01:39:52.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.790+0000 7f71bc7b3700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71b416a890 con 0x7f71b40cb5a0 2023-10-06T01:39:52.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.790+0000 7f71bc7b3700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71b40b4d40 con 0x7f71b415a400 2023-10-06T01:39:52.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.790+0000 7f71b9d4e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71b40cb970 0x7f71b416a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:52.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.790+0000 7f71b9d4e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71b40cb970 0x7f71b416a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50136/0 (socket says 172.21.15.69:50136) 2023-10-06T01:39:52.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.790+0000 7f71b9d4e700 1 -- 172.21.15.69:0/1697538234 learned_addr learned my addr 172.21.15.69:0/1697538234 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:52.794 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.790+0000 7f71bad50700 1 --2- 172.21.15.69:0/1697538234 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71b415a400 0x7f71b40c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:52.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.790+0000 7f71ba54f700 1 --2- 172.21.15.69:0/1697538234 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71b40cb5a0 0x7f71b40b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:52.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.790+0000 7f71b9d4e700 1 -- 172.21.15.69:0/1697538234 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71b415a400 msgr2=0x7f71b40c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:52.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.790+0000 7f71b9d4e700 1 --2- 172.21.15.69:0/1697538234 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71b415a400 0x7f71b40c9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:52.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.790+0000 7f71b9d4e700 1 -- 172.21.15.69:0/1697538234 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71b40cb5a0 msgr2=0x7f71b40b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:52.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.790+0000 7f71b9d4e700 1 --2- 172.21.15.69:0/1697538234 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71b40cb5a0 0x7f71b40b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:52.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.790+0000 7f71b9d4e700 1 -- 172.21.15.69:0/1697538234 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71ac009ae0 con 0x7f71b40cb970 2023-10-06T01:39:52.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.790+0000 7f71b9d4e700 1 --2- 172.21.15.69:0/1697538234 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71b40cb970 0x7f71b416a350 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f71a400ecb0 tx=0x7f71a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:52.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.791+0000 7f71aa7fc700 1 -- 172.21.15.69:0/1697538234 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a400c850 con 0x7f71b40cb970 2023-10-06T01:39:52.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.791+0000 7f71aa7fc700 1 -- 172.21.15.69:0/1697538234 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a400c9b0 con 0x7f71b40cb970 2023-10-06T01:39:52.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.791+0000 7f71bc7b3700 1 -- 172.21.15.69:0/1697538234 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71b40b5020 con 0x7f71b40cb970 2023-10-06T01:39:52.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.791+0000 7f71aa7fc700 1 -- 172.21.15.69:0/1697538234 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a400cd50 con 0x7f71b40cb970 2023-10-06T01:39:52.795 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.791+0000 7f71bc7b3700 1 -- 172.21.15.69:0/1697538234 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71b40b55e0 con 0x7f71b40cb970 2023-10-06T01:39:52.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.792+0000 7f71bc7b3700 1 -- 172.21.15.69:0/1697538234 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b40b5ac0 con 0x7f71b40cb970 2023-10-06T01:39:52.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.792+0000 7f71aa7fc700 1 -- 172.21.15.69:0/1697538234 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f71a4013680 con 0x7f71b40cb970 2023-10-06T01:39:52.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.792+0000 7f71aa7fc700 1 --2- 172.21.15.69:0/1697538234 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7198066f30 0x7f71980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:52.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.792+0000 7f71aa7fc700 1 -- 172.21.15.69:0/1697538234 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f71a40848f0 con 0x7f71b40cb970 2023-10-06T01:39:52.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.792+0000 7f71ba54f700 1 --2- 172.21.15.69:0/1697538234 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7198066f30 0x7f71980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:52.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.793+0000 7f71ba54f700 1 --2- 172.21.15.69:0/1697538234 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7198066f30 0x7f71980693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f71b00039e0 tx=0x7f71b0007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:52.796 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:52.796+0000 7f71aa7fc700 1 -- 172.21.15.69:0/1697538234 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71a4051a00 con 0x7f71b40cb970 2023-10-06T01:39:53.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.005+0000 7f71bc7b3700 1 -- 172.21.15.69:0/1697538234 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f71b404c3c0 con 0x7f7198066f30 2023-10-06T01:39:53.006 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.006+0000 7f71aa7fc700 1 -- 172.21.15.69:0/1697538234 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f71b404c3c0 con 0x7f7198066f30 2023-10-06T01:39:53.006 INFO:teuthology.orchestra.run.smithi069.stdout:[ 2023-10-06T01:39:53.006 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:39:53.007 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cephfs" 2023-10-06T01:39:53.007 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:39:53.007 INFO:teuthology.orchestra.run.smithi069.stdout:] 2023-10-06T01:39:53.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.008+0000 7f71bc7b3700 1 -- 172.21.15.69:0/1697538234 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7198066f30 msgr2=0x7f71980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:53.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.008+0000 7f71bc7b3700 1 --2- 172.21.15.69:0/1697538234 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7198066f30 0x7f71980693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f71b00039e0 tx=0x7f71b0007ec0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.008+0000 7f71bc7b3700 1 -- 172.21.15.69:0/1697538234 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71b40cb970 msgr2=0x7f71b416a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:53.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.008+0000 7f71bc7b3700 1 --2- 172.21.15.69:0/1697538234 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71b40cb970 0x7f71b416a350 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f71a400ecb0 tx=0x7f71a40091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.008+0000 7f71bc7b3700 1 -- 172.21.15.69:0/1697538234 shutdown_connections 2023-10-06T01:39:53.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.008+0000 7f71bc7b3700 1 --2- 172.21.15.69:0/1697538234 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7198066f30 0x7f71980693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.008+0000 7f71bc7b3700 1 --2- 172.21.15.69:0/1697538234 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f71b415a400 0x7f71b40c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.008+0000 7f71bc7b3700 1 --2- 172.21.15.69:0/1697538234 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f71b40cb5a0 0x7f71b40b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.008+0000 7f71bc7b3700 1 --2- 172.21.15.69:0/1697538234 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71b40cb970 0x7f71b416a350 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.008+0000 7f71bc7b3700 1 -- 172.21.15.69:0/1697538234 >> 172.21.15.69:0/1697538234 conn(0x7f71b4070e30 msgr2=0x7f71b40ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:53.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.008+0000 7f71bc7b3700 1 -- 172.21.15.69:0/1697538234 shutdown_connections 2023-10-06T01:39:53.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.008+0000 7f71bc7b3700 1 -- 172.21.15.69:0/1697538234 wait complete. 2023-10-06T01:39:53.020 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-06T01:39:53.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.136+0000 7fe96daa2700 1 Processor -- start 2023-10-06T01:39:53.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.136+0000 7fe96daa2700 1 -- start start 2023-10-06T01:39:53.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.137+0000 7fe96daa2700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe9680c8800 0x7fe9680c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:53.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.137+0000 7fe96daa2700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe9680c8bd0 0x7fe9680b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:53.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.137+0000 7fe96daa2700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9680adbc0 con 0x7fe9680b0f80 2023-10-06T01:39:53.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.137+0000 7fe96daa2700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9680b13d0 con 0x7fe9680c8800 2023-10-06T01:39:53.139 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.137+0000 7fe96daa2700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9680c9d30 con 0x7fe9680c8bd0 2023-10-06T01:39:53.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.137+0000 7fe9677fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe9680c8800 0x7fe9680c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:53.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.137+0000 7fe9677fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe9680c8800 0x7fe9680c94e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50138/0 (socket says 172.21.15.69:50138) 2023-10-06T01:39:53.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.137+0000 7fe967fff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fe9680b0f80 0x7fe9680ae050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:55072/0 (socket says 172.21.15.69:55072) 2023-10-06T01:39:53.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.137+0000 7fe9677fe700 1 -- 172.21.15.69:0/1942136865 learned_addr learned my addr 172.21.15.69:0/1942136865 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:53.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.137+0000 7fe966ffd700 1 --2- 172.21.15.69:0/1942136865 >> v2:172.21.15.88:3300/0 conn(0x7fe9680c8bd0 0x7fe9680b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:53.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.138+0000 7fe9677fe700 1 -- 172.21.15.69:0/1942136865 >> v2:172.21.15.88:3300/0 conn(0x7fe9680c8bd0 msgr2=0x7fe9680b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:53.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.138+0000 7fe9677fe700 1 --2- 172.21.15.69:0/1942136865 >> v2:172.21.15.88:3300/0 conn(0x7fe9680c8bd0 0x7fe9680b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.138+0000 7fe9677fe700 1 -- 172.21.15.69:0/1942136865 >> v1:172.21.15.69:6789/0 conn(0x7fe9680b0f80 legacy=0x7fe9680ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:53.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.138+0000 7fe9677fe700 1 -- 172.21.15.69:0/1942136865 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9680acfb0 con 0x7fe9680c8800 2023-10-06T01:39:53.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.138+0000 7fe9667fc700 1 -- 172.21.15.69:0/1942136865 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3363036905 0 0) 0x7fe9680adbc0 con 0x7fe9680b0f80 2023-10-06T01:39:53.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.138+0000 7fe9677fe700 1 --2- 172.21.15.69:0/1942136865 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9680c8800 0x7fe9680c94e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe968069850 tx=0x7fe958009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b0cb68113118428 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:53.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.138+0000 7fe9667fc700 1 -- 172.21.15.69:0/1942136865 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95800e070 con 0x7fe9680c8800 2023-10-06T01:39:53.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.138+0000 7fe9667fc700 1 -- 172.21.15.69:0/1942136865 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95800ba20 con 0x7fe9680c8800 2023-10-06T01:39:53.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.138+0000 7fe9667fc700 1 -- 172.21.15.69:0/1942136865 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9580092e0 con 0x7fe9680c8800 2023-10-06T01:39:53.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.138+0000 7fe96daa2700 1 -- 172.21.15.69:0/1942136865 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9680c8800 msgr2=0x7fe9680c94e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:53.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.138+0000 7fe96daa2700 1 --2- 172.21.15.69:0/1942136865 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9680c8800 0x7fe9680c94e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fe968069850 tx=0x7fe958009840 comp rx=0 tx=0).stop 2023-10-06T01:39:53.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.139+0000 7fe96daa2700 1 -- 172.21.15.69:0/1942136865 shutdown_connections 2023-10-06T01:39:53.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.139+0000 7fe96daa2700 1 --2- 172.21.15.69:0/1942136865 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9680c8800 0x7fe9680c94e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.139+0000 7fe96daa2700 1 --2- 172.21.15.69:0/1942136865 >> v2:172.21.15.88:3300/0 conn(0x7fe9680c8bd0 0x7fe9680b0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.139+0000 7fe96daa2700 1 -- 172.21.15.69:0/1942136865 >> 172.21.15.69:0/1942136865 conn(0x7fe96806d170 msgr2=0x7fe9680cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:53.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.139+0000 7fe96daa2700 1 -- 172.21.15.69:0/1942136865 shutdown_connections 2023-10-06T01:39:53.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.139+0000 7fe96daa2700 1 -- 172.21.15.69:0/1942136865 wait complete. 2023-10-06T01:39:53.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.140+0000 7fe96daa2700 1 Processor -- start 2023-10-06T01:39:53.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.140+0000 7fe96daa2700 1 -- start start 2023-10-06T01:39:53.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.140+0000 7fe96daa2700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe9680b0f80 0x7fe968156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:53.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.140+0000 7fe96daa2700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9680c8800 0x7fe968155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:53.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.140+0000 7fe96daa2700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9680c8bd0 0x7fe96816a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:53.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.140+0000 7fe96daa2700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9681555a0 con 0x7fe9680c8800 2023-10-06T01:39:53.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.140+0000 7fe96daa2700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe968157680 con 0x7fe9680c8bd0 2023-10-06T01:39:53.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.141+0000 7fe96daa2700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe968154f50 con 0x7fe9680b0f80 2023-10-06T01:39:53.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.141+0000 7fe966ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9680c8800 0x7fe968155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:53.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.141+0000 7fe966ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9680c8800 0x7fe968155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50152/0 (socket says 172.21.15.69:50152) 2023-10-06T01:39:53.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.141+0000 7fe966ffd700 1 -- 172.21.15.69:0/2295925301 learned_addr learned my addr 172.21.15.69:0/2295925301 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:53.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.141+0000 7fe967fff700 1 --2- 172.21.15.69:0/2295925301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9680c8bd0 0x7fe96816a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:53.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.141+0000 7fe9677fe700 1 --2- 172.21.15.69:0/2295925301 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe9680b0f80 0x7fe968156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:53.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.141+0000 7fe966ffd700 1 -- 172.21.15.69:0/2295925301 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe9680b0f80 msgr2=0x7fe968156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:53.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.141+0000 7fe966ffd700 1 --2- 172.21.15.69:0/2295925301 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe9680b0f80 0x7fe968156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.141+0000 7fe966ffd700 1 -- 172.21.15.69:0/2295925301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9680c8bd0 msgr2=0x7fe96816a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:53.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.141+0000 7fe966ffd700 1 --2- 172.21.15.69:0/2295925301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9680c8bd0 0x7fe96816a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.141+0000 7fe966ffd700 1 -- 172.21.15.69:0/2295925301 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe958009ae0 con 0x7fe9680c8800 2023-10-06T01:39:53.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.141+0000 7fe966ffd700 1 --2- 172.21.15.69:0/2295925301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9680c8800 0x7fe968155a30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe95c00ec80 tx=0x7fe95c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:53.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.141+0000 7fe94f7fe700 1 -- 172.21.15.69:0/2295925301 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c00c850 con 0x7fe9680c8800 2023-10-06T01:39:53.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.141+0000 7fe94f7fe700 1 -- 172.21.15.69:0/2295925301 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95c00c9b0 con 0x7fe9680c8800 2023-10-06T01:39:53.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.141+0000 7fe96daa2700 1 -- 172.21.15.69:0/2295925301 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe968155230 con 0x7fe9680c8800 2023-10-06T01:39:53.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.141+0000 7fe94f7fe700 1 -- 172.21.15.69:0/2295925301 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c00cd50 con 0x7fe9680c8800 2023-10-06T01:39:53.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.141+0000 7fe96daa2700 1 -- 172.21.15.69:0/2295925301 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe968157250 con 0x7fe9680c8800 2023-10-06T01:39:53.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.142+0000 7fe96daa2700 1 -- 172.21.15.69:0/2295925301 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe96804c3c0 con 0x7fe9680c8800 2023-10-06T01:39:53.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.143+0000 7fe94f7fe700 1 -- 172.21.15.69:0/2295925301 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe95c013680 con 0x7fe9680c8800 2023-10-06T01:39:53.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.143+0000 7fe94f7fe700 1 --2- 172.21.15.69:0/2295925301 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe954066f30 0x7fe9540693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:53.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.143+0000 7fe94f7fe700 1 -- 172.21.15.69:0/2295925301 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe95c0848b0 con 0x7fe9680c8800 2023-10-06T01:39:53.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.143+0000 7fe9677fe700 1 --2- 172.21.15.69:0/2295925301 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe954066f30 0x7fe9540693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:53.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.143+0000 7fe9677fe700 1 --2- 172.21.15.69:0/2295925301 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe954066f30 0x7fe9540693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe958009880 tx=0x7fe958018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:53.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.147+0000 7fe94f7fe700 1 -- 172.21.15.69:0/2295925301 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe95c0519c0 con 0x7fe9680c8800 2023-10-06T01:39:53.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.329+0000 7fe96daa2700 1 -- 172.21.15.69:0/2295925301 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fe9680cd010 con 0x7fe9680c8800 2023-10-06T01:39:53.330 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.329+0000 7fe94f7fe700 1 -- 172.21.15.69:0/2295925301 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe95c054fe0 con 0x7fe9680c8800 2023-10-06T01:39:53.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.331+0000 7fe96daa2700 1 -- 172.21.15.69:0/2295925301 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe954066f30 msgr2=0x7fe9540693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:53.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.331+0000 7fe96daa2700 1 --2- 172.21.15.69:0/2295925301 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe954066f30 0x7fe9540693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe958009880 tx=0x7fe958018000 comp rx=0 tx=0).stop 2023-10-06T01:39:53.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.331+0000 7fe96daa2700 1 -- 172.21.15.69:0/2295925301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9680c8800 msgr2=0x7fe968155a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:53.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.331+0000 7fe96daa2700 1 --2- 172.21.15.69:0/2295925301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9680c8800 0x7fe968155a30 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe95c00ec80 tx=0x7fe95c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.331+0000 7fe96daa2700 1 -- 172.21.15.69:0/2295925301 shutdown_connections 2023-10-06T01:39:53.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.331+0000 7fe96daa2700 1 --2- 172.21.15.69:0/2295925301 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe954066f30 0x7fe9540693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.331+0000 7fe96daa2700 1 --2- 172.21.15.69:0/2295925301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe9680c8bd0 0x7fe96816a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.331+0000 7fe96daa2700 1 --2- 172.21.15.69:0/2295925301 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe9680b0f80 0x7fe968156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.331+0000 7fe96daa2700 1 --2- 172.21.15.69:0/2295925301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe9680c8800 0x7fe968155a30 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.331+0000 7fe96daa2700 1 -- 172.21.15.69:0/2295925301 >> 172.21.15.69:0/2295925301 conn(0x7fe96806d170 msgr2=0x7fe9680ae050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:53.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.331+0000 7fe96daa2700 1 -- 172.21.15.69:0/2295925301 shutdown_connections 2023-10-06T01:39:53.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.331+0000 7fe96daa2700 1 -- 172.21.15.69:0/2295925301 wait complete. 2023-10-06T01:39:53.344 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs group_0000000000312412 2023-10-06T01:39:53.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.461+0000 7fcbfac7b700 1 Processor -- start 2023-10-06T01:39:53.461 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.461+0000 7fcbfac7b700 1 -- start start 2023-10-06T01:39:53.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.462+0000 7fcbfac7b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fcbf4159530 0x7fcbf40ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:53.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.462+0000 7fcbfac7b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcbf406dc70 0x7fcbf4159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:53.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.462+0000 7fcbfac7b700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbf40ccfd0 con 0x7fcbf406e0e0 2023-10-06T01:39:53.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.462+0000 7fcbfac7b700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbf40cf0e0 con 0x7fcbf4159530 2023-10-06T01:39:53.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.462+0000 7fcbfac7b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbf415a3d0 con 0x7fcbf406dc70 2023-10-06T01:39:53.464 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.462+0000 7fcbf8a17700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fcbf4159530 0x7fcbf40ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:53.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.462+0000 7fcbf9218700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fcbf406e0e0 0x7fcbf40cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:55074/0 (socket says 172.21.15.69:55074) 2023-10-06T01:39:53.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.462+0000 7fcbf9218700 1 -- 172.21.15.69:0/84126176 learned_addr learned my addr 172.21.15.69:0/84126176 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:53.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.462+0000 7fcbf3fff700 1 --2- 172.21.15.69:0/84126176 >> v2:172.21.15.88:3300/0 conn(0x7fcbf406dc70 0x7fcbf4159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:53.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.462+0000 7fcbf8a17700 1 -- 172.21.15.69:0/84126176 >> v2:172.21.15.88:3300/0 conn(0x7fcbf406dc70 msgr2=0x7fcbf4159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:53.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.462+0000 7fcbf8a17700 1 --2- 172.21.15.69:0/84126176 >> v2:172.21.15.88:3300/0 conn(0x7fcbf406dc70 0x7fcbf4159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.462+0000 7fcbf8a17700 1 -- 172.21.15.69:0/84126176 >> v1:172.21.15.69:6789/0 conn(0x7fcbf406e0e0 legacy=0x7fcbf40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:53.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.462+0000 7fcbf8a17700 1 -- 172.21.15.69:0/84126176 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf415a6b0 con 0x7fcbf4159530 2023-10-06T01:39:53.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.462+0000 7fcbf37fe700 1 -- 172.21.15.69:0/84126176 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1320180096 0 0) 0x7fcbf40ccfd0 con 0x7fcbf406e0e0 2023-10-06T01:39:53.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.462+0000 7fcbf3fff700 1 --2- 172.21.15.69:0/84126176 >> v2:172.21.15.88:3300/0 conn(0x7fcbf406dc70 0x7fcbf4159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:53.465 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.462+0000 7fcbf8a17700 1 --2- 172.21.15.69:0/84126176 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbf4159530 0x7fcbf40ceba0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fcbf40b66e0 tx=0x7fcbe80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfbc88b606780c2f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:53.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.462+0000 7fcbf37fe700 1 -- 172.21.15.69:0/84126176 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe800b6b0 con 0x7fcbf4159530 2023-10-06T01:39:53.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.463+0000 7fcbf37fe700 1 -- 172.21.15.69:0/84126176 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe800b810 con 0x7fcbf4159530 2023-10-06T01:39:53.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.463+0000 7fcbf37fe700 1 -- 172.21.15.69:0/84126176 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe800bbb0 con 0x7fcbf4159530 2023-10-06T01:39:53.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.463+0000 7fcbfac7b700 1 -- 172.21.15.69:0/84126176 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbf4159530 msgr2=0x7fcbf40ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:53.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.463+0000 7fcbfac7b700 1 --2- 172.21.15.69:0/84126176 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbf4159530 0x7fcbf40ceba0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fcbf40b66e0 tx=0x7fcbe80091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.463+0000 7fcbfac7b700 1 -- 172.21.15.69:0/84126176 shutdown_connections 2023-10-06T01:39:53.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.463+0000 7fcbfac7b700 1 --2- 172.21.15.69:0/84126176 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbf4159530 0x7fcbf40ceba0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.463+0000 7fcbfac7b700 1 --2- 172.21.15.69:0/84126176 >> v2:172.21.15.88:3300/0 conn(0x7fcbf406dc70 0x7fcbf4159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.466 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.463+0000 7fcbfac7b700 1 -- 172.21.15.69:0/84126176 >> 172.21.15.69:0/84126176 conn(0x7fcbf40703a0 msgr2=0x7fcbf40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:53.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.463+0000 7fcbfac7b700 1 -- 172.21.15.69:0/84126176 shutdown_connections 2023-10-06T01:39:53.467 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.463+0000 7fcbfac7b700 1 -- 172.21.15.69:0/84126176 wait complete. 2023-10-06T01:39:53.469 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.464+0000 7fcbfac7b700 1 Processor -- start 2023-10-06T01:39:53.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.464+0000 7fcbfac7b700 1 -- start start 2023-10-06T01:39:53.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.465+0000 7fcbfac7b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbf406dc70 0x7fcbf4153b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:53.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.465+0000 7fcbfac7b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcbf406e0e0 0x7fcbf40b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:53.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.465+0000 7fcbfac7b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbf4159530 0x7fcbf40b5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:53.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.465+0000 7fcbfac7b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf415e850 con 0x7fcbf406dc70 2023-10-06T01:39:53.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.465+0000 7fcbfac7b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf4154070 con 0x7fcbf4159530 2023-10-06T01:39:53.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.465+0000 7fcbfac7b700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbf40c9100 con 0x7fcbf406e0e0 2023-10-06T01:39:53.470 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.465+0000 7fcbf8a17700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbf406dc70 0x7fcbf4153b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:53.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.465+0000 7fcbf8a17700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbf406dc70 0x7fcbf4153b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50178/0 (socket says 172.21.15.69:50178) 2023-10-06T01:39:53.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.465+0000 7fcbf8a17700 1 -- 172.21.15.69:0/3314618392 learned_addr learned my addr 172.21.15.69:0/3314618392 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:53.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.465+0000 7fcbf9218700 1 --2- 172.21.15.69:0/3314618392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbf4159530 0x7fcbf40b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:53.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.465+0000 7fcbf3fff700 1 --2- 172.21.15.69:0/3314618392 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcbf406e0e0 0x7fcbf40b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:53.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.465+0000 7fcbf8a17700 1 -- 172.21.15.69:0/3314618392 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcbf406e0e0 msgr2=0x7fcbf40b5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:53.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.465+0000 7fcbf8a17700 1 --2- 172.21.15.69:0/3314618392 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcbf406e0e0 0x7fcbf40b5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.465+0000 7fcbf8a17700 1 -- 172.21.15.69:0/3314618392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbf4159530 msgr2=0x7fcbf40b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:53.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.465+0000 7fcbf8a17700 1 --2- 172.21.15.69:0/3314618392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbf4159530 0x7fcbf40b5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.465+0000 7fcbf8a17700 1 -- 172.21.15.69:0/3314618392 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbe8009420 con 0x7fcbf406dc70 2023-10-06T01:39:53.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.466+0000 7fcbf8a17700 1 --2- 172.21.15.69:0/3314618392 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbf406dc70 0x7fcbf4153b30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fcbe80093f0 tx=0x7fcbe8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:53.471 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.466+0000 7fcbf0ff9700 1 -- 172.21.15.69:0/3314618392 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe800bb90 con 0x7fcbf406dc70 2023-10-06T01:39:53.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.466+0000 7fcbf0ff9700 1 -- 172.21.15.69:0/3314618392 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbe8011420 con 0x7fcbf406dc70 2023-10-06T01:39:53.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.466+0000 7fcbfac7b700 1 -- 172.21.15.69:0/3314618392 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf40c8580 con 0x7fcbf406dc70 2023-10-06T01:39:53.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.466+0000 7fcbf0ff9700 1 -- 172.21.15.69:0/3314618392 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbe80117a0 con 0x7fcbf406dc70 2023-10-06T01:39:53.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.466+0000 7fcbfac7b700 1 -- 172.21.15.69:0/3314618392 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbf40c8910 con 0x7fcbf406dc70 2023-10-06T01:39:53.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.467+0000 7fcbfac7b700 1 -- 172.21.15.69:0/3314618392 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbf40c8f40 con 0x7fcbf406dc70 2023-10-06T01:39:53.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.467+0000 7fcbf0ff9700 1 -- 172.21.15.69:0/3314618392 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcbe8011b90 con 0x7fcbf406dc70 2023-10-06T01:39:53.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.468+0000 7fcbf0ff9700 1 --2- 172.21.15.69:0/3314618392 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fcbd8066f30 0x7fcbd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:53.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.468+0000 7fcbf0ff9700 1 -- 172.21.15.69:0/3314618392 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fcbe80860e0 con 0x7fcbf406dc70 2023-10-06T01:39:53.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.468+0000 7fcbf3fff700 1 --2- 172.21.15.69:0/3314618392 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fcbd8066f30 0x7fcbd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:53.472 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.468+0000 7fcbf3fff700 1 --2- 172.21.15.69:0/3314618392 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fcbd8066f30 0x7fcbd80693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0006f00 tx=0x7fcbe0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:53.473 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.472+0000 7fcbf0ff9700 1 -- 172.21.15.69:0/3314618392 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcbe80532a0 con 0x7fcbf406dc70 2023-10-06T01:39:53.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.681+0000 7fcbfac7b700 1 -- 172.21.15.69:0/3314618392 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "group_0000000000312412", "target": ["mon-mgr", ""]}) v1 -- 0x7fcbf415e990 con 0x7fcbd8066f30 2023-10-06T01:39:53.686 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:39:53.685+0000 7f9603415700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T01:39:53.686 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:39:53.685+0000 7f9603415700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T01:39:53.686 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:39:53.685+0000 7f9603415700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T01:39:53.686 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:39:53.685+0000 7f9603415700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T01:39:53.686 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:39:53.685+0000 7f9603415700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T01:39:53.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.700+0000 7fcbf0ff9700 1 -- 172.21.15.69:0/3314618392 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fcbf415e990 con 0x7fcbd8066f30 2023-10-06T01:39:53.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.701+0000 7fcbfac7b700 1 -- 172.21.15.69:0/3314618392 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fcbd8066f30 msgr2=0x7fcbd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:53.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.701+0000 7fcbfac7b700 1 --2- 172.21.15.69:0/3314618392 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fcbd8066f30 0x7fcbd80693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0006f00 tx=0x7fcbe0008040 comp rx=0 tx=0).stop 2023-10-06T01:39:53.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.701+0000 7fcbfac7b700 1 -- 172.21.15.69:0/3314618392 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbf406dc70 msgr2=0x7fcbf4153b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:53.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.701+0000 7fcbfac7b700 1 --2- 172.21.15.69:0/3314618392 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbf406dc70 0x7fcbf4153b30 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fcbe80093f0 tx=0x7fcbe8017000 comp rx=0 tx=0).stop 2023-10-06T01:39:53.702 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.701+0000 7fcbfac7b700 1 -- 172.21.15.69:0/3314618392 shutdown_connections 2023-10-06T01:39:53.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.701+0000 7fcbfac7b700 1 --2- 172.21.15.69:0/3314618392 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fcbd8066f30 0x7fcbd80693e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.701+0000 7fcbfac7b700 1 --2- 172.21.15.69:0/3314618392 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcbf4159530 0x7fcbf40b5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.701+0000 7fcbfac7b700 1 --2- 172.21.15.69:0/3314618392 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcbf406dc70 0x7fcbf4153b30 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.701+0000 7fcbfac7b700 1 --2- 172.21.15.69:0/3314618392 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcbf406e0e0 0x7fcbf40b5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.701+0000 7fcbfac7b700 1 -- 172.21.15.69:0/3314618392 >> 172.21.15.69:0/3314618392 conn(0x7fcbf40703a0 msgr2=0x7fcbf415afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:53.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.702+0000 7fcbfac7b700 1 -- 172.21.15.69:0/3314618392 shutdown_connections 2023-10-06T01:39:53.703 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.702+0000 7fcbfac7b700 1 -- 172.21.15.69:0/3314618392 wait complete. 2023-10-06T01:39:53.714 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000303270 --group_name group_0000000000312412 2023-10-06T01:39:53.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.832+0000 7f91116ef700 1 Processor -- start 2023-10-06T01:39:53.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.832+0000 7f91116ef700 1 -- start start 2023-10-06T01:39:53.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.833+0000 7f91116ef700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f910c0cd770 0x7f910c0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:53.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.833+0000 7f91116ef700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f910c0b04f0 0x7f910c1591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:53.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.833+0000 7f91116ef700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f910c0cf330 con 0x7f910c0cb880 2023-10-06T01:39:53.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.833+0000 7f91116ef700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f910c0cead0 con 0x7f910c0cd770 2023-10-06T01:39:53.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.833+0000 7f91116ef700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910c0cdbc0 con 0x7f910c0b04f0 2023-10-06T01:39:53.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.833+0000 7f910affd700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f910c0cb880 0x7f910c0cd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:55084/0 (socket says 172.21.15.69:55084) 2023-10-06T01:39:53.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.833+0000 7f910affd700 1 -- 172.21.15.69:0/1319589316 learned_addr learned my addr 172.21.15.69:0/1319589316 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:53.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.833+0000 7f91027fc700 1 --2- 172.21.15.69:0/1319589316 >> v2:172.21.15.88:3300/0 conn(0x7f910c0cd770 0x7f910c0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:53.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.833+0000 7f910a7fc700 1 -- 172.21.15.69:0/1319589316 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 929326340 0 0) 0x7f910c0cf330 con 0x7f910c0cb880 2023-10-06T01:39:53.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.834+0000 7f910b7fe700 1 --2- 172.21.15.69:0/1319589316 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f910c0b04f0 0x7f910c1591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:53.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.834+0000 7f910a7fc700 1 -- 172.21.15.69:0/1319589316 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90f8003570 con 0x7f910c0cb880 2023-10-06T01:39:53.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.834+0000 7f910a7fc700 1 -- 172.21.15.69:0/1319589316 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 751313978 0 0) 0x7f90f8003570 con 0x7f910c0cb880 2023-10-06T01:39:53.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.834+0000 7f910a7fc700 1 -- 172.21.15.69:0/1319589316 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f910c0b04f0 msgr2=0x7f910c1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:53.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.834+0000 7f910a7fc700 1 --2- 172.21.15.69:0/1319589316 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f910c0b04f0 0x7f910c1591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.834+0000 7f910a7fc700 1 -- 172.21.15.69:0/1319589316 >> v2:172.21.15.88:3300/0 conn(0x7f910c0cd770 msgr2=0x7f910c0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:53.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.834+0000 7f910a7fc700 1 --2- 172.21.15.69:0/1319589316 >> v2:172.21.15.88:3300/0 conn(0x7f910c0cd770 0x7f910c0cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.834+0000 7f910a7fc700 1 -- 172.21.15.69:0/1319589316 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910c0cddd0 con 0x7f910c0cb880 2023-10-06T01:39:53.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.834+0000 7f910a7fc700 1 -- 172.21.15.69:0/1319589316 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f90fc001470 con 0x7f910c0cb880 2023-10-06T01:39:53.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.834+0000 7f910a7fc700 1 -- 172.21.15.69:0/1319589316 >> v1:172.21.15.69:6789/0 conn(0x7f910c0cb880 legacy=0x7f910c0cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:53.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.834+0000 7f910a7fc700 1 --2- 172.21.15.69:0/1319589316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90f8003a60 0x7f90f8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:53.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.834+0000 7f910a7fc700 1 --2- 172.21.15.69:0/1319589316 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f910c0b04f0 0x7f90f8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:53.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.834+0000 7f910a7fc700 1 --2- 172.21.15.69:0/1319589316 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90f8004d50 0x7f90f80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:53.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.834+0000 7f910a7fc700 1 -- 172.21.15.69:0/1319589316 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910c0cead0 con 0x7f90f8004d50 2023-10-06T01:39:53.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.834+0000 7f910a7fc700 1 -- 172.21.15.69:0/1319589316 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910c0cdbc0 con 0x7f90f8003a60 2023-10-06T01:39:53.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.834+0000 7f910a7fc700 1 -- 172.21.15.69:0/1319589316 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90f800ba60 con 0x7f910c0b04f0 2023-10-06T01:39:53.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.834+0000 7f910b7fe700 1 --2- 172.21.15.69:0/1319589316 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90f8004d50 0x7f90f80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:53.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.834+0000 7f910affd700 1 --2- 172.21.15.69:0/1319589316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90f8003a60 0x7f90f8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:53.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.834+0000 7f91027fc700 1 --2- 172.21.15.69:0/1319589316 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f910c0b04f0 0x7f90f8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:53.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.834+0000 7f910b7fe700 1 -- 172.21.15.69:0/1319589316 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f910c0b04f0 msgr2=0x7f90f8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:53.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.834+0000 7f910b7fe700 1 --2- 172.21.15.69:0/1319589316 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f910c0b04f0 0x7f90f8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.834+0000 7f910b7fe700 1 -- 172.21.15.69:0/1319589316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90f8003a60 msgr2=0x7f90f8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:53.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.834+0000 7f910b7fe700 1 --2- 172.21.15.69:0/1319589316 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f90f8003a60 0x7f90f8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.834+0000 7f910b7fe700 1 -- 172.21.15.69:0/1319589316 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f8003570 con 0x7f90f8004d50 2023-10-06T01:39:53.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.834+0000 7f910b7fe700 1 --2- 172.21.15.69:0/1319589316 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90f8004d50 0x7f90f80051c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f910400e210 tx=0x7f910400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6252fb94e2bbe6e server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:53.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.835+0000 7f910a7fc700 1 -- 172.21.15.69:0/1319589316 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910400ea60 con 0x7f90f8004d50 2023-10-06T01:39:53.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.835+0000 7f910a7fc700 1 -- 172.21.15.69:0/1319589316 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f910400f040 con 0x7f90f8004d50 2023-10-06T01:39:53.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.835+0000 7f910a7fc700 1 -- 172.21.15.69:0/1319589316 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f910400ee10 con 0x7f90f8004d50 2023-10-06T01:39:53.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.835+0000 7f91116ef700 1 -- 172.21.15.69:0/1319589316 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90f8004d50 msgr2=0x7f90f80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:53.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.835+0000 7f91116ef700 1 --2- 172.21.15.69:0/1319589316 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90f8004d50 0x7f90f80051c0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f910400e210 tx=0x7f910400b040 comp rx=0 tx=0).stop 2023-10-06T01:39:53.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.835+0000 7f910b7fe700 1 -- 172.21.15.69:0/1319589316 reap_dead start 2023-10-06T01:39:53.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.835+0000 7f91116ef700 1 -- 172.21.15.69:0/1319589316 shutdown_connections 2023-10-06T01:39:53.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.835+0000 7f91116ef700 1 -- 172.21.15.69:0/1319589316 >> 172.21.15.69:0/1319589316 conn(0x7f910c0703a0 msgr2=0x7f910c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:53.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.835+0000 7f91116ef700 1 -- 172.21.15.69:0/1319589316 shutdown_connections 2023-10-06T01:39:53.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.835+0000 7f91116ef700 1 -- 172.21.15.69:0/1319589316 wait complete. 2023-10-06T01:39:53.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.836+0000 7f91116ef700 1 Processor -- start 2023-10-06T01:39:53.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.836+0000 7f91116ef700 1 -- start start 2023-10-06T01:39:53.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.837+0000 7f91116ef700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f910c159c10 0x7f910c0b5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:53.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.837+0000 7f91116ef700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f910c15bae0 0x7f910c155fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:53.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.837+0000 7f91116ef700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f910c159fe0 0x7f910c1564f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:53.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.837+0000 7f91116ef700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910c0c7ba0 con 0x7f910c159c10 2023-10-06T01:39:53.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.837+0000 7f91116ef700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f910c0b5ce0 con 0x7f910c15bae0 2023-10-06T01:39:53.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.837+0000 7f91116ef700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f910c0b5fc0 con 0x7f910c159fe0 2023-10-06T01:39:53.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.837+0000 7f910affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f910c159c10 0x7f910c0b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:53.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.837+0000 7f910affd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f910c159c10 0x7f910c0b5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50230/0 (socket says 172.21.15.69:50230) 2023-10-06T01:39:53.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.837+0000 7f910affd700 1 -- 172.21.15.69:0/1653761852 learned_addr learned my addr 172.21.15.69:0/1653761852 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:53.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.837+0000 7f91027fc700 1 --2- 172.21.15.69:0/1653761852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f910c15bae0 0x7f910c155fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:53.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.837+0000 7f910b7fe700 1 --2- 172.21.15.69:0/1653761852 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f910c159fe0 0x7f910c1564f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:53.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.838+0000 7f910affd700 1 -- 172.21.15.69:0/1653761852 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f910c159fe0 msgr2=0x7f910c1564f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:53.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.838+0000 7f910affd700 1 --2- 172.21.15.69:0/1653761852 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f910c159fe0 0x7f910c1564f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.838+0000 7f910affd700 1 -- 172.21.15.69:0/1653761852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f910c15bae0 msgr2=0x7f910c155fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:53.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.838+0000 7f910affd700 1 --2- 172.21.15.69:0/1653761852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f910c15bae0 0x7f910c155fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:53.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.838+0000 7f910affd700 1 -- 172.21.15.69:0/1653761852 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f910c0b62a0 con 0x7f910c159c10 2023-10-06T01:39:53.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.838+0000 7f91027fc700 1 --2- 172.21.15.69:0/1653761852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f910c15bae0 0x7f910c155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:53.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.838+0000 7f910affd700 1 --2- 172.21.15.69:0/1653761852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f910c159c10 0x7f910c0b5390 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f90fc004890 tx=0x7f90fc001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:53.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.838+0000 7f91037fe700 1 -- 172.21.15.69:0/1653761852 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc018030 con 0x7f910c159c10 2023-10-06T01:39:53.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.838+0000 7f91037fe700 1 -- 172.21.15.69:0/1653761852 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90fc00f840 con 0x7f910c159c10 2023-10-06T01:39:53.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.838+0000 7f91116ef700 1 -- 172.21.15.69:0/1653761852 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f910c0c7830 con 0x7f910c159c10 2023-10-06T01:39:53.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.838+0000 7f91037fe700 1 -- 172.21.15.69:0/1653761852 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90fc00fbe0 con 0x7f910c159c10 2023-10-06T01:39:53.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.838+0000 7f91116ef700 1 -- 172.21.15.69:0/1653761852 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f910c0b3480 con 0x7f910c159c10 2023-10-06T01:39:53.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.839+0000 7f91116ef700 1 -- 172.21.15.69:0/1653761852 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f910c04c3c0 con 0x7f910c159c10 2023-10-06T01:39:53.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.839+0000 7f91037fe700 1 -- 172.21.15.69:0/1653761852 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f90fc01b070 con 0x7f910c159c10 2023-10-06T01:39:53.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.839+0000 7f91037fe700 1 --2- 172.21.15.69:0/1653761852 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f90ec066f30 0x7f90ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:53.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.840+0000 7f91037fe700 1 -- 172.21.15.69:0/1653761852 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f90fc019070 con 0x7f910c159c10 2023-10-06T01:39:53.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.840+0000 7f91027fc700 1 --2- 172.21.15.69:0/1653761852 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f90ec066f30 0x7f90ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:53.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.840+0000 7f91027fc700 1 --2- 172.21.15.69:0/1653761852 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f90ec066f30 0x7f90ec0693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f910c15beb0 tx=0x7f90f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:53.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:53.844+0000 7f91037fe700 1 -- 172.21.15.69:0/1653761852 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f90fc0517b0 con 0x7f910c159c10 2023-10-06T01:39:54.056 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.056+0000 7f91116ef700 1 -- 172.21.15.69:0/1653761852 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000303270", "group_name": "group_0000000000312412", "target": ["mon-mgr", ""]}) v1 -- 0x7f910c0c7ce0 con 0x7f90ec066f30 2023-10-06T01:39:54.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.088+0000 7f91037fe700 1 -- 172.21.15.69:0/1653761852 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f90f4009a10 con 0x7f90ec066f30 2023-10-06T01:39:54.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.090+0000 7f91116ef700 1 -- 172.21.15.69:0/1653761852 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f90ec066f30 msgr2=0x7f90ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:54.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.090+0000 7f91116ef700 1 --2- 172.21.15.69:0/1653761852 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f90ec066f30 0x7f90ec0693e0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f910c15beb0 tx=0x7f90f4008040 comp rx=0 tx=0).stop 2023-10-06T01:39:54.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.090+0000 7f91116ef700 1 -- 172.21.15.69:0/1653761852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f910c159c10 msgr2=0x7f910c0b5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:54.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.090+0000 7f91116ef700 1 --2- 172.21.15.69:0/1653761852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f910c159c10 0x7f910c0b5390 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f90fc004890 tx=0x7f90fc001e90 comp rx=0 tx=0).stop 2023-10-06T01:39:54.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.090+0000 7f91116ef700 1 -- 172.21.15.69:0/1653761852 shutdown_connections 2023-10-06T01:39:54.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.090+0000 7f91116ef700 1 --2- 172.21.15.69:0/1653761852 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f90ec066f30 0x7f90ec0693e0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:54.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.090+0000 7f91116ef700 1 --2- 172.21.15.69:0/1653761852 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f910c159fe0 0x7f910c1564f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:54.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.090+0000 7f91116ef700 1 --2- 172.21.15.69:0/1653761852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f910c159c10 0x7f910c0b5390 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:54.091 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.090+0000 7f91116ef700 1 --2- 172.21.15.69:0/1653761852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f910c15bae0 0x7f910c155fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:54.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.090+0000 7f91116ef700 1 -- 172.21.15.69:0/1653761852 >> 172.21.15.69:0/1653761852 conn(0x7f910c0703a0 msgr2=0x7f910c1571a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:54.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.090+0000 7f91116ef700 1 -- 172.21.15.69:0/1653761852 shutdown_connections 2023-10-06T01:39:54.092 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.090+0000 7f91116ef700 1 -- 172.21.15.69:0/1653761852 wait complete. 2023-10-06T01:39:54.102 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000303271 --group_name group_0000000000312412 2023-10-06T01:39:54.221 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.221+0000 7f47a8c6e700 1 Processor -- start 2023-10-06T01:39:54.222 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.221+0000 7f47a8c6e700 1 -- start start 2023-10-06T01:39:54.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.222+0000 7f47a8c6e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f47a40cb880 0x7f47a40cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:54.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.222+0000 7f47a8c6e700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a40cf330 con 0x7f47a40b04f0 2023-10-06T01:39:54.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.222+0000 7f47a8c6e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a40cddd0 con 0x7f47a40cd770 2023-10-06T01:39:54.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.222+0000 7f47a8c6e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a40cdbd0 con 0x7f47a40cb880 2023-10-06T01:39:54.225 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.222+0000 7f47a1d9b700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f47a40b04f0 0x7f47a40cd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:55096/0 (socket says 172.21.15.69:55096) 2023-10-06T01:39:54.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.222+0000 7f47a1d9b700 1 -- 172.21.15.69:0/1666611045 learned_addr learned my addr 172.21.15.69:0/1666611045 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:54.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.223+0000 7f47a259c700 1 --2- 172.21.15.69:0/1666611045 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f47a40cb880 0x7f47a40cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:54.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.223+0000 7f47a159a700 1 -- 172.21.15.69:0/1666611045 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2924917957 0 0) 0x7f47a40cf330 con 0x7f47a40b04f0 2023-10-06T01:39:54.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.223+0000 7f47a159a700 1 -- 172.21.15.69:0/1666611045 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f478c003570 con 0x7f47a40b04f0 2023-10-06T01:39:54.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.223+0000 7f47a159a700 1 -- 172.21.15.69:0/1666611045 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2142574129 0 0) 0x7f478c003570 con 0x7f47a40b04f0 2023-10-06T01:39:54.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.223+0000 7f47a159a700 1 -- 172.21.15.69:0/1666611045 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f47a40cb880 msgr2=0x7f47a40cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:54.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.223+0000 7f47a159a700 1 --2- 172.21.15.69:0/1666611045 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f47a40cb880 0x7f47a40cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:54.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.223+0000 7f47a159a700 1 -- 172.21.15.69:0/1666611045 >> v1:172.21.15.88:6789/0 conn(0x7f47a40cd770 legacy=0x7f47a41591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:54.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.223+0000 7f47a159a700 1 -- 172.21.15.69:0/1666611045 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a40cece0 con 0x7f47a40b04f0 2023-10-06T01:39:54.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.223+0000 7f47a159a700 1 -- 172.21.15.69:0/1666611045 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f4798001470 con 0x7f47a40b04f0 2023-10-06T01:39:54.226 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.223+0000 7f47a159a700 1 -- 172.21.15.69:0/1666611045 >> v1:172.21.15.69:6789/0 conn(0x7f47a40b04f0 legacy=0x7f47a40cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:54.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.223+0000 7f47a159a700 1 --2- 172.21.15.69:0/1666611045 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f478c003a90 0x7f478c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:54.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.223+0000 7f47a159a700 1 --2- 172.21.15.69:0/1666611045 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f47a40cb880 0x7f478c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:54.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.223+0000 7f47a159a700 1 --2- 172.21.15.69:0/1666611045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f478c004d50 0x7f478c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:54.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.223+0000 7f47a159a700 1 -- 172.21.15.69:0/1666611045 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a40cdbd0 con 0x7f478c003a90 2023-10-06T01:39:54.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.223+0000 7f47a159a700 1 -- 172.21.15.69:0/1666611045 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f478c00bb70 con 0x7f478c004d50 2023-10-06T01:39:54.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.223+0000 7f47a159a700 1 -- 172.21.15.69:0/1666611045 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f478c00bd30 con 0x7f47a40cb880 2023-10-06T01:39:54.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.223+0000 7f47a259c700 1 --2- 172.21.15.69:0/1666611045 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f478c003a90 0x7f478c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:54.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.223+0000 7f47a1d9b700 1 --2- 172.21.15.69:0/1666611045 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f47a40cb880 0x7f478c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:54.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.223+0000 7f47a2d9d700 1 --2- 172.21.15.69:0/1666611045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f478c004d50 0x7f478c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:54.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.223+0000 7f47a259c700 1 -- 172.21.15.69:0/1666611045 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f47a40cb880 msgr2=0x7f478c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:54.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.223+0000 7f47a259c700 1 --2- 172.21.15.69:0/1666611045 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f47a40cb880 0x7f478c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:54.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.223+0000 7f47a259c700 1 -- 172.21.15.69:0/1666611045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f478c004d50 msgr2=0x7f478c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:54.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.223+0000 7f47a259c700 1 --2- 172.21.15.69:0/1666611045 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f478c004d50 0x7f478c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:54.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.223+0000 7f47a259c700 1 -- 172.21.15.69:0/1666611045 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f478c003570 con 0x7f478c003a90 2023-10-06T01:39:54.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.223+0000 7f47a259c700 1 --2- 172.21.15.69:0/1666611045 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f478c003a90 0x7f478c003ea0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f479400e210 tx=0x7f479400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c869078fad89a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:54.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.224+0000 7f47a159a700 1 -- 172.21.15.69:0/1666611045 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479400eac0 con 0x7f478c003a90 2023-10-06T01:39:54.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.224+0000 7f47a159a700 1 -- 172.21.15.69:0/1666611045 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479400f040 con 0x7f478c003a90 2023-10-06T01:39:54.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.224+0000 7f47a159a700 1 -- 172.21.15.69:0/1666611045 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479400ee70 con 0x7f478c003a90 2023-10-06T01:39:54.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.224+0000 7f47a8c6e700 1 -- 172.21.15.69:0/1666611045 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f478c003a90 msgr2=0x7f478c003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:54.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.224+0000 7f47a8c6e700 1 --2- 172.21.15.69:0/1666611045 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f478c003a90 0x7f478c003ea0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f479400e210 tx=0x7f479400b040 comp rx=0 tx=0).stop 2023-10-06T01:39:54.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.224+0000 7f47a2d9d700 1 -- 172.21.15.69:0/1666611045 reap_dead start 2023-10-06T01:39:54.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.224+0000 7f47a8c6e700 1 -- 172.21.15.69:0/1666611045 shutdown_connections 2023-10-06T01:39:54.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.224+0000 7f47a8c6e700 1 -- 172.21.15.69:0/1666611045 >> 172.21.15.69:0/1666611045 conn(0x7f47a40703a0 msgr2=0x7f47a40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:54.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.224+0000 7f47a8c6e700 1 -- 172.21.15.69:0/1666611045 shutdown_connections 2023-10-06T01:39:54.229 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.224+0000 7f47a8c6e700 1 -- 172.21.15.69:0/1666611045 wait complete. 2023-10-06T01:39:54.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.225+0000 7f47a8c6e700 1 Processor -- start 2023-10-06T01:39:54.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.225+0000 7f47a8c6e700 1 -- start start 2023-10-06T01:39:54.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.226+0000 7f47a8c6e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f478c003a90 0x7f47a40b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:54.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.226+0000 7f47a8c6e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47a40b6270 0x7f47a4169ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:54.231 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.226+0000 7f47a8c6e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47a416a1e0 0x7f47a4150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:54.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.226+0000 7f47a8c6e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a4152220 con 0x7f47a40b6270 2023-10-06T01:39:54.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.226+0000 7f47a8c6e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a416a660 con 0x7f47a416a1e0 2023-10-06T01:39:54.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.226+0000 7f47a8c6e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a4151c60 con 0x7f478c003a90 2023-10-06T01:39:54.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.226+0000 7f47a1d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47a40b6270 0x7f47a4169ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:54.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.226+0000 7f47a1d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47a40b6270 0x7f47a4169ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50248/0 (socket says 172.21.15.69:50248) 2023-10-06T01:39:54.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.226+0000 7f47a1d9b700 1 -- 172.21.15.69:0/2785170740 learned_addr learned my addr 172.21.15.69:0/2785170740 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:54.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.226+0000 7f47a259c700 1 --2- 172.21.15.69:0/2785170740 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f478c003a90 0x7f47a40b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:54.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.226+0000 7f47a2d9d700 1 --2- 172.21.15.69:0/2785170740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47a416a1e0 0x7f47a4150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:54.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.226+0000 7f47a1d9b700 1 -- 172.21.15.69:0/2785170740 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f478c003a90 msgr2=0x7f47a40b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:54.232 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.226+0000 7f47a1d9b700 1 --2- 172.21.15.69:0/2785170740 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f478c003a90 0x7f47a40b5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:54.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.226+0000 7f47a1d9b700 1 -- 172.21.15.69:0/2785170740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47a416a1e0 msgr2=0x7f47a4150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:54.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.226+0000 7f47a1d9b700 1 --2- 172.21.15.69:0/2785170740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47a416a1e0 0x7f47a4150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:54.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.226+0000 7f47a1d9b700 1 -- 172.21.15.69:0/2785170740 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a4151f40 con 0x7f47a40b6270 2023-10-06T01:39:54.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.227+0000 7f47a1d9b700 1 --2- 172.21.15.69:0/2785170740 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47a40b6270 0x7f47a4169ca0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f47980073c0 tx=0x7f4798001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:54.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.227+0000 7f47927fc700 1 -- 172.21.15.69:0/2785170740 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4798018030 con 0x7f47a40b6270 2023-10-06T01:39:54.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.227+0000 7f47927fc700 1 -- 172.21.15.69:0/2785170740 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479800f8d0 con 0x7f47a40b6270 2023-10-06T01:39:54.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.227+0000 7f47a8c6e700 1 -- 172.21.15.69:0/2785170740 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a40c8890 con 0x7f47a40b6270 2023-10-06T01:39:54.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.227+0000 7f47927fc700 1 -- 172.21.15.69:0/2785170740 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f479800fc90 con 0x7f47a40b6270 2023-10-06T01:39:54.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.227+0000 7f47a8c6e700 1 -- 172.21.15.69:0/2785170740 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a416ad40 con 0x7f47a40b6270 2023-10-06T01:39:54.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.228+0000 7f47a8c6e700 1 -- 172.21.15.69:0/2785170740 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a404c3c0 con 0x7f47a40b6270 2023-10-06T01:39:54.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.228+0000 7f47927fc700 1 -- 172.21.15.69:0/2785170740 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f479801b070 con 0x7f47a40b6270 2023-10-06T01:39:54.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.228+0000 7f47927fc700 1 --2- 172.21.15.69:0/2785170740 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4784066f30 0x7f47840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:54.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.229+0000 7f47927fc700 1 -- 172.21.15.69:0/2785170740 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4798019070 con 0x7f47a40b6270 2023-10-06T01:39:54.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.229+0000 7f47a259c700 1 --2- 172.21.15.69:0/2785170740 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4784066f30 0x7f47840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:54.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.229+0000 7f47a259c700 1 --2- 172.21.15.69:0/2785170740 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4784066f30 0x7f47840693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f479400afd0 tx=0x7f479401a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:54.234 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.233+0000 7f47927fc700 1 -- 172.21.15.69:0/2785170740 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4798051630 con 0x7f47a40b6270 2023-10-06T01:39:54.445 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.445+0000 7f47a8c6e700 1 -- 172.21.15.69:0/2785170740 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000303271", "group_name": "group_0000000000312412", "target": ["mon-mgr", ""]}) v1 -- 0x7f47a40ce680 con 0x7f4784066f30 2023-10-06T01:39:54.478 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.478+0000 7f47927fc700 1 -- 172.21.15.69:0/2785170740 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f47a40ce680 con 0x7f4784066f30 2023-10-06T01:39:54.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.480+0000 7f47a8c6e700 1 -- 172.21.15.69:0/2785170740 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4784066f30 msgr2=0x7f47840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:54.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.480+0000 7f47a8c6e700 1 --2- 172.21.15.69:0/2785170740 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4784066f30 0x7f47840693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f479400afd0 tx=0x7f479401a000 comp rx=0 tx=0).stop 2023-10-06T01:39:54.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.480+0000 7f47a8c6e700 1 -- 172.21.15.69:0/2785170740 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47a40b6270 msgr2=0x7f47a4169ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:54.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.480+0000 7f47a8c6e700 1 --2- 172.21.15.69:0/2785170740 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47a40b6270 0x7f47a4169ca0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f47980073c0 tx=0x7f4798001e50 comp rx=0 tx=0).stop 2023-10-06T01:39:54.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.480+0000 7f47a8c6e700 1 -- 172.21.15.69:0/2785170740 shutdown_connections 2023-10-06T01:39:54.481 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.480+0000 7f47a8c6e700 1 --2- 172.21.15.69:0/2785170740 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f4784066f30 0x7f47840693e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:54.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.480+0000 7f47a8c6e700 1 --2- 172.21.15.69:0/2785170740 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f47a416a1e0 0x7f47a4150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:54.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.480+0000 7f47a8c6e700 1 --2- 172.21.15.69:0/2785170740 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f478c003a90 0x7f47a40b5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:54.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.480+0000 7f47a8c6e700 1 --2- 172.21.15.69:0/2785170740 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47a40b6270 0x7f47a4169ca0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:54.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.480+0000 7f47a8c6e700 1 -- 172.21.15.69:0/2785170740 >> 172.21.15.69:0/2785170740 conn(0x7f47a40703a0 msgr2=0x7f47a406d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:54.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.480+0000 7f47a8c6e700 1 -- 172.21.15.69:0/2785170740 shutdown_connections 2023-10-06T01:39:54.482 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.480+0000 7f47a8c6e700 1 -- 172.21.15.69:0/2785170740 wait complete. 2023-10-06T01:39:54.493 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000303272 --group_name group_0000000000312412 2023-10-06T01:39:54.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.612+0000 7f12391ac700 1 Processor -- start 2023-10-06T01:39:54.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.612+0000 7f12391ac700 1 -- start start 2023-10-06T01:39:54.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.612+0000 7f12391ac700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f1234155c80 0x7f12340abca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:54.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.612+0000 7f12391ac700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f12340ac200 0x7f123406acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:54.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.612+0000 7f12391ac700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f123406a560 con 0x7f123406b210 2023-10-06T01:39:54.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.612+0000 7f12391ac700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123406a840 con 0x7f12340ac200 2023-10-06T01:39:54.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.612+0000 7f12391ac700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12340ac700 con 0x7f1234155c80 2023-10-06T01:39:54.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.613+0000 7f123259c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f12340ac200 0x7f123406acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:54.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.613+0000 7f123259c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f12340ac200 0x7f123406acd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50260/0 (socket says 172.21.15.69:50260) 2023-10-06T01:39:54.615 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.613+0000 7f123259c700 1 -- 172.21.15.69:0/64667993 learned_addr learned my addr 172.21.15.69:0/64667993 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:54.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.613+0000 7f1232d9d700 1 --2- 172.21.15.69:0/64667993 >> v2:172.21.15.88:3300/0 conn(0x7f1234155c80 0x7f12340abca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:54.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.613+0000 7f123259c700 1 -- 172.21.15.69:0/64667993 >> v2:172.21.15.88:3300/0 conn(0x7f1234155c80 msgr2=0x7f12340abca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:54.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.613+0000 7f123259c700 1 --2- 172.21.15.69:0/64667993 >> v2:172.21.15.88:3300/0 conn(0x7f1234155c80 0x7f12340abca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:54.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.613+0000 7f123259c700 1 -- 172.21.15.69:0/64667993 >> v1:172.21.15.88:6789/0 conn(0x7f123406b210 legacy=0x7f123406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:54.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.613+0000 7f123259c700 1 -- 172.21.15.69:0/64667993 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12340ac9e0 con 0x7f12340ac200 2023-10-06T01:39:54.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.613+0000 7f123259c700 1 --2- 172.21.15.69:0/64667993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12340ac200 0x7f123406acd0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f12340699b0 tx=0x7f121c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529caa128c51fc2f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:54.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.613+0000 7f1231d9b700 1 -- 172.21.15.69:0/64667993 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c00dc50 con 0x7f12340ac200 2023-10-06T01:39:54.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.613+0000 7f1231d9b700 1 -- 172.21.15.69:0/64667993 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121c00ddb0 con 0x7f12340ac200 2023-10-06T01:39:54.616 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.613+0000 7f1231d9b700 1 -- 172.21.15.69:0/64667993 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c0196d0 con 0x7f12340ac200 2023-10-06T01:39:54.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.614+0000 7f12391ac700 1 -- 172.21.15.69:0/64667993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12340ac200 msgr2=0x7f123406acd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:54.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.614+0000 7f12391ac700 1 --2- 172.21.15.69:0/64667993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12340ac200 0x7f123406acd0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f12340699b0 tx=0x7f121c00b4f0 comp rx=0 tx=0).stop 2023-10-06T01:39:54.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.614+0000 7f12391ac700 1 -- 172.21.15.69:0/64667993 shutdown_connections 2023-10-06T01:39:54.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.614+0000 7f12391ac700 1 --2- 172.21.15.69:0/64667993 >> v2:172.21.15.88:3300/0 conn(0x7f1234155c80 0x7f12340abca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:54.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.614+0000 7f12391ac700 1 --2- 172.21.15.69:0/64667993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12340ac200 0x7f123406acd0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:54.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.614+0000 7f12391ac700 1 -- 172.21.15.69:0/64667993 >> 172.21.15.69:0/64667993 conn(0x7f12340675a0 msgr2=0x7f12340679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:54.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.614+0000 7f12391ac700 1 -- 172.21.15.69:0/64667993 shutdown_connections 2023-10-06T01:39:54.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.614+0000 7f12391ac700 1 -- 172.21.15.69:0/64667993 wait complete. 2023-10-06T01:39:54.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.615+0000 7f12391ac700 1 Processor -- start 2023-10-06T01:39:54.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.615+0000 7f12391ac700 1 -- start start 2023-10-06T01:39:54.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.616+0000 7f12391ac700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f123406b210 0x7f1234153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:54.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.616+0000 7f12391ac700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12340ac200 0x7f12341660b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:54.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.616+0000 7f12391ac700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1234155c80 0x7f1234146cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:54.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.616+0000 7f12391ac700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12341665f0 con 0x7f1234155c80 2023-10-06T01:39:54.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.616+0000 7f12391ac700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12341471f0 con 0x7f12340ac200 2023-10-06T01:39:54.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.616+0000 7f12391ac700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12341543b0 con 0x7f123406b210 2023-10-06T01:39:54.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.616+0000 7f123359e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1234155c80 0x7f1234146cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:54.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.616+0000 7f123359e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1234155c80 0x7f1234146cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50268/0 (socket says 172.21.15.69:50268) 2023-10-06T01:39:54.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.616+0000 7f123359e700 1 -- 172.21.15.69:0/1999019164 learned_addr learned my addr 172.21.15.69:0/1999019164 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:54.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.616+0000 7f1232d9d700 1 --2- 172.21.15.69:0/1999019164 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f123406b210 0x7f1234153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:54.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.616+0000 7f123259c700 1 --2- 172.21.15.69:0/1999019164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12340ac200 0x7f12341660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:54.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.616+0000 7f123359e700 1 -- 172.21.15.69:0/1999019164 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f123406b210 msgr2=0x7f1234153cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:54.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.616+0000 7f123359e700 1 --2- 172.21.15.69:0/1999019164 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f123406b210 0x7f1234153cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:54.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.616+0000 7f123359e700 1 -- 172.21.15.69:0/1999019164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12340ac200 msgr2=0x7f12341660b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:54.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.616+0000 7f123359e700 1 --2- 172.21.15.69:0/1999019164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12340ac200 0x7f12341660b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:54.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.616+0000 7f123359e700 1 -- 172.21.15.69:0/1999019164 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f121c00b790 con 0x7f1234155c80 2023-10-06T01:39:54.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.616+0000 7f123359e700 1 --2- 172.21.15.69:0/1999019164 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1234155c80 0x7f1234146cb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f122c00c4c0 tx=0x7f122c007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:54.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.616+0000 7f122affd700 1 -- 172.21.15.69:0/1999019164 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c00ce70 con 0x7f1234155c80 2023-10-06T01:39:54.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.617+0000 7f122affd700 1 -- 172.21.15.69:0/1999019164 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122c011590 con 0x7f1234155c80 2023-10-06T01:39:54.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.617+0000 7f122affd700 1 -- 172.21.15.69:0/1999019164 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c011970 con 0x7f1234155c80 2023-10-06T01:39:54.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.617+0000 7f12391ac700 1 -- 172.21.15.69:0/1999019164 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1234152110 con 0x7f1234155c80 2023-10-06T01:39:54.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.617+0000 7f12391ac700 1 -- 172.21.15.69:0/1999019164 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12341526d0 con 0x7f1234155c80 2023-10-06T01:39:54.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.618+0000 7f12391ac700 1 -- 172.21.15.69:0/1999019164 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123404c3c0 con 0x7f1234155c80 2023-10-06T01:39:54.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.618+0000 7f122affd700 1 -- 172.21.15.69:0/1999019164 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f122c011ce0 con 0x7f1234155c80 2023-10-06T01:39:54.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.618+0000 7f122affd700 1 --2- 172.21.15.69:0/1999019164 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1214066f30 0x7f12140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:54.622 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.618+0000 7f122affd700 1 -- 172.21.15.69:0/1999019164 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f122c083970 con 0x7f1234155c80 2023-10-06T01:39:54.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.618+0000 7f1232d9d700 1 --2- 172.21.15.69:0/1999019164 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1214066f30 0x7f12140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:54.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.619+0000 7f1232d9d700 1 --2- 172.21.15.69:0/1999019164 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1214066f30 0x7f12140693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1224009fd0 tx=0x7f1224009880 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:54.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.623+0000 7f122affd700 1 -- 172.21.15.69:0/1999019164 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f122c050a80 con 0x7f1234155c80 2023-10-06T01:39:54.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.839+0000 7f12391ac700 1 -- 172.21.15.69:0/1999019164 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000303272", "group_name": "group_0000000000312412", "target": ["mon-mgr", ""]}) v1 -- 0x7f12340cc050 con 0x7f1214066f30 2023-10-06T01:39:54.873 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.873+0000 7f122affd700 1 -- 172.21.15.69:0/1999019164 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f12340cc050 con 0x7f1214066f30 2023-10-06T01:39:54.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.875+0000 7f12391ac700 1 -- 172.21.15.69:0/1999019164 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1214066f30 msgr2=0x7f12140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:54.875 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.875+0000 7f12391ac700 1 --2- 172.21.15.69:0/1999019164 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1214066f30 0x7f12140693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f1224009fd0 tx=0x7f1224009880 comp rx=0 tx=0).stop 2023-10-06T01:39:54.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.875+0000 7f12391ac700 1 -- 172.21.15.69:0/1999019164 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1234155c80 msgr2=0x7f1234146cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:54.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.875+0000 7f12391ac700 1 --2- 172.21.15.69:0/1999019164 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1234155c80 0x7f1234146cb0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f122c00c4c0 tx=0x7f122c007f50 comp rx=0 tx=0).stop 2023-10-06T01:39:54.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.875+0000 7f12391ac700 1 -- 172.21.15.69:0/1999019164 shutdown_connections 2023-10-06T01:39:54.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.875+0000 7f12391ac700 1 --2- 172.21.15.69:0/1999019164 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1214066f30 0x7f12140693e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:54.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.875+0000 7f12391ac700 1 --2- 172.21.15.69:0/1999019164 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1234155c80 0x7f1234146cb0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:54.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.875+0000 7f12391ac700 1 --2- 172.21.15.69:0/1999019164 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f123406b210 0x7f1234153cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:54.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.875+0000 7f12391ac700 1 --2- 172.21.15.69:0/1999019164 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f12340ac200 0x7f12341660b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:54.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.875+0000 7f12391ac700 1 -- 172.21.15.69:0/1999019164 >> 172.21.15.69:0/1999019164 conn(0x7f12340675a0 msgr2=0x7f12340cb380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:54.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.875+0000 7f12391ac700 1 -- 172.21.15.69:0/1999019164 shutdown_connections 2023-10-06T01:39:54.876 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:54.875+0000 7f12391ac700 1 -- 172.21.15.69:0/1999019164 wait complete. 2023-10-06T01:39:54.887 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000303270 group_0000000000312412 2023-10-06T01:39:55.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.005+0000 7f0dc359e700 1 Processor -- start 2023-10-06T01:39:55.005 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.005+0000 7f0dc359e700 1 -- start start 2023-10-06T01:39:55.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.006+0000 7f0dc359e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0dc4159fb0 0x7f0dc415a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:55.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.006+0000 7f0dc359e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f0dc415a8c0 0x7f0dc40cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:55.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.006+0000 7f0dc359e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0dc40cd3d0 0x7f0dc406d830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:55.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.006+0000 7f0dc359e700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc415e180 con 0x7f0dc415a8c0 2023-10-06T01:39:55.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.006+0000 7f0dc359e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0dc40cd830 con 0x7f0dc40cd3d0 2023-10-06T01:39:55.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.006+0000 7f0dc359e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc415d570 con 0x7f0dc4159fb0 2023-10-06T01:39:55.008 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.006+0000 7f0db9d9b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f0dc415a8c0 0x7f0dc40cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:55.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.006+0000 7f0db9d9b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f0dc415a8c0 0x7f0dc40cce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50278/0 (socket says 172.21.15.69:50278) 2023-10-06T01:39:55.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.006+0000 7f0db9d9b700 1 -- 172.21.15.69:0/4003363207 learned_addr learned my addr 172.21.15.69:0/4003363207 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:55.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.006+0000 7f0dc2d9d700 1 --2- 172.21.15.69:0/4003363207 >> v2:172.21.15.88:3300/0 conn(0x7f0dc40cd3d0 0x7f0dc406d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:55.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.006+0000 7f0dc259c700 1 --2- 172.21.15.69:0/4003363207 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0dc4159fb0 0x7f0dc415a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:55.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.006+0000 7f0db9d9b700 1 -- 172.21.15.69:0/4003363207 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0dc4159fb0 msgr2=0x7f0dc415a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:55.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.006+0000 7f0db9d9b700 1 --2- 172.21.15.69:0/4003363207 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0dc4159fb0 0x7f0dc415a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:55.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.006+0000 7f0db9d9b700 1 -- 172.21.15.69:0/4003363207 >> v2:172.21.15.88:3300/0 conn(0x7f0dc40cd3d0 msgr2=0x7f0dc406d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:55.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.006+0000 7f0db9d9b700 1 --2- 172.21.15.69:0/4003363207 >> v2:172.21.15.88:3300/0 conn(0x7f0dc40cd3d0 0x7f0dc406d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:55.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.006+0000 7f0db9d9b700 1 -- 172.21.15.69:0/4003363207 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dc415d850 con 0x7f0dc415a8c0 2023-10-06T01:39:55.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.006+0000 7f0db9d9b700 1 --2- 172.21.15.69:0/4003363207 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc415a8c0 0x7f0dc40cce90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0dc40affc0 tx=0x7f0dac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9fe0622a0942908 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:55.009 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.006+0000 7f0dc1d9b700 1 -- 172.21.15.69:0/4003363207 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac00b860 con 0x7f0dc415a8c0 2023-10-06T01:39:55.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.007+0000 7f0dc1d9b700 1 -- 172.21.15.69:0/4003363207 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac00b9c0 con 0x7f0dc415a8c0 2023-10-06T01:39:55.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.007+0000 7f0dc1d9b700 1 -- 172.21.15.69:0/4003363207 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac00bd60 con 0x7f0dc415a8c0 2023-10-06T01:39:55.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.007+0000 7f0dc359e700 1 -- 172.21.15.69:0/4003363207 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc415a8c0 msgr2=0x7f0dc40cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:55.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.007+0000 7f0dc359e700 1 --2- 172.21.15.69:0/4003363207 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc415a8c0 0x7f0dc40cce90 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f0dc40affc0 tx=0x7f0dac009250 comp rx=0 tx=0).stop 2023-10-06T01:39:55.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.007+0000 7f0dc359e700 1 -- 172.21.15.69:0/4003363207 shutdown_connections 2023-10-06T01:39:55.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.007+0000 7f0dc359e700 1 --2- 172.21.15.69:0/4003363207 >> v2:172.21.15.88:3300/0 conn(0x7f0dc40cd3d0 0x7f0dc406d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:55.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.007+0000 7f0dc359e700 1 --2- 172.21.15.69:0/4003363207 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0dc4159fb0 0x7f0dc415a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:55.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.007+0000 7f0dc359e700 1 --2- 172.21.15.69:0/4003363207 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc415a8c0 0x7f0dc40cce90 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:55.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.007+0000 7f0dc359e700 1 -- 172.21.15.69:0/4003363207 >> 172.21.15.69:0/4003363207 conn(0x7f0dc40703a0 msgr2=0x7f0dc40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:55.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.007+0000 7f0dc359e700 1 -- 172.21.15.69:0/4003363207 shutdown_connections 2023-10-06T01:39:55.010 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.007+0000 7f0dc359e700 1 -- 172.21.15.69:0/4003363207 wait complete. 2023-10-06T01:39:55.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.008+0000 7f0dc359e700 1 Processor -- start 2023-10-06T01:39:55.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.008+0000 7f0dc359e700 1 -- start start 2023-10-06T01:39:55.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.009+0000 7f0dc359e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0dc40cd3d0 0x7f0dc40b51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:55.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.009+0000 7f0dc359e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc4159fb0 0x7f0dc40b32f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:55.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.009+0000 7f0dc359e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc415a8c0 0x7f0dc40b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:55.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.009+0000 7f0dc359e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc416a780 con 0x7f0dc4159fb0 2023-10-06T01:39:55.013 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.009+0000 7f0dc359e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc416aa60 con 0x7f0dc415a8c0 2023-10-06T01:39:55.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.009+0000 7f0dc359e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0dc40b5af0 con 0x7f0dc40cd3d0 2023-10-06T01:39:55.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.009+0000 7f0db9d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc4159fb0 0x7f0dc40b32f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:55.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.009+0000 7f0db9d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc4159fb0 0x7f0dc40b32f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50292/0 (socket says 172.21.15.69:50292) 2023-10-06T01:39:55.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.009+0000 7f0db9d9b700 1 -- 172.21.15.69:0/3960247457 learned_addr learned my addr 172.21.15.69:0/3960247457 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:55.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.009+0000 7f0dc2d9d700 1 --2- 172.21.15.69:0/3960247457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc415a8c0 0x7f0dc40b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:55.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.009+0000 7f0dc259c700 1 --2- 172.21.15.69:0/3960247457 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0dc40cd3d0 0x7f0dc40b51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:55.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.009+0000 7f0db9d9b700 1 -- 172.21.15.69:0/3960247457 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0dc40cd3d0 msgr2=0x7f0dc40b51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:55.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.009+0000 7f0db9d9b700 1 --2- 172.21.15.69:0/3960247457 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0dc40cd3d0 0x7f0dc40b51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:55.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.009+0000 7f0db9d9b700 1 -- 172.21.15.69:0/3960247457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc415a8c0 msgr2=0x7f0dc40b3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:55.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.009+0000 7f0db9d9b700 1 --2- 172.21.15.69:0/3960247457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc415a8c0 0x7f0dc40b3830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:55.014 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.009+0000 7f0db9d9b700 1 -- 172.21.15.69:0/3960247457 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dac0094f0 con 0x7f0dc4159fb0 2023-10-06T01:39:55.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.009+0000 7f0dc259c700 1 --2- 172.21.15.69:0/3960247457 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0dc40cd3d0 0x7f0dc40b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:55.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.010+0000 7f0db9d9b700 1 --2- 172.21.15.69:0/3960247457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc4159fb0 0x7f0dc40b32f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0dc406d1f0 tx=0x7f0dac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:55.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.010+0000 7f0dbaffd700 1 -- 172.21.15.69:0/3960247457 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac024440 con 0x7f0dc4159fb0 2023-10-06T01:39:55.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.010+0000 7f0dbaffd700 1 -- 172.21.15.69:0/3960247457 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dac0245a0 con 0x7f0dc4159fb0 2023-10-06T01:39:55.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.010+0000 7f0dc359e700 1 -- 172.21.15.69:0/3960247457 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0dc40b5dd0 con 0x7f0dc4159fb0 2023-10-06T01:39:55.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.010+0000 7f0dbaffd700 1 -- 172.21.15.69:0/3960247457 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dac024960 con 0x7f0dc4159fb0 2023-10-06T01:39:55.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.010+0000 7f0dc359e700 1 -- 172.21.15.69:0/3960247457 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0dc40b5700 con 0x7f0dc4159fb0 2023-10-06T01:39:55.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.011+0000 7f0dc359e700 1 -- 172.21.15.69:0/3960247457 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0dc40633f0 con 0x7f0dc4159fb0 2023-10-06T01:39:55.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.011+0000 7f0dbaffd700 1 -- 172.21.15.69:0/3960247457 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0dac01a420 con 0x7f0dc4159fb0 2023-10-06T01:39:55.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.011+0000 7f0dbaffd700 1 --2- 172.21.15.69:0/3960247457 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0da4066f30 0x7f0da40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:55.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.011+0000 7f0dbaffd700 1 -- 172.21.15.69:0/3960247457 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0dac086500 con 0x7f0dc4159fb0 2023-10-06T01:39:55.015 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.011+0000 7f0dc259c700 1 --2- 172.21.15.69:0/3960247457 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0da4066f30 0x7f0da40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:55.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.012+0000 7f0dc259c700 1 --2- 172.21.15.69:0/3960247457 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0da4066f30 0x7f0da40693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0db4008a80 tx=0x7f0db4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:55.016 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.016+0000 7f0dbaffd700 1 -- 172.21.15.69:0/3960247457 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0dac053610 con 0x7f0dc4159fb0 2023-10-06T01:39:55.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.228+0000 7f0dc359e700 1 -- 172.21.15.69:0/3960247457 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000303270", "group_name": "group_0000000000312412", "target": ["mon-mgr", ""]}) v1 -- 0x7f0dc404c3c0 con 0x7f0da4066f30 2023-10-06T01:39:55.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.243+0000 7f0dbaffd700 1 -- 172.21.15.69:0/3960247457 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f0dc404c3c0 con 0x7f0da4066f30 2023-10-06T01:39:55.245 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.245+0000 7f0dc359e700 1 -- 172.21.15.69:0/3960247457 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0da4066f30 msgr2=0x7f0da40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:55.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.245+0000 7f0dc359e700 1 --2- 172.21.15.69:0/3960247457 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0da4066f30 0x7f0da40693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f0db4008a80 tx=0x7f0db4008040 comp rx=0 tx=0).stop 2023-10-06T01:39:55.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.245+0000 7f0dc359e700 1 -- 172.21.15.69:0/3960247457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc4159fb0 msgr2=0x7f0dc40b32f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:55.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.245+0000 7f0dc359e700 1 --2- 172.21.15.69:0/3960247457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc4159fb0 0x7f0dc40b32f0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f0dc406d1f0 tx=0x7f0dac017000 comp rx=0 tx=0).stop 2023-10-06T01:39:55.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.245+0000 7f0dc359e700 1 -- 172.21.15.69:0/3960247457 shutdown_connections 2023-10-06T01:39:55.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.245+0000 7f0dc359e700 1 --2- 172.21.15.69:0/3960247457 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f0da4066f30 0x7f0da40693e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:55.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.245+0000 7f0dc359e700 1 --2- 172.21.15.69:0/3960247457 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f0dc415a8c0 0x7f0dc40b3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:55.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.245+0000 7f0dc359e700 1 --2- 172.21.15.69:0/3960247457 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f0dc40cd3d0 0x7f0dc40b51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:55.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.245+0000 7f0dc359e700 1 --2- 172.21.15.69:0/3960247457 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0dc4159fb0 0x7f0dc40b32f0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:55.246 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.245+0000 7f0dc359e700 1 -- 172.21.15.69:0/3960247457 >> 172.21.15.69:0/3960247457 conn(0x7f0dc40703a0 msgr2=0x7f0dc414d910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:55.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.245+0000 7f0dc359e700 1 -- 172.21.15.69:0/3960247457 shutdown_connections 2023-10-06T01:39:55.247 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.245+0000 7f0dc359e700 1 -- 172.21.15.69:0/3960247457 wait complete. 2023-10-06T01:39:55.247 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:39:55.246+0000 7f960641b700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T01:39:55.247 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:39:55.246+0000 7f960641b700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T01:39:55.247 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:39:55.246+0000 7f960641b700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T01:39:55.247 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:39:55.246+0000 7f960641b700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T01:39:55.247 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:39:55.246+0000 7f960641b700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T01:39:55.259 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000303271 group_0000000000312412 2023-10-06T01:39:55.261 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:39:55.261+0000 7f9605419700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T01:39:55.262 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:39:55.261+0000 7f9605419700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T01:39:55.262 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:39:55.261+0000 7f9605419700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T01:39:55.262 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:39:55.261+0000 7f9605419700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T01:39:55.262 INFO:tasks.ceph.mgr.y.smithi069.stderr:2023-10-06T01:39:55.261+0000 7f9605419700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-06T01:39:55.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.378+0000 7ff7edb41700 1 Processor -- start 2023-10-06T01:39:55.379 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.379+0000 7ff7edb41700 1 -- start start 2023-10-06T01:39:55.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.379+0000 7ff7edb41700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff7e806c860 0x7ff7e806cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:55.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.379+0000 7ff7edb41700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff7e80ccb90 0x7ff7e80cafc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:55.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.379+0000 7ff7edb41700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7e80ca620 con 0x7ff7e80cb500 2023-10-06T01:39:55.381 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.379+0000 7ff7edb41700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7e80ca900 con 0x7ff7e80ccb90 2023-10-06T01:39:55.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.379+0000 7ff7edb41700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7e80cabe0 con 0x7ff7e806c860 2023-10-06T01:39:55.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.379+0000 7ff7e6ffd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff7e80ccb90 0x7ff7e80cafc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:55.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.379+0000 7ff7e7fff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7ff7e80cb500 0x7ff7e815d740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:55104/0 (socket says 172.21.15.69:55104) 2023-10-06T01:39:55.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.380+0000 7ff7e7fff700 1 -- 172.21.15.69:0/4248892906 learned_addr learned my addr 172.21.15.69:0/4248892906 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:55.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.380+0000 7ff7e77fe700 1 --2- 172.21.15.69:0/4248892906 >> v2:172.21.15.88:3300/0 conn(0x7ff7e806c860 0x7ff7e806cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:55.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.380+0000 7ff7e6ffd700 1 -- 172.21.15.69:0/4248892906 >> v2:172.21.15.88:3300/0 conn(0x7ff7e806c860 msgr2=0x7ff7e806cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:55.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.380+0000 7ff7e6ffd700 1 --2- 172.21.15.69:0/4248892906 >> v2:172.21.15.88:3300/0 conn(0x7ff7e806c860 0x7ff7e806cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:55.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.380+0000 7ff7e6ffd700 1 -- 172.21.15.69:0/4248892906 >> v1:172.21.15.69:6789/0 conn(0x7ff7e80cb500 legacy=0x7ff7e815d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:55.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.380+0000 7ff7e67fc700 1 -- 172.21.15.69:0/4248892906 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3487448641 0 0) 0x7ff7e80ca620 con 0x7ff7e80cb500 2023-10-06T01:39:55.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.380+0000 7ff7e6ffd700 1 -- 172.21.15.69:0/4248892906 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e80678d0 con 0x7ff7e80ccb90 2023-10-06T01:39:55.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.380+0000 7ff7e6ffd700 1 --2- 172.21.15.69:0/4248892906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7e80ccb90 0x7ff7e80cafc0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8063530 tx=0x7ff7dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43cdcb58688c1b95 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:55.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.380+0000 7ff7e67fc700 1 -- 172.21.15.69:0/4248892906 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc011630 con 0x7ff7e80ccb90 2023-10-06T01:39:55.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.380+0000 7ff7e67fc700 1 -- 172.21.15.69:0/4248892906 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7dc011790 con 0x7ff7e80ccb90 2023-10-06T01:39:55.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.380+0000 7ff7e67fc700 1 -- 172.21.15.69:0/4248892906 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7dc011b30 con 0x7ff7e80ccb90 2023-10-06T01:39:55.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.381+0000 7ff7edb41700 1 -- 172.21.15.69:0/4248892906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7e80ccb90 msgr2=0x7ff7e80cafc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:55.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.381+0000 7ff7edb41700 1 --2- 172.21.15.69:0/4248892906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7e80ccb90 0x7ff7e80cafc0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff7e8063530 tx=0x7ff7dc0091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:55.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.381+0000 7ff7edb41700 1 -- 172.21.15.69:0/4248892906 shutdown_connections 2023-10-06T01:39:55.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.381+0000 7ff7edb41700 1 --2- 172.21.15.69:0/4248892906 >> v2:172.21.15.88:3300/0 conn(0x7ff7e806c860 0x7ff7e806cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:55.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.381+0000 7ff7edb41700 1 --2- 172.21.15.69:0/4248892906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7e80ccb90 0x7ff7e80cafc0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:55.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.381+0000 7ff7edb41700 1 -- 172.21.15.69:0/4248892906 >> 172.21.15.69:0/4248892906 conn(0x7ff7e80cdf00 msgr2=0x7ff7e80c9e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:55.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.381+0000 7ff7edb41700 1 -- 172.21.15.69:0/4248892906 shutdown_connections 2023-10-06T01:39:55.383 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.381+0000 7ff7edb41700 1 -- 172.21.15.69:0/4248892906 wait complete. 2023-10-06T01:39:55.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.382+0000 7ff7edb41700 1 Processor -- start 2023-10-06T01:39:55.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.382+0000 7ff7edb41700 1 -- start start 2023-10-06T01:39:55.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.383+0000 7ff7edb41700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7e806c860 0x7ff7e80b0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:55.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.383+0000 7ff7edb41700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff7e80cb500 0x7ff7e813bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:55.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.383+0000 7ff7edb41700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7e80ccb90 0x7ff7e8154750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:55.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.383+0000 7ff7edb41700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e80b06d0 con 0x7ff7e806c860 2023-10-06T01:39:55.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.383+0000 7ff7edb41700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e813cf50 con 0x7ff7e80ccb90 2023-10-06T01:39:55.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.383+0000 7ff7edb41700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7e80b2d60 con 0x7ff7e80cb500 2023-10-06T01:39:55.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.383+0000 7ff7e77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7e806c860 0x7ff7e80b0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:55.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.383+0000 7ff7e77fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7e806c860 0x7ff7e80b0190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50358/0 (socket says 172.21.15.69:50358) 2023-10-06T01:39:55.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.383+0000 7ff7e77fe700 1 -- 172.21.15.69:0/2129191150 learned_addr learned my addr 172.21.15.69:0/2129191150 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:55.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.383+0000 7ff7e7fff700 1 --2- 172.21.15.69:0/2129191150 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7e80ccb90 0x7ff7e8154750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:55.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.383+0000 7ff7e6ffd700 1 --2- 172.21.15.69:0/2129191150 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff7e80cb500 0x7ff7e813bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:55.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.383+0000 7ff7e77fe700 1 -- 172.21.15.69:0/2129191150 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff7e80cb500 msgr2=0x7ff7e813bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:55.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.383+0000 7ff7e77fe700 1 --2- 172.21.15.69:0/2129191150 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff7e80cb500 0x7ff7e813bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:55.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.383+0000 7ff7e77fe700 1 -- 172.21.15.69:0/2129191150 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7e80ccb90 msgr2=0x7ff7e8154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:55.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.383+0000 7ff7e77fe700 1 --2- 172.21.15.69:0/2129191150 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7e80ccb90 0x7ff7e8154750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:55.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.383+0000 7ff7e77fe700 1 -- 172.21.15.69:0/2129191150 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7dc009420 con 0x7ff7e806c860 2023-10-06T01:39:55.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.383+0000 7ff7e77fe700 1 --2- 172.21.15.69:0/2129191150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7e806c860 0x7ff7e80b0190 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8009ef0 tx=0x7ff7d800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:55.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.383+0000 7ff7cf7fe700 1 -- 172.21.15.69:0/2129191150 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d800cc20 con 0x7ff7e806c860 2023-10-06T01:39:55.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.384+0000 7ff7cf7fe700 1 -- 172.21.15.69:0/2129191150 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7d800f040 con 0x7ff7e806c860 2023-10-06T01:39:55.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.384+0000 7ff7edb41700 1 -- 172.21.15.69:0/2129191150 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7e80b3040 con 0x7ff7e806c860 2023-10-06T01:39:55.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.384+0000 7ff7cf7fe700 1 -- 172.21.15.69:0/2129191150 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7d8014480 con 0x7ff7e806c860 2023-10-06T01:39:55.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.384+0000 7ff7edb41700 1 -- 172.21.15.69:0/2129191150 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7e813cbe0 con 0x7ff7e806c860 2023-10-06T01:39:55.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.384+0000 7ff7edb41700 1 -- 172.21.15.69:0/2129191150 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7e804c3c0 con 0x7ff7e806c860 2023-10-06T01:39:55.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.385+0000 7ff7cf7fe700 1 -- 172.21.15.69:0/2129191150 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff7d80147f0 con 0x7ff7e806c860 2023-10-06T01:39:55.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.385+0000 7ff7cf7fe700 1 --2- 172.21.15.69:0/2129191150 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff7d4066f30 0x7ff7d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:55.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.385+0000 7ff7cf7fe700 1 -- 172.21.15.69:0/2129191150 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7ff7d8085080 con 0x7ff7e806c860 2023-10-06T01:39:55.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.385+0000 7ff7e6ffd700 1 --2- 172.21.15.69:0/2129191150 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff7d4066f30 0x7ff7d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:55.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.386+0000 7ff7e6ffd700 1 --2- 172.21.15.69:0/2129191150 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff7d4066f30 0x7ff7d40693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc0093f0 tx=0x7ff7dc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:55.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.389+0000 7ff7cf7fe700 1 -- 172.21.15.69:0/2129191150 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7d8052190 con 0x7ff7e806c860 2023-10-06T01:39:55.604 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.604+0000 7ff7edb41700 1 -- 172.21.15.69:0/2129191150 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000303271", "group_name": "group_0000000000312412", "target": ["mon-mgr", ""]}) v1 -- 0x7ff7e8067bb0 con 0x7ff7d4066f30 2023-10-06T01:39:55.623 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.623+0000 7ff7cf7fe700 1 -- 172.21.15.69:0/2129191150 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7ff7e8067bb0 con 0x7ff7d4066f30 2023-10-06T01:39:55.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.625+0000 7ff7edb41700 1 -- 172.21.15.69:0/2129191150 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff7d4066f30 msgr2=0x7ff7d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:55.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.625+0000 7ff7edb41700 1 --2- 172.21.15.69:0/2129191150 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff7d4066f30 0x7ff7d40693e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc0093f0 tx=0x7ff7dc017000 comp rx=0 tx=0).stop 2023-10-06T01:39:55.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.625+0000 7ff7edb41700 1 -- 172.21.15.69:0/2129191150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7e806c860 msgr2=0x7ff7e80b0190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:55.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.625+0000 7ff7edb41700 1 --2- 172.21.15.69:0/2129191150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7e806c860 0x7ff7e80b0190 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff7d8009ef0 tx=0x7ff7d800b040 comp rx=0 tx=0).stop 2023-10-06T01:39:55.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.625+0000 7ff7edb41700 1 -- 172.21.15.69:0/2129191150 shutdown_connections 2023-10-06T01:39:55.626 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.625+0000 7ff7edb41700 1 --2- 172.21.15.69:0/2129191150 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff7d4066f30 0x7ff7d40693e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:55.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.625+0000 7ff7edb41700 1 --2- 172.21.15.69:0/2129191150 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff7e80ccb90 0x7ff7e8154750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:55.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.625+0000 7ff7edb41700 1 --2- 172.21.15.69:0/2129191150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff7e806c860 0x7ff7e80b0190 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:55.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.625+0000 7ff7edb41700 1 --2- 172.21.15.69:0/2129191150 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff7e80cb500 0x7ff7e813bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:55.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.625+0000 7ff7edb41700 1 -- 172.21.15.69:0/2129191150 >> 172.21.15.69:0/2129191150 conn(0x7ff7e80cdf00 msgr2=0x7ff7e806acd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:55.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.625+0000 7ff7edb41700 1 -- 172.21.15.69:0/2129191150 shutdown_connections 2023-10-06T01:39:55.627 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.625+0000 7ff7edb41700 1 -- 172.21.15.69:0/2129191150 wait complete. 2023-10-06T01:39:55.639 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000303272 group_0000000000312412 2023-10-06T01:39:55.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.759+0000 7f8f1778b700 1 Processor -- start 2023-10-06T01:39:55.759 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.759+0000 7f8f1778b700 1 -- start start 2023-10-06T01:39:55.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.760+0000 7f8f1778b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f8f100cb880 0x7f8f100cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:55.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.760+0000 7f8f1778b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8f100cd770 0x7f8f101591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:55.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.760+0000 7f8f1778b700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f100cf330 con 0x7f8f100b04f0 2023-10-06T01:39:55.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.760+0000 7f8f1778b700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f100cdbd0 con 0x7f8f100cb880 2023-10-06T01:39:55.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.760+0000 7f8f1778b700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f100cead0 con 0x7f8f100cd770 2023-10-06T01:39:55.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.760+0000 7f8f15527700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f8f100cb880 0x7f8f100cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:55.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.760+0000 7f8f14d26700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f8f100b04f0 0x7f8f100cd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:55108/0 (socket says 172.21.15.69:55108) 2023-10-06T01:39:55.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.760+0000 7f8f14d26700 1 -- 172.21.15.69:0/813042257 learned_addr learned my addr 172.21.15.69:0/813042257 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:55.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.760+0000 7f8f15527700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f8f100cb880 0x7f8f100cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50372/0 (socket says 172.21.15.69:50372) 2023-10-06T01:39:55.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.760+0000 7f8f15d28700 1 --2- 172.21.15.69:0/813042257 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8f100cd770 0x7f8f101591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:55.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.760+0000 7f8f15527700 1 -- 172.21.15.69:0/813042257 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8f100cd770 msgr2=0x7f8f101591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:55.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.760+0000 7f8f15527700 1 --2- 172.21.15.69:0/813042257 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8f100cd770 0x7f8f101591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:55.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.760+0000 7f8f15527700 1 -- 172.21.15.69:0/813042257 >> v1:172.21.15.69:6789/0 conn(0x7f8f100b04f0 legacy=0x7f8f100cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:55.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.760+0000 7f8f15527700 1 -- 172.21.15.69:0/813042257 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f100cddd0 con 0x7f8f100cb880 2023-10-06T01:39:55.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.760+0000 7f8f15d28700 1 --2- 172.21.15.69:0/813042257 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8f100cd770 0x7f8f101591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:55.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.760+0000 7f8f07fff700 1 -- 172.21.15.69:0/813042257 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 411702292 0 0) 0x7f8f100cf330 con 0x7f8f100b04f0 2023-10-06T01:39:55.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.760+0000 7f8f15527700 1 --2- 172.21.15.69:0/813042257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f100cb880 0x7f8f100cbc50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c009e60 tx=0x7f8f0c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad65247ae0ea3b9b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:55.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.761+0000 7f8f07fff700 1 -- 172.21.15.69:0/813042257 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c00e070 con 0x7f8f100cb880 2023-10-06T01:39:55.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.761+0000 7f8f07fff700 1 -- 172.21.15.69:0/813042257 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f0c00bc30 con 0x7f8f100cb880 2023-10-06T01:39:55.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.761+0000 7f8f07fff700 1 -- 172.21.15.69:0/813042257 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f0c012430 con 0x7f8f100cb880 2023-10-06T01:39:55.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.761+0000 7f8f1778b700 1 -- 172.21.15.69:0/813042257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f100cb880 msgr2=0x7f8f100cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:55.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.761+0000 7f8f1778b700 1 --2- 172.21.15.69:0/813042257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f100cb880 0x7f8f100cbc50 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c009e60 tx=0x7f8f0c009780 comp rx=0 tx=0).stop 2023-10-06T01:39:55.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.761+0000 7f8f1778b700 1 -- 172.21.15.69:0/813042257 shutdown_connections 2023-10-06T01:39:55.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.761+0000 7f8f1778b700 1 --2- 172.21.15.69:0/813042257 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8f100cd770 0x7f8f101591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:55.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.761+0000 7f8f1778b700 1 --2- 172.21.15.69:0/813042257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f100cb880 0x7f8f100cbc50 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:55.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.761+0000 7f8f1778b700 1 -- 172.21.15.69:0/813042257 >> 172.21.15.69:0/813042257 conn(0x7f8f100703a0 msgr2=0x7f8f100707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:55.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.761+0000 7f8f1778b700 1 -- 172.21.15.69:0/813042257 shutdown_connections 2023-10-06T01:39:55.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.761+0000 7f8f1778b700 1 -- 172.21.15.69:0/813042257 wait complete. 2023-10-06T01:39:55.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.762+0000 7f8f1778b700 1 Processor -- start 2023-10-06T01:39:55.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.762+0000 7f8f1778b700 1 -- start start 2023-10-06T01:39:55.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.763+0000 7f8f1778b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f100b04f0 0x7f8f1014a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:55.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.763+0000 7f8f1778b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8f100cb880 0x7f8f1016cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:55.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.763+0000 7f8f1778b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f100cd770 0x7f8f100c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:55.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.763+0000 7f8f1778b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1016d930 con 0x7f8f100cd770 2023-10-06T01:39:55.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.763+0000 7f8f1778b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1016dc10 con 0x7f8f100b04f0 2023-10-06T01:39:55.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.763+0000 7f8f1778b700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f100b3620 con 0x7f8f100cb880 2023-10-06T01:39:55.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.763+0000 7f8f15d28700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f100cd770 0x7f8f100c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:55.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.763+0000 7f8f15d28700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f100cd770 0x7f8f100c67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50382/0 (socket says 172.21.15.69:50382) 2023-10-06T01:39:55.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.763+0000 7f8f15d28700 1 -- 172.21.15.69:0/3872034762 learned_addr learned my addr 172.21.15.69:0/3872034762 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:55.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.763+0000 7f8f15527700 1 --2- 172.21.15.69:0/3872034762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f100b04f0 0x7f8f1014a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:55.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.763+0000 7f8f14d26700 1 --2- 172.21.15.69:0/3872034762 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8f100cb880 0x7f8f1016cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:55.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.764+0000 7f8f15d28700 1 -- 172.21.15.69:0/3872034762 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8f100cb880 msgr2=0x7f8f1016cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:55.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.764+0000 7f8f15d28700 1 --2- 172.21.15.69:0/3872034762 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8f100cb880 0x7f8f1016cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:55.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.764+0000 7f8f15d28700 1 -- 172.21.15.69:0/3872034762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f100b04f0 msgr2=0x7f8f1014a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:55.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.764+0000 7f8f15d28700 1 --2- 172.21.15.69:0/3872034762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f100b04f0 0x7f8f1014a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:55.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.764+0000 7f8f15d28700 1 -- 172.21.15.69:0/3872034762 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0c009a20 con 0x7f8f100cd770 2023-10-06T01:39:55.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.764+0000 7f8f15527700 1 --2- 172.21.15.69:0/3872034762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f100b04f0 0x7f8f1014a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:55.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.764+0000 7f8f15d28700 1 --2- 172.21.15.69:0/3872034762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f100cd770 0x7f8f100c67d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800c850 tx=0x7f8f08008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:55.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.764+0000 7f8f057fa700 1 -- 172.21.15.69:0/3872034762 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f08011600 con 0x7f8f100cd770 2023-10-06T01:39:55.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.764+0000 7f8f057fa700 1 -- 172.21.15.69:0/3872034762 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f08011760 con 0x7f8f100cd770 2023-10-06T01:39:55.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.764+0000 7f8f1778b700 1 -- 172.21.15.69:0/3872034762 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f100b3900 con 0x7f8f100cd770 2023-10-06T01:39:55.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.764+0000 7f8f057fa700 1 -- 172.21.15.69:0/3872034762 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f08011b20 con 0x7f8f100cd770 2023-10-06T01:39:55.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.764+0000 7f8f1778b700 1 -- 172.21.15.69:0/3872034762 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f1016d500 con 0x7f8f100cd770 2023-10-06T01:39:55.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.765+0000 7f8f1778b700 1 -- 172.21.15.69:0/3872034762 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f100b3480 con 0x7f8f100cd770 2023-10-06T01:39:55.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.765+0000 7f8f057fa700 1 -- 172.21.15.69:0/3872034762 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f8f08018350 con 0x7f8f100cd770 2023-10-06T01:39:55.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.765+0000 7f8f057fa700 1 --2- 172.21.15.69:0/3872034762 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8ef4066fc0 0x7f8ef4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:55.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.765+0000 7f8f057fa700 1 -- 172.21.15.69:0/3872034762 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8f08084800 con 0x7f8f100cd770 2023-10-06T01:39:55.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.765+0000 7f8f15527700 1 --2- 172.21.15.69:0/3872034762 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8ef4066fc0 0x7f8ef4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:55.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.766+0000 7f8f15527700 1 --2- 172.21.15.69:0/3872034762 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8ef4066fc0 0x7f8ef4069470 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c009e60 tx=0x7f8f0c019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:55.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.770+0000 7f8f057fa700 1 -- 172.21.15.69:0/3872034762 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f100b3480 con 0x7f8f100cd770 2023-10-06T01:39:55.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.982+0000 7f8f1778b700 1 -- 172.21.15.69:0/3872034762 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000303272", "group_name": "group_0000000000312412", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f1016d720 con 0x7f8ef4066fc0 2023-10-06T01:39:55.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:55.999+0000 7f8f057fa700 1 -- 172.21.15.69:0/3872034762 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8f1016d720 con 0x7f8ef4066fc0 2023-10-06T01:39:56.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.001+0000 7f8f1778b700 1 -- 172.21.15.69:0/3872034762 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8ef4066fc0 msgr2=0x7f8ef4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:56.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.001+0000 7f8f1778b700 1 --2- 172.21.15.69:0/3872034762 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8ef4066fc0 0x7f8ef4069470 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f8f0c009e60 tx=0x7f8f0c019000 comp rx=0 tx=0).stop 2023-10-06T01:39:56.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.001+0000 7f8f1778b700 1 -- 172.21.15.69:0/3872034762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f100cd770 msgr2=0x7f8f100c67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:56.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.001+0000 7f8f1778b700 1 --2- 172.21.15.69:0/3872034762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f100cd770 0x7f8f100c67d0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800c850 tx=0x7f8f08008040 comp rx=0 tx=0).stop 2023-10-06T01:39:56.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.001+0000 7f8f1778b700 1 -- 172.21.15.69:0/3872034762 shutdown_connections 2023-10-06T01:39:56.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.001+0000 7f8f1778b700 1 --2- 172.21.15.69:0/3872034762 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8ef4066fc0 0x7f8ef4069470 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:56.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.001+0000 7f8f1778b700 1 --2- 172.21.15.69:0/3872034762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8f100cd770 0x7f8f100c67d0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:56.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.001+0000 7f8f1778b700 1 --2- 172.21.15.69:0/3872034762 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8f100b04f0 0x7f8f1014a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:56.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.001+0000 7f8f1778b700 1 --2- 172.21.15.69:0/3872034762 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8f100cb880 0x7f8f1016cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:56.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.001+0000 7f8f1778b700 1 -- 172.21.15.69:0/3872034762 >> 172.21.15.69:0/3872034762 conn(0x7f8f100703a0 msgr2=0x7f8f10156f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:56.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.001+0000 7f8f1778b700 1 -- 172.21.15.69:0/3872034762 shutdown_connections 2023-10-06T01:39:56.002 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.001+0000 7f8f1778b700 1 -- 172.21.15.69:0/3872034762 wait complete. 2023-10-06T01:39:56.014 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs group_0000000000312412 2023-10-06T01:39:56.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.131+0000 7f511e1a1700 1 Processor -- start 2023-10-06T01:39:56.131 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.131+0000 7f511e1a1700 1 -- start start 2023-10-06T01:39:56.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.132+0000 7f511e1a1700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5118153dd0 0x7f511815de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:56.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.132+0000 7f511e1a1700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511815ac50 con 0x7f51180cea00 2023-10-06T01:39:56.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.132+0000 7f511e1a1700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f511815d010 con 0x7f5118153a00 2023-10-06T01:39:56.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.132+0000 7f511e1a1700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511815af60 con 0x7f5118153dd0 2023-10-06T01:39:56.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.132+0000 7f511d9a0700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f51180cea00 0x7f51180cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:55114/0 (socket says 172.21.15.69:55114) 2023-10-06T01:39:56.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.132+0000 7f511d9a0700 1 -- 172.21.15.69:0/798396301 learned_addr learned my addr 172.21.15.69:0/798396301 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:56.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.132+0000 7f511c99e700 1 --2- 172.21.15.69:0/798396301 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5118153dd0 0x7f511815de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:56.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.132+0000 7f510ffff700 1 -- 172.21.15.69:0/798396301 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2197559950 0 0) 0x7f511815ac50 con 0x7f51180cea00 2023-10-06T01:39:56.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.132+0000 7f510ffff700 1 -- 172.21.15.69:0/798396301 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5104003570 con 0x7f51180cea00 2023-10-06T01:39:56.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.133+0000 7f510ffff700 1 -- 172.21.15.69:0/798396301 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4119275020 0 0) 0x7f511815d010 con 0x7f5118153a00 2023-10-06T01:39:56.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.133+0000 7f510ffff700 1 -- 172.21.15.69:0/798396301 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f511815ac50 con 0x7f5118153a00 2023-10-06T01:39:56.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.133+0000 7f510ffff700 1 -- 172.21.15.69:0/798396301 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2099564033 0 0) 0x7f5104003570 con 0x7f51180cea00 2023-10-06T01:39:56.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.133+0000 7f510ffff700 1 -- 172.21.15.69:0/798396301 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5118153dd0 msgr2=0x7f511815de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:56.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.133+0000 7f510ffff700 1 --2- 172.21.15.69:0/798396301 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5118153dd0 0x7f511815de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:56.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.133+0000 7f510ffff700 1 -- 172.21.15.69:0/798396301 >> v1:172.21.15.88:6789/0 conn(0x7f5118153a00 legacy=0x7f511815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:56.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.133+0000 7f510ffff700 1 -- 172.21.15.69:0/798396301 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511815b240 con 0x7f51180cea00 2023-10-06T01:39:56.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.133+0000 7f510ffff700 1 -- 172.21.15.69:0/798396301 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f5110001470 con 0x7f51180cea00 2023-10-06T01:39:56.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.133+0000 7f510ffff700 1 -- 172.21.15.69:0/798396301 >> v1:172.21.15.69:6789/0 conn(0x7f51180cea00 legacy=0x7f51180cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:56.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.133+0000 7f510ffff700 1 --2- 172.21.15.69:0/798396301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5104003c20 0x7f5104004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:56.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.133+0000 7f510ffff700 1 --2- 172.21.15.69:0/798396301 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5118153dd0 0x7f5104004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:56.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.133+0000 7f510ffff700 1 --2- 172.21.15.69:0/798396301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5104004d50 0x7f51040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:56.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.133+0000 7f510ffff700 1 -- 172.21.15.69:0/798396301 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f511815af60 con 0x7f5104004d50 2023-10-06T01:39:56.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.133+0000 7f510ffff700 1 -- 172.21.15.69:0/798396301 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f510400bb40 con 0x7f5104003c20 2023-10-06T01:39:56.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.133+0000 7f510ffff700 1 -- 172.21.15.69:0/798396301 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f510400bd00 con 0x7f5118153dd0 2023-10-06T01:39:56.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.133+0000 7f511d9a0700 1 --2- 172.21.15.69:0/798396301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5104004d50 0x7f51040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:56.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.133+0000 7f511d19f700 1 --2- 172.21.15.69:0/798396301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5104003c20 0x7f5104004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:56.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.133+0000 7f511c99e700 1 --2- 172.21.15.69:0/798396301 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5118153dd0 0x7f5104004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:56.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.133+0000 7f511d9a0700 1 -- 172.21.15.69:0/798396301 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5118153dd0 msgr2=0x7f5104004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:56.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.133+0000 7f511d9a0700 1 --2- 172.21.15.69:0/798396301 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5118153dd0 0x7f5104004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:56.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.133+0000 7f511d9a0700 1 -- 172.21.15.69:0/798396301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5104003c20 msgr2=0x7f5104004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:56.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.133+0000 7f511d9a0700 1 --2- 172.21.15.69:0/798396301 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5104003c20 0x7f5104004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:56.138 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.133+0000 7f511d9a0700 1 -- 172.21.15.69:0/798396301 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5104003570 con 0x7f5104004d50 2023-10-06T01:39:56.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.133+0000 7f511d9a0700 1 --2- 172.21.15.69:0/798396301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5104004d50 0x7f51040051c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f511000c2d0 tx=0x7f51180d03e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a5ea3596d05ce0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:56.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.133+0000 7f510ffff700 1 -- 172.21.15.69:0/798396301 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511000cc00 con 0x7f5104004d50 2023-10-06T01:39:56.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.133+0000 7f510ffff700 1 -- 172.21.15.69:0/798396301 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f511000cd60 con 0x7f5104004d50 2023-10-06T01:39:56.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.133+0000 7f510ffff700 1 -- 172.21.15.69:0/798396301 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5110005b70 con 0x7f5104004d50 2023-10-06T01:39:56.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.134+0000 7f511e1a1700 1 -- 172.21.15.69:0/798396301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5104004d50 msgr2=0x7f51040051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:56.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.134+0000 7f511e1a1700 1 --2- 172.21.15.69:0/798396301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5104004d50 0x7f51040051c0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f511000c2d0 tx=0x7f51180d03e0 comp rx=0 tx=0).stop 2023-10-06T01:39:56.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.134+0000 7f511d9a0700 1 -- 172.21.15.69:0/798396301 reap_dead start 2023-10-06T01:39:56.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.134+0000 7f511e1a1700 1 -- 172.21.15.69:0/798396301 shutdown_connections 2023-10-06T01:39:56.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.134+0000 7f511e1a1700 1 -- 172.21.15.69:0/798396301 >> 172.21.15.69:0/798396301 conn(0x7f51180703a0 msgr2=0x7f51180707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:56.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.134+0000 7f511e1a1700 1 -- 172.21.15.69:0/798396301 shutdown_connections 2023-10-06T01:39:56.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.134+0000 7f511e1a1700 1 -- 172.21.15.69:0/798396301 wait complete. 2023-10-06T01:39:56.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.135+0000 7f511e1a1700 1 Processor -- start 2023-10-06T01:39:56.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.135+0000 7f511e1a1700 1 -- start start 2023-10-06T01:39:56.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.136+0000 7f511e1a1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f511814b430 0x7f5118157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:56.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.136+0000 7f511e1a1700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f511814b800 0x7f51180cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:56.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.136+0000 7f511e1a1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51181584a0 0x7f51180cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:56.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.136+0000 7f511e1a1700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5118158f00 con 0x7f51181584a0 2023-10-06T01:39:56.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.136+0000 7f511e1a1700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51180cc5a0 con 0x7f511814b430 2023-10-06T01:39:56.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.136+0000 7f511e1a1700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f511814bdd0 con 0x7f511814b800 2023-10-06T01:39:56.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.136+0000 7f511d9a0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51181584a0 0x7f51180cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:56.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.136+0000 7f511d9a0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51181584a0 0x7f51180cc060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50394/0 (socket says 172.21.15.69:50394) 2023-10-06T01:39:56.145 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.136+0000 7f511d9a0700 1 -- 172.21.15.69:0/4272658727 learned_addr learned my addr 172.21.15.69:0/4272658727 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:56.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.136+0000 7f511d19f700 1 --2- 172.21.15.69:0/4272658727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f511814b430 0x7f5118157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:56.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.136+0000 7f511c99e700 1 --2- 172.21.15.69:0/4272658727 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f511814b800 0x7f51180cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:56.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.136+0000 7f511d9a0700 1 -- 172.21.15.69:0/4272658727 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f511814b800 msgr2=0x7f51180cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:56.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.136+0000 7f511d9a0700 1 --2- 172.21.15.69:0/4272658727 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f511814b800 0x7f51180cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:56.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.136+0000 7f511d9a0700 1 -- 172.21.15.69:0/4272658727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f511814b430 msgr2=0x7f5118157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:56.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.136+0000 7f511d9a0700 1 --2- 172.21.15.69:0/4272658727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f511814b430 0x7f5118157f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:56.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.136+0000 7f511d9a0700 1 -- 172.21.15.69:0/4272658727 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f511814c370 con 0x7f51181584a0 2023-10-06T01:39:56.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.137+0000 7f511d9a0700 1 --2- 172.21.15.69:0/4272658727 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51181584a0 0x7f51180cc060 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5110001ed0 tx=0x7f5110015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:56.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.137+0000 7f510d7fa700 1 -- 172.21.15.69:0/4272658727 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f511000cc00 con 0x7f51181584a0 2023-10-06T01:39:56.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.137+0000 7f510d7fa700 1 -- 172.21.15.69:0/4272658727 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5110000fe0 con 0x7f51181584a0 2023-10-06T01:39:56.146 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.137+0000 7f511e1a1700 1 -- 172.21.15.69:0/4272658727 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5118158940 con 0x7f51181584a0 2023-10-06T01:39:56.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.137+0000 7f510d7fa700 1 -- 172.21.15.69:0/4272658727 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5110007300 con 0x7f51181584a0 2023-10-06T01:39:56.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.137+0000 7f511e1a1700 1 -- 172.21.15.69:0/4272658727 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f511814c000 con 0x7f51181584a0 2023-10-06T01:39:56.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.138+0000 7f511e1a1700 1 -- 172.21.15.69:0/4272658727 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f511814c500 con 0x7f51181584a0 2023-10-06T01:39:56.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.138+0000 7f510d7fa700 1 -- 172.21.15.69:0/4272658727 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f51100076b0 con 0x7f51181584a0 2023-10-06T01:39:56.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.138+0000 7f510d7fa700 1 --2- 172.21.15.69:0/4272658727 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f50fc066fc0 0x7f50fc069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:56.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.139+0000 7f510d7fa700 1 -- 172.21.15.69:0/4272658727 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5110085bb0 con 0x7f51181584a0 2023-10-06T01:39:56.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.139+0000 7f511d19f700 1 --2- 172.21.15.69:0/4272658727 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f50fc066fc0 0x7f50fc069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:56.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.139+0000 7f511d19f700 1 --2- 172.21.15.69:0/4272658727 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f50fc066fc0 0x7f50fc069470 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f51181590c0 tx=0x7f51140017a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:56.147 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.143+0000 7f510d7fa700 1 -- 172.21.15.69:0/4272658727 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f511008c080 con 0x7f51181584a0 2023-10-06T01:39:56.353 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.353+0000 7f511e1a1700 1 -- 172.21.15.69:0/4272658727 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "group_0000000000312412", "target": ["mon-mgr", ""]}) v1 -- 0x7f511804c3c0 con 0x7f50fc066fc0 2023-10-06T01:39:56.358 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.358+0000 7f510d7fa700 1 -- 172.21.15.69:0/4272658727 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f511804c3c0 con 0x7f50fc066fc0 2023-10-06T01:39:56.360 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.360+0000 7f511e1a1700 1 -- 172.21.15.69:0/4272658727 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f50fc066fc0 msgr2=0x7f50fc069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:56.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.360+0000 7f511e1a1700 1 --2- 172.21.15.69:0/4272658727 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f50fc066fc0 0x7f50fc069470 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f51181590c0 tx=0x7f51140017a0 comp rx=0 tx=0).stop 2023-10-06T01:39:56.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.360+0000 7f511e1a1700 1 -- 172.21.15.69:0/4272658727 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51181584a0 msgr2=0x7f51180cc060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:56.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.360+0000 7f511e1a1700 1 --2- 172.21.15.69:0/4272658727 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51181584a0 0x7f51180cc060 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5110001ed0 tx=0x7f5110015000 comp rx=0 tx=0).stop 2023-10-06T01:39:56.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.360+0000 7f511e1a1700 1 -- 172.21.15.69:0/4272658727 shutdown_connections 2023-10-06T01:39:56.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.360+0000 7f511e1a1700 1 --2- 172.21.15.69:0/4272658727 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f50fc066fc0 0x7f50fc069470 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:56.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.360+0000 7f511e1a1700 1 --2- 172.21.15.69:0/4272658727 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51181584a0 0x7f51180cc060 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:56.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.360+0000 7f511e1a1700 1 --2- 172.21.15.69:0/4272658727 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f511814b430 0x7f5118157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:56.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.360+0000 7f511e1a1700 1 --2- 172.21.15.69:0/4272658727 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f511814b800 0x7f51180cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:56.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.360+0000 7f511e1a1700 1 -- 172.21.15.69:0/4272658727 >> 172.21.15.69:0/4272658727 conn(0x7f51180703a0 msgr2=0x7f5118151080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:56.361 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.360+0000 7f511e1a1700 1 -- 172.21.15.69:0/4272658727 shutdown_connections 2023-10-06T01:39:56.362 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.360+0000 7f511e1a1700 1 -- 172.21.15.69:0/4272658727 wait complete. 2023-10-06T01:39:56.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:39:56.372 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2023-10-06T01:39:56.405 INFO:teuthology.orchestra.run.smithi069.stdout:2 2023-10-06T01:39:56.405 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-06T01:39:56.405 DEBUG:teuthology.orchestra.run.smithi069:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T01:39:56.480 DEBUG:teuthology.orchestra.run.smithi088:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-06T01:39:56.519 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-06T01:39:56.519 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-06T01:39:56.520 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:39:56.520 DEBUG:teuthology.orchestra.run.smithi069:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-06T01:39:56.557 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi069.front.sepia.ceph.com 2023-10-06T01:39:56.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:56.558 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-06T01:39:56.610 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-06T01:39:56.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-06T01:39:56.610 DEBUG:teuthology.orchestra.run.smithi088:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-06T01:39:56.654 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi088.front.sepia.ceph.com 2023-10-06T01:39:56.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:39:56.655 DEBUG:teuthology.orchestra.run.smithi088:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-06T01:39:56.711 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:39:56.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.825+0000 7f6d8f59e700 1 Processor -- start 2023-10-06T01:39:56.827 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.825+0000 7f6d8f59e700 1 -- start start 2023-10-06T01:39:56.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.826+0000 7f6d8f59e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d90153c30 0x7f6d9015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:56.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.826+0000 7f6d8f59e700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d9015afd0 con 0x7f6d9015de50 2023-10-06T01:39:56.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.826+0000 7f6d8f59e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d9015b2b0 con 0x7f6d900cf110 2023-10-06T01:39:56.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.826+0000 7f6d8f59e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9015b590 con 0x7f6d90153c30 2023-10-06T01:39:56.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.826+0000 7f6d8dd9b700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f6d9015de50 0x7f6d900cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:55124/0 (socket says 172.21.15.69:55124) 2023-10-06T01:39:56.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.826+0000 7f6d8dd9b700 1 -- 172.21.15.69:0/1872495031 learned_addr learned my addr 172.21.15.69:0/1872495031 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:56.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.826+0000 7f6d8d59a700 1 -- 172.21.15.69:0/1872495031 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 723366447 0 0) 0x7f6d9015afd0 con 0x7f6d9015de50 2023-10-06T01:39:56.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.826+0000 7f6d8e59c700 1 --2- 172.21.15.69:0/1872495031 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d90153c30 0x7f6d9015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:56.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.826+0000 7f6d8d59a700 1 -- 172.21.15.69:0/1872495031 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6d7c003570 con 0x7f6d9015de50 2023-10-06T01:39:56.833 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.827+0000 7f6d8d59a700 1 -- 172.21.15.69:0/1872495031 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3092872735 0 0) 0x7f6d7c003570 con 0x7f6d9015de50 2023-10-06T01:39:56.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.827+0000 7f6d8d59a700 1 -- 172.21.15.69:0/1872495031 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d90153c30 msgr2=0x7f6d9015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:56.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.827+0000 7f6d8d59a700 1 --2- 172.21.15.69:0/1872495031 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d90153c30 0x7f6d9015a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:56.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.827+0000 7f6d8d59a700 1 -- 172.21.15.69:0/1872495031 >> v1:172.21.15.88:6789/0 conn(0x7f6d900cf110 legacy=0x7f6d9015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:56.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.827+0000 7f6d8d59a700 1 -- 172.21.15.69:0/1872495031 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d9015b870 con 0x7f6d9015de50 2023-10-06T01:39:56.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.827+0000 7f6d8d59a700 1 -- 172.21.15.69:0/1872495031 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f6d78001470 con 0x7f6d9015de50 2023-10-06T01:39:56.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.827+0000 7f6d8d59a700 1 -- 172.21.15.69:0/1872495031 >> v1:172.21.15.69:6789/0 conn(0x7f6d9015de50 legacy=0x7f6d900cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:56.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.827+0000 7f6d8d59a700 1 --2- 172.21.15.69:0/1872495031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d7c003a90 0x7f6d7c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:56.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.827+0000 7f6d8d59a700 1 --2- 172.21.15.69:0/1872495031 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d90153c30 0x7f6d7c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:56.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.827+0000 7f6d8d59a700 1 --2- 172.21.15.69:0/1872495031 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d7c004d50 0x7f6d7c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:56.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.827+0000 7f6d8d59a700 1 -- 172.21.15.69:0/1872495031 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d9015b590 con 0x7f6d7c004d50 2023-10-06T01:39:56.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.827+0000 7f6d8d59a700 1 -- 172.21.15.69:0/1872495031 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7c00bb10 con 0x7f6d7c003a90 2023-10-06T01:39:56.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.827+0000 7f6d8d59a700 1 -- 172.21.15.69:0/1872495031 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d7c00bcd0 con 0x7f6d90153c30 2023-10-06T01:39:56.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.827+0000 7f6d8ed9d700 1 --2- 172.21.15.69:0/1872495031 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d7c004d50 0x7f6d7c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:56.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.827+0000 7f6d8e59c700 1 --2- 172.21.15.69:0/1872495031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d7c003a90 0x7f6d7c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:56.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.827+0000 7f6d8dd9b700 1 --2- 172.21.15.69:0/1872495031 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d90153c30 0x7f6d7c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:56.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.827+0000 7f6d8ed9d700 1 -- 172.21.15.69:0/1872495031 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d90153c30 msgr2=0x7f6d7c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:56.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.827+0000 7f6d8ed9d700 1 --2- 172.21.15.69:0/1872495031 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d90153c30 0x7f6d7c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:56.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.827+0000 7f6d8ed9d700 1 -- 172.21.15.69:0/1872495031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d7c003a90 msgr2=0x7f6d7c003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:56.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.827+0000 7f6d8ed9d700 1 --2- 172.21.15.69:0/1872495031 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d7c003a90 0x7f6d7c003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:56.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.827+0000 7f6d8ed9d700 1 -- 172.21.15.69:0/1872495031 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d7c003570 con 0x7f6d7c004d50 2023-10-06T01:39:56.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.827+0000 7f6d8ed9d700 1 --2- 172.21.15.69:0/1872495031 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d7c004d50 0x7f6d7c0051c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6d800020a0 tx=0x7f6d800016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a16f481a9c4d51 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:56.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.827+0000 7f6d8d59a700 1 -- 172.21.15.69:0/1872495031 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d800019e0 con 0x7f6d7c004d50 2023-10-06T01:39:56.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.827+0000 7f6d8d59a700 1 -- 172.21.15.69:0/1872495031 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d8000c8b0 con 0x7f6d7c004d50 2023-10-06T01:39:56.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.827+0000 7f6d8d59a700 1 -- 172.21.15.69:0/1872495031 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d8000cc50 con 0x7f6d7c004d50 2023-10-06T01:39:56.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.828+0000 7f6d8f59e700 1 -- 172.21.15.69:0/1872495031 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d7c004d50 msgr2=0x7f6d7c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:56.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.828+0000 7f6d8f59e700 1 --2- 172.21.15.69:0/1872495031 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d7c004d50 0x7f6d7c0051c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f6d800020a0 tx=0x7f6d800016d0 comp rx=0 tx=0).stop 2023-10-06T01:39:56.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.828+0000 7f6d8ed9d700 1 -- 172.21.15.69:0/1872495031 reap_dead start 2023-10-06T01:39:56.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.828+0000 7f6d8f59e700 1 -- 172.21.15.69:0/1872495031 shutdown_connections 2023-10-06T01:39:56.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.828+0000 7f6d8f59e700 1 -- 172.21.15.69:0/1872495031 >> 172.21.15.69:0/1872495031 conn(0x7f6d900703a0 msgr2=0x7f6d900707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:56.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.828+0000 7f6d8f59e700 1 -- 172.21.15.69:0/1872495031 shutdown_connections 2023-10-06T01:39:56.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.828+0000 7f6d8f59e700 1 -- 172.21.15.69:0/1872495031 wait complete. 2023-10-06T01:39:56.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.829+0000 7f6d8f59e700 1 Processor -- start 2023-10-06T01:39:56.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.829+0000 7f6d8f59e700 1 -- start start 2023-10-06T01:39:56.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.830+0000 7f6d8f59e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d7c004d50 0x7f6d901698a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:56.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.830+0000 7f6d8f59e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d901530f0 0x7f6d900cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:56.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.830+0000 7f6d8f59e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d900cc720 0x7f6d900c7650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:56.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.830+0000 7f6d8f59e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d900ccb90 con 0x7f6d901530f0 2023-10-06T01:39:56.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.830+0000 7f6d8f59e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d900c8780 con 0x7f6d900cc720 2023-10-06T01:39:56.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.830+0000 7f6d8f59e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d900c9020 con 0x7f6d7c004d50 2023-10-06T01:39:56.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.830+0000 7f6d8dd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d901530f0 0x7f6d900cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:56.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.830+0000 7f6d8dd9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d901530f0 0x7f6d900cc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50416/0 (socket says 172.21.15.69:50416) 2023-10-06T01:39:56.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.830+0000 7f6d8dd9b700 1 -- 172.21.15.69:0/825674281 learned_addr learned my addr 172.21.15.69:0/825674281 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:56.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.830+0000 7f6d8e59c700 1 --2- 172.21.15.69:0/825674281 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d7c004d50 0x7f6d901698a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:56.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.830+0000 7f6d8ed9d700 1 --2- 172.21.15.69:0/825674281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d900cc720 0x7f6d900c7650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:56.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.830+0000 7f6d8dd9b700 1 -- 172.21.15.69:0/825674281 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d7c004d50 msgr2=0x7f6d901698a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:56.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.830+0000 7f6d8dd9b700 1 --2- 172.21.15.69:0/825674281 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d7c004d50 0x7f6d901698a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:56.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.830+0000 7f6d8dd9b700 1 -- 172.21.15.69:0/825674281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d900cc720 msgr2=0x7f6d900c7650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:56.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.830+0000 7f6d8dd9b700 1 --2- 172.21.15.69:0/825674281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d900cc720 0x7f6d900c7650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:56.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.830+0000 7f6d8dd9b700 1 -- 172.21.15.69:0/825674281 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d90153560 con 0x7f6d901530f0 2023-10-06T01:39:56.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.830+0000 7f6d8dd9b700 1 --2- 172.21.15.69:0/825674281 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d901530f0 0x7f6d900cc1e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6d780073f0 tx=0x7f6d78001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:56.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.830+0000 7f6d867fc700 1 -- 172.21.15.69:0/825674281 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d78012560 con 0x7f6d901530f0 2023-10-06T01:39:56.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.831+0000 7f6d867fc700 1 -- 172.21.15.69:0/825674281 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d780126c0 con 0x7f6d901530f0 2023-10-06T01:39:56.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.831+0000 7f6d8f59e700 1 -- 172.21.15.69:0/825674281 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d900c83a0 con 0x7f6d901530f0 2023-10-06T01:39:56.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.831+0000 7f6d867fc700 1 -- 172.21.15.69:0/825674281 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d78012a80 con 0x7f6d901530f0 2023-10-06T01:39:56.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.831+0000 7f6d8f59e700 1 -- 172.21.15.69:0/825674281 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d900c8cb0 con 0x7f6d901530f0 2023-10-06T01:39:56.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.831+0000 7f6d8f59e700 1 -- 172.21.15.69:0/825674281 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d900c8e70 con 0x7f6d901530f0 2023-10-06T01:39:56.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.832+0000 7f6d867fc700 1 -- 172.21.15.69:0/825674281 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f6d7801d460 con 0x7f6d901530f0 2023-10-06T01:39:56.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.832+0000 7f6d867fc700 1 --2- 172.21.15.69:0/825674281 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6d70066fc0 0x7f6d70069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:56.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.832+0000 7f6d867fc700 1 -- 172.21.15.69:0/825674281 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f6d780847b0 con 0x7f6d901530f0 2023-10-06T01:39:56.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.832+0000 7f6d8e59c700 1 --2- 172.21.15.69:0/825674281 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6d70066fc0 0x7f6d70069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:56.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.833+0000 7f6d8e59c700 1 --2- 172.21.15.69:0/825674281 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6d70066fc0 0x7f6d70069470 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6d88006f00 tx=0x7f6d880091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:56.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:56.837+0000 7f6d867fc700 1 -- 172.21.15.69:0/825674281 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6d780518d0 con 0x7f6d901530f0 2023-10-06T01:39:57.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.061+0000 7f6d8f59e700 1 -- 172.21.15.69:0/825674281 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6d9004c3c0 con 0x7f6d901530f0 2023-10-06T01:39:57.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.062+0000 7f6d867fc700 1 -- 172.21.15.69:0/825674281 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f6d78054ef0 con 0x7f6d901530f0 2023-10-06T01:39:57.063 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:57.063 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4837,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2963206981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":2963206981},{"type":"v1","addr":"172.21.15.88:6835","nonce":2963206981}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5028,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6836/1958085129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":1958085129},{"type":"v1","addr":"172.21.15.69:6836","nonce":1958085129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5031,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1745977228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6835","nonce":1745977228},{"type":"v1","addr":"172.21.15.69:6837","nonce":1745977228}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:39:38.993158+0000","modified":"2023-10-06T01:39:42.621141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5037},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5037":{"gid":5037,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6834/3221701951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3221701951},{"type":"v1","addr":"172.21.15.88:6834","nonce":3221701951}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T01:39:57.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.064+0000 7f6d8f59e700 1 -- 172.21.15.69:0/825674281 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6d70066fc0 msgr2=0x7f6d70069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.064+0000 7f6d8f59e700 1 --2- 172.21.15.69:0/825674281 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6d70066fc0 0x7f6d70069470 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f6d88006f00 tx=0x7f6d880091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.065 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.064+0000 7f6d8f59e700 1 -- 172.21.15.69:0/825674281 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d901530f0 msgr2=0x7f6d900cc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.064+0000 7f6d8f59e700 1 --2- 172.21.15.69:0/825674281 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d901530f0 0x7f6d900cc1e0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f6d780073f0 tx=0x7f6d78001e70 comp rx=0 tx=0).stop 2023-10-06T01:39:57.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.064+0000 7f6d8f59e700 1 -- 172.21.15.69:0/825674281 shutdown_connections 2023-10-06T01:39:57.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.064+0000 7f6d8f59e700 1 --2- 172.21.15.69:0/825674281 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f6d70066fc0 0x7f6d70069470 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.064+0000 7f6d8f59e700 1 --2- 172.21.15.69:0/825674281 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f6d900cc720 0x7f6d900c7650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.064+0000 7f6d8f59e700 1 --2- 172.21.15.69:0/825674281 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f6d7c004d50 0x7f6d901698a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.064+0000 7f6d8f59e700 1 --2- 172.21.15.69:0/825674281 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6d901530f0 0x7f6d900cc1e0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.064+0000 7f6d8f59e700 1 -- 172.21.15.69:0/825674281 >> 172.21.15.69:0/825674281 conn(0x7f6d900703a0 msgr2=0x7f6d900c61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:57.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.064+0000 7f6d8f59e700 1 -- 172.21.15.69:0/825674281 shutdown_connections 2023-10-06T01:39:57.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.064+0000 7f6d8f59e700 1 -- 172.21.15.69:0/825674281 wait complete. 2023-10-06T01:39:57.067 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 18 2023-10-06T01:39:57.077 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:39:57.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.190+0000 7f19a429b700 1 Processor -- start 2023-10-06T01:39:57.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.190+0000 7f19a429b700 1 -- start start 2023-10-06T01:39:57.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.191+0000 7f19a429b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f199c15a5d0 0x7f199c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.191+0000 7f19a429b700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199c15ae40 con 0x7f199c0cb970 2023-10-06T01:39:57.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.191+0000 7f19a429b700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f199c15ab60 con 0x7f199c0cb5a0 2023-10-06T01:39:57.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.191+0000 7f19a429b700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f199c0ce0f0 con 0x7f199c15a5d0 2023-10-06T01:39:57.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.191+0000 7f19a2838700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f199c15a5d0 0x7f199c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.191+0000 7f19a1836700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f199c0cb970 0x7f199c159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:55136/0 (socket says 172.21.15.69:55136) 2023-10-06T01:39:57.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.191+0000 7f19a1836700 1 -- 172.21.15.69:0/686027120 learned_addr learned my addr 172.21.15.69:0/686027120 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:57.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.191+0000 7f19a2838700 1 -- 172.21.15.69:0/686027120 >> v1:172.21.15.88:6789/0 conn(0x7f199c0cb5a0 legacy=0x7f199c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.191+0000 7f19a2838700 1 -- 172.21.15.69:0/686027120 >> v1:172.21.15.69:6789/0 conn(0x7f199c0cb970 legacy=0x7f199c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.191+0000 7f19a2838700 1 -- 172.21.15.69:0/686027120 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f199c0ccf00 con 0x7f199c15a5d0 2023-10-06T01:39:57.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.191+0000 7f19a2838700 1 --2- 172.21.15.69:0/686027120 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c15a5d0 0x7f199c156e90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1994009e60 tx=0x7f1994009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ce2d82dce34635b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:57.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.191+0000 7f19a1035700 1 -- 172.21.15.69:0/686027120 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f199400e070 con 0x7f199c15a5d0 2023-10-06T01:39:57.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.192+0000 7f19a1035700 1 -- 172.21.15.69:0/686027120 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f199400bc30 con 0x7f199c15a5d0 2023-10-06T01:39:57.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.192+0000 7f19a1035700 1 -- 172.21.15.69:0/686027120 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1994012430 con 0x7f199c15a5d0 2023-10-06T01:39:57.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.192+0000 7f19a429b700 1 -- 172.21.15.69:0/686027120 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c15a5d0 msgr2=0x7f199c156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.192+0000 7f19a429b700 1 --2- 172.21.15.69:0/686027120 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c15a5d0 0x7f199c156e90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f1994009e60 tx=0x7f1994009780 comp rx=0 tx=0).stop 2023-10-06T01:39:57.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.192+0000 7f19a429b700 1 -- 172.21.15.69:0/686027120 shutdown_connections 2023-10-06T01:39:57.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.192+0000 7f19a429b700 1 --2- 172.21.15.69:0/686027120 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c15a5d0 0x7f199c156e90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.192+0000 7f19a429b700 1 -- 172.21.15.69:0/686027120 >> 172.21.15.69:0/686027120 conn(0x7f199c070e30 msgr2=0x7f199c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:57.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.192+0000 7f19a429b700 1 -- 172.21.15.69:0/686027120 shutdown_connections 2023-10-06T01:39:57.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.192+0000 7f19a429b700 1 -- 172.21.15.69:0/686027120 wait complete. 2023-10-06T01:39:57.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.193+0000 7f19a429b700 1 Processor -- start 2023-10-06T01:39:57.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.193+0000 7f19a429b700 1 -- start start 2023-10-06T01:39:57.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.194+0000 7f19a429b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c0cb5a0 0x7f199c0b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.194+0000 7f19a429b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f199c0cb970 0x7f199c151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.194+0000 7f19a429b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f199c15a5d0 0x7f199c0c9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.194+0000 7f19a429b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c156da0 con 0x7f199c0cb5a0 2023-10-06T01:39:57.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.194+0000 7f19a429b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199c0b44a0 con 0x7f199c0cb970 2023-10-06T01:39:57.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.194+0000 7f19a429b700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f199c0b4780 con 0x7f199c15a5d0 2023-10-06T01:39:57.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.194+0000 7f19a2037700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c0cb5a0 0x7f199c0b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.194+0000 7f19a2037700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c0cb5a0 0x7f199c0b3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50438/0 (socket says 172.21.15.69:50438) 2023-10-06T01:39:57.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.194+0000 7f19a2037700 1 -- 172.21.15.69:0/995694143 learned_addr learned my addr 172.21.15.69:0/995694143 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:57.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.194+0000 7f19a1836700 1 --2- 172.21.15.69:0/995694143 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f199c0cb970 0x7f199c151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.194+0000 7f19a2838700 1 --2- 172.21.15.69:0/995694143 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f199c15a5d0 0x7f199c0c9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.194+0000 7f19a2037700 1 -- 172.21.15.69:0/995694143 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f199c15a5d0 msgr2=0x7f199c0c9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.194+0000 7f19a2037700 1 --2- 172.21.15.69:0/995694143 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f199c15a5d0 0x7f199c0c9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.194+0000 7f19a2037700 1 -- 172.21.15.69:0/995694143 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f199c0cb970 msgr2=0x7f199c151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.194+0000 7f19a2037700 1 --2- 172.21.15.69:0/995694143 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f199c0cb970 0x7f199c151500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.194+0000 7f19a2037700 1 -- 172.21.15.69:0/995694143 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1994009a20 con 0x7f199c0cb5a0 2023-10-06T01:39:57.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.194+0000 7f19a1836700 1 --2- 172.21.15.69:0/995694143 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f199c0cb970 0x7f199c151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:57.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.194+0000 7f19a2037700 1 --2- 172.21.15.69:0/995694143 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c0cb5a0 0x7f199c0b3e60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f199800c790 tx=0x7f1998007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:57.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.194+0000 7f19927fc700 1 -- 172.21.15.69:0/995694143 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1998011590 con 0x7f199c0cb5a0 2023-10-06T01:39:57.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.194+0000 7f19927fc700 1 -- 172.21.15.69:0/995694143 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1998011710 con 0x7f199c0cb5a0 2023-10-06T01:39:57.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.194+0000 7f19927fc700 1 -- 172.21.15.69:0/995694143 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1998011ad0 con 0x7f199c0cb5a0 2023-10-06T01:39:57.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.194+0000 7f19a429b700 1 -- 172.21.15.69:0/995694143 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f199c0b4a60 con 0x7f199c0cb5a0 2023-10-06T01:39:57.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.195+0000 7f19a429b700 1 -- 172.21.15.69:0/995694143 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f199c0c9a40 con 0x7f199c0cb5a0 2023-10-06T01:39:57.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.195+0000 7f19a429b700 1 -- 172.21.15.69:0/995694143 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f199c04c3c0 con 0x7f199c0cb5a0 2023-10-06T01:39:57.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.196+0000 7f19927fc700 1 -- 172.21.15.69:0/995694143 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f199801b3b0 con 0x7f199c0cb5a0 2023-10-06T01:39:57.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.196+0000 7f19927fc700 1 --2- 172.21.15.69:0/995694143 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1980066fc0 0x7f1980069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.196+0000 7f19927fc700 1 -- 172.21.15.69:0/995694143 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1998083bd0 con 0x7f199c0cb5a0 2023-10-06T01:39:57.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.196+0000 7f19a1836700 1 --2- 172.21.15.69:0/995694143 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1980066fc0 0x7f1980069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.197+0000 7f19a1836700 1 --2- 172.21.15.69:0/995694143 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1980066fc0 0x7f1980069470 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f199c0c6670 tx=0x7f198c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:57.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.200+0000 7f19927fc700 1 -- 172.21.15.69:0/995694143 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1998050cf0 con 0x7f199c0cb5a0 2023-10-06T01:39:57.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.385+0000 7f19a429b700 1 -- 172.21.15.69:0/995694143 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f199c0cabc0 con 0x7f199c0cb5a0 2023-10-06T01:39:57.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.386+0000 7f19927fc700 1 -- 172.21.15.69:0/995694143 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f1998017070 con 0x7f199c0cb5a0 2023-10-06T01:39:57.387 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:57.388 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":35,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:39:40.515179+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:38:43.046056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:39:37.033167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T01:39:37.950855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:39:57.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.388+0000 7f19a429b700 1 -- 172.21.15.69:0/995694143 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1980066fc0 msgr2=0x7f1980069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.388+0000 7f19a429b700 1 --2- 172.21.15.69:0/995694143 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1980066fc0 0x7f1980069470 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f199c0c6670 tx=0x7f198c009040 comp rx=0 tx=0).stop 2023-10-06T01:39:57.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.388+0000 7f19a429b700 1 -- 172.21.15.69:0/995694143 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c0cb5a0 msgr2=0x7f199c0b3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.388+0000 7f19a429b700 1 --2- 172.21.15.69:0/995694143 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c0cb5a0 0x7f199c0b3e60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f199800c790 tx=0x7f1998007f40 comp rx=0 tx=0).stop 2023-10-06T01:39:57.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.388+0000 7f19a429b700 1 -- 172.21.15.69:0/995694143 shutdown_connections 2023-10-06T01:39:57.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.388+0000 7f19a429b700 1 --2- 172.21.15.69:0/995694143 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1980066fc0 0x7f1980069470 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.388+0000 7f19a429b700 1 --2- 172.21.15.69:0/995694143 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f199c15a5d0 0x7f199c0c9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.388+0000 7f19a429b700 1 --2- 172.21.15.69:0/995694143 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c0cb5a0 0x7f199c0b3e60 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.388+0000 7f19a429b700 1 --2- 172.21.15.69:0/995694143 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f199c0cb970 0x7f199c151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.388+0000 7f19a429b700 1 -- 172.21.15.69:0/995694143 >> 172.21.15.69:0/995694143 conn(0x7f199c070e30 msgr2=0x7f199c0b0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:57.390 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.388+0000 7f19a429b700 1 -- 172.21.15.69:0/995694143 shutdown_connections 2023-10-06T01:39:57.391 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.388+0000 7f19a429b700 1 -- 172.21.15.69:0/995694143 wait complete. 2023-10-06T01:39:57.401 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:38:38.288642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:38:43.046056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-06T01:39:37.033167+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-10-06T01:39:37.950855+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-06T01:39:57.402 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:39:57.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.518+0000 7f328049d700 1 Processor -- start 2023-10-06T01:39:57.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.518+0000 7f328049d700 1 -- start start 2023-10-06T01:39:57.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.519+0000 7f328049d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f327806dc70 0x7f3278159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.519+0000 7f328049d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f327806e0e0 0x7f32780cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.519+0000 7f328049d700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32780ccfd0 con 0x7f3278159530 2023-10-06T01:39:57.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.519+0000 7f328049d700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f327815a3d0 con 0x7f327806e0e0 2023-10-06T01:39:57.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.519+0000 7f328049d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327815a6b0 con 0x7f327806dc70 2023-10-06T01:39:57.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.519+0000 7f327ea3a700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f327806e0e0 0x7f32780cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.519+0000 7f327e239700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f3278159530 0x7f32780ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:45372/0 (socket says 172.21.15.69:45372) 2023-10-06T01:39:57.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.519+0000 7f327e239700 1 -- 172.21.15.69:0/275388518 learned_addr learned my addr 172.21.15.69:0/275388518 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:57.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.519+0000 7f327da38700 1 --2- 172.21.15.69:0/275388518 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f327806dc70 0x7f3278159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.520+0000 7f327ea3a700 1 -- 172.21.15.69:0/275388518 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f327806dc70 msgr2=0x7f3278159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:57.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.520+0000 7f327ea3a700 1 --2- 172.21.15.69:0/275388518 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f327806dc70 0x7f3278159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.520+0000 7f327ea3a700 1 -- 172.21.15.69:0/275388518 >> v1:172.21.15.69:6789/0 conn(0x7f3278159530 legacy=0x7f32780ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.520+0000 7f327d237700 1 -- 172.21.15.69:0/275388518 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3216061293 0 0) 0x7f32780ccfd0 con 0x7f3278159530 2023-10-06T01:39:57.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.520+0000 7f327ea3a700 1 -- 172.21.15.69:0/275388518 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327815a990 con 0x7f327806e0e0 2023-10-06T01:39:57.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.520+0000 7f327ea3a700 1 --2- 172.21.15.69:0/275388518 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f327806e0e0 0x7f32780cb6f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f32700098e0 tx=0x7f32700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b81941cfa3fd4028 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:57.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.520+0000 7f327d237700 1 -- 172.21.15.69:0/275388518 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327000b640 con 0x7f327806e0e0 2023-10-06T01:39:57.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.520+0000 7f327d237700 1 -- 172.21.15.69:0/275388518 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327000b7a0 con 0x7f327806e0e0 2023-10-06T01:39:57.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.520+0000 7f327d237700 1 -- 172.21.15.69:0/275388518 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327000bb40 con 0x7f327806e0e0 2023-10-06T01:39:57.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.520+0000 7f328049d700 1 -- 172.21.15.69:0/275388518 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f327806e0e0 msgr2=0x7f32780cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.520+0000 7f328049d700 1 --2- 172.21.15.69:0/275388518 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f327806e0e0 0x7f32780cb6f0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f32700098e0 tx=0x7f32700091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.520+0000 7f328049d700 1 -- 172.21.15.69:0/275388518 shutdown_connections 2023-10-06T01:39:57.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.520+0000 7f328049d700 1 --2- 172.21.15.69:0/275388518 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f327806e0e0 0x7f32780cb6f0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.520+0000 7f328049d700 1 --2- 172.21.15.69:0/275388518 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f327806dc70 0x7f3278159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.520+0000 7f328049d700 1 -- 172.21.15.69:0/275388518 >> 172.21.15.69:0/275388518 conn(0x7f32780703a0 msgr2=0x7f32780707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:57.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.520+0000 7f328049d700 1 -- 172.21.15.69:0/275388518 shutdown_connections 2023-10-06T01:39:57.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.520+0000 7f328049d700 1 -- 172.21.15.69:0/275388518 wait complete. 2023-10-06T01:39:57.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.521+0000 7f328049d700 1 Processor -- start 2023-10-06T01:39:57.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.522+0000 7f328049d700 1 -- start start 2023-10-06T01:39:57.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.522+0000 7f328049d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f327806dc70 0x7f32780b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.522+0000 7f328049d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f327806e0e0 0x7f32780b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.522+0000 7f328049d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3278159530 0x7f32780b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.522+0000 7f328049d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32780b5040 con 0x7f327806e0e0 2023-10-06T01:39:57.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.522+0000 7f328049d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32780b62d0 con 0x7f327806dc70 2023-10-06T01:39:57.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.522+0000 7f328049d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32780b3a60 con 0x7f3278159530 2023-10-06T01:39:57.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.522+0000 7f327da38700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f327806e0e0 0x7f32780b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.522+0000 7f327da38700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f327806e0e0 0x7f32780b4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33172/0 (socket says 172.21.15.69:33172) 2023-10-06T01:39:57.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.522+0000 7f327da38700 1 -- 172.21.15.69:0/154092285 learned_addr learned my addr 172.21.15.69:0/154092285 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:57.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.523+0000 7f327e239700 1 --2- 172.21.15.69:0/154092285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f327806dc70 0x7f32780b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.523+0000 7f327ea3a700 1 --2- 172.21.15.69:0/154092285 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3278159530 0x7f32780b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.523+0000 7f327da38700 1 -- 172.21.15.69:0/154092285 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3278159530 msgr2=0x7f32780b5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.523+0000 7f327da38700 1 --2- 172.21.15.69:0/154092285 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3278159530 0x7f32780b5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.523+0000 7f327da38700 1 -- 172.21.15.69:0/154092285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f327806dc70 msgr2=0x7f32780b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.523+0000 7f327da38700 1 --2- 172.21.15.69:0/154092285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f327806dc70 0x7f32780b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.523+0000 7f327da38700 1 -- 172.21.15.69:0/154092285 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3270009420 con 0x7f327806e0e0 2023-10-06T01:39:57.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.523+0000 7f327da38700 1 --2- 172.21.15.69:0/154092285 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f327806e0e0 0x7f32780b4b00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f326c00ec80 tx=0x7f326c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:57.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.523+0000 7f32767fc700 1 -- 172.21.15.69:0/154092285 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c00ca60 con 0x7f327806e0e0 2023-10-06T01:39:57.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.523+0000 7f32767fc700 1 -- 172.21.15.69:0/154092285 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326c00cbe0 con 0x7f327806e0e0 2023-10-06T01:39:57.528 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.523+0000 7f328049d700 1 -- 172.21.15.69:0/154092285 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32780b3d40 con 0x7f327806e0e0 2023-10-06T01:39:57.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.523+0000 7f32767fc700 1 -- 172.21.15.69:0/154092285 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326c013470 con 0x7f327806e0e0 2023-10-06T01:39:57.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.523+0000 7f328049d700 1 -- 172.21.15.69:0/154092285 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32780b4300 con 0x7f327806e0e0 2023-10-06T01:39:57.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.524+0000 7f328049d700 1 -- 172.21.15.69:0/154092285 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f327804c3c0 con 0x7f327806e0e0 2023-10-06T01:39:57.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.524+0000 7f32767fc700 1 -- 172.21.15.69:0/154092285 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f326c013860 con 0x7f327806e0e0 2023-10-06T01:39:57.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.525+0000 7f32767fc700 1 --2- 172.21.15.69:0/154092285 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3264066fc0 0x7f3264069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.525+0000 7f32767fc700 1 -- 172.21.15.69:0/154092285 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f326c084ac0 con 0x7f327806e0e0 2023-10-06T01:39:57.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.525+0000 7f327e239700 1 --2- 172.21.15.69:0/154092285 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3264066fc0 0x7f3264069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.529 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.525+0000 7f327e239700 1 --2- 172.21.15.69:0/154092285 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3264066fc0 0x7f3264069470 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3268002230 tx=0x7f3268009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:57.530 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.529+0000 7f32767fc700 1 -- 172.21.15.69:0/154092285 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f326c051be0 con 0x7f327806e0e0 2023-10-06T01:39:57.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.680+0000 7f32767fc700 1 -- 172.21.15.69:0/154092285 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f326c051fb0 con 0x7f327806e0e0 2023-10-06T01:39:57.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.716+0000 7f328049d700 1 -- 172.21.15.69:0/154092285 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f327815ac70 con 0x7f327806e0e0 2023-10-06T01:39:57.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.716+0000 7f32767fc700 1 -- 172.21.15.69:0/154092285 <== mon.0 v2:172.21.15.69:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f326c055670 con 0x7f327806e0e0 2023-10-06T01:39:57.718 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-10-06T01:39:57.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.719+0000 7f328049d700 1 -- 172.21.15.69:0/154092285 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3264066fc0 msgr2=0x7f3264069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.719+0000 7f328049d700 1 --2- 172.21.15.69:0/154092285 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3264066fc0 0x7f3264069470 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f3268002230 tx=0x7f3268009040 comp rx=0 tx=0).stop 2023-10-06T01:39:57.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.719+0000 7f328049d700 1 -- 172.21.15.69:0/154092285 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f327806e0e0 msgr2=0x7f32780b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.719+0000 7f328049d700 1 --2- 172.21.15.69:0/154092285 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f327806e0e0 0x7f32780b4b00 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f326c00ec80 tx=0x7f326c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.719+0000 7f328049d700 1 -- 172.21.15.69:0/154092285 shutdown_connections 2023-10-06T01:39:57.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.719+0000 7f328049d700 1 --2- 172.21.15.69:0/154092285 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f3264066fc0 0x7f3264069470 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.719+0000 7f328049d700 1 --2- 172.21.15.69:0/154092285 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f3278159530 0x7f32780b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.719+0000 7f328049d700 1 --2- 172.21.15.69:0/154092285 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f327806dc70 0x7f32780b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.719+0000 7f328049d700 1 --2- 172.21.15.69:0/154092285 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f327806e0e0 0x7f32780b4b00 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.719+0000 7f328049d700 1 -- 172.21.15.69:0/154092285 >> 172.21.15.69:0/154092285 conn(0x7f32780703a0 msgr2=0x7f327815cad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:57.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.719+0000 7f328049d700 1 -- 172.21.15.69:0/154092285 shutdown_connections 2023-10-06T01:39:57.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.719+0000 7f328049d700 1 -- 172.21.15.69:0/154092285 wait complete. 2023-10-06T01:39:57.732 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:39:57.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.848+0000 7fae575eb700 1 Processor -- start 2023-10-06T01:39:57.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.849+0000 7fae575eb700 1 -- start start 2023-10-06T01:39:57.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.849+0000 7fae575eb700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fae500cc320 0x7fae5013c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.849+0000 7fae575eb700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fae5006a110 0x7fae5013c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.849+0000 7fae575eb700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae5006d7b0 con 0x7fae500cc6f0 2023-10-06T01:39:57.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.849+0000 7fae575eb700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae5006a590 con 0x7fae5006a110 2023-10-06T01:39:57.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.849+0000 7fae575eb700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae5006f7d0 con 0x7fae500cc320 2023-10-06T01:39:57.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.849+0000 7fae55b88700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fae5006a110 0x7fae5013c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.849+0000 7fae54b86700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fae500cc6f0 0x7fae50069a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:45380/0 (socket says 172.21.15.69:45380) 2023-10-06T01:39:57.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.850+0000 7fae54b86700 1 -- 172.21.15.69:0/123082 learned_addr learned my addr 172.21.15.69:0/123082 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:57.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.849+0000 7fae55b88700 1 --2- 172.21.15.69:0/123082 >> v2:172.21.15.69:3300/0 conn(0x7fae5006a110 0x7fae5013c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33178/0 (socket says 172.21.15.69:33178) 2023-10-06T01:39:57.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.850+0000 7fae55387700 1 --2- 172.21.15.69:0/123082 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fae500cc320 0x7fae5013c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.850+0000 7fae55b88700 1 -- 172.21.15.69:0/123082 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fae500cc320 msgr2=0x7fae5013c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:57.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.850+0000 7fae55b88700 1 --2- 172.21.15.69:0/123082 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fae500cc320 0x7fae5013c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.850+0000 7fae55b88700 1 -- 172.21.15.69:0/123082 >> v1:172.21.15.69:6789/0 conn(0x7fae500cc6f0 legacy=0x7fae50069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.850+0000 7fae55b88700 1 -- 172.21.15.69:0/123082 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae5006e330 con 0x7fae5006a110 2023-10-06T01:39:57.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.850+0000 7fae55b88700 1 --2- 172.21.15.69:0/123082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae5006a110 0x7fae5013c7e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fae480098e0 tx=0x7fae480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7869bea96b239d41 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:57.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.850+0000 7fae4ffff700 1 -- 172.21.15.69:0/123082 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae48009e80 con 0x7fae5006a110 2023-10-06T01:39:57.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.850+0000 7fae4ffff700 1 -- 172.21.15.69:0/123082 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae4800b860 con 0x7fae5006a110 2023-10-06T01:39:57.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.850+0000 7fae4ffff700 1 -- 172.21.15.69:0/123082 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4800bbe0 con 0x7fae5006a110 2023-10-06T01:39:57.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.851+0000 7fae575eb700 1 -- 172.21.15.69:0/123082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae5006a110 msgr2=0x7fae5013c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.851+0000 7fae575eb700 1 --2- 172.21.15.69:0/123082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae5006a110 0x7fae5013c7e0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fae480098e0 tx=0x7fae480091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.851+0000 7fae575eb700 1 -- 172.21.15.69:0/123082 shutdown_connections 2023-10-06T01:39:57.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.851+0000 7fae575eb700 1 --2- 172.21.15.69:0/123082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae5006a110 0x7fae5013c7e0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.851+0000 7fae575eb700 1 --2- 172.21.15.69:0/123082 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fae500cc320 0x7fae5013c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.851+0000 7fae575eb700 1 -- 172.21.15.69:0/123082 >> 172.21.15.69:0/123082 conn(0x7fae50067f00 msgr2=0x7fae50068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:57.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.851+0000 7fae575eb700 1 -- 172.21.15.69:0/123082 shutdown_connections 2023-10-06T01:39:57.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.851+0000 7fae575eb700 1 -- 172.21.15.69:0/123082 wait complete. 2023-10-06T01:39:57.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.852+0000 7fae575eb700 1 Processor -- start 2023-10-06T01:39:57.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.852+0000 7fae575eb700 1 -- start start 2023-10-06T01:39:57.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.853+0000 7fae575eb700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae5006a110 0x7fae50152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.853+0000 7fae575eb700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fae500cc320 0x7fae500c5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.853+0000 7fae575eb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae500cc6f0 0x7fae50136890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.853+0000 7fae575eb700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae500ca140 con 0x7fae500cc6f0 2023-10-06T01:39:57.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.853+0000 7fae575eb700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae50153500 con 0x7fae5006a110 2023-10-06T01:39:57.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.853+0000 7fae575eb700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae500c6590 con 0x7fae500cc320 2023-10-06T01:39:57.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.853+0000 7fae55b88700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae500cc6f0 0x7fae50136890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.853+0000 7fae55b88700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae500cc6f0 0x7fae50136890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33190/0 (socket says 172.21.15.69:33190) 2023-10-06T01:39:57.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.853+0000 7fae55b88700 1 -- 172.21.15.69:0/1566466471 learned_addr learned my addr 172.21.15.69:0/1566466471 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:57.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.853+0000 7fae55b88700 1 -- 172.21.15.69:0/1566466471 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fae500cc320 msgr2=0x7fae500c5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.853+0000 7fae54b86700 1 --2- 172.21.15.69:0/1566466471 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fae500cc320 0x7fae500c5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.853+0000 7fae55387700 1 --2- 172.21.15.69:0/1566466471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae5006a110 0x7fae50152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.853+0000 7fae55b88700 1 --2- 172.21.15.69:0/1566466471 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fae500cc320 0x7fae500c5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.853+0000 7fae55b88700 1 -- 172.21.15.69:0/1566466471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae5006a110 msgr2=0x7fae50152fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:57.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.853+0000 7fae55b88700 1 --2- 172.21.15.69:0/1566466471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae5006a110 0x7fae50152fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:57.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.853+0000 7fae55b88700 1 -- 172.21.15.69:0/1566466471 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae48009420 con 0x7fae500cc6f0 2023-10-06T01:39:57.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.853+0000 7fae55b88700 1 --2- 172.21.15.69:0/1566466471 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae500cc6f0 0x7fae50136890 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fae500cf610 tx=0x7fae48017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:57.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.853+0000 7fae4d7fa700 1 -- 172.21.15.69:0/1566466471 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae4800bb50 con 0x7fae500cc6f0 2023-10-06T01:39:57.858 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.853+0000 7fae4d7fa700 1 -- 172.21.15.69:0/1566466471 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae48011630 con 0x7fae500cc6f0 2023-10-06T01:39:57.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.853+0000 7fae4d7fa700 1 -- 172.21.15.69:0/1566466471 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae480119f0 con 0x7fae500cc6f0 2023-10-06T01:39:57.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.853+0000 7fae575eb700 1 -- 172.21.15.69:0/1566466471 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae500c6870 con 0x7fae500cc6f0 2023-10-06T01:39:57.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.853+0000 7fae575eb700 1 -- 172.21.15.69:0/1566466471 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae500c6e30 con 0x7fae500cc6f0 2023-10-06T01:39:57.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.854+0000 7fae575eb700 1 -- 172.21.15.69:0/1566466471 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae500ca310 con 0x7fae500cc6f0 2023-10-06T01:39:57.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.855+0000 7fae4d7fa700 1 -- 172.21.15.69:0/1566466471 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fae480233f0 con 0x7fae500cc6f0 2023-10-06T01:39:57.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.855+0000 7fae4d7fa700 1 --2- 172.21.15.69:0/1566466471 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fae340670e0 0x7fae34069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:57.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.855+0000 7fae4d7fa700 1 -- 172.21.15.69:0/1566466471 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fae48086090 con 0x7fae500cc6f0 2023-10-06T01:39:57.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.855+0000 7fae55387700 1 --2- 172.21.15.69:0/1566466471 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fae340670e0 0x7fae34069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:57.859 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.856+0000 7fae55387700 1 --2- 172.21.15.69:0/1566466471 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fae340670e0 0x7fae34069590 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fae44007460 tx=0x7fae4400b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:57.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:57.859+0000 7fae4d7fa700 1 -- 172.21.15.69:0/1566466471 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae48052f20 con 0x7fae500cc6f0 2023-10-06T01:39:58.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.042+0000 7fae575eb700 1 -- 172.21.15.69:0/1566466471 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fae5004c3c0 con 0x7fae500cc6f0 2023-10-06T01:39:58.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.042+0000 7fae4d7fa700 1 -- 172.21.15.69:0/1566466471 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v35) v1 ==== 92+0+10 (secure 0 0 0) 0x7fae48056540 con 0x7fae500cc6f0 2023-10-06T01:39:58.044 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 8 2023-10-06T01:39:58.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.044+0000 7fae575eb700 1 -- 172.21.15.69:0/1566466471 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fae340670e0 msgr2=0x7fae34069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.044+0000 7fae575eb700 1 --2- 172.21.15.69:0/1566466471 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fae340670e0 0x7fae34069590 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fae44007460 tx=0x7fae4400b040 comp rx=0 tx=0).stop 2023-10-06T01:39:58.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.044+0000 7fae575eb700 1 -- 172.21.15.69:0/1566466471 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae500cc6f0 msgr2=0x7fae50136890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.044+0000 7fae575eb700 1 --2- 172.21.15.69:0/1566466471 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae500cc6f0 0x7fae50136890 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fae500cf610 tx=0x7fae48017000 comp rx=0 tx=0).stop 2023-10-06T01:39:58.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.044+0000 7fae575eb700 1 -- 172.21.15.69:0/1566466471 shutdown_connections 2023-10-06T01:39:58.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.044+0000 7fae575eb700 1 --2- 172.21.15.69:0/1566466471 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fae340670e0 0x7fae34069590 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.044+0000 7fae575eb700 1 --2- 172.21.15.69:0/1566466471 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae500cc6f0 0x7fae50136890 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.044+0000 7fae575eb700 1 --2- 172.21.15.69:0/1566466471 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fae5006a110 0x7fae50152fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.044+0000 7fae575eb700 1 --2- 172.21.15.69:0/1566466471 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fae500cc320 0x7fae500c5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.044+0000 7fae575eb700 1 -- 172.21.15.69:0/1566466471 >> 172.21.15.69:0/1566466471 conn(0x7fae50067f00 msgr2=0x7fae50138010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:58.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.044+0000 7fae575eb700 1 -- 172.21.15.69:0/1566466471 shutdown_connections 2023-10-06T01:39:58.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.044+0000 7fae575eb700 1 -- 172.21.15.69:0/1566466471 wait complete. 2023-10-06T01:39:58.057 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-06T01:39:58.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.173+0000 7fe2010f8700 1 Processor -- start 2023-10-06T01:39:58.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.173+0000 7fe2010f8700 1 -- start start 2023-10-06T01:39:58.178 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.174+0000 7fe2010f8700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1fc159530 0x7fe1fc0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.174+0000 7fe2010f8700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe1fc06e0e0 0x7fe1fc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.174+0000 7fe2010f8700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1fc0ccfd0 con 0x7fe1fc06dc70 2023-10-06T01:39:58.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.174+0000 7fe2010f8700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1fc0cf0e0 con 0x7fe1fc06e0e0 2023-10-06T01:39:58.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.174+0000 7fe2010f8700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc15a3d0 con 0x7fe1fc159530 2023-10-06T01:39:58.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.174+0000 7fe1f259c700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fe1fc06dc70 0x7fe1fc159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:45390/0 (socket says 172.21.15.69:45390) 2023-10-06T01:39:58.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.174+0000 7fe1f259c700 1 -- 172.21.15.69:0/2828700552 learned_addr learned my addr 172.21.15.69:0/2828700552 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:58.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.174+0000 7fe1fb59e700 1 --2- 172.21.15.69:0/2828700552 >> v2:172.21.15.88:3300/0 conn(0x7fe1fc06e0e0 0x7fe1fc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.174+0000 7fe1fad9d700 1 --2- 172.21.15.69:0/2828700552 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1fc159530 0x7fe1fc0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.174+0000 7fe1fa59c700 1 -- 172.21.15.69:0/2828700552 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3901207923 0 0) 0x7fe1fc0ccfd0 con 0x7fe1fc06dc70 2023-10-06T01:39:58.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.174+0000 7fe1fa59c700 1 -- 172.21.15.69:0/2828700552 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1e8003570 con 0x7fe1fc06dc70 2023-10-06T01:39:58.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.175+0000 7fe1fa59c700 1 -- 172.21.15.69:0/2828700552 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 174043251 0 0) 0x7fe1e8003570 con 0x7fe1fc06dc70 2023-10-06T01:39:58.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.175+0000 7fe1fa59c700 1 -- 172.21.15.69:0/2828700552 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1fc159530 msgr2=0x7fe1fc0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:58.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.175+0000 7fe1fa59c700 1 --2- 172.21.15.69:0/2828700552 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1fc159530 0x7fe1fc0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.175+0000 7fe1fa59c700 1 -- 172.21.15.69:0/2828700552 >> v2:172.21.15.88:3300/0 conn(0x7fe1fc06e0e0 msgr2=0x7fe1fc0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:58.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.175+0000 7fe1fa59c700 1 --2- 172.21.15.69:0/2828700552 >> v2:172.21.15.88:3300/0 conn(0x7fe1fc06e0e0 0x7fe1fc0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.175+0000 7fe1fa59c700 1 -- 172.21.15.69:0/2828700552 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1fc15a6b0 con 0x7fe1fc06dc70 2023-10-06T01:39:58.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.175+0000 7fe1fa59c700 1 -- 172.21.15.69:0/2828700552 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7fe1e4001470 con 0x7fe1fc06dc70 2023-10-06T01:39:58.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.175+0000 7fe1fa59c700 1 -- 172.21.15.69:0/2828700552 >> v1:172.21.15.69:6789/0 conn(0x7fe1fc06dc70 legacy=0x7fe1fc159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.175+0000 7fe1fa59c700 1 --2- 172.21.15.69:0/2828700552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1e8003a60 0x7fe1e8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.175+0000 7fe1fa59c700 1 --2- 172.21.15.69:0/2828700552 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1fc159530 0x7fe1e8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.175+0000 7fe1fa59c700 1 --2- 172.21.15.69:0/2828700552 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1e8004d50 0x7fe1e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.175+0000 7fe1fa59c700 1 -- 172.21.15.69:0/2828700552 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc0cf0e0 con 0x7fe1e8004d50 2023-10-06T01:39:58.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.175+0000 7fe1fa59c700 1 -- 172.21.15.69:0/2828700552 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc15a3d0 con 0x7fe1e8003a60 2023-10-06T01:39:58.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.175+0000 7fe1fa59c700 1 -- 172.21.15.69:0/2828700552 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e800ba60 con 0x7fe1fc159530 2023-10-06T01:39:58.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.175+0000 7fe1fb59e700 1 --2- 172.21.15.69:0/2828700552 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1e8004d50 0x7fe1e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.175+0000 7fe1fad9d700 1 --2- 172.21.15.69:0/2828700552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1e8003a60 0x7fe1e8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.175+0000 7fe1f259c700 1 --2- 172.21.15.69:0/2828700552 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1fc159530 0x7fe1e8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.175+0000 7fe1fb59e700 1 -- 172.21.15.69:0/2828700552 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1fc159530 msgr2=0x7fe1e8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:58.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.175+0000 7fe1fb59e700 1 --2- 172.21.15.69:0/2828700552 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1fc159530 0x7fe1e8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.175+0000 7fe1fb59e700 1 -- 172.21.15.69:0/2828700552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1e8003a60 msgr2=0x7fe1e8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:58.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.175+0000 7fe1fb59e700 1 --2- 172.21.15.69:0/2828700552 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1e8003a60 0x7fe1e8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.175+0000 7fe1fb59e700 1 -- 172.21.15.69:0/2828700552 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e8003570 con 0x7fe1e8004d50 2023-10-06T01:39:58.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.175+0000 7fe1fb59e700 1 --2- 172.21.15.69:0/2828700552 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1e8004d50 0x7fe1e80051c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc0cacd0 tx=0x7fe1f400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b931a488ef8e75c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:58.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.175+0000 7fe1fa59c700 1 -- 172.21.15.69:0/2828700552 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f400ea30 con 0x7fe1e8004d50 2023-10-06T01:39:58.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.175+0000 7fe1fa59c700 1 -- 172.21.15.69:0/2828700552 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f400f040 con 0x7fe1e8004d50 2023-10-06T01:39:58.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.175+0000 7fe1fa59c700 1 -- 172.21.15.69:0/2828700552 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f400ede0 con 0x7fe1e8004d50 2023-10-06T01:39:58.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.176+0000 7fe2010f8700 1 -- 172.21.15.69:0/2828700552 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1e8004d50 msgr2=0x7fe1e80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.176+0000 7fe2010f8700 1 --2- 172.21.15.69:0/2828700552 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1e8004d50 0x7fe1e80051c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc0cacd0 tx=0x7fe1f400b040 comp rx=0 tx=0).stop 2023-10-06T01:39:58.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.176+0000 7fe1fb59e700 1 -- 172.21.15.69:0/2828700552 reap_dead start 2023-10-06T01:39:58.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.176+0000 7fe2010f8700 1 -- 172.21.15.69:0/2828700552 shutdown_connections 2023-10-06T01:39:58.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.176+0000 7fe2010f8700 1 -- 172.21.15.69:0/2828700552 >> 172.21.15.69:0/2828700552 conn(0x7fe1fc0703a0 msgr2=0x7fe1fc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:58.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.176+0000 7fe2010f8700 1 -- 172.21.15.69:0/2828700552 shutdown_connections 2023-10-06T01:39:58.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.176+0000 7fe2010f8700 1 -- 172.21.15.69:0/2828700552 wait complete. 2023-10-06T01:39:58.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.177+0000 7fe2010f8700 1 Processor -- start 2023-10-06T01:39:58.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.177+0000 7fe2010f8700 1 -- start start 2023-10-06T01:39:58.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.178+0000 7fe2010f8700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1fc150b70 0x7fe1fc155bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.178+0000 7fe2010f8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1fc0ca390 0x7fe1fc0c8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.178+0000 7fe2010f8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1fc0c8d70 0x7fe1fc14e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.178+0000 7fe2010f8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc14daa0 con 0x7fe1fc0c8d70 2023-10-06T01:39:58.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.178+0000 7fe2010f8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc0c83a0 con 0x7fe1fc0ca390 2023-10-06T01:39:58.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.178+0000 7fe2010f8700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1fc0c7790 con 0x7fe1fc150b70 2023-10-06T01:39:58.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.178+0000 7fe1fb59e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1fc0c8d70 0x7fe1fc14e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.178+0000 7fe1fb59e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1fc0c8d70 0x7fe1fc14e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33216/0 (socket says 172.21.15.69:33216) 2023-10-06T01:39:58.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.178+0000 7fe1fb59e700 1 -- 172.21.15.69:0/1547073809 learned_addr learned my addr 172.21.15.69:0/1547073809 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:58.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.178+0000 7fe1fad9d700 1 --2- 172.21.15.69:0/1547073809 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1fc150b70 0x7fe1fc155bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.178+0000 7fe1f259c700 1 --2- 172.21.15.69:0/1547073809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1fc0ca390 0x7fe1fc0c8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.178+0000 7fe1fb59e700 1 -- 172.21.15.69:0/1547073809 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1fc150b70 msgr2=0x7fe1fc155bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.178+0000 7fe1fb59e700 1 --2- 172.21.15.69:0/1547073809 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1fc150b70 0x7fe1fc155bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.178+0000 7fe1fb59e700 1 -- 172.21.15.69:0/1547073809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1fc0ca390 msgr2=0x7fe1fc0c8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.178+0000 7fe1fb59e700 1 --2- 172.21.15.69:0/1547073809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1fc0ca390 0x7fe1fc0c8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.178+0000 7fe1fb59e700 1 -- 172.21.15.69:0/1547073809 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1fc0c7a70 con 0x7fe1fc0c8d70 2023-10-06T01:39:58.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.178+0000 7fe1f259c700 1 --2- 172.21.15.69:0/1547073809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1fc0ca390 0x7fe1fc0c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:39:58.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.178+0000 7fe1fb59e700 1 --2- 172.21.15.69:0/1547073809 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1fc0c8d70 0x7fe1fc14e6d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4016000 tx=0x7fe1f401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:58.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.179+0000 7fe1f37fe700 1 -- 172.21.15.69:0/1547073809 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f400ee90 con 0x7fe1fc0c8d70 2023-10-06T01:39:58.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.179+0000 7fe1f37fe700 1 -- 172.21.15.69:0/1547073809 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1f4022070 con 0x7fe1fc0c8d70 2023-10-06T01:39:58.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.179+0000 7fe2010f8700 1 -- 172.21.15.69:0/1547073809 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1fc0c7d50 con 0x7fe1fc0c8d70 2023-10-06T01:39:58.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.179+0000 7fe1f37fe700 1 -- 172.21.15.69:0/1547073809 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1f4027680 con 0x7fe1fc0c8d70 2023-10-06T01:39:58.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.179+0000 7fe2010f8700 1 -- 172.21.15.69:0/1547073809 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1fc150f40 con 0x7fe1fc0c8d70 2023-10-06T01:39:58.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.179+0000 7fe2010f8700 1 -- 172.21.15.69:0/1547073809 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1fc0c8530 con 0x7fe1fc0c8d70 2023-10-06T01:39:58.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.180+0000 7fe1f37fe700 1 -- 172.21.15.69:0/1547073809 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fe1f4024030 con 0x7fe1fc0c8d70 2023-10-06T01:39:58.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.180+0000 7fe1f37fe700 1 --2- 172.21.15.69:0/1547073809 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe1dc0670e0 0x7fe1dc069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.180+0000 7fe1fad9d700 1 --2- 172.21.15.69:0/1547073809 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe1dc0670e0 0x7fe1dc069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.180+0000 7fe1f37fe700 1 -- 172.21.15.69:0/1547073809 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe1f4086840 con 0x7fe1fc0c8d70 2023-10-06T01:39:58.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.181+0000 7fe1fad9d700 1 --2- 172.21.15.69:0/1547073809 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe1dc0670e0 0x7fe1dc069590 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec006f00 tx=0x7fe1ec0091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:58.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.185+0000 7fe1f37fe700 1 -- 172.21.15.69:0/1547073809 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1f40536d0 con 0x7fe1fc0c8d70 2023-10-06T01:39:58.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.367+0000 7fe2010f8700 1 -- 172.21.15.69:0/1547073809 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe1fc04c3c0 con 0x7fe1fc0c8d70 2023-10-06T01:39:58.369 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.368+0000 7fe1f37fe700 1 -- 172.21.15.69:0/1547073809 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe1f4056cf0 con 0x7fe1fc0c8d70 2023-10-06T01:39:58.369 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2023-10-06T01:39:58.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.370+0000 7fe2010f8700 1 -- 172.21.15.69:0/1547073809 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe1dc0670e0 msgr2=0x7fe1dc069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.370+0000 7fe2010f8700 1 --2- 172.21.15.69:0/1547073809 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe1dc0670e0 0x7fe1dc069590 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec006f00 tx=0x7fe1ec0091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.370+0000 7fe2010f8700 1 -- 172.21.15.69:0/1547073809 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1fc0c8d70 msgr2=0x7fe1fc14e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.370+0000 7fe2010f8700 1 --2- 172.21.15.69:0/1547073809 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1fc0c8d70 0x7fe1fc14e6d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4016000 tx=0x7fe1f401a000 comp rx=0 tx=0).stop 2023-10-06T01:39:58.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.370+0000 7fe2010f8700 1 -- 172.21.15.69:0/1547073809 shutdown_connections 2023-10-06T01:39:58.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.370+0000 7fe2010f8700 1 --2- 172.21.15.69:0/1547073809 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe1dc0670e0 0x7fe1dc069590 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.370+0000 7fe2010f8700 1 --2- 172.21.15.69:0/1547073809 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1fc0c8d70 0x7fe1fc14e6d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.372 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.370+0000 7fe2010f8700 1 --2- 172.21.15.69:0/1547073809 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1fc150b70 0x7fe1fc155bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.370+0000 7fe2010f8700 1 --2- 172.21.15.69:0/1547073809 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1fc0ca390 0x7fe1fc0c8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.370+0000 7fe2010f8700 1 -- 172.21.15.69:0/1547073809 >> 172.21.15.69:0/1547073809 conn(0x7fe1fc0703a0 msgr2=0x7fe1fc0b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:58.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.370+0000 7fe2010f8700 1 -- 172.21.15.69:0/1547073809 shutdown_connections 2023-10-06T01:39:58.373 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.370+0000 7fe2010f8700 1 -- 172.21.15.69:0/1547073809 wait complete. 2023-10-06T01:39:58.383 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-06T01:39:58.499 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.498+0000 7fb22bdaf700 1 Processor -- start 2023-10-06T01:39:58.500 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.498+0000 7fb22bdaf700 1 -- start start 2023-10-06T01:39:58.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.499+0000 7fb22bdaf700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb224159530 0x7fb2240ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.499+0000 7fb22bdaf700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb22406dc70 0x7fb224159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.499+0000 7fb22bdaf700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb22406e0e0 0x7fb2240cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.499+0000 7fb22bdaf700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2240ccfd0 con 0x7fb22406dc70 2023-10-06T01:39:58.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.499+0000 7fb22bdaf700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2240cf0e0 con 0x7fb22406e0e0 2023-10-06T01:39:58.502 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.499+0000 7fb22bdaf700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22415a3d0 con 0x7fb224159530 2023-10-06T01:39:58.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.499+0000 7fb22934a700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb22406dc70 0x7fb224159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.499+0000 7fb22934a700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fb22406dc70 0x7fb224159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33230/0 (socket says 172.21.15.69:33230) 2023-10-06T01:39:58.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.499+0000 7fb22934a700 1 -- 172.21.15.69:0/2504325965 learned_addr learned my addr 172.21.15.69:0/2504325965 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:58.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.499+0000 7fb229b4b700 1 --2- 172.21.15.69:0/2504325965 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb224159530 0x7fb2240ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.499+0000 7fb22a34c700 1 --2- 172.21.15.69:0/2504325965 >> v2:172.21.15.88:3300/0 conn(0x7fb22406e0e0 0x7fb2240cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.499+0000 7fb22934a700 1 -- 172.21.15.69:0/2504325965 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb224159530 msgr2=0x7fb2240ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:58.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.499+0000 7fb22934a700 1 --2- 172.21.15.69:0/2504325965 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb224159530 0x7fb2240ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.499+0000 7fb22934a700 1 -- 172.21.15.69:0/2504325965 >> v2:172.21.15.88:3300/0 conn(0x7fb22406e0e0 msgr2=0x7fb2240cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:58.503 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.499+0000 7fb22934a700 1 --2- 172.21.15.69:0/2504325965 >> v2:172.21.15.88:3300/0 conn(0x7fb22406e0e0 0x7fb2240cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.499+0000 7fb22934a700 1 -- 172.21.15.69:0/2504325965 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb22415a6b0 con 0x7fb22406dc70 2023-10-06T01:39:58.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.500+0000 7fb229b4b700 1 --2- 172.21.15.69:0/2504325965 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb224159530 0x7fb2240ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:58.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.500+0000 7fb22934a700 1 --2- 172.21.15.69:0/2504325965 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb22406dc70 0x7fb224159900 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb224089880 tx=0x7fb214009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eeab9cbcced3cc96 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:58.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.500+0000 7fb228b49700 1 -- 172.21.15.69:0/2504325965 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21400b860 con 0x7fb22406dc70 2023-10-06T01:39:58.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.500+0000 7fb228b49700 1 -- 172.21.15.69:0/2504325965 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21400b9c0 con 0x7fb22406dc70 2023-10-06T01:39:58.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.500+0000 7fb228b49700 1 -- 172.21.15.69:0/2504325965 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21400bd60 con 0x7fb22406dc70 2023-10-06T01:39:58.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.500+0000 7fb22bdaf700 1 -- 172.21.15.69:0/2504325965 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb22406dc70 msgr2=0x7fb224159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.500+0000 7fb22bdaf700 1 --2- 172.21.15.69:0/2504325965 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb22406dc70 0x7fb224159900 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb224089880 tx=0x7fb214009250 comp rx=0 tx=0).stop 2023-10-06T01:39:58.504 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.500+0000 7fb22bdaf700 1 -- 172.21.15.69:0/2504325965 shutdown_connections 2023-10-06T01:39:58.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.500+0000 7fb22bdaf700 1 --2- 172.21.15.69:0/2504325965 >> v2:172.21.15.88:3300/0 conn(0x7fb22406e0e0 0x7fb2240cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.500+0000 7fb22bdaf700 1 --2- 172.21.15.69:0/2504325965 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb224159530 0x7fb2240ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.500+0000 7fb22bdaf700 1 --2- 172.21.15.69:0/2504325965 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb22406dc70 0x7fb224159900 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.500+0000 7fb22bdaf700 1 -- 172.21.15.69:0/2504325965 >> 172.21.15.69:0/2504325965 conn(0x7fb2240703a0 msgr2=0x7fb2240707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:58.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.500+0000 7fb22bdaf700 1 -- 172.21.15.69:0/2504325965 shutdown_connections 2023-10-06T01:39:58.505 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.500+0000 7fb22bdaf700 1 -- 172.21.15.69:0/2504325965 wait complete. 2023-10-06T01:39:58.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.501+0000 7fb22bdaf700 1 Processor -- start 2023-10-06T01:39:58.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.501+0000 7fb22bdaf700 1 -- start start 2023-10-06T01:39:58.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.502+0000 7fb22bdaf700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb22406dc70 0x7fb2240af840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.502+0000 7fb22bdaf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb22406e0e0 0x7fb2240ca270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.502+0000 7fb22bdaf700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb224159530 0x7fb2241583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.502+0000 7fb22bdaf700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2240c7b40 con 0x7fb22406e0e0 2023-10-06T01:39:58.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.502+0000 7fb22bdaf700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2241569a0 con 0x7fb224159530 2023-10-06T01:39:58.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.502+0000 7fb22bdaf700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb224156c80 con 0x7fb22406dc70 2023-10-06T01:39:58.508 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.502+0000 7fb22934a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb22406e0e0 0x7fb2240ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.502+0000 7fb22934a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb22406e0e0 0x7fb2240ca270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33238/0 (socket says 172.21.15.69:33238) 2023-10-06T01:39:58.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.502+0000 7fb22934a700 1 -- 172.21.15.69:0/2906735000 learned_addr learned my addr 172.21.15.69:0/2906735000 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:58.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.502+0000 7fb229b4b700 1 --2- 172.21.15.69:0/2906735000 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb22406dc70 0x7fb2240af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.502+0000 7fb22a34c700 1 --2- 172.21.15.69:0/2906735000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb224159530 0x7fb2241583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.503+0000 7fb22934a700 1 -- 172.21.15.69:0/2906735000 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb22406dc70 msgr2=0x7fb2240af840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.503+0000 7fb22934a700 1 --2- 172.21.15.69:0/2906735000 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb22406dc70 0x7fb2240af840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.503+0000 7fb22934a700 1 -- 172.21.15.69:0/2906735000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb224159530 msgr2=0x7fb2241583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.503+0000 7fb22934a700 1 --2- 172.21.15.69:0/2906735000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb224159530 0x7fb2241583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.503+0000 7fb22934a700 1 -- 172.21.15.69:0/2906735000 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2140094f0 con 0x7fb22406e0e0 2023-10-06T01:39:58.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.503+0000 7fb22934a700 1 --2- 172.21.15.69:0/2906735000 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb22406e0e0 0x7fb2240ca270 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb224089650 tx=0x7fb214017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:58.509 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.503+0000 7fb219ffb700 1 -- 172.21.15.69:0/2906735000 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb214024440 con 0x7fb22406e0e0 2023-10-06T01:39:58.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.503+0000 7fb219ffb700 1 -- 172.21.15.69:0/2906735000 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2140245a0 con 0x7fb22406e0e0 2023-10-06T01:39:58.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.503+0000 7fb22bdaf700 1 -- 172.21.15.69:0/2906735000 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb224156f60 con 0x7fb22406e0e0 2023-10-06T01:39:58.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.503+0000 7fb219ffb700 1 -- 172.21.15.69:0/2906735000 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb214024960 con 0x7fb22406e0e0 2023-10-06T01:39:58.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.503+0000 7fb22bdaf700 1 -- 172.21.15.69:0/2906735000 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb224157520 con 0x7fb22406e0e0 2023-10-06T01:39:58.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.504+0000 7fb22bdaf700 1 -- 172.21.15.69:0/2906735000 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb224157740 con 0x7fb22406e0e0 2023-10-06T01:39:58.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.504+0000 7fb219ffb700 1 -- 172.21.15.69:0/2906735000 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fb21401a420 con 0x7fb22406e0e0 2023-10-06T01:39:58.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.505+0000 7fb219ffb700 1 --2- 172.21.15.69:0/2906735000 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb2080670e0 0x7fb208069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.505+0000 7fb219ffb700 1 -- 172.21.15.69:0/2906735000 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fb2140867b0 con 0x7fb22406e0e0 2023-10-06T01:39:58.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.505+0000 7fb229b4b700 1 --2- 172.21.15.69:0/2906735000 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb2080670e0 0x7fb208069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.510 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.505+0000 7fb229b4b700 1 --2- 172.21.15.69:0/2906735000 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb2080670e0 0x7fb208069590 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb220006fd0 tx=0x7fb220008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:58.511 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.509+0000 7fb219ffb700 1 -- 172.21.15.69:0/2906735000 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb214053640 con 0x7fb22406e0e0 2023-10-06T01:39:58.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.694+0000 7fb22bdaf700 1 -- 172.21.15.69:0/2906735000 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb22404c3c0 con 0x7fb22406e0e0 2023-10-06T01:39:58.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.695+0000 7fb219ffb700 1 -- 172.21.15.69:0/2906735000 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb214056c60 con 0x7fb22406e0e0 2023-10-06T01:39:58.696 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2023-10-06T01:39:58.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.697+0000 7fb22bdaf700 1 -- 172.21.15.69:0/2906735000 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb2080670e0 msgr2=0x7fb208069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.697+0000 7fb22bdaf700 1 --2- 172.21.15.69:0/2906735000 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb2080670e0 0x7fb208069590 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fb220006fd0 tx=0x7fb220008040 comp rx=0 tx=0).stop 2023-10-06T01:39:58.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.697+0000 7fb22bdaf700 1 -- 172.21.15.69:0/2906735000 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb22406e0e0 msgr2=0x7fb2240ca270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.697+0000 7fb22bdaf700 1 --2- 172.21.15.69:0/2906735000 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb22406e0e0 0x7fb2240ca270 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb224089650 tx=0x7fb214017000 comp rx=0 tx=0).stop 2023-10-06T01:39:58.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.697+0000 7fb22bdaf700 1 -- 172.21.15.69:0/2906735000 shutdown_connections 2023-10-06T01:39:58.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.697+0000 7fb22bdaf700 1 --2- 172.21.15.69:0/2906735000 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb2080670e0 0x7fb208069590 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.697+0000 7fb22bdaf700 1 --2- 172.21.15.69:0/2906735000 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb224159530 0x7fb2241583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.697+0000 7fb22bdaf700 1 --2- 172.21.15.69:0/2906735000 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb22406dc70 0x7fb2240af840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.697+0000 7fb22bdaf700 1 --2- 172.21.15.69:0/2906735000 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb22406e0e0 0x7fb2240ca270 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.697+0000 7fb22bdaf700 1 -- 172.21.15.69:0/2906735000 >> 172.21.15.69:0/2906735000 conn(0x7fb2240703a0 msgr2=0x7fb22415b500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:58.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.697+0000 7fb22bdaf700 1 -- 172.21.15.69:0/2906735000 shutdown_connections 2023-10-06T01:39:58.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.697+0000 7fb22bdaf700 1 -- 172.21.15.69:0/2906735000 wait complete. 2023-10-06T01:39:58.710 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:39:58.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.824+0000 7f0037008700 1 Processor -- start 2023-10-06T01:39:58.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.824+0000 7f0037008700 1 -- start start 2023-10-06T01:39:58.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.825+0000 7f0037008700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0030153c30 0x7f003015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.825+0000 7f0037008700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f003015de50 0x7f00300cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.825+0000 7f0037008700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f003015afd0 con 0x7f00300cef40 2023-10-06T01:39:58.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.825+0000 7f0037008700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f003015b2b0 con 0x7f0030153c30 2023-10-06T01:39:58.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.825+0000 7f0037008700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003015b590 con 0x7f003015de50 2023-10-06T01:39:58.828 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.825+0000 7f0035805700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f003015de50 0x7f00300cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.825+0000 7f0036006700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0030153c30 0x7f003015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.825+0000 7f0035805700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f003015de50 0x7f00300cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.69:48264/0 (socket says 172.21.15.69:48264) 2023-10-06T01:39:58.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.825+0000 7f0036006700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f0030153c30 0x7f003015a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.69:56096/0 (socket says 172.21.15.69:56096) 2023-10-06T01:39:58.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.825+0000 7f0035805700 1 -- 172.21.15.69:0/3817350464 learned_addr learned my addr 172.21.15.69:0/3817350464 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:58.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.826+0000 7f0035805700 1 -- 172.21.15.69:0/3817350464 >> v2:172.21.15.88:3300/0 conn(0x7f0030153c30 msgr2=0x7f003015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:58.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.826+0000 7f0035805700 1 --2- 172.21.15.69:0/3817350464 >> v2:172.21.15.88:3300/0 conn(0x7f0030153c30 0x7f003015a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.829 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.826+0000 7f0035805700 1 -- 172.21.15.69:0/3817350464 >> v1:172.21.15.88:6789/0 conn(0x7f00300cef40 legacy=0x7f003006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.826+0000 7f0035805700 1 -- 172.21.15.69:0/3817350464 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003015b870 con 0x7f003015de50 2023-10-06T01:39:58.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.826+0000 7f0036006700 1 --2- 172.21.15.69:0/3817350464 >> v2:172.21.15.88:3300/0 conn(0x7f0030153c30 0x7f003015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:58.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.826+0000 7f0035805700 1 --2- 172.21.15.69:0/3817350464 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f003015de50 0x7f00300cea00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f00200099b0 tx=0x7f0020009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2734216702616c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:58.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.826+0000 7f0035004700 1 -- 172.21.15.69:0/3817350464 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0020009ea0 con 0x7f003015de50 2023-10-06T01:39:58.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.826+0000 7f0035004700 1 -- 172.21.15.69:0/3817350464 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002000b860 con 0x7f003015de50 2023-10-06T01:39:58.830 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.826+0000 7f0035004700 1 -- 172.21.15.69:0/3817350464 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002000bc00 con 0x7f003015de50 2023-10-06T01:39:58.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.826+0000 7f0037008700 1 -- 172.21.15.69:0/3817350464 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f003015de50 msgr2=0x7f00300cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.826+0000 7f0037008700 1 --2- 172.21.15.69:0/3817350464 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f003015de50 0x7f00300cea00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f00200099b0 tx=0x7f0020009250 comp rx=0 tx=0).stop 2023-10-06T01:39:58.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.827+0000 7f0037008700 1 -- 172.21.15.69:0/3817350464 shutdown_connections 2023-10-06T01:39:58.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.827+0000 7f0037008700 1 --2- 172.21.15.69:0/3817350464 >> v2:172.21.15.88:3300/0 conn(0x7f0030153c30 0x7f003015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.827+0000 7f0037008700 1 --2- 172.21.15.69:0/3817350464 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f003015de50 0x7f00300cea00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.827+0000 7f0037008700 1 -- 172.21.15.69:0/3817350464 >> 172.21.15.69:0/3817350464 conn(0x7f00300703a0 msgr2=0x7f00300707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:58.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.827+0000 7f0037008700 1 -- 172.21.15.69:0/3817350464 shutdown_connections 2023-10-06T01:39:58.832 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.827+0000 7f0037008700 1 -- 172.21.15.69:0/3817350464 wait complete. 2023-10-06T01:39:58.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.828+0000 7f0037008700 1 Processor -- start 2023-10-06T01:39:58.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.828+0000 7f0037008700 1 -- start start 2023-10-06T01:39:58.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.828+0000 7f0037008700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f00300cef40 0x7f0030152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.828+0000 7f0037008700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0030153c30 0x7f00300b4230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.828+0000 7f0037008700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f003015de50 0x7f003006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.828+0000 7f0037008700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00300b3da0 con 0x7f0030153c30 2023-10-06T01:39:58.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.828+0000 7f0037008700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00300b3470 con 0x7f003015de50 2023-10-06T01:39:58.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.828+0000 7f0037008700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00300b3750 con 0x7f00300cef40 2023-10-06T01:39:58.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.828+0000 7f0035805700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0030153c30 0x7f00300b4230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.829+0000 7f0035805700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0030153c30 0x7f00300b4230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33250/0 (socket says 172.21.15.69:33250) 2023-10-06T01:39:58.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.829+0000 7f0035805700 1 -- 172.21.15.69:0/2132112685 learned_addr learned my addr 172.21.15.69:0/2132112685 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:58.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.829+0000 7f0036807700 1 --2- 172.21.15.69:0/2132112685 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f003015de50 0x7f003006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.829+0000 7f0036006700 1 --2- 172.21.15.69:0/2132112685 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f00300cef40 0x7f0030152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.829+0000 7f0035805700 1 -- 172.21.15.69:0/2132112685 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f00300cef40 msgr2=0x7f0030152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.836 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.829+0000 7f0035805700 1 --2- 172.21.15.69:0/2132112685 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f00300cef40 0x7f0030152410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.829+0000 7f0035805700 1 -- 172.21.15.69:0/2132112685 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f003015de50 msgr2=0x7f003006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:58.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.829+0000 7f0035805700 1 --2- 172.21.15.69:0/2132112685 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f003015de50 0x7f003006d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:58.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.829+0000 7f0035805700 1 -- 172.21.15.69:0/2132112685 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002c009420 con 0x7f0030153c30 2023-10-06T01:39:58.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.829+0000 7f0035805700 1 --2- 172.21.15.69:0/2132112685 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0030153c30 0x7f00300b4230 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f003015b6d0 tx=0x7f0020017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:58.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.829+0000 7f00267fc700 1 -- 172.21.15.69:0/2132112685 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002000bbe0 con 0x7f0030153c30 2023-10-06T01:39:58.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.829+0000 7f00267fc700 1 -- 172.21.15.69:0/2132112685 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002001a450 con 0x7f0030153c30 2023-10-06T01:39:58.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.829+0000 7f0037008700 1 -- 172.21.15.69:0/2132112685 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00200094f0 con 0x7f0030153c30 2023-10-06T01:39:58.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.829+0000 7f00267fc700 1 -- 172.21.15.69:0/2132112685 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002001a7f0 con 0x7f0030153c30 2023-10-06T01:39:58.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.829+0000 7f0037008700 1 -- 172.21.15.69:0/2132112685 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0030152950 con 0x7f0030153c30 2023-10-06T01:39:58.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.830+0000 7f0037008700 1 -- 172.21.15.69:0/2132112685 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f003004c3c0 con 0x7f0030153c30 2023-10-06T01:39:58.837 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.830+0000 7f00267fc700 1 -- 172.21.15.69:0/2132112685 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f002001ab60 con 0x7f0030153c30 2023-10-06T01:39:58.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.831+0000 7f00267fc700 1 --2- 172.21.15.69:0/2132112685 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f00140670e0 0x7f0014069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:58.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.831+0000 7f00267fc700 1 -- 172.21.15.69:0/2132112685 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f0020086430 con 0x7f0030153c30 2023-10-06T01:39:58.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.831+0000 7f0036006700 1 --2- 172.21.15.69:0/2132112685 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f00140670e0 0x7f0014069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:58.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.831+0000 7f0036006700 1 --2- 172.21.15.69:0/2132112685 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f00140670e0 0x7f0014069590 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f002c009d60 tx=0x7f002c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:58.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:58.835+0000 7f00267fc700 1 -- 172.21.15.69:0/2132112685 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00200532c0 con 0x7f0030153c30 2023-10-06T01:39:59.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.058+0000 7f0037008700 1 -- 172.21.15.69:0/2132112685 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00300b3ee0 con 0x7f0030153c30 2023-10-06T01:39:59.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.059+0000 7f00267fc700 1 -- 172.21.15.69:0/2132112685 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f00200568e0 con 0x7f0030153c30 2023-10-06T01:39:59.061 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:59.061 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4837,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2963206981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":2963206981},{"type":"v1","addr":"172.21.15.88:6835","nonce":2963206981}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5028,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6836/1958085129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":1958085129},{"type":"v1","addr":"172.21.15.69:6836","nonce":1958085129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5031,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1745977228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6835","nonce":1745977228},{"type":"v1","addr":"172.21.15.69:6837","nonce":1745977228}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:39:38.993158+0000","modified":"2023-10-06T01:39:42.621141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5037},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5037":{"gid":5037,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6834/3221701951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3221701951},{"type":"v1","addr":"172.21.15.88:6834","nonce":3221701951}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T01:39:59.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.061+0000 7f0037008700 1 -- 172.21.15.69:0/2132112685 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f00140670e0 msgr2=0x7f0014069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.061+0000 7f0037008700 1 --2- 172.21.15.69:0/2132112685 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f00140670e0 0x7f0014069590 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f002c009d60 tx=0x7f002c008040 comp rx=0 tx=0).stop 2023-10-06T01:39:59.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.061+0000 7f0037008700 1 -- 172.21.15.69:0/2132112685 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0030153c30 msgr2=0x7f00300b4230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.061+0000 7f0037008700 1 --2- 172.21.15.69:0/2132112685 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0030153c30 0x7f00300b4230 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f003015b6d0 tx=0x7f0020017000 comp rx=0 tx=0).stop 2023-10-06T01:39:59.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.061+0000 7f0037008700 1 -- 172.21.15.69:0/2132112685 shutdown_connections 2023-10-06T01:39:59.063 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.061+0000 7f0037008700 1 --2- 172.21.15.69:0/2132112685 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f00140670e0 0x7f0014069590 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.061+0000 7f0037008700 1 --2- 172.21.15.69:0/2132112685 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f003015de50 0x7f003006d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.061+0000 7f0037008700 1 --2- 172.21.15.69:0/2132112685 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f00300cef40 0x7f0030152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.061+0000 7f0037008700 1 --2- 172.21.15.69:0/2132112685 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0030153c30 0x7f00300b4230 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.061+0000 7f0037008700 1 -- 172.21.15.69:0/2132112685 >> 172.21.15.69:0/2132112685 conn(0x7f00300703a0 msgr2=0x7f00300cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:59.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.061+0000 7f0037008700 1 -- 172.21.15.69:0/2132112685 shutdown_connections 2023-10-06T01:39:59.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.061+0000 7f0037008700 1 -- 172.21.15.69:0/2132112685 wait complete. 2023-10-06T01:39:59.065 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 18 2023-10-06T01:39:59.074 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:39:59.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.187+0000 7f48a4270700 1 Processor -- start 2023-10-06T01:39:59.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.187+0000 7f48a4270700 1 -- start start 2023-10-06T01:39:59.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.188+0000 7f48a4270700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f489c0a8be0 0x7f489c0a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.188+0000 7f48a4270700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f489c0aee90 0x7f489c0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.188+0000 7f48a4270700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f489c0ce1a0 con 0x7f489c06d280 2023-10-06T01:39:59.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.188+0000 7f48a4270700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f489c0cd5d0 con 0x7f489c0a8be0 2023-10-06T01:39:59.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.188+0000 7f48a4270700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489c0cd870 con 0x7f489c0aee90 2023-10-06T01:39:59.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.188+0000 7f48a180b700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f489c06d280 0x7f489c0ae780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:45404/0 (socket says 172.21.15.69:45404) 2023-10-06T01:39:59.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.188+0000 7f48a180b700 1 -- 172.21.15.69:0/3185773128 learned_addr learned my addr 172.21.15.69:0/3185773128 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:39:59.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.188+0000 7f48a200c700 1 --2- 172.21.15.69:0/3185773128 >> v2:172.21.15.88:3300/0 conn(0x7f489c0a8be0 0x7f489c0a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.188+0000 7f48a280d700 1 --2- 172.21.15.69:0/3185773128 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f489c0aee90 0x7f489c0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.189+0000 7f48a100a700 1 -- 172.21.15.69:0/3185773128 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1886595929 0 0) 0x7f489c0ce1a0 con 0x7f489c06d280 2023-10-06T01:39:59.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.189+0000 7f48a100a700 1 -- 172.21.15.69:0/3185773128 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4888003570 con 0x7f489c06d280 2023-10-06T01:39:59.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.189+0000 7f48a200c700 1 -- 172.21.15.69:0/3185773128 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f489c0aee90 msgr2=0x7f489c0b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:59.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.189+0000 7f48a100a700 1 -- 172.21.15.69:0/3185773128 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3850864749 0 0) 0x7f4888003570 con 0x7f489c06d280 2023-10-06T01:39:59.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.189+0000 7f48a200c700 1 --2- 172.21.15.69:0/3185773128 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f489c0aee90 0x7f489c0b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.189+0000 7f48a200c700 1 -- 172.21.15.69:0/3185773128 >> v1:172.21.15.69:6789/0 conn(0x7f489c06d280 legacy=0x7f489c0ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.189+0000 7f48a200c700 1 -- 172.21.15.69:0/3185773128 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489c0cdb50 con 0x7f489c0a8be0 2023-10-06T01:39:59.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.189+0000 7f48a200c700 1 --2- 172.21.15.69:0/3185773128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f489c0a8be0 0x7f489c0a8fb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4898009eb0 tx=0x7f4898009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=96f08e203a461d44 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:59.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.189+0000 7f48a100a700 1 -- 172.21.15.69:0/3185773128 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489800e070 con 0x7f489c0a8be0 2023-10-06T01:39:59.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.189+0000 7f48a100a700 1 -- 172.21.15.69:0/3185773128 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489800b900 con 0x7f489c0a8be0 2023-10-06T01:39:59.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.189+0000 7f48a100a700 1 -- 172.21.15.69:0/3185773128 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c0015f0 con 0x7f489c0a8be0 2023-10-06T01:39:59.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.190+0000 7f48a4270700 1 -- 172.21.15.69:0/3185773128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f489c0a8be0 msgr2=0x7f489c0a8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.190+0000 7f48a4270700 1 --2- 172.21.15.69:0/3185773128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f489c0a8be0 0x7f489c0a8fb0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4898009eb0 tx=0x7f4898009780 comp rx=0 tx=0).stop 2023-10-06T01:39:59.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.190+0000 7f48a4270700 1 -- 172.21.15.69:0/3185773128 shutdown_connections 2023-10-06T01:39:59.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.190+0000 7f48a4270700 1 --2- 172.21.15.69:0/3185773128 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f489c0aee90 0x7f489c0b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.190+0000 7f48a4270700 1 --2- 172.21.15.69:0/3185773128 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f489c0a8be0 0x7f489c0a8fb0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.190+0000 7f48a4270700 1 -- 172.21.15.69:0/3185773128 >> 172.21.15.69:0/3185773128 conn(0x7f489c06ce80 msgr2=0x7f489c0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:59.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.190+0000 7f48a4270700 1 -- 172.21.15.69:0/3185773128 shutdown_connections 2023-10-06T01:39:59.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.190+0000 7f48a4270700 1 -- 172.21.15.69:0/3185773128 wait complete. 2023-10-06T01:39:59.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.191+0000 7f48a4270700 1 Processor -- start 2023-10-06T01:39:59.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.191+0000 7f48a4270700 1 -- start start 2023-10-06T01:39:59.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.191+0000 7f48a4270700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f489c06d280 0x7f489c14ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.191+0000 7f48a4270700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f489c0a8be0 0x7f489c09b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.191+0000 7f48a4270700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f489c0aee90 0x7f489c09b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.191+0000 7f48a4270700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489c14bf40 con 0x7f489c0aee90 2023-10-06T01:39:59.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.191+0000 7f48a4270700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f489c099d10 con 0x7f489c0a8be0 2023-10-06T01:39:59.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.191+0000 7f48a4270700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f489c09bcf0 con 0x7f489c06d280 2023-10-06T01:39:59.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.192+0000 7f48a280d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f489c0aee90 0x7f489c09b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.192+0000 7f48a280d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f489c0aee90 0x7f489c09b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33254/0 (socket says 172.21.15.69:33254) 2023-10-06T01:39:59.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.192+0000 7f48a280d700 1 -- 172.21.15.69:0/3341275959 learned_addr learned my addr 172.21.15.69:0/3341275959 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:59.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.192+0000 7f48a180b700 1 --2- 172.21.15.69:0/3341275959 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f489c0a8be0 0x7f489c09b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.192+0000 7f48a200c700 1 --2- 172.21.15.69:0/3341275959 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f489c06d280 0x7f489c14ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.192+0000 7f48a280d700 1 -- 172.21.15.69:0/3341275959 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f489c06d280 msgr2=0x7f489c14ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.192+0000 7f48a280d700 1 --2- 172.21.15.69:0/3341275959 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f489c06d280 0x7f489c14ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.192+0000 7f48a280d700 1 -- 172.21.15.69:0/3341275959 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f489c0a8be0 msgr2=0x7f489c09b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.206 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.192+0000 7f48a280d700 1 --2- 172.21.15.69:0/3341275959 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f489c0a8be0 0x7f489c09b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.192+0000 7f48a280d700 1 -- 172.21.15.69:0/3341275959 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4898009a20 con 0x7f489c0aee90 2023-10-06T01:39:59.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.192+0000 7f48a180b700 1 --2- 172.21.15.69:0/3341275959 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f489c0a8be0 0x7f489c09b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:59.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.192+0000 7f48a280d700 1 --2- 172.21.15.69:0/3341275959 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f489c0aee90 0x7f489c09b7b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f489400ea50 tx=0x7f48940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:59.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.192+0000 7f48927fc700 1 -- 172.21.15.69:0/3341275959 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489400c8c0 con 0x7f489c0aee90 2023-10-06T01:39:59.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.192+0000 7f48927fc700 1 -- 172.21.15.69:0/3341275959 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f489400ca40 con 0x7f489c0aee90 2023-10-06T01:39:59.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.192+0000 7f48a4270700 1 -- 172.21.15.69:0/3341275959 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f489c099100 con 0x7f489c0aee90 2023-10-06T01:39:59.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.192+0000 7f48927fc700 1 -- 172.21.15.69:0/3341275959 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f489400ce00 con 0x7f489c0aee90 2023-10-06T01:39:59.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.192+0000 7f48a4270700 1 -- 172.21.15.69:0/3341275959 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f489c0996c0 con 0x7f489c0aee90 2023-10-06T01:39:59.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.193+0000 7f48a4270700 1 -- 172.21.15.69:0/3341275959 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f489c0a8fb0 con 0x7f489c0aee90 2023-10-06T01:39:59.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.194+0000 7f48927fc700 1 -- 172.21.15.69:0/3341275959 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f4894013680 con 0x7f489c0aee90 2023-10-06T01:39:59.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.194+0000 7f48927fc700 1 --2- 172.21.15.69:0/3341275959 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f48800670e0 0x7f4880069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.194+0000 7f48927fc700 1 -- 172.21.15.69:0/3341275959 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f4894084d10 con 0x7f489c0aee90 2023-10-06T01:39:59.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.194+0000 7f48a200c700 1 --2- 172.21.15.69:0/3341275959 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f48800670e0 0x7f4880069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.194+0000 7f48a200c700 1 --2- 172.21.15.69:0/3341275959 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f48800670e0 0x7f4880069590 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f48980099a0 tx=0x7f4898018000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:59.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.198+0000 7f48927fc700 1 -- 172.21.15.69:0/3341275959 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f489c0a8fb0 con 0x7f489c0aee90 2023-10-06T01:39:59.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.382+0000 7f48a4270700 1 -- 172.21.15.69:0/3341275959 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f489c0a8fb0 con 0x7f489c0aee90 2023-10-06T01:39:59.384 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.383+0000 7f48927fc700 1 -- 172.21.15.69:0/3341275959 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16818 (secure 0 0 0) 0x7f489c0a8fb0 con 0x7f489c0aee90 2023-10-06T01:39:59.385 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:59.385 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":35,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:39:40.515179+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:38:43.046056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:39:37.033167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T01:39:37.950855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:39:59.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.386+0000 7f48a4270700 1 -- 172.21.15.69:0/3341275959 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f48800670e0 msgr2=0x7f4880069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.386+0000 7f48a4270700 1 --2- 172.21.15.69:0/3341275959 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f48800670e0 0x7f4880069590 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f48980099a0 tx=0x7f4898018000 comp rx=0 tx=0).stop 2023-10-06T01:39:59.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.386+0000 7f48a4270700 1 -- 172.21.15.69:0/3341275959 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f489c0aee90 msgr2=0x7f489c09b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.386+0000 7f48a4270700 1 --2- 172.21.15.69:0/3341275959 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f489c0aee90 0x7f489c09b7b0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f489400ea50 tx=0x7f48940091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.386+0000 7f48a4270700 1 -- 172.21.15.69:0/3341275959 shutdown_connections 2023-10-06T01:39:59.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.386+0000 7f48a4270700 1 --2- 172.21.15.69:0/3341275959 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f48800670e0 0x7f4880069590 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.386+0000 7f48a4270700 1 --2- 172.21.15.69:0/3341275959 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f489c0aee90 0x7f489c09b7b0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.386+0000 7f48a4270700 1 --2- 172.21.15.69:0/3341275959 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f489c06d280 0x7f489c14ba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.386+0000 7f48a4270700 1 --2- 172.21.15.69:0/3341275959 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f489c0a8be0 0x7f489c09b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.386+0000 7f48a4270700 1 -- 172.21.15.69:0/3341275959 >> 172.21.15.69:0/3341275959 conn(0x7f489c06ce80 msgr2=0x7f489c0b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:59.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.386+0000 7f48a4270700 1 -- 172.21.15.69:0/3341275959 shutdown_connections 2023-10-06T01:39:59.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.386+0000 7f48a4270700 1 -- 172.21.15.69:0/3341275959 wait complete. 2023-10-06T01:39:59.399 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T01:39:59.399 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:39:59.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.513+0000 7f8c57fff700 1 Processor -- start 2023-10-06T01:39:59.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.513+0000 7f8c57fff700 1 -- start start 2023-10-06T01:39:59.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.514+0000 7f8c57fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8c58153c30 0x7f8c5815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.514+0000 7f8c57fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8c5815de50 0x7f8c580cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.514+0000 7f8c57fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c5815afd0 con 0x7f8c580cef40 2023-10-06T01:39:59.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.514+0000 7f8c57fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c5815b2b0 con 0x7f8c5815de50 2023-10-06T01:39:59.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.514+0000 7f8c57fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5815b590 con 0x7f8c58153c30 2023-10-06T01:39:59.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.514+0000 7f8c56ffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8c58153c30 0x7f8c5815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.514+0000 7f8c567fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8c5815de50 0x7f8c580cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.514+0000 7f8c56ffd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8c58153c30 0x7f8c5815a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.69:48302/0 (socket says 172.21.15.69:48302) 2023-10-06T01:39:59.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.514+0000 7f8c567fc700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f8c5815de50 0x7f8c580cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.69:56122/0 (socket says 172.21.15.69:56122) 2023-10-06T01:39:59.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.514+0000 7f8c56ffd700 1 -- 172.21.15.69:0/2329041693 learned_addr learned my addr 172.21.15.69:0/2329041693 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:59.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.515+0000 7f8c55ffb700 1 -- 172.21.15.69:0/2329041693 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4017988321 0 0) 0x7f8c5815afd0 con 0x7f8c580cef40 2023-10-06T01:39:59.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.515+0000 7f8c55ffb700 1 -- 172.21.15.69:0/2329041693 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c44003570 con 0x7f8c580cef40 2023-10-06T01:39:59.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.515+0000 7f8c567fc700 1 -- 172.21.15.69:0/2329041693 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8c58153c30 msgr2=0x7f8c5815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:59.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.515+0000 7f8c567fc700 1 --2- 172.21.15.69:0/2329041693 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8c58153c30 0x7f8c5815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.515+0000 7f8c567fc700 1 -- 172.21.15.69:0/2329041693 >> v1:172.21.15.88:6789/0 conn(0x7f8c580cef40 legacy=0x7f8c5806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.515+0000 7f8c567fc700 1 -- 172.21.15.69:0/2329041693 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c5815b870 con 0x7f8c5815de50 2023-10-06T01:39:59.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.515+0000 7f8c56ffd700 1 --2- 172.21.15.69:0/2329041693 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8c58153c30 0x7f8c5815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:39:59.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.515+0000 7f8c567fc700 1 --2- 172.21.15.69:0/2329041693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c5815de50 0x7f8c580cea00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8c400098e0 tx=0x7f8c400091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4b65bc76db15ae8 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:59.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.515+0000 7f8c55ffb700 1 -- 172.21.15.69:0/2329041693 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c40011630 con 0x7f8c5815de50 2023-10-06T01:39:59.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.515+0000 7f8c55ffb700 1 -- 172.21.15.69:0/2329041693 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c40011790 con 0x7f8c5815de50 2023-10-06T01:39:59.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.515+0000 7f8c55ffb700 1 -- 172.21.15.69:0/2329041693 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c40011b30 con 0x7f8c5815de50 2023-10-06T01:39:59.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.515+0000 7f8c57fff700 1 -- 172.21.15.69:0/2329041693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c5815de50 msgr2=0x7f8c580cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.515+0000 7f8c57fff700 1 --2- 172.21.15.69:0/2329041693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c5815de50 0x7f8c580cea00 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8c400098e0 tx=0x7f8c400091a0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.516+0000 7f8c57fff700 1 -- 172.21.15.69:0/2329041693 shutdown_connections 2023-10-06T01:39:59.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.516+0000 7f8c57fff700 1 --2- 172.21.15.69:0/2329041693 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8c58153c30 0x7f8c5815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.516+0000 7f8c57fff700 1 --2- 172.21.15.69:0/2329041693 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c5815de50 0x7f8c580cea00 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.516+0000 7f8c57fff700 1 -- 172.21.15.69:0/2329041693 >> 172.21.15.69:0/2329041693 conn(0x7f8c580703a0 msgr2=0x7f8c580707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:59.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.516+0000 7f8c57fff700 1 -- 172.21.15.69:0/2329041693 shutdown_connections 2023-10-06T01:39:59.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.516+0000 7f8c57fff700 1 -- 172.21.15.69:0/2329041693 wait complete. 2023-10-06T01:39:59.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.517+0000 7f8c57fff700 1 Processor -- start 2023-10-06T01:39:59.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.517+0000 7f8c57fff700 1 -- start start 2023-10-06T01:39:59.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.518+0000 7f8c57fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c580cef40 0x7f8c5816cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.518+0000 7f8c57fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c58153c30 0x7f8c58154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.518+0000 7f8c57fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8c5815de50 0x7f8c58153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.518+0000 7f8c57fff700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c580b6250 con 0x7f8c58153c30 2023-10-06T01:39:59.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.518+0000 7f8c57fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c580b3400 con 0x7f8c580cef40 2023-10-06T01:39:59.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.518+0000 7f8c57fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5816ddb0 con 0x7f8c5815de50 2023-10-06T01:39:59.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.519+0000 7f8c567fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c58153c30 0x7f8c58154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.519+0000 7f8c567fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c58153c30 0x7f8c58154000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33268/0 (socket says 172.21.15.69:33268) 2023-10-06T01:39:59.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.519+0000 7f8c567fc700 1 -- 172.21.15.69:0/716658298 learned_addr learned my addr 172.21.15.69:0/716658298 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:59.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.519+0000 7f8c56ffd700 1 --2- 172.21.15.69:0/716658298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c580cef40 0x7f8c5816cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.519+0000 7f8c577fe700 1 --2- 172.21.15.69:0/716658298 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8c5815de50 0x7f8c58153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.519+0000 7f8c567fc700 1 -- 172.21.15.69:0/716658298 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8c5815de50 msgr2=0x7f8c58153080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.519+0000 7f8c567fc700 1 --2- 172.21.15.69:0/716658298 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8c5815de50 0x7f8c58153080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.519+0000 7f8c567fc700 1 -- 172.21.15.69:0/716658298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c580cef40 msgr2=0x7f8c5816cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.519+0000 7f8c567fc700 1 --2- 172.21.15.69:0/716658298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c580cef40 0x7f8c5816cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.519+0000 7f8c567fc700 1 -- 172.21.15.69:0/716658298 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c48009ae0 con 0x7f8c58153c30 2023-10-06T01:39:59.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.519+0000 7f8c567fc700 1 --2- 172.21.15.69:0/716658298 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c58153c30 0x7f8c58154000 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8c5806eb00 tx=0x7f8c40017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:59.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.519+0000 7f8c4effd700 1 -- 172.21.15.69:0/716658298 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c40000c40 con 0x7f8c58153c30 2023-10-06T01:39:59.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.519+0000 7f8c4effd700 1 -- 172.21.15.69:0/716658298 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c40011900 con 0x7f8c58153c30 2023-10-06T01:39:59.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.519+0000 7f8c4effd700 1 -- 172.21.15.69:0/716658298 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c40025420 con 0x7f8c58153c30 2023-10-06T01:39:59.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.519+0000 7f8c57fff700 1 -- 172.21.15.69:0/716658298 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c40009420 con 0x7f8c58153c30 2023-10-06T01:39:59.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.519+0000 7f8c57fff700 1 -- 172.21.15.69:0/716658298 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c5816d7f0 con 0x7f8c58153c30 2023-10-06T01:39:59.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.520+0000 7f8c57fff700 1 -- 172.21.15.69:0/716658298 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c580b3590 con 0x7f8c58153c30 2023-10-06T01:39:59.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.521+0000 7f8c4effd700 1 -- 172.21.15.69:0/716658298 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f8c40023070 con 0x7f8c58153c30 2023-10-06T01:39:59.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.521+0000 7f8c4effd700 1 --2- 172.21.15.69:0/716658298 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8c380670e0 0x7f8c38069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.521+0000 7f8c4effd700 1 -- 172.21.15.69:0/716658298 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f8c40085ea0 con 0x7f8c58153c30 2023-10-06T01:39:59.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.521+0000 7f8c56ffd700 1 --2- 172.21.15.69:0/716658298 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8c380670e0 0x7f8c38069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.522+0000 7f8c56ffd700 1 --2- 172.21.15.69:0/716658298 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8c380670e0 0x7f8c38069590 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8c480072d0 tx=0x7f8c4800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:59.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.525+0000 7f8c4effd700 1 -- 172.21.15.69:0/716658298 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c40052c90 con 0x7f8c58153c30 2023-10-06T01:39:59.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.753+0000 7f8c57fff700 1 -- 172.21.15.69:0/716658298 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c5804c3c0 con 0x7f8c58153c30 2023-10-06T01:39:59.754 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.753+0000 7f8c4effd700 1 -- 172.21.15.69:0/716658298 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f8c40015090 con 0x7f8c58153c30 2023-10-06T01:39:59.755 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:39:59.755 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4837,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2963206981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":2963206981},{"type":"v1","addr":"172.21.15.88:6835","nonce":2963206981}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5028,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6836/1958085129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":1958085129},{"type":"v1","addr":"172.21.15.69:6836","nonce":1958085129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5031,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1745977228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6835","nonce":1745977228},{"type":"v1","addr":"172.21.15.69:6837","nonce":1745977228}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:39:38.993158+0000","modified":"2023-10-06T01:39:42.621141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5037},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5037":{"gid":5037,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6834/3221701951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3221701951},{"type":"v1","addr":"172.21.15.88:6834","nonce":3221701951}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T01:39:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.755+0000 7f8c57fff700 1 -- 172.21.15.69:0/716658298 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8c380670e0 msgr2=0x7f8c38069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.755+0000 7f8c57fff700 1 --2- 172.21.15.69:0/716658298 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8c380670e0 0x7f8c38069590 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8c480072d0 tx=0x7f8c4800b040 comp rx=0 tx=0).stop 2023-10-06T01:39:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.755+0000 7f8c57fff700 1 -- 172.21.15.69:0/716658298 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c58153c30 msgr2=0x7f8c58154000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.755+0000 7f8c57fff700 1 --2- 172.21.15.69:0/716658298 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c58153c30 0x7f8c58154000 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8c5806eb00 tx=0x7f8c40017000 comp rx=0 tx=0).stop 2023-10-06T01:39:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.755+0000 7f8c57fff700 1 -- 172.21.15.69:0/716658298 shutdown_connections 2023-10-06T01:39:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.755+0000 7f8c57fff700 1 --2- 172.21.15.69:0/716658298 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8c380670e0 0x7f8c38069590 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.755+0000 7f8c57fff700 1 --2- 172.21.15.69:0/716658298 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8c5815de50 0x7f8c58153080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.755+0000 7f8c57fff700 1 --2- 172.21.15.69:0/716658298 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c580cef40 0x7f8c5816cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.755+0000 7f8c57fff700 1 --2- 172.21.15.69:0/716658298 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c58153c30 0x7f8c58154000 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.755+0000 7f8c57fff700 1 -- 172.21.15.69:0/716658298 >> 172.21.15.69:0/716658298 conn(0x7f8c580703a0 msgr2=0x7f8c5815bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:59.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.755+0000 7f8c57fff700 1 -- 172.21.15.69:0/716658298 shutdown_connections 2023-10-06T01:39:59.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.755+0000 7f8c57fff700 1 -- 172.21.15.69:0/716658298 wait complete. 2023-10-06T01:39:59.759 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 18 2023-10-06T01:39:59.768 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:39:59.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.881+0000 7f5c20d5e700 1 Processor -- start 2023-10-06T01:39:59.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.881+0000 7f5c20d5e700 1 -- start start 2023-10-06T01:39:59.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.882+0000 7f5c20d5e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5c1c1576a0 0x7f5c1c0c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.882+0000 7f5c20d5e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5c1c0c8040 0x7f5c1c0cc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.882+0000 7f5c20d5e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5c1c0c5510 0x7f5c1c0c5950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.882+0000 7f5c20d5e700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c1c0c5e90 con 0x7f5c1c0c8040 2023-10-06T01:39:59.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.882+0000 7f5c20d5e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c1c157a70 con 0x7f5c1c1576a0 2023-10-06T01:39:59.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.882+0000 7f5c20d5e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c0c8800 con 0x7f5c1c0c5510 2023-10-06T01:39:59.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.882+0000 7f5c11d9b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5c1c0c8040 0x7f5c1c0cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.882+0000 7f5c11d9b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5c1c0c8040 0x7f5c1c0cc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33278/0 (socket says 172.21.15.69:33278) 2023-10-06T01:39:59.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.882+0000 7f5c11d9b700 1 -- 172.21.15.69:0/1888650855 learned_addr learned my addr 172.21.15.69:0/1888650855 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:59.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.882+0000 7f5c1a59c700 1 --2- 172.21.15.69:0/1888650855 >> v2:172.21.15.88:3300/0 conn(0x7f5c1c1576a0 0x7f5c1c0c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.882+0000 7f5c1ad9d700 1 --2- 172.21.15.69:0/1888650855 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5c1c0c5510 0x7f5c1c0c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.882+0000 7f5c11d9b700 1 -- 172.21.15.69:0/1888650855 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5c1c0c5510 msgr2=0x7f5c1c0c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:59.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.882+0000 7f5c11d9b700 1 --2- 172.21.15.69:0/1888650855 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5c1c0c5510 0x7f5c1c0c5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.882+0000 7f5c11d9b700 1 -- 172.21.15.69:0/1888650855 >> v2:172.21.15.88:3300/0 conn(0x7f5c1c1576a0 msgr2=0x7f5c1c0c4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:39:59.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.882+0000 7f5c11d9b700 1 --2- 172.21.15.69:0/1888650855 >> v2:172.21.15.88:3300/0 conn(0x7f5c1c1576a0 0x7f5c1c0c4d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.882+0000 7f5c11d9b700 1 -- 172.21.15.69:0/1888650855 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c1c0cb780 con 0x7f5c1c0c8040 2023-10-06T01:39:59.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.883+0000 7f5c1a59c700 1 --2- 172.21.15.69:0/1888650855 >> v2:172.21.15.88:3300/0 conn(0x7f5c1c1576a0 0x7f5c1c0c4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:59.887 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.883+0000 7f5c1ad9d700 1 --2- 172.21.15.69:0/1888650855 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5c1c0c5510 0x7f5c1c0c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:39:59.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.883+0000 7f5c11d9b700 1 --2- 172.21.15.69:0/1888650855 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c1c0c8040 0x7f5c1c0cc260 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c06a1a0 tx=0x7f5c04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d385e03ba674ad28 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:59.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.883+0000 7f5c19d9b700 1 -- 172.21.15.69:0/1888650855 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0400b860 con 0x7f5c1c0c8040 2023-10-06T01:39:59.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.883+0000 7f5c19d9b700 1 -- 172.21.15.69:0/1888650855 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c0400b9c0 con 0x7f5c1c0c8040 2023-10-06T01:39:59.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.883+0000 7f5c19d9b700 1 -- 172.21.15.69:0/1888650855 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c0400bd60 con 0x7f5c1c0c8040 2023-10-06T01:39:59.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.883+0000 7f5c20d5e700 1 -- 172.21.15.69:0/1888650855 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c1c0c8040 msgr2=0x7f5c1c0cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.883+0000 7f5c20d5e700 1 --2- 172.21.15.69:0/1888650855 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c1c0c8040 0x7f5c1c0cc260 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5c1c06a1a0 tx=0x7f5c04009250 comp rx=0 tx=0).stop 2023-10-06T01:39:59.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.883+0000 7f5c20d5e700 1 -- 172.21.15.69:0/1888650855 shutdown_connections 2023-10-06T01:39:59.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.883+0000 7f5c20d5e700 1 --2- 172.21.15.69:0/1888650855 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5c1c0c5510 0x7f5c1c0c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.888 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.883+0000 7f5c20d5e700 1 --2- 172.21.15.69:0/1888650855 >> v2:172.21.15.88:3300/0 conn(0x7f5c1c1576a0 0x7f5c1c0c4d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.883+0000 7f5c20d5e700 1 --2- 172.21.15.69:0/1888650855 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c1c0c8040 0x7f5c1c0cc260 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.883+0000 7f5c20d5e700 1 -- 172.21.15.69:0/1888650855 >> 172.21.15.69:0/1888650855 conn(0x7f5c1c0ccb60 msgr2=0x7f5c1c0ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:39:59.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.883+0000 7f5c20d5e700 1 -- 172.21.15.69:0/1888650855 shutdown_connections 2023-10-06T01:39:59.889 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.883+0000 7f5c20d5e700 1 -- 172.21.15.69:0/1888650855 wait complete. 2023-10-06T01:39:59.892 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.885+0000 7f5c20d5e700 1 Processor -- start 2023-10-06T01:39:59.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.885+0000 7f5c20d5e700 1 -- start start 2023-10-06T01:39:59.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.885+0000 7f5c20d5e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5c1c0c5510 0x7f5c1c16ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.885+0000 7f5c20d5e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c1c0c8040 0x7f5c1c15a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.885+0000 7f5c20d5e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c1c1576a0 0x7f5c1c13f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.885+0000 7f5c20d5e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c158e40 con 0x7f5c1c1576a0 2023-10-06T01:39:59.893 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.885+0000 7f5c20d5e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c15a9d0 con 0x7f5c1c0c8040 2023-10-06T01:39:59.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.885+0000 7f5c20d5e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c1c16b2e0 con 0x7f5c1c0c5510 2023-10-06T01:39:59.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.885+0000 7f5c1ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c1c1576a0 0x7f5c1c13f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.885+0000 7f5c1ad9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c1c1576a0 0x7f5c1c13f230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33286/0 (socket says 172.21.15.69:33286) 2023-10-06T01:39:59.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.885+0000 7f5c1ad9d700 1 -- 172.21.15.69:0/2636520381 learned_addr learned my addr 172.21.15.69:0/2636520381 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:39:59.894 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.886+0000 7f5c11d9b700 1 --2- 172.21.15.69:0/2636520381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c1c0c8040 0x7f5c1c15a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.886+0000 7f5c1a59c700 1 --2- 172.21.15.69:0/2636520381 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5c1c0c5510 0x7f5c1c16ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.886+0000 7f5c1ad9d700 1 -- 172.21.15.69:0/2636520381 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5c1c0c5510 msgr2=0x7f5c1c16ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.886+0000 7f5c1ad9d700 1 --2- 172.21.15.69:0/2636520381 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5c1c0c5510 0x7f5c1c16ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.886+0000 7f5c1ad9d700 1 -- 172.21.15.69:0/2636520381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c1c0c8040 msgr2=0x7f5c1c15a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:39:59.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.886+0000 7f5c1ad9d700 1 --2- 172.21.15.69:0/2636520381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c1c0c8040 0x7f5c1c15a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:39:59.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.886+0000 7f5c1ad9d700 1 -- 172.21.15.69:0/2636520381 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c040094f0 con 0x7f5c1c1576a0 2023-10-06T01:39:59.895 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.886+0000 7f5c1ad9d700 1 --2- 172.21.15.69:0/2636520381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c1c1576a0 0x7f5c1c13f230 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5c1400cf90 tx=0x7f5c14007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:59.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.886+0000 7f5c12ffd700 1 -- 172.21.15.69:0/2636520381 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c14015440 con 0x7f5c1c1576a0 2023-10-06T01:39:59.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.886+0000 7f5c12ffd700 1 -- 172.21.15.69:0/2636520381 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c140155a0 con 0x7f5c1c1576a0 2023-10-06T01:39:59.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.886+0000 7f5c20d5e700 1 -- 172.21.15.69:0/2636520381 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c1c16b5c0 con 0x7f5c1c1576a0 2023-10-06T01:39:59.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.886+0000 7f5c12ffd700 1 -- 172.21.15.69:0/2636520381 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c14015960 con 0x7f5c1c1576a0 2023-10-06T01:39:59.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.886+0000 7f5c20d5e700 1 -- 172.21.15.69:0/2636520381 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c1c16bb80 con 0x7f5c1c1576a0 2023-10-06T01:39:59.896 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.887+0000 7f5c20d5e700 1 -- 172.21.15.69:0/2636520381 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c1c158ff0 con 0x7f5c1c1576a0 2023-10-06T01:39:59.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.887+0000 7f5c12ffd700 1 -- 172.21.15.69:0/2636520381 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f5c1400d440 con 0x7f5c1c1576a0 2023-10-06T01:39:59.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.888+0000 7f5c12ffd700 1 --2- 172.21.15.69:0/2636520381 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5bfc0670e0 0x7f5bfc069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:39:59.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.888+0000 7f5c12ffd700 1 -- 172.21.15.69:0/2636520381 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f5c14085630 con 0x7f5c1c1576a0 2023-10-06T01:39:59.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.888+0000 7f5c1a59c700 1 --2- 172.21.15.69:0/2636520381 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5bfc0670e0 0x7f5bfc069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:39:59.897 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.888+0000 7f5c1a59c700 1 --2- 172.21.15.69:0/2636520381 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5bfc0670e0 0x7f5bfc069590 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c006fd0 tx=0x7f5c0c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:39:59.898 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:39:59.892+0000 7f5c12ffd700 1 -- 172.21.15.69:0/2636520381 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c1c158ff0 con 0x7f5c1c1576a0 2023-10-06T01:40:00.118 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.117+0000 7f5c20d5e700 1 -- 172.21.15.69:0/2636520381 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5c1c158ff0 con 0x7f5c1c1576a0 2023-10-06T01:40:00.119 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.118+0000 7f5c12ffd700 1 -- 172.21.15.69:0/2636520381 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f5c1c158ff0 con 0x7f5c1c1576a0 2023-10-06T01:40:00.119 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:40:00.119 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":18,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4837,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2963206981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":2963206981},{"type":"v1","addr":"172.21.15.88:6835","nonce":2963206981}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5028,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6836/1958085129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":1958085129},{"type":"v1","addr":"172.21.15.69:6836","nonce":1958085129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5031,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1745977228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6835","nonce":1745977228},{"type":"v1","addr":"172.21.15.69:6837","nonce":1745977228}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-06T01:39:38.993158+0000","modified":"2023-10-06T01:39:42.621141+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5037},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5037":{"gid":5037,"name":"d","rank":0,"incarnation":13,"state":"up:active","state_seq":3,"addr":"172.21.15.88:6834/3221701951","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":3221701951},{"type":"v1","addr":"172.21.15.88:6834","nonce":3221701951}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-06T01:40:00.121 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.120+0000 7f5c20d5e700 1 -- 172.21.15.69:0/2636520381 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5bfc0670e0 msgr2=0x7f5bfc069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:00.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.120+0000 7f5c20d5e700 1 --2- 172.21.15.69:0/2636520381 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5bfc0670e0 0x7f5bfc069590 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5c0c006fd0 tx=0x7f5c0c008040 comp rx=0 tx=0).stop 2023-10-06T01:40:00.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.120+0000 7f5c20d5e700 1 -- 172.21.15.69:0/2636520381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c1c1576a0 msgr2=0x7f5c1c13f230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:00.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.120+0000 7f5c20d5e700 1 --2- 172.21.15.69:0/2636520381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c1c1576a0 0x7f5c1c13f230 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5c1400cf90 tx=0x7f5c14007870 comp rx=0 tx=0).stop 2023-10-06T01:40:00.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.120+0000 7f5c20d5e700 1 -- 172.21.15.69:0/2636520381 shutdown_connections 2023-10-06T01:40:00.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.120+0000 7f5c20d5e700 1 --2- 172.21.15.69:0/2636520381 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5bfc0670e0 0x7f5bfc069590 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.122 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.120+0000 7f5c20d5e700 1 --2- 172.21.15.69:0/2636520381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5c1c1576a0 0x7f5c1c13f230 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.120+0000 7f5c20d5e700 1 --2- 172.21.15.69:0/2636520381 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5c1c0c5510 0x7f5c1c16ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.120+0000 7f5c20d5e700 1 --2- 172.21.15.69:0/2636520381 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5c1c0c8040 0x7f5c1c15a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.120+0000 7f5c20d5e700 1 -- 172.21.15.69:0/2636520381 >> 172.21.15.69:0/2636520381 conn(0x7f5c1c0ccb60 msgr2=0x7f5c1c0cc160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:00.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.120+0000 7f5c20d5e700 1 -- 172.21.15.69:0/2636520381 shutdown_connections 2023-10-06T01:40:00.123 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.120+0000 7f5c20d5e700 1 -- 172.21.15.69:0/2636520381 wait complete. 2023-10-06T01:40:00.124 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 18 2023-10-06T01:40:00.133 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:40:00.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.247+0000 7fe1dd18e700 1 Processor -- start 2023-10-06T01:40:00.249 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.247+0000 7fe1dd18e700 1 -- start start 2023-10-06T01:40:00.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.248+0000 7fe1dd18e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1d80cb5a0 0x7fe1d80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:00.251 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.248+0000 7fe1dd18e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe1d80cd9e0 0x7fe1d8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:00.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.248+0000 7fe1dd18e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d815ae40 con 0x7fe1d80cde50 2023-10-06T01:40:00.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.248+0000 7fe1dd18e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1d80d13f0 con 0x7fe1d80cd9e0 2023-10-06T01:40:00.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.248+0000 7fe1dd18e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d815ab60 con 0x7fe1d80cb5a0 2023-10-06T01:40:00.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.249+0000 7fe1d759e700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fe1d80cde50 0x7fe1d8156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.69:46616/0 (socket says 172.21.15.69:46616) 2023-10-06T01:40:00.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.249+0000 7fe1d759e700 1 -- 172.21.15.69:0/4116229485 learned_addr learned my addr 172.21.15.69:0/4116229485 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:40:00.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.249+0000 7fe1d6d9d700 1 --2- 172.21.15.69:0/4116229485 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1d80cb5a0 0x7fe1d80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:00.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.249+0000 7fe1ce59c700 1 --2- 172.21.15.69:0/4116229485 >> v2:172.21.15.88:3300/0 conn(0x7fe1d80cd9e0 0x7fe1d8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:00.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.249+0000 7fe1d659c700 1 -- 172.21.15.69:0/4116229485 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1038961057 0 0) 0x7fe1d815ae40 con 0x7fe1d80cde50 2023-10-06T01:40:00.252 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.249+0000 7fe1d659c700 1 -- 172.21.15.69:0/4116229485 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1c4003570 con 0x7fe1d80cde50 2023-10-06T01:40:00.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.249+0000 7fe1d6d9d700 1 -- 172.21.15.69:0/4116229485 >> v2:172.21.15.88:3300/0 conn(0x7fe1d80cd9e0 msgr2=0x7fe1d8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:00.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.249+0000 7fe1d6d9d700 1 --2- 172.21.15.69:0/4116229485 >> v2:172.21.15.88:3300/0 conn(0x7fe1d80cd9e0 0x7fe1d8159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.249+0000 7fe1d6d9d700 1 -- 172.21.15.69:0/4116229485 >> v1:172.21.15.88:6789/0 conn(0x7fe1d80cde50 legacy=0x7fe1d8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:00.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.249+0000 7fe1d6d9d700 1 -- 172.21.15.69:0/4116229485 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d80ccf00 con 0x7fe1d80cb5a0 2023-10-06T01:40:00.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.249+0000 7fe1ce59c700 1 --2- 172.21.15.69:0/4116229485 >> v2:172.21.15.88:3300/0 conn(0x7fe1d80cd9e0 0x7fe1d8159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:40:00.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.249+0000 7fe1d6d9d700 1 --2- 172.21.15.69:0/4116229485 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1d80cb5a0 0x7fe1d80cb970 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe1c80098e0 tx=0x7fe1c80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbda321f14bbbb8d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:00.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.249+0000 7fe1d659c700 1 -- 172.21.15.69:0/4116229485 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8011630 con 0x7fe1d80cb5a0 2023-10-06T01:40:00.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.249+0000 7fe1d659c700 1 -- 172.21.15.69:0/4116229485 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c8011790 con 0x7fe1d80cb5a0 2023-10-06T01:40:00.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.249+0000 7fe1d659c700 1 -- 172.21.15.69:0/4116229485 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8011b10 con 0x7fe1d80cb5a0 2023-10-06T01:40:00.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.250+0000 7fe1dd18e700 1 -- 172.21.15.69:0/4116229485 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1d80cb5a0 msgr2=0x7fe1d80cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:00.253 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.250+0000 7fe1dd18e700 1 --2- 172.21.15.69:0/4116229485 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1d80cb5a0 0x7fe1d80cb970 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe1c80098e0 tx=0x7fe1c80091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.250+0000 7fe1dd18e700 1 -- 172.21.15.69:0/4116229485 shutdown_connections 2023-10-06T01:40:00.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.250+0000 7fe1dd18e700 1 --2- 172.21.15.69:0/4116229485 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1d80cb5a0 0x7fe1d80cb970 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.250+0000 7fe1dd18e700 1 --2- 172.21.15.69:0/4116229485 >> v2:172.21.15.88:3300/0 conn(0x7fe1d80cd9e0 0x7fe1d8159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.250+0000 7fe1dd18e700 1 -- 172.21.15.69:0/4116229485 >> 172.21.15.69:0/4116229485 conn(0x7fe1d8070e30 msgr2=0x7fe1d80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:00.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.250+0000 7fe1dd18e700 1 -- 172.21.15.69:0/4116229485 shutdown_connections 2023-10-06T01:40:00.254 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.250+0000 7fe1dd18e700 1 -- 172.21.15.69:0/4116229485 wait complete. 2023-10-06T01:40:00.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.251+0000 7fe1dd18e700 1 Processor -- start 2023-10-06T01:40:00.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.251+0000 7fe1dd18e700 1 -- start start 2023-10-06T01:40:00.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.252+0000 7fe1dd18e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1d80cb5a0 0x7fe1d8152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:00.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.252+0000 7fe1dd18e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1d80cd9e0 0x7fe1d8155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:00.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.252+0000 7fe1dd18e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1d81558a0 0x7fe1d80c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:00.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.252+0000 7fe1dd18e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d8152560 con 0x7fe1d80cb5a0 2023-10-06T01:40:00.257 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.252+0000 7fe1dd18e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d8155d40 con 0x7fe1d80cd9e0 2023-10-06T01:40:00.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.252+0000 7fe1dd18e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d8156020 con 0x7fe1d81558a0 2023-10-06T01:40:00.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.252+0000 7fe1d6d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1d80cb5a0 0x7fe1d8152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:00.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.252+0000 7fe1d6d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1d80cb5a0 0x7fe1d8152020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33292/0 (socket says 172.21.15.69:33292) 2023-10-06T01:40:00.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.252+0000 7fe1d6d9d700 1 -- 172.21.15.69:0/1950002895 learned_addr learned my addr 172.21.15.69:0/1950002895 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:00.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.252+0000 7fe1ce59c700 1 --2- 172.21.15.69:0/1950002895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1d80cd9e0 0x7fe1d8155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:00.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.252+0000 7fe1d759e700 1 --2- 172.21.15.69:0/1950002895 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1d81558a0 0x7fe1d80c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:00.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.252+0000 7fe1d6d9d700 1 -- 172.21.15.69:0/1950002895 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1d81558a0 msgr2=0x7fe1d80c8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:00.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.253+0000 7fe1d6d9d700 1 --2- 172.21.15.69:0/1950002895 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1d81558a0 0x7fe1d80c8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.253+0000 7fe1d6d9d700 1 -- 172.21.15.69:0/1950002895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1d80cd9e0 msgr2=0x7fe1d8155360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:00.258 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.253+0000 7fe1d6d9d700 1 --2- 172.21.15.69:0/1950002895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1d80cd9e0 0x7fe1d8155360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.253+0000 7fe1d6d9d700 1 -- 172.21.15.69:0/1950002895 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c0009420 con 0x7fe1d80cb5a0 2023-10-06T01:40:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.253+0000 7fe1d759e700 1 --2- 172.21.15.69:0/1950002895 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1d81558a0 0x7fe1d80c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.253+0000 7fe1d6d9d700 1 --2- 172.21.15.69:0/1950002895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1d80cb5a0 0x7fe1d8152020 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe1d815aca0 tx=0x7fe1c8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.253+0000 7fe1cf7fe700 1 -- 172.21.15.69:0/1950002895 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c8011900 con 0x7fe1d80cb5a0 2023-10-06T01:40:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.253+0000 7fe1cf7fe700 1 -- 172.21.15.69:0/1950002895 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c8011a80 con 0x7fe1d80cb5a0 2023-10-06T01:40:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.253+0000 7fe1dd18e700 1 -- 172.21.15.69:0/1950002895 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1c8009420 con 0x7fe1d80cb5a0 2023-10-06T01:40:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.253+0000 7fe1cf7fe700 1 -- 172.21.15.69:0/1950002895 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c801a680 con 0x7fe1d80cb5a0 2023-10-06T01:40:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.253+0000 7fe1dd18e700 1 -- 172.21.15.69:0/1950002895 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d815c140 con 0x7fe1d80cb5a0 2023-10-06T01:40:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.254+0000 7fe1dd18e700 1 -- 172.21.15.69:0/1950002895 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d804c3c0 con 0x7fe1d80cb5a0 2023-10-06T01:40:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.254+0000 7fe1cf7fe700 1 -- 172.21.15.69:0/1950002895 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fe1c801aa70 con 0x7fe1d80cb5a0 2023-10-06T01:40:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.255+0000 7fe1cf7fe700 1 --2- 172.21.15.69:0/1950002895 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe1b8067160 0x7fe1b8069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:00.259 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.255+0000 7fe1ce59c700 1 --2- 172.21.15.69:0/1950002895 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe1b8067160 0x7fe1b8069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:00.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.255+0000 7fe1cf7fe700 1 -- 172.21.15.69:0/1950002895 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe1c80865f0 con 0x7fe1d80cb5a0 2023-10-06T01:40:00.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.255+0000 7fe1ce59c700 1 --2- 172.21.15.69:0/1950002895 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe1b8067160 0x7fe1b8069610 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe1d815aa90 tx=0x7fe1c00091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:00.260 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.259+0000 7fe1cf7fe700 1 -- 172.21.15.69:0/1950002895 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1c80533e0 con 0x7fe1d80cb5a0 2023-10-06T01:40:00.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.444+0000 7fe1dd18e700 1 -- 172.21.15.69:0/1950002895 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1d80cd1e0 con 0x7fe1d80cb5a0 2023-10-06T01:40:00.446 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.445+0000 7fe1cf7fe700 1 -- 172.21.15.69:0/1950002895 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16818 (secure 0 0 0) 0x7fe1c8056a00 con 0x7fe1d80cb5a0 2023-10-06T01:40:00.447 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:40:00.447 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":35,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:39:40.515179+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:38:43.046056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-10-06T01:39:37.033167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-10-06T01:39:37.950855+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:40:00.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.447+0000 7fe1dd18e700 1 -- 172.21.15.69:0/1950002895 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe1b8067160 msgr2=0x7fe1b8069610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:00.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.447+0000 7fe1dd18e700 1 --2- 172.21.15.69:0/1950002895 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe1b8067160 0x7fe1b8069610 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fe1d815aa90 tx=0x7fe1c00091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.447+0000 7fe1dd18e700 1 -- 172.21.15.69:0/1950002895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1d80cb5a0 msgr2=0x7fe1d8152020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:00.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.447+0000 7fe1dd18e700 1 --2- 172.21.15.69:0/1950002895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1d80cb5a0 0x7fe1d8152020 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fe1d815aca0 tx=0x7fe1c8017000 comp rx=0 tx=0).stop 2023-10-06T01:40:00.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.447+0000 7fe1dd18e700 1 -- 172.21.15.69:0/1950002895 shutdown_connections 2023-10-06T01:40:00.449 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.447+0000 7fe1dd18e700 1 --2- 172.21.15.69:0/1950002895 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe1b8067160 0x7fe1b8069610 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.447+0000 7fe1dd18e700 1 --2- 172.21.15.69:0/1950002895 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1d81558a0 0x7fe1d80c8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.447+0000 7fe1dd18e700 1 --2- 172.21.15.69:0/1950002895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1d80cb5a0 0x7fe1d8152020 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.447+0000 7fe1dd18e700 1 --2- 172.21.15.69:0/1950002895 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1d80cd9e0 0x7fe1d8155360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.447+0000 7fe1dd18e700 1 -- 172.21.15.69:0/1950002895 >> 172.21.15.69:0/1950002895 conn(0x7fe1d8070e30 msgr2=0x7fe1d80c6270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:00.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.447+0000 7fe1dd18e700 1 -- 172.21.15.69:0/1950002895 shutdown_connections 2023-10-06T01:40:00.450 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.447+0000 7fe1dd18e700 1 -- 172.21.15.69:0/1950002895 wait complete. 2023-10-06T01:40:00.461 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-06T01:40:00.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.575+0000 7fee961c4700 1 Processor -- start 2023-10-06T01:40:00.577 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.575+0000 7fee961c4700 1 -- start start 2023-10-06T01:40:00.578 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.576+0000 7fee961c4700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fee900cf200 0x7fee900c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:00.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.576+0000 7fee961c4700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fee900b0ba0 0x7fee9006e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:00.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.576+0000 7fee961c4700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee9015a280 con 0x7fee900b07d0 2023-10-06T01:40:00.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.576+0000 7fee961c4700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee9006e180 con 0x7fee900cf200 2023-10-06T01:40:00.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.576+0000 7fee961c4700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9006d850 con 0x7fee900b0ba0 2023-10-06T01:40:00.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.577+0000 7fee8ffff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fee900b0ba0 0x7fee9006e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:00.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.577+0000 7fee8effd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fee900cf200 0x7fee900c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:00.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.577+0000 7fee8f7fe700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fee900b07d0 0x7fee900ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.69:46628/0 (socket says 172.21.15.69:46628) 2023-10-06T01:40:00.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.577+0000 7fee8f7fe700 1 -- 172.21.15.69:0/1190147499 learned_addr learned my addr 172.21.15.69:0/1190147499 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:40:00.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.577+0000 7fee8effd700 1 -- 172.21.15.69:0/1190147499 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fee900b0ba0 msgr2=0x7fee9006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:00.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.577+0000 7fee8effd700 1 --2- 172.21.15.69:0/1190147499 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fee900b0ba0 0x7fee9006e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.579 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.577+0000 7fee8effd700 1 -- 172.21.15.69:0/1190147499 >> v1:172.21.15.88:6789/0 conn(0x7fee900b07d0 legacy=0x7fee900ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:00.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.577+0000 7fee8effd700 1 -- 172.21.15.69:0/1190147499 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9006db30 con 0x7fee900cf200 2023-10-06T01:40:00.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.577+0000 7fee8effd700 1 --2- 172.21.15.69:0/1190147499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee900cf200 0x7fee900c42c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fee840098e0 tx=0x7fee840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e79330bf4299f08 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:00.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.577+0000 7fee8e7fc700 1 -- 172.21.15.69:0/1190147499 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8400b640 con 0x7fee900cf200 2023-10-06T01:40:00.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.577+0000 7fee8e7fc700 1 -- 172.21.15.69:0/1190147499 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8400b7a0 con 0x7fee900cf200 2023-10-06T01:40:00.580 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.577+0000 7fee8e7fc700 1 -- 172.21.15.69:0/1190147499 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8400bb40 con 0x7fee900cf200 2023-10-06T01:40:00.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.578+0000 7fee961c4700 1 -- 172.21.15.69:0/1190147499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee900cf200 msgr2=0x7fee900c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:00.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.578+0000 7fee961c4700 1 --2- 172.21.15.69:0/1190147499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee900cf200 0x7fee900c42c0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fee840098e0 tx=0x7fee840091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.578+0000 7fee961c4700 1 -- 172.21.15.69:0/1190147499 shutdown_connections 2023-10-06T01:40:00.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.578+0000 7fee961c4700 1 --2- 172.21.15.69:0/1190147499 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fee900b0ba0 0x7fee9006e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.578+0000 7fee961c4700 1 --2- 172.21.15.69:0/1190147499 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee900cf200 0x7fee900c42c0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.578+0000 7fee961c4700 1 -- 172.21.15.69:0/1190147499 >> 172.21.15.69:0/1190147499 conn(0x7fee9006ce80 msgr2=0x7fee900ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:00.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.578+0000 7fee961c4700 1 -- 172.21.15.69:0/1190147499 shutdown_connections 2023-10-06T01:40:00.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.578+0000 7fee961c4700 1 -- 172.21.15.69:0/1190147499 wait complete. 2023-10-06T01:40:00.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.579+0000 7fee961c4700 1 Processor -- start 2023-10-06T01:40:00.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.579+0000 7fee961c4700 1 -- start start 2023-10-06T01:40:00.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.580+0000 7fee961c4700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee900b07d0 0x7fee90158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:00.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.580+0000 7fee961c4700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fee900b0ba0 0x7fee90153310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:00.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.580+0000 7fee961c4700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee900cf200 0x7fee9016e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:00.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.580+0000 7fee961c4700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee90153850 con 0x7fee900b07d0 2023-10-06T01:40:00.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.580+0000 7fee961c4700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9016e6c0 con 0x7fee900cf200 2023-10-06T01:40:00.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.580+0000 7fee961c4700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee90158ed0 con 0x7fee900b0ba0 2023-10-06T01:40:00.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.580+0000 7fee8f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee900b07d0 0x7fee90158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:00.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.580+0000 7fee8f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee900b07d0 0x7fee90158860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33300/0 (socket says 172.21.15.69:33300) 2023-10-06T01:40:00.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.580+0000 7fee8f7fe700 1 -- 172.21.15.69:0/3524149706 learned_addr learned my addr 172.21.15.69:0/3524149706 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:00.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.580+0000 7fee8effd700 1 --2- 172.21.15.69:0/3524149706 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fee900b0ba0 0x7fee90153310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:00.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.580+0000 7fee8ffff700 1 --2- 172.21.15.69:0/3524149706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee900cf200 0x7fee9016e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:00.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.580+0000 7fee8f7fe700 1 -- 172.21.15.69:0/3524149706 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fee900b0ba0 msgr2=0x7fee90153310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:00.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.580+0000 7fee8f7fe700 1 --2- 172.21.15.69:0/3524149706 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fee900b0ba0 0x7fee90153310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.580+0000 7fee8f7fe700 1 -- 172.21.15.69:0/3524149706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee900cf200 msgr2=0x7fee9016e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:00.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.580+0000 7fee8f7fe700 1 --2- 172.21.15.69:0/3524149706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee900cf200 0x7fee9016e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.580+0000 7fee8f7fe700 1 -- 172.21.15.69:0/3524149706 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee84009420 con 0x7fee900b07d0 2023-10-06T01:40:00.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.580+0000 7fee8f7fe700 1 --2- 172.21.15.69:0/3524149706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee900b07d0 0x7fee90158860 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fee8000c590 tx=0x7fee80001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:00.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.581+0000 7fee777fe700 1 -- 172.21.15.69:0/3524149706 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee80005b80 con 0x7fee900b07d0 2023-10-06T01:40:00.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.581+0000 7fee777fe700 1 -- 172.21.15.69:0/3524149706 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee80005ce0 con 0x7fee900b07d0 2023-10-06T01:40:00.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.581+0000 7fee777fe700 1 -- 172.21.15.69:0/3524149706 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee80004ad0 con 0x7fee900b07d0 2023-10-06T01:40:00.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.581+0000 7fee961c4700 1 -- 172.21.15.69:0/3524149706 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee90156280 con 0x7fee900b07d0 2023-10-06T01:40:00.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.581+0000 7fee961c4700 1 -- 172.21.15.69:0/3524149706 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee90156840 con 0x7fee900b07d0 2023-10-06T01:40:00.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.582+0000 7fee961c4700 1 -- 172.21.15.69:0/3524149706 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee900c4a60 con 0x7fee900b07d0 2023-10-06T01:40:00.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.582+0000 7fee777fe700 1 -- 172.21.15.69:0/3524149706 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fee800070d0 con 0x7fee900b07d0 2023-10-06T01:40:00.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.582+0000 7fee777fe700 1 --2- 172.21.15.69:0/3524149706 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fee7c0670e0 0x7fee7c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:00.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.583+0000 7fee8effd700 1 --2- 172.21.15.69:0/3524149706 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fee7c0670e0 0x7fee7c069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:00.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.583+0000 7fee777fe700 1 -- 172.21.15.69:0/3524149706 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fee80083c10 con 0x7fee900b07d0 2023-10-06T01:40:00.587 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.583+0000 7fee8effd700 1 --2- 172.21.15.69:0/3524149706 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fee7c0670e0 0x7fee7c069590 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fee840093f0 tx=0x7fee84017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:00.588 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.587+0000 7fee777fe700 1 -- 172.21.15.69:0/3524149706 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee8004b5a0 con 0x7fee900b07d0 2023-10-06T01:40:00.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.814+0000 7fee961c4700 1 -- 172.21.15.69:0/3524149706 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fee9004c3c0 con 0x7fee900b07d0 2023-10-06T01:40:00.816 INFO:tasks.ceph.mon.a.smithi069.stderr:2023-10-06T01:40:00.814+0000 7fed5f87a700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-06T01:40:00.819 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.818+0000 7fee777fe700 1 -- 172.21.15.69:0/3524149706 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v19) v1 ==== 161+0+0 (secure 0 0 0) 0x7fee80050aa0 con 0x7fee900b07d0 2023-10-06T01:40:00.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.821+0000 7fee961c4700 1 -- 172.21.15.69:0/3524149706 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fee7c0670e0 msgr2=0x7fee7c069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:00.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.821+0000 7fee961c4700 1 --2- 172.21.15.69:0/3524149706 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fee7c0670e0 0x7fee7c069590 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fee840093f0 tx=0x7fee84017000 comp rx=0 tx=0).stop 2023-10-06T01:40:00.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.821+0000 7fee961c4700 1 -- 172.21.15.69:0/3524149706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee900b07d0 msgr2=0x7fee90158860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:00.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.821+0000 7fee961c4700 1 --2- 172.21.15.69:0/3524149706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee900b07d0 0x7fee90158860 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fee8000c590 tx=0x7fee80001070 comp rx=0 tx=0).stop 2023-10-06T01:40:00.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.821+0000 7fee961c4700 1 -- 172.21.15.69:0/3524149706 shutdown_connections 2023-10-06T01:40:00.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.821+0000 7fee961c4700 1 --2- 172.21.15.69:0/3524149706 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fee7c0670e0 0x7fee7c069590 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.821+0000 7fee961c4700 1 --2- 172.21.15.69:0/3524149706 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee900cf200 0x7fee9016e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.821+0000 7fee961c4700 1 --2- 172.21.15.69:0/3524149706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee900b07d0 0x7fee90158860 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.821+0000 7fee961c4700 1 --2- 172.21.15.69:0/3524149706 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fee900b0ba0 0x7fee90153310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.821+0000 7fee961c4700 1 -- 172.21.15.69:0/3524149706 >> 172.21.15.69:0/3524149706 conn(0x7fee9006ce80 msgr2=0x7fee90068f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:00.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.821+0000 7fee961c4700 1 -- 172.21.15.69:0/3524149706 shutdown_connections 2023-10-06T01:40:00.823 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.821+0000 7fee961c4700 1 -- 172.21.15.69:0/3524149706 wait complete. 2023-10-06T01:40:00.824 INFO:teuthology.orchestra.run.smithi069.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-06T01:40:00.835 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-06T01:40:00.858 INFO:tasks.ceph.mds.d.smithi088.stdout:starting mds.d at 2023-10-06T01:40:00.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.950+0000 7fe1d0a86700 1 Processor -- start 2023-10-06T01:40:00.951 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.950+0000 7fe1d0a86700 1 -- start start 2023-10-06T01:40:00.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.951+0000 7fe1d0a86700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe1cc159530 0x7fe1cc0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:00.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.951+0000 7fe1d0a86700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1cc06e0e0 0x7fe1cc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:00.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.951+0000 7fe1d0a86700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1cc0ccfd0 con 0x7fe1cc06dc70 2023-10-06T01:40:00.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.951+0000 7fe1d0a86700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1cc0cf0e0 con 0x7fe1cc159530 2023-10-06T01:40:00.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.951+0000 7fe1d0a86700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc15a3d0 con 0x7fe1cc06e0e0 2023-10-06T01:40:00.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.951+0000 7fe1ca59c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe1cc159530 0x7fe1cc0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:00.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.951+0000 7fe1ca59c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe1cc159530 0x7fe1cc0ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33314/0 (socket says 172.21.15.69:33314) 2023-10-06T01:40:00.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.951+0000 7fe1ca59c700 1 -- 172.21.15.69:0/3885667477 learned_addr learned my addr 172.21.15.69:0/3885667477 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:00.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.951+0000 7fe1cad9d700 1 --2- 172.21.15.69:0/3885667477 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1cc06e0e0 0x7fe1cc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:00.954 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.951+0000 7fe1ca59c700 1 -- 172.21.15.69:0/3885667477 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1cc06e0e0 msgr2=0x7fe1cc0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:00.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.951+0000 7fe1ca59c700 1 --2- 172.21.15.69:0/3885667477 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1cc06e0e0 0x7fe1cc0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.951+0000 7fe1ca59c700 1 -- 172.21.15.69:0/3885667477 >> v1:172.21.15.88:6789/0 conn(0x7fe1cc06dc70 legacy=0x7fe1cc159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:00.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.951+0000 7fe1ca59c700 1 -- 172.21.15.69:0/3885667477 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1cc15a6b0 con 0x7fe1cc159530 2023-10-06T01:40:00.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.951+0000 7fe1ca59c700 1 --2- 172.21.15.69:0/3885667477 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1cc159530 0x7fe1cc0ceba0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40099b0 tx=0x7fe1c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9843dbb2bd34420 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:00.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.951+0000 7fe1c959a700 1 -- 172.21.15.69:0/3885667477 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c400b820 con 0x7fe1cc159530 2023-10-06T01:40:00.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.951+0000 7fe1c959a700 1 -- 172.21.15.69:0/3885667477 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c400b980 con 0x7fe1cc159530 2023-10-06T01:40:00.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.952+0000 7fe1c959a700 1 -- 172.21.15.69:0/3885667477 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c400bd20 con 0x7fe1cc159530 2023-10-06T01:40:00.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.952+0000 7fe1d0a86700 1 -- 172.21.15.69:0/3885667477 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1cc159530 msgr2=0x7fe1cc0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:00.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.952+0000 7fe1d0a86700 1 --2- 172.21.15.69:0/3885667477 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1cc159530 0x7fe1cc0ceba0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40099b0 tx=0x7fe1c4009250 comp rx=0 tx=0).stop 2023-10-06T01:40:00.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.952+0000 7fe1d0a86700 1 -- 172.21.15.69:0/3885667477 shutdown_connections 2023-10-06T01:40:00.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.952+0000 7fe1d0a86700 1 --2- 172.21.15.69:0/3885667477 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1cc06e0e0 0x7fe1cc0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.952+0000 7fe1d0a86700 1 --2- 172.21.15.69:0/3885667477 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1cc159530 0x7fe1cc0ceba0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.952+0000 7fe1d0a86700 1 -- 172.21.15.69:0/3885667477 >> 172.21.15.69:0/3885667477 conn(0x7fe1cc0703a0 msgr2=0x7fe1cc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:00.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.952+0000 7fe1d0a86700 1 -- 172.21.15.69:0/3885667477 shutdown_connections 2023-10-06T01:40:00.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.952+0000 7fe1d0a86700 1 -- 172.21.15.69:0/3885667477 wait complete. 2023-10-06T01:40:00.958 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.953+0000 7fe1d0a86700 1 Processor -- start 2023-10-06T01:40:00.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.953+0000 7fe1d0a86700 1 -- start start 2023-10-06T01:40:00.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.954+0000 7fe1d0a86700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1cc06dc70 0x7fe1cc15e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:00.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.954+0000 7fe1d0a86700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1cc06e0e0 0x7fe1cc1529d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:00.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.954+0000 7fe1d0a86700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1cc159530 0x7fe1cc14c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:00.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.954+0000 7fe1d0a86700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0b6240 con 0x7fe1cc06e0e0 2023-10-06T01:40:00.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.954+0000 7fe1d0a86700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0b59a0 con 0x7fe1cc06dc70 2023-10-06T01:40:00.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.954+0000 7fe1d0a86700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0b5c80 con 0x7fe1cc159530 2023-10-06T01:40:00.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.954+0000 7fe1c9d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1cc06e0e0 0x7fe1cc1529d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:00.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.954+0000 7fe1c9d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1cc06e0e0 0x7fe1cc1529d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33326/0 (socket says 172.21.15.69:33326) 2023-10-06T01:40:00.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.954+0000 7fe1c9d9b700 1 -- 172.21.15.69:0/3890513893 learned_addr learned my addr 172.21.15.69:0/3890513893 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:00.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.954+0000 7fe1ca59c700 1 --2- 172.21.15.69:0/3890513893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1cc06dc70 0x7fe1cc15e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:00.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.954+0000 7fe1cad9d700 1 --2- 172.21.15.69:0/3890513893 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1cc159530 0x7fe1cc14c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:00.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.954+0000 7fe1c9d9b700 1 -- 172.21.15.69:0/3890513893 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1cc159530 msgr2=0x7fe1cc14c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:00.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.954+0000 7fe1c9d9b700 1 --2- 172.21.15.69:0/3890513893 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1cc159530 0x7fe1cc14c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.954+0000 7fe1c9d9b700 1 -- 172.21.15.69:0/3890513893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1cc06dc70 msgr2=0x7fe1cc15e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:00.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.954+0000 7fe1c9d9b700 1 --2- 172.21.15.69:0/3890513893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1cc06dc70 0x7fe1cc15e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:00.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.954+0000 7fe1c9d9b700 1 -- 172.21.15.69:0/3890513893 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1c40094f0 con 0x7fe1cc06e0e0 2023-10-06T01:40:00.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.954+0000 7fe1ca59c700 1 --2- 172.21.15.69:0/3890513893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1cc06dc70 0x7fe1cc15e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:40:00.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.954+0000 7fe1c9d9b700 1 --2- 172.21.15.69:0/3890513893 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1cc06e0e0 0x7fe1cc1529d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe1c000c5d0 tx=0x7fe1c0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:00.960 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.955+0000 7fe1ba7fc700 1 -- 172.21.15.69:0/3890513893 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c0011590 con 0x7fe1cc06e0e0 2023-10-06T01:40:00.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.955+0000 7fe1ba7fc700 1 -- 172.21.15.69:0/3890513893 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c0011710 con 0x7fe1cc06e0e0 2023-10-06T01:40:00.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.955+0000 7fe1ba7fc700 1 -- 172.21.15.69:0/3890513893 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c0011ad0 con 0x7fe1cc06e0e0 2023-10-06T01:40:00.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.955+0000 7fe1d0a86700 1 -- 172.21.15.69:0/3890513893 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1cc0b5f60 con 0x7fe1cc06e0e0 2023-10-06T01:40:00.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.955+0000 7fe1d0a86700 1 -- 172.21.15.69:0/3890513893 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1cc0b55e0 con 0x7fe1cc06e0e0 2023-10-06T01:40:00.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.955+0000 7fe1d0a86700 1 -- 172.21.15.69:0/3890513893 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1cc0cf590 con 0x7fe1cc06e0e0 2023-10-06T01:40:00.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.956+0000 7fe1ba7fc700 1 -- 172.21.15.69:0/3890513893 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fe1c001c460 con 0x7fe1cc06e0e0 2023-10-06T01:40:00.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.956+0000 7fe1ba7fc700 1 --2- 172.21.15.69:0/3890513893 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe1ac0670e0 0x7fe1ac069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:00.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.956+0000 7fe1ba7fc700 1 -- 172.21.15.69:0/3890513893 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6144+0+0 (secure 0 0 0) 0x7fe1c00846b0 con 0x7fe1cc06e0e0 2023-10-06T01:40:00.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.956+0000 7fe1ca59c700 1 --2- 172.21.15.69:0/3890513893 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe1ac0670e0 0x7fe1ac069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:00.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.957+0000 7fe1ca59c700 1 --2- 172.21.15.69:0/3890513893 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe1ac0670e0 0x7fe1ac069590 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40099b0 tx=0x7fe1c4016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:00.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:00.961+0000 7fe1ba7fc700 1 -- 172.21.15.69:0/3890513893 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1c00514f0 con 0x7fe1cc06e0e0 2023-10-06T01:40:01.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.185+0000 7fe1d0a86700 1 -- 172.21.15.69:0/3890513893 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe1cc04c3c0 con 0x7fe1cc06e0e0 2023-10-06T01:40:01.822 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.821+0000 7fe1ba7fc700 1 -- 172.21.15.69:0/3890513893 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v20) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe1c0054b10 con 0x7fe1cc06e0e0 2023-10-06T01:40:01.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.823+0000 7fe1d0a86700 1 -- 172.21.15.69:0/3890513893 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe1ac0670e0 msgr2=0x7fe1ac069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:01.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.823+0000 7fe1d0a86700 1 --2- 172.21.15.69:0/3890513893 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe1ac0670e0 0x7fe1ac069590 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe1c40099b0 tx=0x7fe1c4016000 comp rx=0 tx=0).stop 2023-10-06T01:40:01.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.823+0000 7fe1d0a86700 1 -- 172.21.15.69:0/3890513893 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1cc06e0e0 msgr2=0x7fe1cc1529d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:01.825 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.823+0000 7fe1d0a86700 1 --2- 172.21.15.69:0/3890513893 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1cc06e0e0 0x7fe1cc1529d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fe1c000c5d0 tx=0x7fe1c0007f60 comp rx=0 tx=0).stop 2023-10-06T01:40:01.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.824+0000 7fe1d0a86700 1 -- 172.21.15.69:0/3890513893 shutdown_connections 2023-10-06T01:40:01.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.824+0000 7fe1d0a86700 1 --2- 172.21.15.69:0/3890513893 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe1ac0670e0 0x7fe1ac069590 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:01.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.824+0000 7fe1d0a86700 1 --2- 172.21.15.69:0/3890513893 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe1cc159530 0x7fe1cc14c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:01.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.824+0000 7fe1d0a86700 1 --2- 172.21.15.69:0/3890513893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe1cc06dc70 0x7fe1cc15e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:01.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.824+0000 7fe1d0a86700 1 --2- 172.21.15.69:0/3890513893 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe1cc06e0e0 0x7fe1cc1529d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:01.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.824+0000 7fe1d0a86700 1 -- 172.21.15.69:0/3890513893 >> 172.21.15.69:0/3890513893 conn(0x7fe1cc0703a0 msgr2=0x7fe1cc15ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:01.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.824+0000 7fe1d0a86700 1 -- 172.21.15.69:0/3890513893 shutdown_connections 2023-10-06T01:40:01.826 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.824+0000 7fe1d0a86700 1 -- 172.21.15.69:0/3890513893 wait complete. 2023-10-06T01:40:01.838 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-06T01:40:01.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.958+0000 7f7f2812f700 1 Processor -- start 2023-10-06T01:40:01.959 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.958+0000 7f7f2812f700 1 -- start start 2023-10-06T01:40:01.961 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.959+0000 7f7f2812f700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f200cb880 0x7f7f200cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:01.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.959+0000 7f7f2812f700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7f200cd770 0x7f7f201591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:01.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.959+0000 7f7f2812f700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f200cf330 con 0x7f7f200b04f0 2023-10-06T01:40:01.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.959+0000 7f7f2812f700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f200cdbd0 con 0x7f7f200cd770 2023-10-06T01:40:01.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.959+0000 7f7f2812f700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f200cead0 con 0x7f7f200cb880 2023-10-06T01:40:01.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.959+0000 7f7f266cc700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7f200cd770 0x7f7f201591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:01.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.959+0000 7f7f256ca700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f7f200b04f0 0x7f7f200cd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:45416/0 (socket says 172.21.15.69:45416) 2023-10-06T01:40:01.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.959+0000 7f7f266cc700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f7f200cd770 0x7f7f201591e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33342/0 (socket says 172.21.15.69:33342) 2023-10-06T01:40:01.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.959+0000 7f7f256ca700 1 -- 172.21.15.69:0/4256652413 learned_addr learned my addr 172.21.15.69:0/4256652413 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:40:01.962 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.959+0000 7f7f25ecb700 1 --2- 172.21.15.69:0/4256652413 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f200cb880 0x7f7f200cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:01.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.959+0000 7f7f266cc700 1 -- 172.21.15.69:0/4256652413 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f200cb880 msgr2=0x7f7f200cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:01.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.959+0000 7f7f266cc700 1 --2- 172.21.15.69:0/4256652413 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f200cb880 0x7f7f200cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:01.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.959+0000 7f7f266cc700 1 -- 172.21.15.69:0/4256652413 >> v1:172.21.15.69:6789/0 conn(0x7f7f200b04f0 legacy=0x7f7f200cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:01.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.959+0000 7f7f266cc700 1 -- 172.21.15.69:0/4256652413 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f200cddd0 con 0x7f7f200cd770 2023-10-06T01:40:01.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.959+0000 7f7f25ecb700 1 --2- 172.21.15.69:0/4256652413 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f200cb880 0x7f7f200cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:40:01.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.959+0000 7f7f266cc700 1 --2- 172.21.15.69:0/4256652413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f200cd770 0x7f7f201591e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7f180098e0 tx=0x7f7f180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f63c936eacf839cd server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:01.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.959+0000 7f7f24ec9700 1 -- 172.21.15.69:0/4256652413 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18009e80 con 0x7f7f200cd770 2023-10-06T01:40:01.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.960+0000 7f7f24ec9700 1 -- 172.21.15.69:0/4256652413 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f1800b860 con 0x7f7f200cd770 2023-10-06T01:40:01.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.960+0000 7f7f24ec9700 1 -- 172.21.15.69:0/4256652413 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f1800bbe0 con 0x7f7f200cd770 2023-10-06T01:40:01.963 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.960+0000 7f7f2812f700 1 -- 172.21.15.69:0/4256652413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f200cd770 msgr2=0x7f7f201591e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:01.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.960+0000 7f7f2812f700 1 --2- 172.21.15.69:0/4256652413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f200cd770 0x7f7f201591e0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f7f180098e0 tx=0x7f7f180091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:01.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.960+0000 7f7f2812f700 1 -- 172.21.15.69:0/4256652413 shutdown_connections 2023-10-06T01:40:01.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.960+0000 7f7f2812f700 1 --2- 172.21.15.69:0/4256652413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f200cd770 0x7f7f201591e0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:01.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.960+0000 7f7f2812f700 1 --2- 172.21.15.69:0/4256652413 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f200cb880 0x7f7f200cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:01.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.960+0000 7f7f2812f700 1 -- 172.21.15.69:0/4256652413 >> 172.21.15.69:0/4256652413 conn(0x7f7f200703a0 msgr2=0x7f7f200707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:01.964 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.960+0000 7f7f2812f700 1 -- 172.21.15.69:0/4256652413 shutdown_connections 2023-10-06T01:40:01.965 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.960+0000 7f7f2812f700 1 -- 172.21.15.69:0/4256652413 wait complete. 2023-10-06T01:40:01.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.961+0000 7f7f2812f700 1 Processor -- start 2023-10-06T01:40:01.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.961+0000 7f7f2812f700 1 -- start start 2023-10-06T01:40:01.967 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.962+0000 7f7f2812f700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f200b04f0 0x7f7f201551d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:01.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.962+0000 7f7f2812f700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f200cb880 0x7f7f20155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:01.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.962+0000 7f7f2812f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f200cd770 0x7f7f20157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:01.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.962+0000 7f7f2812f700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f200b57f0 con 0x7f7f200cd770 2023-10-06T01:40:01.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.962+0000 7f7f2812f700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f200b3860 con 0x7f7f200b04f0 2023-10-06T01:40:01.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.962+0000 7f7f2812f700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f200b3b40 con 0x7f7f200cb880 2023-10-06T01:40:01.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.962+0000 7f7f266cc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f200cd770 0x7f7f20157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:01.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.962+0000 7f7f266cc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f200cd770 0x7f7f20157ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33356/0 (socket says 172.21.15.69:33356) 2023-10-06T01:40:01.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.962+0000 7f7f266cc700 1 -- 172.21.15.69:0/2361270539 learned_addr learned my addr 172.21.15.69:0/2361270539 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:01.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.962+0000 7f7f256ca700 1 --2- 172.21.15.69:0/2361270539 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f200cb880 0x7f7f20155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:01.968 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.962+0000 7f7f25ecb700 1 --2- 172.21.15.69:0/2361270539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f200b04f0 0x7f7f201551d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:01.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.962+0000 7f7f266cc700 1 -- 172.21.15.69:0/2361270539 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f200cb880 msgr2=0x7f7f20155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:01.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.962+0000 7f7f266cc700 1 --2- 172.21.15.69:0/2361270539 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f200cb880 0x7f7f20155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:01.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.962+0000 7f7f266cc700 1 -- 172.21.15.69:0/2361270539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f200b04f0 msgr2=0x7f7f201551d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:01.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.962+0000 7f7f266cc700 1 --2- 172.21.15.69:0/2361270539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f200b04f0 0x7f7f201551d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:01.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.962+0000 7f7f266cc700 1 -- 172.21.15.69:0/2361270539 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f18009420 con 0x7f7f200cd770 2023-10-06T01:40:01.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.963+0000 7f7f266cc700 1 --2- 172.21.15.69:0/2361270539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f200cd770 0x7f7f20157ba0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7f20089650 tx=0x7f7f18017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:01.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.963+0000 7f7f1dffb700 1 -- 172.21.15.69:0/2361270539 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18011420 con 0x7f7f200cd770 2023-10-06T01:40:01.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.963+0000 7f7f1dffb700 1 -- 172.21.15.69:0/2361270539 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f18011580 con 0x7f7f200cd770 2023-10-06T01:40:01.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.963+0000 7f7f2812f700 1 -- 172.21.15.69:0/2361270539 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f200b3e20 con 0x7f7f200cd770 2023-10-06T01:40:01.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.963+0000 7f7f1dffb700 1 -- 172.21.15.69:0/2361270539 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f18011920 con 0x7f7f200cd770 2023-10-06T01:40:01.969 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.963+0000 7f7f2812f700 1 -- 172.21.15.69:0/2361270539 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f200b43e0 con 0x7f7f200cd770 2023-10-06T01:40:01.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.964+0000 7f7f2812f700 1 -- 172.21.15.69:0/2361270539 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f2004c3c0 con 0x7f7f200cd770 2023-10-06T01:40:01.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.964+0000 7f7f1dffb700 1 -- 172.21.15.69:0/2361270539 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f7f18011cd0 con 0x7f7f200cd770 2023-10-06T01:40:01.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.964+0000 7f7f1dffb700 1 --2- 172.21.15.69:0/2361270539 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7f0c0670e0 0x7f7f0c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:01.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.965+0000 7f7f1dffb700 1 -- 172.21.15.69:0/2361270539 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6144+0+0 (secure 0 0 0) 0x7f7f180860b0 con 0x7f7f200cd770 2023-10-06T01:40:01.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.965+0000 7f7f25ecb700 1 --2- 172.21.15.69:0/2361270539 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7f0c0670e0 0x7f7f0c069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:01.970 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.965+0000 7f7f25ecb700 1 --2- 172.21.15.69:0/2361270539 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7f0c0670e0 0x7f7f0c069590 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7f1000d6e0 tx=0x7f7f10007850 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:01.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:01.969+0000 7f7f1dffb700 1 -- 172.21.15.69:0/2361270539 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7f18052ef0 con 0x7f7f200cd770 2023-10-06T01:40:02.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.152+0000 7f7f2812f700 1 -- 172.21.15.69:0/2361270539 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7f200b6510 con 0x7f7f200cd770 2023-10-06T01:40:02.831 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.829+0000 7f7f1dffb700 1 -- 172.21.15.69:0/2361270539 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) v1 ==== 181+0+0 (secure 0 0 0) 0x7f7f18056510 con 0x7f7f200cd770 2023-10-06T01:40:02.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.832+0000 7f7f2812f700 1 -- 172.21.15.69:0/2361270539 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7f0c0670e0 msgr2=0x7f7f0c069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:02.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.832+0000 7f7f2812f700 1 --2- 172.21.15.69:0/2361270539 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7f0c0670e0 0x7f7f0c069590 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f7f1000d6e0 tx=0x7f7f10007850 comp rx=0 tx=0).stop 2023-10-06T01:40:02.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.832+0000 7f7f2812f700 1 -- 172.21.15.69:0/2361270539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f200cd770 msgr2=0x7f7f20157ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:02.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.832+0000 7f7f2812f700 1 --2- 172.21.15.69:0/2361270539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f200cd770 0x7f7f20157ba0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f7f20089650 tx=0x7f7f18017000 comp rx=0 tx=0).stop 2023-10-06T01:40:02.834 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.833+0000 7f7f2812f700 1 -- 172.21.15.69:0/2361270539 shutdown_connections 2023-10-06T01:40:02.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.833+0000 7f7f2812f700 1 --2- 172.21.15.69:0/2361270539 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f7f0c0670e0 0x7f7f0c069590 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:02.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.833+0000 7f7f2812f700 1 --2- 172.21.15.69:0/2361270539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f200cd770 0x7f7f20157ba0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:02.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.833+0000 7f7f2812f700 1 --2- 172.21.15.69:0/2361270539 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f7f200b04f0 0x7f7f201551d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:02.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.833+0000 7f7f2812f700 1 --2- 172.21.15.69:0/2361270539 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f7f200cb880 0x7f7f20155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:02.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.833+0000 7f7f2812f700 1 -- 172.21.15.69:0/2361270539 >> 172.21.15.69:0/2361270539 conn(0x7f7f200703a0 msgr2=0x7f7f2015fc90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:02.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.833+0000 7f7f2812f700 1 -- 172.21.15.69:0/2361270539 shutdown_connections 2023-10-06T01:40:02.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.833+0000 7f7f2812f700 1 -- 172.21.15.69:0/2361270539 wait complete. 2023-10-06T01:40:02.835 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_metadata' removed 2023-10-06T01:40:02.848 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-06T01:40:02.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.967+0000 7fc73d260700 1 Processor -- start 2023-10-06T01:40:02.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.967+0000 7fc73d260700 1 -- start start 2023-10-06T01:40:02.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.968+0000 7fc73d260700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc738088400 0x7fc7380a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:02.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.968+0000 7fc73d260700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7380ce1c0 con 0x7fc7380a8aa0 2023-10-06T01:40:02.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.968+0000 7fc73d260700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7380cd5b0 con 0x7fc7380ae6f0 2023-10-06T01:40:02.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.968+0000 7fc73d260700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7380cd890 con 0x7fc738088400 2023-10-06T01:40:02.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.968+0000 7fc73659c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc738088400 0x7fc7380a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:02.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.968+0000 7fc73659c700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc738088400 0x7fc7380a8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33364/0 (socket says 172.21.15.69:33364) 2023-10-06T01:40:02.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.968+0000 7fc73659c700 1 -- 172.21.15.69:0/4233957859 learned_addr learned my addr 172.21.15.69:0/4233957859 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:02.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.968+0000 7fc736d9d700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fc7380a8aa0 0x7fc7380b0830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:45426/0 (socket says 172.21.15.69:45426) 2023-10-06T01:40:02.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.969+0000 7fc73659c700 1 -- 172.21.15.69:0/4233957859 >> v1:172.21.15.88:6789/0 conn(0x7fc7380ae6f0 legacy=0x7fc7380aeaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:02.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.969+0000 7fc73659c700 1 -- 172.21.15.69:0/4233957859 >> v1:172.21.15.69:6789/0 conn(0x7fc7380a8aa0 legacy=0x7fc7380b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:02.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.969+0000 7fc73659c700 1 -- 172.21.15.69:0/4233957859 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7380cdb70 con 0x7fc738088400 2023-10-06T01:40:02.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.969+0000 7fc735d9b700 1 -- 172.21.15.69:0/4233957859 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3314556871 0 0) 0x7fc7380ce1c0 con 0x7fc7380a8aa0 2023-10-06T01:40:02.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.969+0000 7fc73659c700 1 --2- 172.21.15.69:0/4233957859 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc738088400 0x7fc7380a8e70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc72c0099b0 tx=0x7fc72c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=418a910eda49a384 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:02.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.969+0000 7fc735d9b700 1 -- 172.21.15.69:0/4233957859 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c00b820 con 0x7fc738088400 2023-10-06T01:40:02.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.969+0000 7fc735d9b700 1 -- 172.21.15.69:0/4233957859 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72c00b980 con 0x7fc738088400 2023-10-06T01:40:02.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.969+0000 7fc735d9b700 1 -- 172.21.15.69:0/4233957859 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72c00bd20 con 0x7fc738088400 2023-10-06T01:40:02.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.969+0000 7fc73d260700 1 -- 172.21.15.69:0/4233957859 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc738088400 msgr2=0x7fc7380a8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:02.972 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.969+0000 7fc73d260700 1 --2- 172.21.15.69:0/4233957859 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc738088400 0x7fc7380a8e70 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fc72c0099b0 tx=0x7fc72c009250 comp rx=0 tx=0).stop 2023-10-06T01:40:02.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.969+0000 7fc73d260700 1 -- 172.21.15.69:0/4233957859 shutdown_connections 2023-10-06T01:40:02.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.969+0000 7fc73d260700 1 --2- 172.21.15.69:0/4233957859 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc738088400 0x7fc7380a8e70 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:02.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.969+0000 7fc73d260700 1 -- 172.21.15.69:0/4233957859 >> 172.21.15.69:0/4233957859 conn(0x7fc738088000 msgr2=0x7fc7380ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:02.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.969+0000 7fc73d260700 1 -- 172.21.15.69:0/4233957859 shutdown_connections 2023-10-06T01:40:02.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.970+0000 7fc73d260700 1 -- 172.21.15.69:0/4233957859 wait complete. 2023-10-06T01:40:02.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.971+0000 7fc73d260700 1 Processor -- start 2023-10-06T01:40:02.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.971+0000 7fc73d260700 1 -- start start 2023-10-06T01:40:02.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.971+0000 7fc73d260700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc7380a8aa0 0x7fc7380ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:02.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.971+0000 7fc73d260700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7380ae6f0 0x7fc7380ad360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:02.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.971+0000 7fc73d260700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc738159260 0x7fc73815d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:02.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.971+0000 7fc73d260700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7380ac840 con 0x7fc7380a8aa0 2023-10-06T01:40:02.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.971+0000 7fc73d260700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7380abc30 con 0x7fc7380ae6f0 2023-10-06T01:40:02.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.971+0000 7fc73d260700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7380abf10 con 0x7fc738159260 2023-10-06T01:40:02.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.971+0000 7fc736d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc7380a8aa0 0x7fc7380ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:02.976 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.972+0000 7fc736d9d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc7380a8aa0 0x7fc7380ab5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33380/0 (socket says 172.21.15.69:33380) 2023-10-06T01:40:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.972+0000 7fc736d9d700 1 -- 172.21.15.69:0/4124566208 learned_addr learned my addr 172.21.15.69:0/4124566208 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.972+0000 7fc73659c700 1 --2- 172.21.15.69:0/4124566208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7380ae6f0 0x7fc7380ad360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.972+0000 7fc73759e700 1 --2- 172.21.15.69:0/4124566208 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc738159260 0x7fc73815d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.972+0000 7fc736d9d700 1 -- 172.21.15.69:0/4124566208 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc738159260 msgr2=0x7fc73815d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.972+0000 7fc736d9d700 1 --2- 172.21.15.69:0/4124566208 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc738159260 0x7fc73815d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.972+0000 7fc736d9d700 1 -- 172.21.15.69:0/4124566208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7380ae6f0 msgr2=0x7fc7380ad360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.972+0000 7fc736d9d700 1 --2- 172.21.15.69:0/4124566208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7380ae6f0 0x7fc7380ad360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.972+0000 7fc736d9d700 1 -- 172.21.15.69:0/4124566208 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc72c0094f0 con 0x7fc7380a8aa0 2023-10-06T01:40:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.972+0000 7fc736d9d700 1 --2- 172.21.15.69:0/4124566208 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc7380a8aa0 0x7fc7380ab5c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc72800c930 tx=0x7fc7280016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.972+0000 7fc71effd700 1 -- 172.21.15.69:0/4124566208 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc728005d80 con 0x7fc7380a8aa0 2023-10-06T01:40:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.972+0000 7fc71effd700 1 -- 172.21.15.69:0/4124566208 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc72800a5d0 con 0x7fc7380a8aa0 2023-10-06T01:40:02.977 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.972+0000 7fc73d260700 1 -- 172.21.15.69:0/4124566208 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7380ac1f0 con 0x7fc7380a8aa0 2023-10-06T01:40:02.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.972+0000 7fc71effd700 1 -- 172.21.15.69:0/4124566208 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc72800a990 con 0x7fc7380a8aa0 2023-10-06T01:40:02.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.972+0000 7fc73d260700 1 -- 172.21.15.69:0/4124566208 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7380ad8a0 con 0x7fc7380a8aa0 2023-10-06T01:40:02.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.973+0000 7fc73d260700 1 -- 172.21.15.69:0/4124566208 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7380ac690 con 0x7fc7380a8aa0 2023-10-06T01:40:02.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.974+0000 7fc71effd700 1 -- 172.21.15.69:0/4124566208 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fc7280070f0 con 0x7fc7380a8aa0 2023-10-06T01:40:02.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.974+0000 7fc71effd700 1 --2- 172.21.15.69:0/4124566208 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc7240670e0 0x7fc724069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:02.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.974+0000 7fc71effd700 1 -- 172.21.15.69:0/4124566208 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5706+0+0 (secure 0 0 0) 0x7fc7280845f0 con 0x7fc7380a8aa0 2023-10-06T01:40:02.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.974+0000 7fc73659c700 1 --2- 172.21.15.69:0/4124566208 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc7240670e0 0x7fc724069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:02.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.974+0000 7fc73659c700 1 --2- 172.21.15.69:0/4124566208 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc7240670e0 0x7fc724069590 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc72c0099b0 tx=0x7fc72c016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:02.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:02.978+0000 7fc71effd700 1 -- 172.21.15.69:0/4124566208 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc728051660 con 0x7fc7380a8aa0 2023-10-06T01:40:03.165 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.163+0000 7fc73d260700 1 -- 172.21.15.69:0/4124566208 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc73804c3c0 con 0x7fc7380a8aa0 2023-10-06T01:40:03.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.836+0000 7fc71effd700 1 -- 172.21.15.69:0/4124566208 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc728054c80 con 0x7fc7380a8aa0 2023-10-06T01:40:03.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.839+0000 7fc73d260700 1 -- 172.21.15.69:0/4124566208 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc7240670e0 msgr2=0x7fc724069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:03.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.839+0000 7fc73d260700 1 --2- 172.21.15.69:0/4124566208 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc7240670e0 0x7fc724069590 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc72c0099b0 tx=0x7fc72c016000 comp rx=0 tx=0).stop 2023-10-06T01:40:03.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.839+0000 7fc73d260700 1 -- 172.21.15.69:0/4124566208 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc7380a8aa0 msgr2=0x7fc7380ab5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:03.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.839+0000 7fc73d260700 1 --2- 172.21.15.69:0/4124566208 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc7380a8aa0 0x7fc7380ab5c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fc72800c930 tx=0x7fc7280016f0 comp rx=0 tx=0).stop 2023-10-06T01:40:03.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.839+0000 7fc73d260700 1 -- 172.21.15.69:0/4124566208 shutdown_connections 2023-10-06T01:40:03.841 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.839+0000 7fc73d260700 1 --2- 172.21.15.69:0/4124566208 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc7240670e0 0x7fc724069590 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:03.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.839+0000 7fc73d260700 1 --2- 172.21.15.69:0/4124566208 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc738159260 0x7fc73815d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:03.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.839+0000 7fc73d260700 1 --2- 172.21.15.69:0/4124566208 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc7380a8aa0 0x7fc7380ab5c0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:03.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.839+0000 7fc73d260700 1 --2- 172.21.15.69:0/4124566208 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc7380ae6f0 0x7fc7380ad360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:03.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.839+0000 7fc73d260700 1 -- 172.21.15.69:0/4124566208 >> 172.21.15.69:0/4124566208 conn(0x7fc738088000 msgr2=0x7fc7380b3880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:03.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.839+0000 7fc73d260700 1 -- 172.21.15.69:0/4124566208 shutdown_connections 2023-10-06T01:40:03.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.839+0000 7fc73d260700 1 -- 172.21.15.69:0/4124566208 wait complete. 2023-10-06T01:40:03.842 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_data' removed 2023-10-06T01:40:03.854 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-06T01:40:03.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.969+0000 7f950a6f8700 1 Processor -- start 2023-10-06T01:40:03.971 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.969+0000 7f950a6f8700 1 -- start start 2023-10-06T01:40:03.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.970+0000 7f950a6f8700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f950406dc70 0x7f9504159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:03.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.970+0000 7f950a6f8700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f950406e0e0 0x7f95040cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:03.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.970+0000 7f950a6f8700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95040ccfd0 con 0x7f9504159530 2023-10-06T01:40:03.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.970+0000 7f950a6f8700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f950415a3d0 con 0x7f950406dc70 2023-10-06T01:40:03.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.970+0000 7f950a6f8700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f950415a6b0 con 0x7f950406e0e0 2023-10-06T01:40:03.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.970+0000 7f94fbfff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f950406dc70 0x7f9504159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:03.973 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.970+0000 7f94fbfff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f950406dc70 0x7f9504159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33392/0 (socket says 172.21.15.69:33392) 2023-10-06T01:40:03.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.970+0000 7f94fbfff700 1 -- 172.21.15.69:0/627243760 learned_addr learned my addr 172.21.15.69:0/627243760 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:03.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.970+0000 7f9508c95700 1 --2- 172.21.15.69:0/627243760 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f950406e0e0 0x7f95040cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:03.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.971+0000 7f94fbfff700 1 -- 172.21.15.69:0/627243760 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f950406e0e0 msgr2=0x7f95040cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:03.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.971+0000 7f94fbfff700 1 --2- 172.21.15.69:0/627243760 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f950406e0e0 0x7f95040cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:03.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.971+0000 7f94fbfff700 1 -- 172.21.15.69:0/627243760 >> v1:172.21.15.88:6789/0 conn(0x7f9504159530 legacy=0x7f95040ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:03.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.971+0000 7f94fbfff700 1 -- 172.21.15.69:0/627243760 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f950415a990 con 0x7f950406dc70 2023-10-06T01:40:03.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.971+0000 7f94fbfff700 1 --2- 172.21.15.69:0/627243760 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f950406dc70 0x7f9504159900 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f94ec0099b0 tx=0x7f94ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf0f1bb5758eb422 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:03.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.971+0000 7f95037fe700 1 -- 172.21.15.69:0/627243760 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec009ea0 con 0x7f950406dc70 2023-10-06T01:40:03.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.971+0000 7f95037fe700 1 -- 172.21.15.69:0/627243760 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94ec00b860 con 0x7f950406dc70 2023-10-06T01:40:03.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.971+0000 7f95037fe700 1 -- 172.21.15.69:0/627243760 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94ec00bc00 con 0x7f950406dc70 2023-10-06T01:40:03.974 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.972+0000 7f950a6f8700 1 -- 172.21.15.69:0/627243760 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f950406dc70 msgr2=0x7f9504159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:03.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.972+0000 7f950a6f8700 1 --2- 172.21.15.69:0/627243760 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f950406dc70 0x7f9504159900 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f94ec0099b0 tx=0x7f94ec009250 comp rx=0 tx=0).stop 2023-10-06T01:40:03.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.972+0000 7f950a6f8700 1 -- 172.21.15.69:0/627243760 shutdown_connections 2023-10-06T01:40:03.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.972+0000 7f950a6f8700 1 --2- 172.21.15.69:0/627243760 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f950406e0e0 0x7f95040cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:03.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.972+0000 7f950a6f8700 1 --2- 172.21.15.69:0/627243760 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f950406dc70 0x7f9504159900 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:03.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.972+0000 7f950a6f8700 1 -- 172.21.15.69:0/627243760 >> 172.21.15.69:0/627243760 conn(0x7f95040703a0 msgr2=0x7f95040707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:03.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.972+0000 7f950a6f8700 1 -- 172.21.15.69:0/627243760 shutdown_connections 2023-10-06T01:40:03.975 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.972+0000 7f950a6f8700 1 -- 172.21.15.69:0/627243760 wait complete. 2023-10-06T01:40:03.978 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.973+0000 7f950a6f8700 1 Processor -- start 2023-10-06T01:40:03.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.973+0000 7f950a6f8700 1 -- start start 2023-10-06T01:40:03.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.973+0000 7f950a6f8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f950406dc70 0x7f950414ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:03.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.973+0000 7f950a6f8700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f950406e0e0 0x7f9504155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:03.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.973+0000 7f950a6f8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9504159530 0x7f95040b5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:03.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.973+0000 7f950a6f8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95040b63c0 con 0x7f9504159530 2023-10-06T01:40:03.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.973+0000 7f950a6f8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9504152390 con 0x7f950406dc70 2023-10-06T01:40:03.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.973+0000 7f950a6f8700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9504152670 con 0x7f950406e0e0 2023-10-06T01:40:03.979 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.974+0000 7f9508c95700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9504159530 0x7f95040b5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:03.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.974+0000 7f9508c95700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9504159530 0x7f95040b5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33396/0 (socket says 172.21.15.69:33396) 2023-10-06T01:40:03.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.974+0000 7f9508c95700 1 -- 172.21.15.69:0/172629428 learned_addr learned my addr 172.21.15.69:0/172629428 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:03.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.974+0000 7f94fbfff700 1 --2- 172.21.15.69:0/172629428 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f950406e0e0 0x7f9504155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:03.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.974+0000 7f9503fff700 1 --2- 172.21.15.69:0/172629428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f950406dc70 0x7f950414ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:03.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.974+0000 7f9508c95700 1 -- 172.21.15.69:0/172629428 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f950406e0e0 msgr2=0x7f9504155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:03.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.974+0000 7f9508c95700 1 --2- 172.21.15.69:0/172629428 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f950406e0e0 0x7f9504155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:03.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.974+0000 7f9508c95700 1 -- 172.21.15.69:0/172629428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f950406dc70 msgr2=0x7f950414ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:03.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.974+0000 7f9508c95700 1 --2- 172.21.15.69:0/172629428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f950406dc70 0x7f950414ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:03.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.974+0000 7f9508c95700 1 -- 172.21.15.69:0/172629428 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec0094f0 con 0x7f9504159530 2023-10-06T01:40:03.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.974+0000 7f9508c95700 1 --2- 172.21.15.69:0/172629428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9504159530 0x7f95040b5a70 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f94fc009ec0 tx=0x7f94fc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:03.980 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.974+0000 7f9500ff9700 1 -- 172.21.15.69:0/172629428 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc00cb70 con 0x7f9504159530 2023-10-06T01:40:03.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.974+0000 7f9500ff9700 1 -- 172.21.15.69:0/172629428 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94fc00f040 con 0x7f9504159530 2023-10-06T01:40:03.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.974+0000 7f950a6f8700 1 -- 172.21.15.69:0/172629428 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9504152950 con 0x7f9504159530 2023-10-06T01:40:03.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.974+0000 7f9500ff9700 1 -- 172.21.15.69:0/172629428 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94fc014480 con 0x7f9504159530 2023-10-06T01:40:03.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.974+0000 7f950a6f8700 1 -- 172.21.15.69:0/172629428 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9504155f50 con 0x7f9504159530 2023-10-06T01:40:03.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.975+0000 7f950a6f8700 1 -- 172.21.15.69:0/172629428 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f950404c3c0 con 0x7f9504159530 2023-10-06T01:40:03.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.975+0000 7f9500ff9700 1 -- 172.21.15.69:0/172629428 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f94fc0147f0 con 0x7f9504159530 2023-10-06T01:40:03.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.976+0000 7f9500ff9700 1 --2- 172.21.15.69:0/172629428 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f94e40670e0 0x7f94e4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:03.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.976+0000 7f9500ff9700 1 -- 172.21.15.69:0/172629428 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f94fc0853e0 con 0x7f9504159530 2023-10-06T01:40:03.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.976+0000 7f9503fff700 1 --2- 172.21.15.69:0/172629428 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f94e40670e0 0x7f94e4069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:03.981 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.976+0000 7f9503fff700 1 --2- 172.21.15.69:0/172629428 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f94e40670e0 0x7f94e4069590 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f94f40039e0 tx=0x7f94f4007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:03.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:03.980+0000 7f9500ff9700 1 -- 172.21.15.69:0/172629428 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f94fc052460 con 0x7f9504159530 2023-10-06T01:40:04.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.162+0000 7f950a6f8700 1 -- 172.21.15.69:0/172629428 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f95041524d0 con 0x7f9504159530 2023-10-06T01:40:04.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.166+0000 7f9500ff9700 1 -- 172.21.15.69:0/172629428 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f95041524d0 con 0x7f9504159530 2023-10-06T01:40:04.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.168+0000 7f950a6f8700 1 -- 172.21.15.69:0/172629428 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f94e40670e0 msgr2=0x7f94e4069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:04.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.168+0000 7f950a6f8700 1 --2- 172.21.15.69:0/172629428 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f94e40670e0 0x7f94e4069590 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f94f40039e0 tx=0x7f94f4007ec0 comp rx=0 tx=0).stop 2023-10-06T01:40:04.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.168+0000 7f950a6f8700 1 -- 172.21.15.69:0/172629428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9504159530 msgr2=0x7f95040b5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:04.170 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.168+0000 7f950a6f8700 1 --2- 172.21.15.69:0/172629428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9504159530 0x7f95040b5a70 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f94fc009ec0 tx=0x7f94fc00b040 comp rx=0 tx=0).stop 2023-10-06T01:40:04.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.168+0000 7f950a6f8700 1 -- 172.21.15.69:0/172629428 shutdown_connections 2023-10-06T01:40:04.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.168+0000 7f950a6f8700 1 --2- 172.21.15.69:0/172629428 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f94e40670e0 0x7f94e4069590 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:04.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.169+0000 7f950a6f8700 1 --2- 172.21.15.69:0/172629428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9504159530 0x7f95040b5a70 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:04.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.169+0000 7f950a6f8700 1 --2- 172.21.15.69:0/172629428 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f950406dc70 0x7f950414ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:04.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.169+0000 7f950a6f8700 1 --2- 172.21.15.69:0/172629428 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f950406e0e0 0x7f9504155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:04.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.169+0000 7f950a6f8700 1 -- 172.21.15.69:0/172629428 >> 172.21.15.69:0/172629428 conn(0x7f95040703a0 msgr2=0x7f950415aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:04.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.169+0000 7f950a6f8700 1 -- 172.21.15.69:0/172629428 shutdown_connections 2023-10-06T01:40:04.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.169+0000 7f950a6f8700 1 -- 172.21.15.69:0/172629428 wait complete. 2023-10-06T01:40:04.182 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread' 2023-10-06T01:40:04.297 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.296+0000 7f365d56b700 1 Processor -- start 2023-10-06T01:40:04.298 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.296+0000 7f365d56b700 1 -- start start 2023-10-06T01:40:04.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.297+0000 7f365d56b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36580a8d00 0x7f36580cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:04.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.297+0000 7f365d56b700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f36580a90d0 0x7f365806de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:04.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.297+0000 7f365d56b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f365806e380 0x7f36580cc420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:04.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.297+0000 7f365d56b700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36580ae680 con 0x7f365806e380 2023-10-06T01:40:04.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.297+0000 7f365d56b700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f365806e7f0 con 0x7f36580a90d0 2023-10-06T01:40:04.300 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.297+0000 7f365d56b700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36580aeee0 con 0x7f36580a8d00 2023-10-06T01:40:04.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.297+0000 7f36577fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f365806e380 0x7f36580cc420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:04.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.297+0000 7f36577fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f365806e380 0x7f36580cc420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33410/0 (socket says 172.21.15.69:33410) 2023-10-06T01:40:04.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.297+0000 7f36577fe700 1 -- 172.21.15.69:0/994440914 learned_addr learned my addr 172.21.15.69:0/994440914 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:04.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.297+0000 7f364e7fc700 1 --2- 172.21.15.69:0/994440914 >> v2:172.21.15.88:3300/0 conn(0x7f36580a90d0 0x7f365806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:04.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.297+0000 7f3656ffd700 1 --2- 172.21.15.69:0/994440914 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36580a8d00 0x7f36580cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:04.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.298+0000 7f36577fe700 1 -- 172.21.15.69:0/994440914 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36580a8d00 msgr2=0x7f36580cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:04.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.298+0000 7f36577fe700 1 --2- 172.21.15.69:0/994440914 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36580a8d00 0x7f36580cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:04.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.298+0000 7f36577fe700 1 -- 172.21.15.69:0/994440914 >> v2:172.21.15.88:3300/0 conn(0x7f36580a90d0 msgr2=0x7f365806de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:04.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.298+0000 7f36577fe700 1 --2- 172.21.15.69:0/994440914 >> v2:172.21.15.88:3300/0 conn(0x7f36580a90d0 0x7f365806de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:04.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.298+0000 7f36577fe700 1 -- 172.21.15.69:0/994440914 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36580cf490 con 0x7f365806e380 2023-10-06T01:40:04.301 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.298+0000 7f3656ffd700 1 --2- 172.21.15.69:0/994440914 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36580a8d00 0x7f36580cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:04.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.298+0000 7f36577fe700 1 --2- 172.21.15.69:0/994440914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f365806e380 0x7f36580cc420 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f365806a9e0 tx=0x7f3650009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dac4e7e7ffb3538 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:04.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.298+0000 7f36567fc700 1 -- 172.21.15.69:0/994440914 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365000e070 con 0x7f365806e380 2023-10-06T01:40:04.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.298+0000 7f36567fc700 1 -- 172.21.15.69:0/994440914 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365000ba20 con 0x7f365806e380 2023-10-06T01:40:04.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.298+0000 7f36567fc700 1 -- 172.21.15.69:0/994440914 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36500092e0 con 0x7f365806e380 2023-10-06T01:40:04.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.298+0000 7f365d56b700 1 -- 172.21.15.69:0/994440914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f365806e380 msgr2=0x7f36580cc420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:04.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.298+0000 7f365d56b700 1 --2- 172.21.15.69:0/994440914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f365806e380 0x7f36580cc420 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f365806a9e0 tx=0x7f3650009840 comp rx=0 tx=0).stop 2023-10-06T01:40:04.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.298+0000 7f365d56b700 1 -- 172.21.15.69:0/994440914 shutdown_connections 2023-10-06T01:40:04.302 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.298+0000 7f365d56b700 1 --2- 172.21.15.69:0/994440914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f365806e380 0x7f36580cc420 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:04.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.298+0000 7f365d56b700 1 --2- 172.21.15.69:0/994440914 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f36580a8d00 0x7f36580cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:04.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.298+0000 7f365d56b700 1 --2- 172.21.15.69:0/994440914 >> v2:172.21.15.88:3300/0 conn(0x7f36580a90d0 0x7f365806de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:04.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.298+0000 7f365d56b700 1 -- 172.21.15.69:0/994440914 >> 172.21.15.69:0/994440914 conn(0x7f365806ce80 msgr2=0x7f36580ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:04.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.299+0000 7f365d56b700 1 -- 172.21.15.69:0/994440914 shutdown_connections 2023-10-06T01:40:04.303 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.299+0000 7f365d56b700 1 -- 172.21.15.69:0/994440914 wait complete. 2023-10-06T01:40:04.305 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.300+0000 7f365d56b700 1 Processor -- start 2023-10-06T01:40:04.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.300+0000 7f365d56b700 1 -- start start 2023-10-06T01:40:04.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.300+0000 7f365d56b700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f365806e380 0x7f36580b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:04.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.300+0000 7f365d56b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36580a8d00 0x7f3658098cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:04.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.300+0000 7f365d56b700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36580a90d0 0x7f3658099200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:04.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.300+0000 7f365d56b700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3658169900 con 0x7f36580a8d00 2023-10-06T01:40:04.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.300+0000 7f365d56b700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3658099a30 con 0x7f36580a90d0 2023-10-06T01:40:04.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.300+0000 7f365d56b700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3658099d10 con 0x7f365806e380 2023-10-06T01:40:04.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.301+0000 7f364e7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36580a8d00 0x7f3658098cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:04.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.301+0000 7f364e7fc700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36580a8d00 0x7f3658098cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33414/0 (socket says 172.21.15.69:33414) 2023-10-06T01:40:04.306 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.301+0000 7f364e7fc700 1 -- 172.21.15.69:0/1012083294 learned_addr learned my addr 172.21.15.69:0/1012083294 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:04.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.301+0000 7f36577fe700 1 --2- 172.21.15.69:0/1012083294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36580a90d0 0x7f3658099200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:04.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.301+0000 7f3656ffd700 1 --2- 172.21.15.69:0/1012083294 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f365806e380 0x7f36580b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:04.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.301+0000 7f364e7fc700 1 -- 172.21.15.69:0/1012083294 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f365806e380 msgr2=0x7f36580b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:04.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.301+0000 7f364e7fc700 1 --2- 172.21.15.69:0/1012083294 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f365806e380 0x7f36580b24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:04.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.301+0000 7f364e7fc700 1 -- 172.21.15.69:0/1012083294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36580a90d0 msgr2=0x7f3658099200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:04.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.301+0000 7f364e7fc700 1 --2- 172.21.15.69:0/1012083294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36580a90d0 0x7f3658099200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:04.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.301+0000 7f364e7fc700 1 -- 172.21.15.69:0/1012083294 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3650009ae0 con 0x7f36580a8d00 2023-10-06T01:40:04.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.301+0000 7f36577fe700 1 --2- 172.21.15.69:0/1012083294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36580a90d0 0x7f3658099200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:04.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.301+0000 7f364e7fc700 1 --2- 172.21.15.69:0/1012083294 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36580a8d00 0x7f3658098cc0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f364000ea00 tx=0x7f3640009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:04.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.301+0000 7f364f7fe700 1 -- 172.21.15.69:0/1012083294 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364000c850 con 0x7f36580a8d00 2023-10-06T01:40:04.307 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.301+0000 7f364f7fe700 1 -- 172.21.15.69:0/1012083294 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f364000c9b0 con 0x7f36580a8d00 2023-10-06T01:40:04.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.301+0000 7f365d56b700 1 -- 172.21.15.69:0/1012083294 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3658099ff0 con 0x7f36580a8d00 2023-10-06T01:40:04.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.301+0000 7f364f7fe700 1 -- 172.21.15.69:0/1012083294 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f364000cd30 con 0x7f36580a8d00 2023-10-06T01:40:04.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.301+0000 7f365d56b700 1 -- 172.21.15.69:0/1012083294 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3658099740 con 0x7f36580a8d00 2023-10-06T01:40:04.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.302+0000 7f365d56b700 1 -- 172.21.15.69:0/1012083294 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f365806f3d0 con 0x7f36580a8d00 2023-10-06T01:40:04.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.302+0000 7f364f7fe700 1 -- 172.21.15.69:0/1012083294 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f3640013680 con 0x7f36580a8d00 2023-10-06T01:40:04.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.303+0000 7f364f7fe700 1 --2- 172.21.15.69:0/1012083294 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f36380670e0 0x7f3638069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:04.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.303+0000 7f364f7fe700 1 -- 172.21.15.69:0/1012083294 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f3640084d40 con 0x7f36580a8d00 2023-10-06T01:40:04.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.303+0000 7f3656ffd700 1 --2- 172.21.15.69:0/1012083294 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f36380670e0 0x7f3638069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:04.308 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.303+0000 7f3656ffd700 1 --2- 172.21.15.69:0/1012083294 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f36380670e0 0x7f3638069590 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3648006ea0 tx=0x7f3648008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:04.309 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.307+0000 7f364f7fe700 1 -- 172.21.15.69:0/1012083294 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3640051ed0 con 0x7f36580a8d00 2023-10-06T01:40:04.568 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.567+0000 7f365d56b700 1 -- 172.21.15.69:0/1012083294 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]} v 0) v1 -- 0x7f3658169a40 con 0x7f36580a8d00 2023-10-06T01:40:04.835 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.834+0000 7f364f7fe700 1 -- 172.21.15.69:0/1012083294 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestPerModuleFinsherThread.test_volumes_module_finisher_thread"]}]=0 v94) v1 ==== 167+0+0 (secure 0 0 0) 0x7f36400170e0 con 0x7f36580a8d00 2023-10-06T01:40:04.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.836+0000 7f365d56b700 1 -- 172.21.15.69:0/1012083294 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f36380670e0 msgr2=0x7f3638069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:04.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.836+0000 7f365d56b700 1 --2- 172.21.15.69:0/1012083294 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f36380670e0 0x7f3638069590 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f3648006ea0 tx=0x7f3648008040 comp rx=0 tx=0).stop 2023-10-06T01:40:04.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.836+0000 7f365d56b700 1 -- 172.21.15.69:0/1012083294 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36580a8d00 msgr2=0x7f3658098cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:04.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.836+0000 7f365d56b700 1 --2- 172.21.15.69:0/1012083294 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36580a8d00 0x7f3658098cc0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f364000ea00 tx=0x7f3640009120 comp rx=0 tx=0).stop 2023-10-06T01:40:04.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.836+0000 7f365d56b700 1 -- 172.21.15.69:0/1012083294 shutdown_connections 2023-10-06T01:40:04.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.836+0000 7f365d56b700 1 --2- 172.21.15.69:0/1012083294 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f36380670e0 0x7f3638069590 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:04.838 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.836+0000 7f365d56b700 1 --2- 172.21.15.69:0/1012083294 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f36580a90d0 0x7f3658099200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:04.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.836+0000 7f365d56b700 1 --2- 172.21.15.69:0/1012083294 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f365806e380 0x7f36580b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:04.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.836+0000 7f365d56b700 1 --2- 172.21.15.69:0/1012083294 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f36580a8d00 0x7f3658098cc0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:04.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.836+0000 7f365d56b700 1 -- 172.21.15.69:0/1012083294 >> 172.21.15.69:0/1012083294 conn(0x7f365806ce80 msgr2=0x7f36580ce4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:04.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.836+0000 7f365d56b700 1 -- 172.21.15.69:0/1012083294 shutdown_connections 2023-10-06T01:40:04.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:04.836+0000 7f365d56b700 1 -- 172.21.15.69:0/1012083294 wait complete. 2023-10-06T01:40:04.850 INFO:tasks.cephfs_test_runner:test_volumes_module_finisher_thread (tasks.cephfs.test_volumes.TestPerModuleFinsherThread) ... ok 2023-10-06T01:40:04.850 INFO:tasks.cephfs_test_runner: 2023-10-06T01:40:04.850 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-06T01:40:04.850 INFO:tasks.cephfs_test_runner:Ran 1 test in 42.380s 2023-10-06T01:40:04.850 INFO:tasks.cephfs_test_runner: 2023-10-06T01:40:04.850 INFO:tasks.cephfs_test_runner:OK 2023-10-06T01:40:04.851 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-06T01:40:04.860 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2023-10-06T01:40:05.068 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:40:05.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.184+0000 7f110c1d3700 1 Processor -- start 2023-10-06T01:40:05.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.184+0000 7f110c1d3700 1 -- start start 2023-10-06T01:40:05.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.184+0000 7f110c1d3700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f11040cb5a0 0x7f11040cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:05.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.184+0000 7f110c1d3700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f11040cde50 0x7f1104156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:05.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.185+0000 7f110c1d3700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f110415ae40 con 0x7f11040cd9e0 2023-10-06T01:40:05.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.185+0000 7f110c1d3700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11040d13f0 con 0x7f11040cde50 2023-10-06T01:40:05.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.185+0000 7f110c1d3700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110415ab60 con 0x7f11040cb5a0 2023-10-06T01:40:05.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.185+0000 7f110976e700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f11040cd9e0 0x7f1104159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:45434/0 (socket says 172.21.15.69:45434) 2023-10-06T01:40:05.193 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.185+0000 7f110976e700 1 -- 172.21.15.69:0/4135972002 learned_addr learned my addr 172.21.15.69:0/4135972002 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:40:05.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.185+0000 7f1108f6d700 1 -- 172.21.15.69:0/4135972002 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3612431817 0 0) 0x7f110415ae40 con 0x7f11040cd9e0 2023-10-06T01:40:05.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.185+0000 7f1108f6d700 1 -- 172.21.15.69:0/4135972002 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10f0003570 con 0x7f11040cd9e0 2023-10-06T01:40:05.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.185+0000 7f110a770700 1 --2- 172.21.15.69:0/4135972002 >> v2:172.21.15.88:3300/0 conn(0x7f11040cde50 0x7f1104156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:05.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.185+0000 7f1109f6f700 1 --2- 172.21.15.69:0/4135972002 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f11040cb5a0 0x7f11040cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:05.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.185+0000 7f1108f6d700 1 -- 172.21.15.69:0/4135972002 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2654539750 0 0) 0x7f10f0003570 con 0x7f11040cd9e0 2023-10-06T01:40:05.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.185+0000 7f1108f6d700 1 -- 172.21.15.69:0/4135972002 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f11040cb5a0 msgr2=0x7f11040cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:05.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.185+0000 7f1108f6d700 1 --2- 172.21.15.69:0/4135972002 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f11040cb5a0 0x7f11040cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:05.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.185+0000 7f1108f6d700 1 -- 172.21.15.69:0/4135972002 >> v2:172.21.15.88:3300/0 conn(0x7f11040cde50 msgr2=0x7f1104156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:05.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.185+0000 7f1108f6d700 1 --2- 172.21.15.69:0/4135972002 >> v2:172.21.15.88:3300/0 conn(0x7f11040cde50 0x7f1104156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:05.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.185+0000 7f1108f6d700 1 -- 172.21.15.69:0/4135972002 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11040ccf00 con 0x7f11040cd9e0 2023-10-06T01:40:05.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.185+0000 7f1108f6d700 1 -- 172.21.15.69:0/4135972002 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f10f4001470 con 0x7f11040cd9e0 2023-10-06T01:40:05.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.185+0000 7f1108f6d700 1 -- 172.21.15.69:0/4135972002 >> v1:172.21.15.69:6789/0 conn(0x7f11040cd9e0 legacy=0x7f1104159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:05.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.185+0000 7f1108f6d700 1 --2- 172.21.15.69:0/4135972002 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f11040cb5a0 0x7f10f0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:05.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.185+0000 7f1108f6d700 1 --2- 172.21.15.69:0/4135972002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10f0003fe0 0x7f10f0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:05.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.185+0000 7f1108f6d700 1 --2- 172.21.15.69:0/4135972002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10f0004d50 0x7f10f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:05.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.185+0000 7f1108f6d700 1 -- 172.21.15.69:0/4135972002 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110415ab60 con 0x7f10f0003fe0 2023-10-06T01:40:05.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.185+0000 7f1108f6d700 1 -- 172.21.15.69:0/4135972002 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10f000ba60 con 0x7f10f0004d50 2023-10-06T01:40:05.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.185+0000 7f1108f6d700 1 -- 172.21.15.69:0/4135972002 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10f000bbd0 con 0x7f11040cb5a0 2023-10-06T01:40:05.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.185+0000 7f110976e700 1 --2- 172.21.15.69:0/4135972002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10f0003fe0 0x7f10f0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:05.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.186+0000 7f1109f6f700 1 --2- 172.21.15.69:0/4135972002 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f11040cb5a0 0x7f10f0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:05.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.186+0000 7f110a770700 1 --2- 172.21.15.69:0/4135972002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10f0004d50 0x7f10f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:05.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.186+0000 7f110976e700 1 -- 172.21.15.69:0/4135972002 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f11040cb5a0 msgr2=0x7f10f0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:05.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.186+0000 7f110976e700 1 --2- 172.21.15.69:0/4135972002 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f11040cb5a0 0x7f10f0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:05.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.186+0000 7f110976e700 1 -- 172.21.15.69:0/4135972002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10f0004d50 msgr2=0x7f10f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:05.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.186+0000 7f110976e700 1 --2- 172.21.15.69:0/4135972002 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f10f0004d50 0x7f10f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:05.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.186+0000 7f110976e700 1 -- 172.21.15.69:0/4135972002 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f0003570 con 0x7f10f0003fe0 2023-10-06T01:40:05.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.186+0000 7f110976e700 1 --2- 172.21.15.69:0/4135972002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10f0003fe0 0x7f10f0004810 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f10f400c3c0 tx=0x7f10f4001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13aaa976040d78f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:05.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.186+0000 7f1108f6d700 1 -- 172.21.15.69:0/4135972002 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f400cc30 con 0x7f10f0003fe0 2023-10-06T01:40:05.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.186+0000 7f1108f6d700 1 -- 172.21.15.69:0/4135972002 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f400cdb0 con 0x7f10f0003fe0 2023-10-06T01:40:05.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.186+0000 7f1108f6d700 1 -- 172.21.15.69:0/4135972002 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f4005b70 con 0x7f10f0003fe0 2023-10-06T01:40:05.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.187+0000 7f110c1d3700 1 -- 172.21.15.69:0/4135972002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10f0003fe0 msgr2=0x7f10f0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:05.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.187+0000 7f110c1d3700 1 --2- 172.21.15.69:0/4135972002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10f0003fe0 0x7f10f0004810 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f10f400c3c0 tx=0x7f10f4001e90 comp rx=0 tx=0).stop 2023-10-06T01:40:05.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.187+0000 7f110a770700 1 -- 172.21.15.69:0/4135972002 reap_dead start 2023-10-06T01:40:05.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.187+0000 7f110c1d3700 1 -- 172.21.15.69:0/4135972002 shutdown_connections 2023-10-06T01:40:05.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.187+0000 7f110c1d3700 1 -- 172.21.15.69:0/4135972002 >> 172.21.15.69:0/4135972002 conn(0x7f1104070e30 msgr2=0x7f11040d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:05.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.187+0000 7f110c1d3700 1 -- 172.21.15.69:0/4135972002 shutdown_connections 2023-10-06T01:40:05.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.187+0000 7f110c1d3700 1 -- 172.21.15.69:0/4135972002 wait complete. 2023-10-06T01:40:05.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.188+0000 7f110c1d3700 1 Processor -- start 2023-10-06T01:40:05.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.188+0000 7f110c1d3700 1 -- start start 2023-10-06T01:40:05.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.188+0000 7f110c1d3700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f10f0003fe0 0x7f110415bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:05.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.188+0000 7f110c1d3700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f110415b2a0 0x7f1104169530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:05.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.188+0000 7f110c1d3700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1104169a70 0x7f1104159fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:05.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.188+0000 7f110c1d3700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110416a510 con 0x7f110415b2a0 2023-10-06T01:40:05.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.188+0000 7f110c1d3700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1104154d90 con 0x7f1104169a70 2023-10-06T01:40:05.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.188+0000 7f110c1d3700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11040b4510 con 0x7f10f0003fe0 2023-10-06T01:40:05.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.188+0000 7f110976e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f110415b2a0 0x7f1104169530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:05.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.188+0000 7f110976e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f110415b2a0 0x7f1104169530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33434/0 (socket says 172.21.15.69:33434) 2023-10-06T01:40:05.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.188+0000 7f110976e700 1 -- 172.21.15.69:0/297266121 learned_addr learned my addr 172.21.15.69:0/297266121 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:05.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.189+0000 7f1109f6f700 1 --2- 172.21.15.69:0/297266121 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f10f0003fe0 0x7f110415bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:05.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.189+0000 7f110a770700 1 --2- 172.21.15.69:0/297266121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1104169a70 0x7f1104159fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:05.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.189+0000 7f110976e700 1 -- 172.21.15.69:0/297266121 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f10f0003fe0 msgr2=0x7f110415bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:05.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.189+0000 7f110976e700 1 --2- 172.21.15.69:0/297266121 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f10f0003fe0 0x7f110415bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:05.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.189+0000 7f110976e700 1 -- 172.21.15.69:0/297266121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1104169a70 msgr2=0x7f1104159fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:05.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.189+0000 7f110976e700 1 --2- 172.21.15.69:0/297266121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1104169a70 0x7f1104159fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:05.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.189+0000 7f110976e700 1 -- 172.21.15.69:0/297266121 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1104169f50 con 0x7f110415b2a0 2023-10-06T01:40:05.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.189+0000 7f110976e700 1 --2- 172.21.15.69:0/297266121 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f110415b2a0 0x7f1104169530 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f10f4001ed0 tx=0x7f10f4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:05.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.189+0000 7f10f9ffb700 1 -- 172.21.15.69:0/297266121 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f400cc30 con 0x7f110415b2a0 2023-10-06T01:40:05.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.189+0000 7f10f9ffb700 1 -- 172.21.15.69:0/297266121 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f4001430 con 0x7f110415b2a0 2023-10-06T01:40:05.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.189+0000 7f110c1d3700 1 -- 172.21.15.69:0/297266121 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f110416a230 con 0x7f110415b2a0 2023-10-06T01:40:05.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.189+0000 7f10f9ffb700 1 -- 172.21.15.69:0/297266121 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f4007530 con 0x7f110415b2a0 2023-10-06T01:40:05.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.189+0000 7f110c1d3700 1 -- 172.21.15.69:0/297266121 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f110415c210 con 0x7f110415b2a0 2023-10-06T01:40:05.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.190+0000 7f110c1d3700 1 -- 172.21.15.69:0/297266121 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f110415c430 con 0x7f110415b2a0 2023-10-06T01:40:05.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.191+0000 7f10f9ffb700 1 -- 172.21.15.69:0/297266121 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f10f4019030 con 0x7f110415b2a0 2023-10-06T01:40:05.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.191+0000 7f10f9ffb700 1 --2- 172.21.15.69:0/297266121 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f10e80670e0 0x7f10e8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:05.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.191+0000 7f1109f6f700 1 --2- 172.21.15.69:0/297266121 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f10e80670e0 0x7f10e8069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:05.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.191+0000 7f10f9ffb700 1 -- 172.21.15.69:0/297266121 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f10f4085fd0 con 0x7f110415b2a0 2023-10-06T01:40:05.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.191+0000 7f1109f6f700 1 --2- 172.21.15.69:0/297266121 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f10e80670e0 0x7f10e8069590 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f110415e4d0 tx=0x7f110000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:05.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.195+0000 7f10f9ffb700 1 -- 172.21.15.69:0/297266121 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10f4053160 con 0x7f110415b2a0 2023-10-06T01:40:05.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.381+0000 7f110c1d3700 1 -- 172.21.15.69:0/297266121 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f110404c3c0 con 0x7f110415b2a0 2023-10-06T01:40:05.382 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.381+0000 7f10f9ffb700 1 -- 172.21.15.69:0/297266121 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+13731 (secure 0 0 0) 0x7f10f4056780 con 0x7f110415b2a0 2023-10-06T01:40:05.383 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:40:05.383 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":38,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:40:03.829639+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:38:43.046056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6834/3221701951":"2023-10-07T01:40:00.815980+0000","172.21.15.88:6832/3221701951":"2023-10-07T01:40:00.815980+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:40:05.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.383+0000 7f110c1d3700 1 -- 172.21.15.69:0/297266121 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f10e80670e0 msgr2=0x7f10e8069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:05.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.383+0000 7f110c1d3700 1 --2- 172.21.15.69:0/297266121 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f10e80670e0 0x7f10e8069590 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f110415e4d0 tx=0x7f110000b040 comp rx=0 tx=0).stop 2023-10-06T01:40:05.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.384+0000 7f110c1d3700 1 -- 172.21.15.69:0/297266121 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f110415b2a0 msgr2=0x7f1104169530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:05.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.384+0000 7f110c1d3700 1 --2- 172.21.15.69:0/297266121 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f110415b2a0 0x7f1104169530 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f10f4001ed0 tx=0x7f10f4015000 comp rx=0 tx=0).stop 2023-10-06T01:40:05.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.384+0000 7f110c1d3700 1 -- 172.21.15.69:0/297266121 shutdown_connections 2023-10-06T01:40:05.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.384+0000 7f110c1d3700 1 --2- 172.21.15.69:0/297266121 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f10e80670e0 0x7f10e8069590 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:05.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.384+0000 7f110c1d3700 1 --2- 172.21.15.69:0/297266121 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1104169a70 0x7f1104159fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:05.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.384+0000 7f110c1d3700 1 --2- 172.21.15.69:0/297266121 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f10f0003fe0 0x7f110415bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:05.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.384+0000 7f110c1d3700 1 --2- 172.21.15.69:0/297266121 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f110415b2a0 0x7f1104169530 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:05.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.384+0000 7f110c1d3700 1 -- 172.21.15.69:0/297266121 >> 172.21.15.69:0/297266121 conn(0x7f1104070e30 msgr2=0x7f110406e100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:05.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.384+0000 7f110c1d3700 1 -- 172.21.15.69:0/297266121 shutdown_connections 2023-10-06T01:40:05.386 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.384+0000 7f110c1d3700 1 -- 172.21.15.69:0/297266121 wait complete. 2023-10-06T01:40:05.397 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-06T01:38:38.288642+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-10-06T01:38:43.046056+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-10-06T01:40:05.397 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-06T01:40:05.514 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.513+0000 7f5fc92c1700 1 Processor -- start 2023-10-06T01:40:05.515 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.513+0000 7f5fc92c1700 1 -- start start 2023-10-06T01:40:05.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.514+0000 7f5fc92c1700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5fc4153a00 0x7f5fc4153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:05.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.514+0000 7f5fc92c1700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5fc415de50 0x7f5fc415a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:05.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.514+0000 7f5fc92c1700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc415af60 con 0x7f5fc40cea00 2023-10-06T01:40:05.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.514+0000 7f5fc92c1700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc415d010 con 0x7f5fc415de50 2023-10-06T01:40:05.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.514+0000 7f5fc92c1700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc415b240 con 0x7f5fc4153a00 2023-10-06T01:40:05.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.514+0000 7f5fbbfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5fc415de50 0x7f5fc415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:05.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.514+0000 7f5fc3fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5fc4153a00 0x7f5fc4153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:05.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.514+0000 7f5fbbfff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f5fc415de50 0x7f5fc415a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.69:56270/0 (socket says 172.21.15.69:56270) 2023-10-06T01:40:05.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.514+0000 7f5fc8ac0700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7f5fc40cea00 0x7f5fc40cee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.69:46648/0 (socket says 172.21.15.69:46648) 2023-10-06T01:40:05.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.514+0000 7f5fbbfff700 1 -- 172.21.15.69:0/3034539987 learned_addr learned my addr 172.21.15.69:0/3034539987 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:05.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.515+0000 7f5fbbfff700 1 -- 172.21.15.69:0/3034539987 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5fc4153a00 msgr2=0x7f5fc4153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:05.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.515+0000 7f5fbbfff700 1 --2- 172.21.15.69:0/3034539987 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5fc4153a00 0x7f5fc4153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:05.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.515+0000 7f5fbbfff700 1 -- 172.21.15.69:0/3034539987 >> v1:172.21.15.88:6789/0 conn(0x7f5fc40cea00 legacy=0x7f5fc40cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:05.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.515+0000 7f5fbbfff700 1 -- 172.21.15.69:0/3034539987 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc415b520 con 0x7f5fc415de50 2023-10-06T01:40:05.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.515+0000 7f5fc37fe700 1 -- 172.21.15.69:0/3034539987 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3393347196 0 0) 0x7f5fc415af60 con 0x7f5fc40cea00 2023-10-06T01:40:05.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.515+0000 7f5fbbfff700 1 --2- 172.21.15.69:0/3034539987 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fc415de50 0x7f5fc415a540 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5fac0099b0 tx=0x7f5fac009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0fc7b411c114aa5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:05.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.515+0000 7f5fc37fe700 1 -- 172.21.15.69:0/3034539987 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac009ea0 con 0x7f5fc415de50 2023-10-06T01:40:05.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.515+0000 7f5fc37fe700 1 -- 172.21.15.69:0/3034539987 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fac00b860 con 0x7f5fc415de50 2023-10-06T01:40:05.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.515+0000 7f5fc37fe700 1 -- 172.21.15.69:0/3034539987 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fac00bc00 con 0x7f5fc415de50 2023-10-06T01:40:05.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.515+0000 7f5fc92c1700 1 -- 172.21.15.69:0/3034539987 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fc415de50 msgr2=0x7f5fc415a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:05.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.515+0000 7f5fc92c1700 1 --2- 172.21.15.69:0/3034539987 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fc415de50 0x7f5fc415a540 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5fac0099b0 tx=0x7f5fac009250 comp rx=0 tx=0).stop 2023-10-06T01:40:05.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.516+0000 7f5fc92c1700 1 -- 172.21.15.69:0/3034539987 shutdown_connections 2023-10-06T01:40:05.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.516+0000 7f5fc92c1700 1 --2- 172.21.15.69:0/3034539987 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5fc4153a00 0x7f5fc4153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:05.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.516+0000 7f5fc92c1700 1 --2- 172.21.15.69:0/3034539987 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fc415de50 0x7f5fc415a540 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:05.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.516+0000 7f5fc92c1700 1 -- 172.21.15.69:0/3034539987 >> 172.21.15.69:0/3034539987 conn(0x7f5fc40703a0 msgr2=0x7f5fc40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:05.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.516+0000 7f5fc92c1700 1 -- 172.21.15.69:0/3034539987 shutdown_connections 2023-10-06T01:40:05.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.516+0000 7f5fc92c1700 1 -- 172.21.15.69:0/3034539987 wait complete. 2023-10-06T01:40:05.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.517+0000 7f5fc92c1700 1 Processor -- start 2023-10-06T01:40:05.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.517+0000 7f5fc92c1700 1 -- start start 2023-10-06T01:40:05.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.517+0000 7f5fc92c1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fc40cea00 0x7f5fc40c8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:05.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.517+0000 7f5fc92c1700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5fc4153a00 0x7f5fc41577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:05.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.517+0000 7f5fc92c1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fc415de50 0x7f5fc4157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:05.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.517+0000 7f5fc92c1700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc4158240 con 0x7f5fc415de50 2023-10-06T01:40:05.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.517+0000 7f5fc92c1700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc40cbaf0 con 0x7f5fc40cea00 2023-10-06T01:40:05.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.517+0000 7f5fc92c1700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc40cbdc0 con 0x7f5fc4153a00 2023-10-06T01:40:05.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.517+0000 7f5fc8ac0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fc415de50 0x7f5fc4157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:05.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.517+0000 7f5fc8ac0700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fc415de50 0x7f5fc4157d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33442/0 (socket says 172.21.15.69:33442) 2023-10-06T01:40:05.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.517+0000 7f5fc8ac0700 1 -- 172.21.15.69:0/638968840 learned_addr learned my addr 172.21.15.69:0/638968840 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:05.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.518+0000 7f5fc3fff700 1 --2- 172.21.15.69:0/638968840 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fc40cea00 0x7f5fc40c8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:05.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.518+0000 7f5fbbfff700 1 --2- 172.21.15.69:0/638968840 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5fc4153a00 0x7f5fc41577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:05.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.518+0000 7f5fc8ac0700 1 -- 172.21.15.69:0/638968840 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5fc4153a00 msgr2=0x7f5fc41577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:05.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.518+0000 7f5fc8ac0700 1 --2- 172.21.15.69:0/638968840 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5fc4153a00 0x7f5fc41577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:05.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.518+0000 7f5fc8ac0700 1 -- 172.21.15.69:0/638968840 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fc40cea00 msgr2=0x7f5fc40c8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:05.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.518+0000 7f5fc8ac0700 1 --2- 172.21.15.69:0/638968840 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fc40cea00 0x7f5fc40c8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:05.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.518+0000 7f5fc8ac0700 1 -- 172.21.15.69:0/638968840 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fac0094f0 con 0x7f5fc415de50 2023-10-06T01:40:05.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.518+0000 7f5fc8ac0700 1 --2- 172.21.15.69:0/638968840 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fc415de50 0x7f5fc4157d00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc00cd50 tx=0x7f5fbc001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:05.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.518+0000 7f5fc0ff9700 1 -- 172.21.15.69:0/638968840 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc005df0 con 0x7f5fc415de50 2023-10-06T01:40:05.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.518+0000 7f5fc0ff9700 1 -- 172.21.15.69:0/638968840 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fbc00a8b0 con 0x7f5fc415de50 2023-10-06T01:40:05.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.518+0000 7f5fc92c1700 1 -- 172.21.15.69:0/638968840 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc40cc0a0 con 0x7f5fc415de50 2023-10-06T01:40:05.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.518+0000 7f5fc0ff9700 1 -- 172.21.15.69:0/638968840 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fbc00ac70 con 0x7f5fc415de50 2023-10-06T01:40:05.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.518+0000 7f5fc92c1700 1 -- 172.21.15.69:0/638968840 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc40cc660 con 0x7f5fc415de50 2023-10-06T01:40:05.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.519+0000 7f5fc92c1700 1 -- 172.21.15.69:0/638968840 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc404c3c0 con 0x7f5fc415de50 2023-10-06T01:40:05.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.519+0000 7f5fc0ff9700 1 -- 172.21.15.69:0/638968840 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f5fbc007300 con 0x7f5fc415de50 2023-10-06T01:40:05.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.520+0000 7f5fc0ff9700 1 --2- 172.21.15.69:0/638968840 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5fa40670e0 0x7f5fa4069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:05.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.520+0000 7f5fc0ff9700 1 -- 172.21.15.69:0/638968840 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f5fbc0847a0 con 0x7f5fc415de50 2023-10-06T01:40:05.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.520+0000 7f5fc3fff700 1 --2- 172.21.15.69:0/638968840 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5fa40670e0 0x7f5fa4069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:05.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.520+0000 7f5fc3fff700 1 --2- 172.21.15.69:0/638968840 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5fa40670e0 0x7f5fa4069590 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4009db0 tx=0x7f5fb40091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:05.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.524+0000 7f5fc0ff9700 1 -- 172.21.15.69:0/638968840 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5fbc0519b0 con 0x7f5fc415de50 2023-10-06T01:40:05.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.706+0000 7f5fc92c1700 1 -- 172.21.15.69:0/638968840 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5fc415b800 con 0x7f5fc415de50 2023-10-06T01:40:05.707 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.706+0000 7f5fc0ff9700 1 -- 172.21.15.69:0/638968840 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f5fbc054fd0 con 0x7f5fc415de50 2023-10-06T01:40:05.708 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2023-10-06T01:40:05.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.708+0000 7f5fc92c1700 1 -- 172.21.15.69:0/638968840 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5fa40670e0 msgr2=0x7f5fa4069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:05.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.708+0000 7f5fc92c1700 1 --2- 172.21.15.69:0/638968840 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5fa40670e0 0x7f5fa4069590 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5fb4009db0 tx=0x7f5fb40091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:05.710 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.708+0000 7f5fc92c1700 1 -- 172.21.15.69:0/638968840 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fc415de50 msgr2=0x7f5fc4157d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:05.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.708+0000 7f5fc92c1700 1 --2- 172.21.15.69:0/638968840 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fc415de50 0x7f5fc4157d00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5fbc00cd50 tx=0x7f5fbc001b10 comp rx=0 tx=0).stop 2023-10-06T01:40:05.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.708+0000 7f5fc92c1700 1 -- 172.21.15.69:0/638968840 shutdown_connections 2023-10-06T01:40:05.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.708+0000 7f5fc92c1700 1 --2- 172.21.15.69:0/638968840 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f5fa40670e0 0x7f5fa4069590 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:05.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.708+0000 7f5fc92c1700 1 --2- 172.21.15.69:0/638968840 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fc415de50 0x7f5fc4157d00 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:05.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.708+0000 7f5fc92c1700 1 --2- 172.21.15.69:0/638968840 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5fc40cea00 0x7f5fc40c8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:05.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.708+0000 7f5fc92c1700 1 --2- 172.21.15.69:0/638968840 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f5fc4153a00 0x7f5fc41577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:05.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.708+0000 7f5fc92c1700 1 -- 172.21.15.69:0/638968840 >> 172.21.15.69:0/638968840 conn(0x7f5fc40703a0 msgr2=0x7f5fc40cee40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:05.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.708+0000 7f5fc92c1700 1 -- 172.21.15.69:0/638968840 shutdown_connections 2023-10-06T01:40:05.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.708+0000 7f5fc92c1700 1 -- 172.21.15.69:0/638968840 wait complete. 2023-10-06T01:40:05.722 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-10-06T01:40:05.839 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.838+0000 7f8c86bba700 1 Processor -- start 2023-10-06T01:40:05.840 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.838+0000 7f8c86bba700 1 -- start start 2023-10-06T01:40:05.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.839+0000 7f8c86bba700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f8c80153c90 0x7f8c8015a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:05.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.839+0000 7f8c86bba700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c8015ada0 con 0x7f8c8006db20 2023-10-06T01:40:05.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.839+0000 7f8c86bba700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c8006ca80 con 0x7f8c800caec0 2023-10-06T01:40:05.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.839+0000 7f8c86bba700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c8006cd60 con 0x7f8c80153c90 2023-10-06T01:40:05.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.839+0000 7f8c85bb8700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f8c80153c90 0x7f8c8015a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:05.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.839+0000 7f8c853b7700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f8c8006db20 0x7f8c800ca7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:45436/0 (socket says 172.21.15.69:45436) 2023-10-06T01:40:05.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.839+0000 7f8c85bb8700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f8c80153c90 0x7f8c8015a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33444/0 (socket says 172.21.15.69:33444) 2023-10-06T01:40:05.842 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.839+0000 7f8c853b7700 1 -- 172.21.15.69:0/2263997948 learned_addr learned my addr 172.21.15.69:0/2263997948 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:40:05.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.840+0000 7f8c85bb8700 1 -- 172.21.15.69:0/2263997948 >> v1:172.21.15.88:6789/0 conn(0x7f8c800caec0 legacy=0x7f8c8015afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:05.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.840+0000 7f8c85bb8700 1 -- 172.21.15.69:0/2263997948 >> v1:172.21.15.69:6789/0 conn(0x7f8c8006db20 legacy=0x7f8c800ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:05.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.840+0000 7f8c85bb8700 1 -- 172.21.15.69:0/2263997948 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c8006d040 con 0x7f8c80153c90 2023-10-06T01:40:05.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.840+0000 7f8c84bb6700 1 -- 172.21.15.69:0/2263997948 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 234968438 0 0) 0x7f8c74001110 con 0x7f8c8006db20 2023-10-06T01:40:05.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.840+0000 7f8c85bb8700 1 --2- 172.21.15.69:0/2263997948 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c80153c90 0x7f8c8015a860 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8c70009e60 tx=0x7f8c70009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf752caf8de9fba server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:05.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.840+0000 7f8c84bb6700 1 -- 172.21.15.69:0/2263997948 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7000e070 con 0x7f8c80153c90 2023-10-06T01:40:05.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.840+0000 7f8c84bb6700 1 -- 172.21.15.69:0/2263997948 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7000bc30 con 0x7f8c80153c90 2023-10-06T01:40:05.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.840+0000 7f8c84bb6700 1 -- 172.21.15.69:0/2263997948 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c70012430 con 0x7f8c80153c90 2023-10-06T01:40:05.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.840+0000 7f8c86bba700 1 -- 172.21.15.69:0/2263997948 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c80153c90 msgr2=0x7f8c8015a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:05.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.840+0000 7f8c86bba700 1 --2- 172.21.15.69:0/2263997948 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c80153c90 0x7f8c8015a860 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f8c70009e60 tx=0x7f8c70009780 comp rx=0 tx=0).stop 2023-10-06T01:40:05.843 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.840+0000 7f8c86bba700 1 -- 172.21.15.69:0/2263997948 shutdown_connections 2023-10-06T01:40:05.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.840+0000 7f8c86bba700 1 --2- 172.21.15.69:0/2263997948 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c80153c90 0x7f8c8015a860 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:05.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.840+0000 7f8c86bba700 1 -- 172.21.15.69:0/2263997948 >> 172.21.15.69:0/2263997948 conn(0x7f8c8006e720 msgr2=0x7f8c8006eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:05.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.841+0000 7f8c86bba700 1 -- 172.21.15.69:0/2263997948 shutdown_connections 2023-10-06T01:40:05.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.841+0000 7f8c86bba700 1 -- 172.21.15.69:0/2263997948 wait complete. 2023-10-06T01:40:05.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.842+0000 7f8c86bba700 1 Processor -- start 2023-10-06T01:40:05.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.842+0000 7f8c86bba700 1 -- start start 2023-10-06T01:40:05.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.842+0000 7f8c86bba700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c8006db20 0x7f8c800c5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:05.846 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.842+0000 7f8c86bba700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c800caec0 0x7f8c80152910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:05.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.842+0000 7f8c86bba700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8c80153c90 0x7f8c800b0d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:05.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.842+0000 7f8c86bba700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c80152e50 con 0x7f8c8006db20 2023-10-06T01:40:05.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.842+0000 7f8c86bba700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c800b2600 con 0x7f8c800caec0 2023-10-06T01:40:05.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.842+0000 7f8c86bba700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c800b12c0 con 0x7f8c80153c90 2023-10-06T01:40:05.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.842+0000 7f8c85bb8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c8006db20 0x7f8c800c5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:05.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.842+0000 7f8c85bb8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c8006db20 0x7f8c800c5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33446/0 (socket says 172.21.15.69:33446) 2023-10-06T01:40:05.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.842+0000 7f8c85bb8700 1 -- 172.21.15.69:0/1317168223 learned_addr learned my addr 172.21.15.69:0/1317168223 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:05.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.843+0000 7f8c85bb8700 1 -- 172.21.15.69:0/1317168223 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8c80153c90 msgr2=0x7f8c800b0d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:05.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.843+0000 7f8c85bb8700 1 --2- 172.21.15.69:0/1317168223 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8c80153c90 0x7f8c800b0d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:05.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.843+0000 7f8c853b7700 1 --2- 172.21.15.69:0/1317168223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c800caec0 0x7f8c80152910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:05.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.843+0000 7f8c85bb8700 1 -- 172.21.15.69:0/1317168223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c800caec0 msgr2=0x7f8c80152910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:05.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.843+0000 7f8c85bb8700 1 --2- 172.21.15.69:0/1317168223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c800caec0 0x7f8c80152910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:05.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.843+0000 7f8c85bb8700 1 -- 172.21.15.69:0/1317168223 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c70009a20 con 0x7f8c8006db20 2023-10-06T01:40:05.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.843+0000 7f8c853b7700 1 --2- 172.21.15.69:0/1317168223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c800caec0 0x7f8c80152910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:40:05.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.843+0000 7f8c85bb8700 1 --2- 172.21.15.69:0/1317168223 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c8006db20 0x7f8c800c5130 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8c700099f0 tx=0x7f8c70019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:05.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.843+0000 7f8c7dffb700 1 -- 172.21.15.69:0/1317168223 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c70012e60 con 0x7f8c8006db20 2023-10-06T01:40:05.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.843+0000 7f8c7dffb700 1 -- 172.21.15.69:0/1317168223 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c7001b630 con 0x7f8c8006db20 2023-10-06T01:40:05.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.843+0000 7f8c86bba700 1 -- 172.21.15.69:0/1317168223 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c800b1560 con 0x7f8c8006db20 2023-10-06T01:40:05.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.843+0000 7f8c7dffb700 1 -- 172.21.15.69:0/1317168223 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c7001b9f0 con 0x7f8c8006db20 2023-10-06T01:40:05.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.843+0000 7f8c86bba700 1 -- 172.21.15.69:0/1317168223 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c800b1b20 con 0x7f8c8006db20 2023-10-06T01:40:05.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.844+0000 7f8c86bba700 1 -- 172.21.15.69:0/1317168223 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c8004c3c0 con 0x7f8c8006db20 2023-10-06T01:40:05.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.845+0000 7f8c7dffb700 1 -- 172.21.15.69:0/1317168223 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f8c7001c400 con 0x7f8c8006db20 2023-10-06T01:40:05.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.845+0000 7f8c7dffb700 1 --2- 172.21.15.69:0/1317168223 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8c6c0670e0 0x7f8c6c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:05.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.845+0000 7f8c7dffb700 1 -- 172.21.15.69:0/1317168223 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f8c70086620 con 0x7f8c8006db20 2023-10-06T01:40:05.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.845+0000 7f8c853b7700 1 --2- 172.21.15.69:0/1317168223 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8c6c0670e0 0x7f8c6c069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:05.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.845+0000 7f8c853b7700 1 --2- 172.21.15.69:0/1317168223 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8c6c0670e0 0x7f8c6c069590 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8c8015f3e0 tx=0x7f8c74009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:05.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:05.849+0000 7f8c7dffb700 1 -- 172.21.15.69:0/1317168223 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8c700536a0 con 0x7f8c8006db20 2023-10-06T01:40:06.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.034+0000 7f8c86bba700 1 -- 172.21.15.69:0/1317168223 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8c800b2820 con 0x7f8c8006db20 2023-10-06T01:40:06.036 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.034+0000 7f8c7dffb700 1 -- 172.21.15.69:0/1317168223 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v38) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8c7002a020 con 0x7f8c8006db20 2023-10-06T01:40:06.036 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 8 2023-10-06T01:40:06.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.037+0000 7f8c86bba700 1 -- 172.21.15.69:0/1317168223 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8c6c0670e0 msgr2=0x7f8c6c069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:06.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.037+0000 7f8c86bba700 1 --2- 172.21.15.69:0/1317168223 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8c6c0670e0 0x7f8c6c069590 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8c8015f3e0 tx=0x7f8c74009040 comp rx=0 tx=0).stop 2023-10-06T01:40:06.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.037+0000 7f8c86bba700 1 -- 172.21.15.69:0/1317168223 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c8006db20 msgr2=0x7f8c800c5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:06.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.037+0000 7f8c86bba700 1 --2- 172.21.15.69:0/1317168223 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c8006db20 0x7f8c800c5130 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f8c700099f0 tx=0x7f8c70019000 comp rx=0 tx=0).stop 2023-10-06T01:40:06.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.037+0000 7f8c86bba700 1 -- 172.21.15.69:0/1317168223 shutdown_connections 2023-10-06T01:40:06.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.037+0000 7f8c86bba700 1 --2- 172.21.15.69:0/1317168223 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f8c6c0670e0 0x7f8c6c069590 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:06.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.037+0000 7f8c86bba700 1 --2- 172.21.15.69:0/1317168223 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f8c80153c90 0x7f8c800b0d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:06.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.037+0000 7f8c86bba700 1 --2- 172.21.15.69:0/1317168223 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8c8006db20 0x7f8c800c5130 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:06.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.037+0000 7f8c86bba700 1 --2- 172.21.15.69:0/1317168223 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f8c800caec0 0x7f8c80152910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:06.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.037+0000 7f8c86bba700 1 -- 172.21.15.69:0/1317168223 >> 172.21.15.69:0/1317168223 conn(0x7f8c8006e720 msgr2=0x7f8c80153170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:06.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.037+0000 7f8c86bba700 1 -- 172.21.15.69:0/1317168223 shutdown_connections 2023-10-06T01:40:06.039 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.037+0000 7f8c86bba700 1 -- 172.21.15.69:0/1317168223 wait complete. 2023-10-06T01:40:06.050 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2023-10-06T01:40:06.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.162+0000 7fd146a36700 1 Processor -- start 2023-10-06T01:40:06.164 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.163+0000 7fd146a36700 1 -- start start 2023-10-06T01:40:06.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.163+0000 7fd146a36700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd1400a90d0 0x7fd14006de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:06.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.163+0000 7fd146a36700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1400aeee0 con 0x7fd14006e380 2023-10-06T01:40:06.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.163+0000 7fd146a36700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1400cf490 con 0x7fd1400a8d00 2023-10-06T01:40:06.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.163+0000 7fd146a36700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd14006e820 con 0x7fd1400a90d0 2023-10-06T01:40:06.166 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.163+0000 7fd13f7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd1400a90d0 0x7fd14006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:06.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.164+0000 7fd144fd3700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fd14006e380 0x7fd1400af370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:45448/0 (socket says 172.21.15.69:45448) 2023-10-06T01:40:06.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.164+0000 7fd13f7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd1400a90d0 0x7fd14006de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33452/0 (socket says 172.21.15.69:33452) 2023-10-06T01:40:06.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.164+0000 7fd144fd3700 1 -- 172.21.15.69:0/1760828606 learned_addr learned my addr 172.21.15.69:0/1760828606 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:40:06.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.164+0000 7fd13f7fe700 1 -- 172.21.15.69:0/1760828606 >> v1:172.21.15.88:6789/0 conn(0x7fd1400a8d00 legacy=0x7fd1400cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:06.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.164+0000 7fd13f7fe700 1 -- 172.21.15.69:0/1760828606 >> v1:172.21.15.69:6789/0 conn(0x7fd14006e380 legacy=0x7fd1400af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:06.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.164+0000 7fd13effd700 1 -- 172.21.15.69:0/1760828606 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2038044192 0 0) 0x7fd1400aeee0 con 0x7fd14006e380 2023-10-06T01:40:06.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.164+0000 7fd13f7fe700 1 -- 172.21.15.69:0/1760828606 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1400cf1b0 con 0x7fd1400a90d0 2023-10-06T01:40:06.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.164+0000 7fd13f7fe700 1 --2- 172.21.15.69:0/1760828606 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1400a90d0 0x7fd14006de40 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fd134009900 tx=0x7fd134009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f9cd85e461145ac server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:06.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.164+0000 7fd13effd700 1 -- 172.21.15.69:0/1760828606 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd134009ea0 con 0x7fd1400a90d0 2023-10-06T01:40:06.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.164+0000 7fd13effd700 1 -- 172.21.15.69:0/1760828606 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd134005c10 con 0x7fd1400a90d0 2023-10-06T01:40:06.167 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.164+0000 7fd13effd700 1 -- 172.21.15.69:0/1760828606 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13400b610 con 0x7fd1400a90d0 2023-10-06T01:40:06.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.165+0000 7fd146a36700 1 -- 172.21.15.69:0/1760828606 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1400a90d0 msgr2=0x7fd14006de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:06.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.165+0000 7fd146a36700 1 --2- 172.21.15.69:0/1760828606 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1400a90d0 0x7fd14006de40 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fd134009900 tx=0x7fd134009120 comp rx=0 tx=0).stop 2023-10-06T01:40:06.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.165+0000 7fd146a36700 1 -- 172.21.15.69:0/1760828606 shutdown_connections 2023-10-06T01:40:06.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.165+0000 7fd146a36700 1 --2- 172.21.15.69:0/1760828606 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1400a90d0 0x7fd14006de40 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:06.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.165+0000 7fd146a36700 1 -- 172.21.15.69:0/1760828606 >> 172.21.15.69:0/1760828606 conn(0x7fd14006ce80 msgr2=0x7fd1400ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:06.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.165+0000 7fd146a36700 1 -- 172.21.15.69:0/1760828606 shutdown_connections 2023-10-06T01:40:06.168 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.165+0000 7fd146a36700 1 -- 172.21.15.69:0/1760828606 wait complete. 2023-10-06T01:40:06.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.166+0000 7fd146a36700 1 Processor -- start 2023-10-06T01:40:06.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.166+0000 7fd146a36700 1 -- start start 2023-10-06T01:40:06.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.167+0000 7fd146a36700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd14006e380 0x7fd14015fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:06.171 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.167+0000 7fd146a36700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1400a8d00 0x7fd14014a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:06.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.167+0000 7fd146a36700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd1400a90d0 0x7fd14015bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:06.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.167+0000 7fd146a36700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14015b410 con 0x7fd1400a8d00 2023-10-06T01:40:06.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.167+0000 7fd146a36700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14015ae50 con 0x7fd14006e380 2023-10-06T01:40:06.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.167+0000 7fd146a36700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd14015b130 con 0x7fd1400a90d0 2023-10-06T01:40:06.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.167+0000 7fd13f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1400a8d00 0x7fd14014a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:06.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.167+0000 7fd13f7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1400a8d00 0x7fd14014a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33462/0 (socket says 172.21.15.69:33462) 2023-10-06T01:40:06.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.167+0000 7fd13f7fe700 1 -- 172.21.15.69:0/1836533759 learned_addr learned my addr 172.21.15.69:0/1836533759 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:06.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.167+0000 7fd13f7fe700 1 -- 172.21.15.69:0/1836533759 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd1400a90d0 msgr2=0x7fd14015bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:06.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.167+0000 7fd13ffff700 1 --2- 172.21.15.69:0/1836533759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd14006e380 0x7fd14015fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:06.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.167+0000 7fd144fd3700 1 --2- 172.21.15.69:0/1836533759 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd1400a90d0 0x7fd14015bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:06.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.167+0000 7fd13f7fe700 1 --2- 172.21.15.69:0/1836533759 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd1400a90d0 0x7fd14015bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:06.172 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.167+0000 7fd13f7fe700 1 -- 172.21.15.69:0/1836533759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd14006e380 msgr2=0x7fd14015fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:06.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.167+0000 7fd13f7fe700 1 --2- 172.21.15.69:0/1836533759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd14006e380 0x7fd14015fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:06.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.167+0000 7fd13f7fe700 1 -- 172.21.15.69:0/1836533759 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1340093c0 con 0x7fd1400a8d00 2023-10-06T01:40:06.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.167+0000 7fd13f7fe700 1 --2- 172.21.15.69:0/1836533759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1400a8d00 0x7fd14014a860 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd134009160 tx=0x7fd134016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:06.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.167+0000 7fd127fff700 1 -- 172.21.15.69:0/1836533759 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1340064a0 con 0x7fd1400a8d00 2023-10-06T01:40:06.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.167+0000 7fd127fff700 1 -- 172.21.15.69:0/1836533759 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd134006600 con 0x7fd1400a8d00 2023-10-06T01:40:06.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.167+0000 7fd146a36700 1 -- 172.21.15.69:0/1836533759 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd14015d950 con 0x7fd1400a8d00 2023-10-06T01:40:06.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.167+0000 7fd127fff700 1 -- 172.21.15.69:0/1836533759 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13401b480 con 0x7fd1400a8d00 2023-10-06T01:40:06.173 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.167+0000 7fd146a36700 1 -- 172.21.15.69:0/1836533759 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd140160110 con 0x7fd1400a8d00 2023-10-06T01:40:06.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.168+0000 7fd146a36700 1 -- 172.21.15.69:0/1836533759 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd14004c3c0 con 0x7fd1400a8d00 2023-10-06T01:40:06.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.169+0000 7fd127fff700 1 -- 172.21.15.69:0/1836533759 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fd13401b830 con 0x7fd1400a8d00 2023-10-06T01:40:06.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.169+0000 7fd127fff700 1 --2- 172.21.15.69:0/1836533759 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd12c0670e0 0x7fd12c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:06.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.169+0000 7fd127fff700 1 -- 172.21.15.69:0/1836533759 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fd1340869c0 con 0x7fd1400a8d00 2023-10-06T01:40:06.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.169+0000 7fd13ffff700 1 --2- 172.21.15.69:0/1836533759 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd12c0670e0 0x7fd12c069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:06.174 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.170+0000 7fd13ffff700 1 --2- 172.21.15.69:0/1836533759 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd12c0670e0 0x7fd12c069590 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd1300017b0 tx=0x7fd130009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:06.175 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.173+0000 7fd127fff700 1 -- 172.21.15.69:0/1836533759 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd134053b50 con 0x7fd1400a8d00 2023-10-06T01:40:06.412 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.411+0000 7fd146a36700 1 -- 172.21.15.69:0/1836533759 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) v1 -- 0x7fd1400b42f0 con 0x7fd1400a8d00 2023-10-06T01:40:06.417 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.416+0000 7fd127fff700 1 -- 172.21.15.69:0/1836533759 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v7) v1 ==== 81+0+449948 (secure 0 0 0) 0x7fd134057170 con 0x7fd1400a8d00 2023-10-06T01:40:06.422 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:40:06.423 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-10-06T01:40:06.423 INFO:teuthology.orchestra.run.smithi069.stdout: "epoch": 7, 2023-10-06T01:40:06.423 INFO:teuthology.orchestra.run.smithi069.stdout: "active_gid": 4105, 2023-10-06T01:40:06.423 INFO:teuthology.orchestra.run.smithi069.stdout: "active_name": "y", 2023-10-06T01:40:06.423 INFO:teuthology.orchestra.run.smithi069.stdout: "active_addrs": { 2023-10-06T01:40:06.423 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2023-10-06T01:40:06.424 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.424 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2023-10-06T01:40:06.424 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:6832", 2023-10-06T01:40:06.424 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 90441 2023-10-06T01:40:06.424 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.424 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.424 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v1", 2023-10-06T01:40:06.424 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:6833", 2023-10-06T01:40:06.424 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 90441 2023-10-06T01:40:06.424 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.424 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-10-06T01:40:06.425 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.425 INFO:teuthology.orchestra.run.smithi069.stdout: "active_addr": "172.21.15.69:6833/90441", 2023-10-06T01:40:06.425 INFO:teuthology.orchestra.run.smithi069.stdout: "active_change": "2023-10-06T01:38:30.239016+0000", 2023-10-06T01:40:06.425 INFO:teuthology.orchestra.run.smithi069.stdout: "active_mgr_features": 4540138320759226367, 2023-10-06T01:40:06.425 INFO:teuthology.orchestra.run.smithi069.stdout: "available": true, 2023-10-06T01:40:06.425 INFO:teuthology.orchestra.run.smithi069.stdout: "standbys": [ 2023-10-06T01:40:06.425 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.425 INFO:teuthology.orchestra.run.smithi069.stdout: "gid": 4100, 2023-10-06T01:40:06.425 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "x", 2023-10-06T01:40:06.425 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_features": 4540138320759226367, 2023-10-06T01:40:06.425 INFO:teuthology.orchestra.run.smithi069.stdout: "available_modules": [ 2023-10-06T01:40:06.426 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.426 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "alerts", 2023-10-06T01:40:06.426 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.426 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.426 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.426 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-10-06T01:40:06.426 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-10-06T01:40:06.426 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.426 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.426 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.426 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-10-06T01:40:06.427 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.427 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.427 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.427 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How frequently to reexamine health status", 2023-10-06T01:40:06.427 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.427 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.427 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.427 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.427 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.427 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.427 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.428 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.428 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.428 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.428 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.428 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.428 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.428 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.428 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.428 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.428 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.428 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.429 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.429 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.429 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.429 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.429 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.429 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.429 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.429 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.429 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.429 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.429 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.430 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.430 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.430 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.430 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.430 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.430 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.430 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.430 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.430 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.430 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.430 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.430 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.431 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.431 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.431 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.431 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.431 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.431 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.431 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.431 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.431 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.431 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.431 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.431 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.432 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.432 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.432 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.432 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.432 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.432 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.432 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.432 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.432 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.432 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.432 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.433 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.433 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.433 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.433 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.433 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.433 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.433 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.433 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.433 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.433 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.433 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_destination": { 2023-10-06T01:40:06.434 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_destination", 2023-10-06T01:40:06.434 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.434 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.434 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.434 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.434 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.434 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.434 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.434 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email address to send alerts to", 2023-10-06T01:40:06.434 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.434 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.435 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.435 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.435 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_from_name": { 2023-10-06T01:40:06.435 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_from_name", 2023-10-06T01:40:06.435 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.435 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.435 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.435 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "Ceph", 2023-10-06T01:40:06.435 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.435 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.435 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.435 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email From: name", 2023-10-06T01:40:06.436 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.436 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.436 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.436 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.436 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_host": { 2023-10-06T01:40:06.436 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_host", 2023-10-06T01:40:06.436 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.436 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.436 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.436 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.436 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.437 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.437 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.437 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP server", 2023-10-06T01:40:06.437 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.437 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.437 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.437 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.437 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_password": { 2023-10-06T01:40:06.437 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_password", 2023-10-06T01:40:06.437 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.437 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.437 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.438 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.438 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.438 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.438 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.438 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Password to authenticate with", 2023-10-06T01:40:06.438 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.438 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.438 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.438 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.438 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_port": { 2023-10-06T01:40:06.439 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_port", 2023-10-06T01:40:06.439 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.439 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.439 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.439 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "465", 2023-10-06T01:40:06.439 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.439 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.439 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.439 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP port", 2023-10-06T01:40:06.439 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.439 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.439 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.440 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.440 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_sender": { 2023-10-06T01:40:06.440 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_sender", 2023-10-06T01:40:06.440 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.440 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.440 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.440 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.440 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.440 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.440 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.440 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP envelope sender", 2023-10-06T01:40:06.440 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.441 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.441 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.441 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.441 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_ssl": { 2023-10-06T01:40:06.441 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_ssl", 2023-10-06T01:40:06.441 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.441 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.441 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.441 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.441 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.441 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.442 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.442 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-06T01:40:06.442 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.442 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.442 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.442 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.442 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_user": { 2023-10-06T01:40:06.442 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_user", 2023-10-06T01:40:06.442 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.442 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.442 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.443 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.443 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.443 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.443 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.443 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "User to authenticate as", 2023-10-06T01:40:06.443 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.443 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.443 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.443 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.443 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.443 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.443 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.444 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "balancer", 2023-10-06T01:40:06.444 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.444 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.444 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.444 INFO:teuthology.orchestra.run.smithi069.stdout: "active": { 2023-10-06T01:40:06.444 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "active", 2023-10-06T01:40:06.444 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.444 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.444 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.445 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.445 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.445 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.445 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.445 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically balance PGs across cluster", 2023-10-06T01:40:06.445 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.445 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.445 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.445 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.445 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_time": { 2023-10-06T01:40:06.445 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_time", 2023-10-06T01:40:06.446 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.446 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.446 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.446 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0000", 2023-10-06T01:40:06.446 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.446 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.446 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.446 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "beginning time of day to automatically balance", 2023-10-06T01:40:06.446 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-06T01:40:06.447 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.447 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.447 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.447 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_weekday": { 2023-10-06T01:40:06.447 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_weekday", 2023-10-06T01:40:06.447 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-10-06T01:40:06.447 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.447 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.447 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-10-06T01:40:06.447 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2023-10-06T01:40:06.447 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "7", 2023-10-06T01:40:06.447 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.448 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-06T01:40:06.448 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2023-10-06T01:40:06.448 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.448 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.448 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.448 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_max_iterations": { 2023-10-06T01:40:06.448 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_max_iterations", 2023-10-06T01:40:06.448 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-10-06T01:40:06.448 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.448 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.448 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "25", 2023-10-06T01:40:06.449 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-10-06T01:40:06.449 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "250", 2023-10-06T01:40:06.449 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.449 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-06T01:40:06.449 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.449 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.449 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.449 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.449 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_metrics": { 2023-10-06T01:40:06.449 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_metrics", 2023-10-06T01:40:06.449 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.449 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.450 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.450 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "pgs,objects,bytes", 2023-10-06T01:40:06.450 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.450 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.450 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.450 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-06T01:40:06.450 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-06T01:40:06.450 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.450 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.450 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.450 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_step": { 2023-10-06T01:40:06.451 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_step", 2023-10-06T01:40:06.451 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-10-06T01:40:06.451 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.451 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.451 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.5", 2023-10-06T01:40:06.451 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0.001", 2023-10-06T01:40:06.451 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "0.999", 2023-10-06T01:40:06.451 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.451 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "aggressiveness of optimization", 2023-10-06T01:40:06.451 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-06T01:40:06.451 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.452 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.452 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.452 INFO:teuthology.orchestra.run.smithi069.stdout: "end_time": { 2023-10-06T01:40:06.452 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_time", 2023-10-06T01:40:06.452 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.452 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.452 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.452 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2400", 2023-10-06T01:40:06.452 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.452 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.452 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.453 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ending time of day to automatically balance", 2023-10-06T01:40:06.453 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-06T01:40:06.453 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.453 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.453 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.453 INFO:teuthology.orchestra.run.smithi069.stdout: "end_weekday": { 2023-10-06T01:40:06.453 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_weekday", 2023-10-06T01:40:06.453 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-10-06T01:40:06.453 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.453 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.453 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7", 2023-10-06T01:40:06.454 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2023-10-06T01:40:06.454 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "7", 2023-10-06T01:40:06.454 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.454 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-06T01:40:06.454 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2023-10-06T01:40:06.454 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.454 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.454 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.454 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.455 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.455 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.455 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.455 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.455 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.455 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.455 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.455 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.455 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.455 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.455 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.455 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.456 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.456 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.456 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.456 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.456 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.456 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.456 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.456 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.456 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.456 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.456 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.457 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.457 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.457 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.457 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.457 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.457 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.457 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.457 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.457 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.457 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.458 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.458 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.458 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.458 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.458 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.458 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.458 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.458 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.458 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.458 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.459 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.459 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.459 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.459 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.459 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.459 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.459 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.459 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.459 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.459 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.459 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.460 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.460 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.460 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.460 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.460 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.460 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.460 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.460 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.460 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.460 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.460 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.460 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.461 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.461 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.461 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.461 INFO:teuthology.orchestra.run.smithi069.stdout: "min_score": { 2023-10-06T01:40:06.461 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_score", 2023-10-06T01:40:06.461 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-10-06T01:40:06.461 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.461 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.461 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-10-06T01:40:06.461 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.461 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.462 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.462 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-06T01:40:06.462 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.462 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.462 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.462 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.462 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2023-10-06T01:40:06.462 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2023-10-06T01:40:06.462 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.462 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.462 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.462 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "upmap", 2023-10-06T01:40:06.463 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.463 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.463 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.463 INFO:teuthology.orchestra.run.smithi069.stdout: "crush-compat", 2023-10-06T01:40:06.463 INFO:teuthology.orchestra.run.smithi069.stdout: "none", 2023-10-06T01:40:06.463 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap" 2023-10-06T01:40:06.463 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.463 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Balancer mode", 2023-10-06T01:40:06.463 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.463 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.463 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.464 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.464 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_ids": { 2023-10-06T01:40:06.464 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_ids", 2023-10-06T01:40:06.464 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.464 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.464 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.464 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.464 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.464 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.464 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.464 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-06T01:40:06.464 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.465 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.465 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.465 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.465 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-10-06T01:40:06.465 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-10-06T01:40:06.465 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.465 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.465 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.465 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-10-06T01:40:06.465 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.465 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.466 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.466 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-06T01:40:06.466 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.466 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.466 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.466 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.466 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_deviation": { 2023-10-06T01:40:06.466 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_deviation", 2023-10-06T01:40:06.466 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.466 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.466 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.467 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-10-06T01:40:06.467 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-10-06T01:40:06.467 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.467 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.467 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-06T01:40:06.467 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-06T01:40:06.467 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.467 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.467 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.467 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_optimizations": { 2023-10-06T01:40:06.467 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_optimizations", 2023-10-06T01:40:06.468 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-10-06T01:40:06.468 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.468 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.468 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-10-06T01:40:06.468 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.468 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.468 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.468 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-06T01:40:06.468 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.468 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.468 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.468 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.469 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.469 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.469 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.469 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cephadm", 2023-10-06T01:40:06.469 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.469 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.469 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.469 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_down_multiplier": { 2023-10-06T01:40:06.469 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_down_multiplier", 2023-10-06T01:40:06.469 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-10-06T01:40:06.469 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.470 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.470 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2023-10-06T01:40:06.470 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.470 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.470 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.470 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-06T01:40:06.470 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.470 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.470 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.470 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.471 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_refresh_rate": { 2023-10-06T01:40:06.471 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_refresh_rate", 2023-10-06T01:40:06.471 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.471 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.471 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.471 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "20", 2023-10-06T01:40:06.471 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.471 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.471 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.471 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-06T01:40:06.471 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.471 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.472 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.472 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.472 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_starting_port": { 2023-10-06T01:40:06.472 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_starting_port", 2023-10-06T01:40:06.472 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.472 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.472 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.472 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4721", 2023-10-06T01:40:06.472 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.472 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.472 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.472 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-06T01:40:06.473 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.473 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.473 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.473 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.473 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_ptrace": { 2023-10-06T01:40:06.473 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_ptrace", 2023-10-06T01:40:06.473 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.473 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.474 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.474 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.474 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.474 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.474 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.474 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-06T01:40:06.474 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-06T01:40:06.474 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.474 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.474 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.475 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_interval": { 2023-10-06T01:40:06.475 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_interval", 2023-10-06T01:40:06.475 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.475 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.475 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.475 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-10-06T01:40:06.475 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.475 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.475 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.475 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-06T01:40:06.475 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.475 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.476 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.476 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.476 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_memory_target_ratio": { 2023-10-06T01:40:06.476 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_memory_target_ratio", 2023-10-06T01:40:06.476 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-10-06T01:40:06.476 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.476 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.476 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.7", 2023-10-06T01:40:06.476 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.476 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.476 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.477 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-06T01:40:06.477 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.477 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.477 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.477 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.477 INFO:teuthology.orchestra.run.smithi069.stdout: "cgroups_split": { 2023-10-06T01:40:06.477 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cgroups_split", 2023-10-06T01:40:06.477 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.477 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.477 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.477 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.477 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.478 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.478 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.478 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-06T01:40:06.478 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.478 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.478 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.478 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.478 INFO:teuthology.orchestra.run.smithi069.stdout: "config_checks_enabled": { 2023-10-06T01:40:06.478 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_checks_enabled", 2023-10-06T01:40:06.478 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.478 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.479 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.479 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.479 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.479 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.479 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.479 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-06T01:40:06.479 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.479 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.479 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.479 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.479 INFO:teuthology.orchestra.run.smithi069.stdout: "config_dashboard": { 2023-10-06T01:40:06.479 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_dashboard", 2023-10-06T01:40:06.480 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.480 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.480 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.480 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.480 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.480 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.480 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.480 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-06T01:40:06.480 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.480 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.480 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.481 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.481 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_alertmanager": { 2023-10-06T01:40:06.481 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_alertmanager", 2023-10-06T01:40:06.481 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.481 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.481 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.481 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-06T01:40:06.481 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.481 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.481 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.481 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-10-06T01:40:06.481 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.482 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.482 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.482 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.482 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_base": { 2023-10-06T01:40:06.482 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_base", 2023-10-06T01:40:06.482 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.482 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.482 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.482 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-06T01:40:06.482 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.482 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.483 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.483 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Container image name, without the tag", 2023-10-06T01:40:06.483 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.483 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.483 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.483 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.483 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_grafana": { 2023-10-06T01:40:06.483 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_grafana", 2023-10-06T01:40:06.483 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.483 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.483 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.484 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-06T01:40:06.484 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.484 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.484 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.484 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-10-06T01:40:06.484 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.484 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.484 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.484 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.484 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_haproxy": { 2023-10-06T01:40:06.484 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_haproxy", 2023-10-06T01:40:06.485 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.485 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.485 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.485 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-06T01:40:06.485 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.485 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.485 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.485 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "HAproxy container image", 2023-10-06T01:40:06.485 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.485 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.485 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.485 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.486 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_keepalived": { 2023-10-06T01:40:06.486 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_keepalived", 2023-10-06T01:40:06.486 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.486 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.486 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.486 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/keepalived:2.1.5", 2023-10-06T01:40:06.486 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.486 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.486 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.486 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Keepalived container image", 2023-10-06T01:40:06.486 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.487 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.487 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.487 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.487 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_loki": { 2023-10-06T01:40:06.487 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_loki", 2023-10-06T01:40:06.487 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.487 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.487 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.487 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-06T01:40:06.487 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.487 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.487 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.488 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Loki container image", 2023-10-06T01:40:06.488 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.488 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.488 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.488 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.488 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_node_exporter": { 2023-10-06T01:40:06.488 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_node_exporter", 2023-10-06T01:40:06.488 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.488 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.488 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.489 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-06T01:40:06.489 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.489 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.489 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.489 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-10-06T01:40:06.489 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.489 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.489 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.489 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.489 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_prometheus": { 2023-10-06T01:40:06.489 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_prometheus", 2023-10-06T01:40:06.490 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.490 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.490 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.490 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-06T01:40:06.490 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.490 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.490 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.490 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-10-06T01:40:06.490 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.490 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.490 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.491 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.491 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_promtail": { 2023-10-06T01:40:06.491 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_promtail", 2023-10-06T01:40:06.491 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.491 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.491 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.491 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-06T01:40:06.491 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.491 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.491 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.491 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Promtail container image", 2023-10-06T01:40:06.492 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.492 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.492 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.492 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.492 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_snmp_gateway": { 2023-10-06T01:40:06.492 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_snmp_gateway", 2023-10-06T01:40:06.492 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.492 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.492 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.492 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-06T01:40:06.492 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.492 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.493 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.493 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SNMP Gateway container image", 2023-10-06T01:40:06.493 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.493 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.493 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.493 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.493 INFO:teuthology.orchestra.run.smithi069.stdout: "container_init": { 2023-10-06T01:40:06.493 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_init", 2023-10-06T01:40:06.493 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.493 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.493 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.494 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.494 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.494 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.494 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.494 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Run podman/docker with `--init`", 2023-10-06T01:40:06.494 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.494 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.494 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.494 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.494 INFO:teuthology.orchestra.run.smithi069.stdout: "daemon_cache_timeout": { 2023-10-06T01:40:06.494 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "daemon_cache_timeout", 2023-10-06T01:40:06.494 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.495 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.495 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.495 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-10-06T01:40:06.495 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.495 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.495 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.495 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-06T01:40:06.495 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.495 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.495 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.495 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.496 INFO:teuthology.orchestra.run.smithi069.stdout: "default_cephadm_command_timeout": { 2023-10-06T01:40:06.496 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_cephadm_command_timeout", 2023-10-06T01:40:06.496 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.496 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.496 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.496 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "900", 2023-10-06T01:40:06.496 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.496 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.496 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.497 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-06T01:40:06.497 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.497 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.497 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.497 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.497 INFO:teuthology.orchestra.run.smithi069.stdout: "default_registry": { 2023-10-06T01:40:06.497 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_registry", 2023-10-06T01:40:06.497 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.497 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.497 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.498 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io", 2023-10-06T01:40:06.498 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.498 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.498 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.498 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-06T01:40:06.498 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.498 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.498 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.498 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.498 INFO:teuthology.orchestra.run.smithi069.stdout: "device_cache_timeout": { 2023-10-06T01:40:06.499 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_cache_timeout", 2023-10-06T01:40:06.499 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.499 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.499 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.499 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1800", 2023-10-06T01:40:06.499 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.499 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.499 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.499 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache device inventory", 2023-10-06T01:40:06.499 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.500 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.500 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.500 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.500 INFO:teuthology.orchestra.run.smithi069.stdout: "device_enhanced_scan": { 2023-10-06T01:40:06.500 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_enhanced_scan", 2023-10-06T01:40:06.500 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.500 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.500 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.500 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.501 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.501 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.501 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.501 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-06T01:40:06.501 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.501 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.501 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.501 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.501 INFO:teuthology.orchestra.run.smithi069.stdout: "facts_cache_timeout": { 2023-10-06T01:40:06.501 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "facts_cache_timeout", 2023-10-06T01:40:06.502 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.502 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.502 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.502 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-10-06T01:40:06.502 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.502 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.502 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.502 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache host facts data", 2023-10-06T01:40:06.502 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.503 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.503 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.503 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.503 INFO:teuthology.orchestra.run.smithi069.stdout: "host_check_interval": { 2023-10-06T01:40:06.503 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "host_check_interval", 2023-10-06T01:40:06.503 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.503 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.503 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.503 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-10-06T01:40:06.503 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.504 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.504 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.504 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to perform a host check", 2023-10-06T01:40:06.504 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.504 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.504 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.504 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.504 INFO:teuthology.orchestra.run.smithi069.stdout: "inventory_list_all": { 2023-10-06T01:40:06.504 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "inventory_list_all", 2023-10-06T01:40:06.505 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.505 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.505 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.505 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.505 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.505 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.505 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.505 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-06T01:40:06.505 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.505 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.506 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.506 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.506 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.506 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.506 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.506 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.506 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.506 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.506 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.506 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.507 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.507 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.507 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.507 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.507 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.507 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.507 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.507 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.507 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.507 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.507 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.508 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.508 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.508 INFO:teuthology.orchestra.run.smithi069.stdout: "log_refresh_metadata": { 2023-10-06T01:40:06.508 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_refresh_metadata", 2023-10-06T01:40:06.508 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.508 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.508 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.508 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.508 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.508 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.509 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.509 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-06T01:40:06.509 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.509 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.509 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.509 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.509 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.509 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.509 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.509 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.509 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.510 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.510 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.510 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.510 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.510 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-06T01:40:06.510 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.510 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.510 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.510 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.510 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.511 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.511 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.511 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.511 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.511 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.511 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.511 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.511 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.511 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.511 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.511 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.511 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.512 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.512 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.512 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.512 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.512 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.512 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.512 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.512 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.512 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.512 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.512 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.513 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.513 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.513 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.513 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.513 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.513 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.513 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.513 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.513 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.513 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.513 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.514 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-06T01:40:06.514 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-06T01:40:06.514 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.514 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.514 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.514 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.514 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.514 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.514 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.514 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-06T01:40:06.514 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.515 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.515 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.515 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.515 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-06T01:40:06.515 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-06T01:40:06.515 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.515 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.515 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.515 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "*", 2023-10-06T01:40:06.515 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.515 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.516 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.516 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-06T01:40:06.516 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.516 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.516 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.516 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.516 INFO:teuthology.orchestra.run.smithi069.stdout: "max_count_per_host": { 2023-10-06T01:40:06.516 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_count_per_host", 2023-10-06T01:40:06.516 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.516 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.516 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.516 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-10-06T01:40:06.517 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.517 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.517 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.517 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of daemons per service per host", 2023-10-06T01:40:06.517 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.517 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.517 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.517 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.517 INFO:teuthology.orchestra.run.smithi069.stdout: "max_osd_draining_count": { 2023-10-06T01:40:06.517 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_osd_draining_count", 2023-10-06T01:40:06.517 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.518 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.518 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.518 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-10-06T01:40:06.518 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.518 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.518 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.518 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-06T01:40:06.518 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.518 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.518 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.518 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.519 INFO:teuthology.orchestra.run.smithi069.stdout: "migration_current": { 2023-10-06T01:40:06.519 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "migration_current", 2023-10-06T01:40:06.519 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.519 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.519 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.519 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.519 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.519 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.519 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.519 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "internal - do not modify", 2023-10-06T01:40:06.519 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.520 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.520 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.520 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.520 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2023-10-06T01:40:06.520 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2023-10-06T01:40:06.520 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.520 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.520 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.520 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "root", 2023-10-06T01:40:06.520 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.520 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.520 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.521 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm-package", 2023-10-06T01:40:06.521 INFO:teuthology.orchestra.run.smithi069.stdout: "root" 2023-10-06T01:40:06.521 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.521 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "mode for remote execution of cephadm", 2023-10-06T01:40:06.521 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.521 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.521 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.521 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.521 INFO:teuthology.orchestra.run.smithi069.stdout: "prometheus_alerts_path": { 2023-10-06T01:40:06.521 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus_alerts_path", 2023-10-06T01:40:06.522 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.522 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.522 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.522 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-06T01:40:06.522 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.522 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.522 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.522 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-06T01:40:06.522 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.522 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.522 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.522 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.523 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_insecure": { 2023-10-06T01:40:06.523 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_insecure", 2023-10-06T01:40:06.523 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.523 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.523 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.523 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.523 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.523 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.523 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.523 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-06T01:40:06.523 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.524 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.524 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.524 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.524 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_password": { 2023-10-06T01:40:06.524 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_password", 2023-10-06T01:40:06.524 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.524 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.524 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.524 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.524 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.524 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.525 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.525 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-06T01:40:06.525 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.525 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.525 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.525 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.525 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_url": { 2023-10-06T01:40:06.525 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_url", 2023-10-06T01:40:06.525 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.525 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.525 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.526 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.526 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.526 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.526 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.526 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-06T01:40:06.526 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.526 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.526 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.526 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.526 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_username": { 2023-10-06T01:40:06.526 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_username", 2023-10-06T01:40:06.527 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.527 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.527 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.527 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.527 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.527 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.527 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.527 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-06T01:40:06.527 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.527 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.527 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.528 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.528 INFO:teuthology.orchestra.run.smithi069.stdout: "ssh_config_file": { 2023-10-06T01:40:06.528 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssh_config_file", 2023-10-06T01:40:06.528 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.528 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.528 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.528 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.528 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.528 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.528 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.528 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-06T01:40:06.529 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.529 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.529 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.529 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.529 INFO:teuthology.orchestra.run.smithi069.stdout: "use_agent": { 2023-10-06T01:40:06.529 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_agent", 2023-10-06T01:40:06.529 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.529 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.529 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.529 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.529 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.530 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.530 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.530 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-06T01:40:06.530 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.530 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.530 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.530 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.530 INFO:teuthology.orchestra.run.smithi069.stdout: "use_repo_digest": { 2023-10-06T01:40:06.530 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_repo_digest", 2023-10-06T01:40:06.530 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.530 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.530 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.531 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.531 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.531 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.531 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.531 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-06T01:40:06.531 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.531 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.531 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.531 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.531 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_failed_host_check": { 2023-10-06T01:40:06.531 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_failed_host_check", 2023-10-06T01:40:06.532 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.532 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.532 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.532 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.532 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.532 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.532 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.532 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if the host check fails", 2023-10-06T01:40:06.532 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.532 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.532 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.533 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.533 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_daemons": { 2023-10-06T01:40:06.533 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_daemons", 2023-10-06T01:40:06.533 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.533 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.533 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.533 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.533 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.533 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.533 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.533 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-06T01:40:06.533 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.534 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.534 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.534 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.534 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_hosts": { 2023-10-06T01:40:06.534 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_hosts", 2023-10-06T01:40:06.534 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.534 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.534 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.534 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.534 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.534 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.535 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.535 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-06T01:40:06.535 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.535 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.535 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.535 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.535 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.535 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.535 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.535 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crash", 2023-10-06T01:40:06.535 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.535 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.536 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.536 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.536 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.536 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.536 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.536 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.536 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.536 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.536 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.536 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.536 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.537 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.537 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.537 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.537 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.537 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.537 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.537 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.537 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.537 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.537 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.537 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.538 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.538 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.538 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.538 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.538 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.538 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.538 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.538 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.538 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.538 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.538 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.538 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.539 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.539 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.539 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.539 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.539 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.539 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.539 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.539 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.539 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.539 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.539 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.540 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.540 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.540 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.540 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.540 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.540 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.540 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.540 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.540 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.540 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.540 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.541 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.541 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.541 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.541 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.541 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.541 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.541 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.541 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.541 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.541 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.541 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.541 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.542 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.542 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.542 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.542 INFO:teuthology.orchestra.run.smithi069.stdout: "retain_interval": { 2023-10-06T01:40:06.542 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retain_interval", 2023-10-06T01:40:06.542 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.542 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.542 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.542 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "31536000", 2023-10-06T01:40:06.542 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.542 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.543 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.543 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-06T01:40:06.543 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.543 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.543 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.543 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.543 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_recent_interval": { 2023-10-06T01:40:06.543 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_recent_interval", 2023-10-06T01:40:06.543 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.543 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.543 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.544 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1209600", 2023-10-06T01:40:06.544 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.544 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.544 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.544 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-06T01:40:06.544 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.544 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.544 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.544 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.544 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.544 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.544 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.545 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dashboard", 2023-10-06T01:40:06.545 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.545 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.545 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.545 INFO:teuthology.orchestra.run.smithi069.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-06T01:40:06.545 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-06T01:40:06.545 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.545 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.545 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.545 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-10-06T01:40:06.545 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.546 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.546 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.546 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.546 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.546 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.546 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.546 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.546 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_HOST": { 2023-10-06T01:40:06.546 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-06T01:40:06.546 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.546 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.547 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.547 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.547 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.547 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.547 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.547 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.547 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.547 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.547 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.547 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.547 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-06T01:40:06.547 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-06T01:40:06.548 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.548 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.548 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.548 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.548 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.548 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.548 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.548 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.548 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.548 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.548 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.549 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.549 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_ENABLED": { 2023-10-06T01:40:06.549 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_ENABLED", 2023-10-06T01:40:06.549 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.549 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.549 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.549 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.549 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.549 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.549 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.549 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.550 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.550 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.550 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.550 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.550 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-06T01:40:06.550 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-06T01:40:06.550 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.550 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.550 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.550 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.550 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.551 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.551 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.551 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.551 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.551 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.551 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.551 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.551 INFO:teuthology.orchestra.run.smithi069.stdout: "ENABLE_BROWSABLE_API": { 2023-10-06T01:40:06.551 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-06T01:40:06.551 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.551 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.552 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.552 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.552 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.552 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.552 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.552 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.552 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.552 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.552 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.552 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.552 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-06T01:40:06.552 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-06T01:40:06.553 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.553 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.553 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.553 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.553 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.553 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.553 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.553 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.553 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.553 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.554 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.554 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.554 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-06T01:40:06.554 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-06T01:40:06.554 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.554 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.554 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.554 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.554 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.554 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.554 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.555 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.555 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.555 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.555 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.555 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.555 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-06T01:40:06.555 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-06T01:40:06.555 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.555 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.555 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.555 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.555 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.556 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.556 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.556 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.556 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.556 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.556 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.556 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.556 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-06T01:40:06.556 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-06T01:40:06.556 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.557 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.557 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.557 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.557 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.557 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.557 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.557 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.557 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.557 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.557 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.557 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.558 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-06T01:40:06.558 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-06T01:40:06.558 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.558 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.558 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.558 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.558 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.558 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.558 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.558 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.558 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.559 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.559 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.559 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.559 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-06T01:40:06.559 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-06T01:40:06.559 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.559 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.559 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.559 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.559 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.559 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.560 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.560 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.560 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.560 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.560 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.560 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.560 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-06T01:40:06.560 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-06T01:40:06.560 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.560 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.560 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.560 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.561 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.561 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.561 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.561 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.561 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.561 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.561 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.561 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.561 INFO:teuthology.orchestra.run.smithi069.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-06T01:40:06.561 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-06T01:40:06.561 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.562 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.562 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.562 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.562 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.562 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.562 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.562 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.562 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.562 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.562 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.562 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.563 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_PASSWORD": { 2023-10-06T01:40:06.563 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-06T01:40:06.563 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.563 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.563 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.563 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-10-06T01:40:06.563 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.563 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.563 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.563 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.563 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.564 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.564 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.564 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.564 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-06T01:40:06.564 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-06T01:40:06.564 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.564 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.564 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.564 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.564 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.564 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.564 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.565 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.565 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.565 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.565 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.565 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.565 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_URL": { 2023-10-06T01:40:06.565 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_URL", 2023-10-06T01:40:06.565 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.565 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.565 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.565 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.566 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.566 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.566 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.566 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.566 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.566 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.566 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.566 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.566 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_USERNAME": { 2023-10-06T01:40:06.566 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-06T01:40:06.566 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.567 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.567 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.567 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-10-06T01:40:06.567 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.567 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.567 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.567 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.567 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.567 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.567 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.567 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.568 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-06T01:40:06.568 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-06T01:40:06.568 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.568 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.568 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.568 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.568 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.568 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.568 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.568 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.568 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.569 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.569 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.569 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.569 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-06T01:40:06.569 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-06T01:40:06.569 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.569 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.569 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.569 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.569 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.570 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.570 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.570 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.570 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.570 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.570 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.570 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.570 INFO:teuthology.orchestra.run.smithi069.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-06T01:40:06.570 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-06T01:40:06.570 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.570 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.570 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.571 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.571 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.571 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.571 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.571 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.571 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.571 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.571 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.571 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.571 INFO:teuthology.orchestra.run.smithi069.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-06T01:40:06.572 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-06T01:40:06.572 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.572 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.572 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.572 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.572 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.572 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.572 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.572 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.572 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.572 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.573 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.573 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.573 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_HOST": { 2023-10-06T01:40:06.573 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-06T01:40:06.573 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.573 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.573 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.573 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.573 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.573 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.573 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.573 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.574 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.574 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.574 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.574 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.574 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-06T01:40:06.574 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-06T01:40:06.574 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.574 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.574 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.574 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.574 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.575 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.575 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.575 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.575 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.575 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.575 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.575 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.575 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-06T01:40:06.575 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-06T01:40:06.575 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.575 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.576 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.576 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.576 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.576 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.576 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.576 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.576 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.576 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.576 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.576 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.576 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-06T01:40:06.577 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-06T01:40:06.577 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.577 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.577 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.577 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.577 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.577 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.577 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.577 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.577 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.577 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.577 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.578 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.578 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-06T01:40:06.578 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-06T01:40:06.578 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.578 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.578 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.578 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.578 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.578 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.578 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.578 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.579 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.579 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.579 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.579 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.579 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-06T01:40:06.579 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-06T01:40:06.579 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.579 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.579 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.579 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.579 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.579 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.580 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.580 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.580 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.580 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.580 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.580 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.580 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-06T01:40:06.580 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-06T01:40:06.580 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.580 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.580 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.581 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.581 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.581 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.581 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.581 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.581 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.581 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.581 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.581 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.581 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-06T01:40:06.581 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-06T01:40:06.581 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.582 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.582 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.582 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.582 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.582 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.582 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.582 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.582 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.582 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.582 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.582 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.583 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-06T01:40:06.583 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-06T01:40:06.583 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.583 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.583 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.583 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.583 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.583 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.583 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.583 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.583 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.583 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.584 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.584 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.584 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_ENABLED": { 2023-10-06T01:40:06.584 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-06T01:40:06.584 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.584 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.584 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.584 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.584 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.584 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.584 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.585 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.585 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.585 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.585 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.585 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.585 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-06T01:40:06.585 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-06T01:40:06.585 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.585 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.585 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.585 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-06T01:40:06.586 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.586 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.586 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.586 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.586 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.586 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.586 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.586 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.586 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-06T01:40:06.586 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-06T01:40:06.586 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.587 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.587 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.587 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-10-06T01:40:06.587 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.587 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.587 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.587 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.587 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.587 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.587 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.587 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.587 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-06T01:40:06.588 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-06T01:40:06.588 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.588 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.588 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.588 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8", 2023-10-06T01:40:06.588 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.588 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.588 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.588 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.588 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.588 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.589 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.589 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.589 INFO:teuthology.orchestra.run.smithi069.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-06T01:40:06.589 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-06T01:40:06.589 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.589 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.589 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.589 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "45", 2023-10-06T01:40:06.589 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.589 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.589 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.590 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.590 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.590 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.590 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.590 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.590 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ACCESS_KEY": { 2023-10-06T01:40:06.590 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-06T01:40:06.590 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.590 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.590 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.590 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.591 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.591 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.591 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.591 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.591 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.591 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.591 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.591 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.591 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-06T01:40:06.591 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-06T01:40:06.591 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.591 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.593 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.593 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-10-06T01:40:06.593 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.593 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.593 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.593 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.593 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.594 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.594 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.594 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.594 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SECRET_KEY": { 2023-10-06T01:40:06.594 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-06T01:40:06.594 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.594 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.594 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.594 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.594 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.594 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.595 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.595 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.595 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.595 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.595 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.595 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.595 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SSL_VERIFY": { 2023-10-06T01:40:06.595 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-06T01:40:06.595 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.595 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.595 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.596 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.596 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.596 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.596 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.596 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.596 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.596 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.596 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.596 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.596 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-06T01:40:06.596 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-06T01:40:06.597 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.597 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.597 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.597 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-10-06T01:40:06.597 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.597 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.597 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.597 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.597 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.597 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.597 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.597 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.598 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-06T01:40:06.598 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-06T01:40:06.598 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.598 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.598 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.598 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-10-06T01:40:06.598 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.598 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.598 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.598 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.598 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.599 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.599 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.599 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.599 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-06T01:40:06.599 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-06T01:40:06.599 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.599 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.599 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.599 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-10-06T01:40:06.599 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.599 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.600 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.600 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.600 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.600 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.600 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.600 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.600 INFO:teuthology.orchestra.run.smithi069.stdout: "cross_origin_url": { 2023-10-06T01:40:06.600 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cross_origin_url", 2023-10-06T01:40:06.600 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.600 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.600 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.600 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.601 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.601 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.601 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.601 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.601 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.601 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.601 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.601 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.601 INFO:teuthology.orchestra.run.smithi069.stdout: "crt_file": { 2023-10-06T01:40:06.601 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crt_file", 2023-10-06T01:40:06.601 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.602 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.602 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.602 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.602 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.602 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.602 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.602 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.602 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.602 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.602 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.602 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.602 INFO:teuthology.orchestra.run.smithi069.stdout: "debug": { 2023-10-06T01:40:06.603 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "debug", 2023-10-06T01:40:06.603 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.603 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.603 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.603 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.603 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.603 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.603 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.603 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable/disable debug options", 2023-10-06T01:40:06.603 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.603 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.604 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.604 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.604 INFO:teuthology.orchestra.run.smithi069.stdout: "jwt_token_ttl": { 2023-10-06T01:40:06.604 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "jwt_token_ttl", 2023-10-06T01:40:06.604 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.604 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.604 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.604 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "28800", 2023-10-06T01:40:06.604 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.604 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.604 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.605 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.605 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.605 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.605 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.605 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.605 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2023-10-06T01:40:06.605 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2023-10-06T01:40:06.605 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.605 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.605 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.605 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.605 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.606 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.606 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.606 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.606 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.606 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.606 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.606 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.606 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.606 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.606 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.606 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.607 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.607 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.607 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.607 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.607 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.607 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.607 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.607 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.607 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.607 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.607 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.607 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.608 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.608 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.608 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.608 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.608 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.608 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.608 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.608 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.608 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.608 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.608 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.609 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.609 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.609 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.609 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.609 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.609 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.609 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.609 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.609 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.609 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.609 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.609 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.610 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.610 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.610 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.610 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.610 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.610 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.610 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.610 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.610 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.610 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.610 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.611 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.611 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.611 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.611 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.611 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.611 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.611 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.611 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.611 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.611 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.611 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.612 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.612 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.612 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.612 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.612 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.612 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.612 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.612 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.612 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.612 INFO:teuthology.orchestra.run.smithi069.stdout: "motd": { 2023-10-06T01:40:06.612 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "motd", 2023-10-06T01:40:06.613 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.613 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.613 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.613 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.613 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.613 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.613 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.613 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "The message of the day", 2023-10-06T01:40:06.613 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.613 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.613 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.613 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.614 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect_resolve_ip_addr": { 2023-10-06T01:40:06.614 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "redirect_resolve_ip_addr", 2023-10-06T01:40:06.614 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.614 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.614 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.614 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.614 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.614 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.614 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.614 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.614 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.615 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.615 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.615 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.615 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2023-10-06T01:40:06.615 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2023-10-06T01:40:06.615 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.615 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.615 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.615 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2023-10-06T01:40:06.615 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.615 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.615 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.616 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.616 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.616 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.616 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.616 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.616 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2023-10-06T01:40:06.616 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2023-10-06T01:40:06.616 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.616 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.616 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.616 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8080", 2023-10-06T01:40:06.616 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.617 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.617 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.617 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.617 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.617 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.617 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.617 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.617 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2023-10-06T01:40:06.617 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2023-10-06T01:40:06.617 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.618 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.618 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.618 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.618 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.618 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.618 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.618 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.618 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.618 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.618 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.618 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.619 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl_server_port": { 2023-10-06T01:40:06.619 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl_server_port", 2023-10-06T01:40:06.619 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.619 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.619 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.619 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8443", 2023-10-06T01:40:06.619 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.619 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.619 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.619 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.619 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.620 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.620 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.620 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.620 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2023-10-06T01:40:06.620 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2023-10-06T01:40:06.620 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.620 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.620 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.620 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "redirect", 2023-10-06T01:40:06.620 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.620 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.621 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.621 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.621 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect" 2023-10-06T01:40:06.621 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.621 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.621 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.621 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.621 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.621 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.621 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2023-10-06T01:40:06.621 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2023-10-06T01:40:06.622 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.622 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.622 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.622 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2023-10-06T01:40:06.622 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2023-10-06T01:40:06.622 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2023-10-06T01:40:06.622 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.622 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.622 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.622 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.622 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.622 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.623 INFO:teuthology.orchestra.run.smithi069.stdout: "url_prefix": { 2023-10-06T01:40:06.623 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url_prefix", 2023-10-06T01:40:06.623 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.623 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.623 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.623 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.623 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.623 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.623 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.623 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.623 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.624 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.624 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.624 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.624 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.624 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.624 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.624 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "devicehealth", 2023-10-06T01:40:06.624 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.624 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.624 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.624 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_monitoring": { 2023-10-06T01:40:06.624 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_monitoring", 2023-10-06T01:40:06.625 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.625 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.625 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.625 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.625 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.625 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.625 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.625 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "monitor device health metrics", 2023-10-06T01:40:06.625 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.625 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.625 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.626 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.626 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.626 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.626 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.626 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.626 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.626 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.626 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.626 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.626 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.626 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.626 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.627 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.627 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.627 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.627 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.627 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.627 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.627 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.627 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.627 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.627 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.627 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.628 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.628 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.628 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.628 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.628 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.628 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.628 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.628 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.628 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.628 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.628 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.629 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.629 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.629 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.629 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.629 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.629 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.629 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.629 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.629 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.629 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.629 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.629 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.630 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.630 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.630 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.630 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.630 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.630 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.630 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.630 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.630 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.630 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.630 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.630 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.631 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.631 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.631 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.631 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.631 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.631 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.631 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.631 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.631 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.631 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.631 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.632 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.632 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.632 INFO:teuthology.orchestra.run.smithi069.stdout: "mark_out_threshold": { 2023-10-06T01:40:06.632 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mark_out_threshold", 2023-10-06T01:40:06.632 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.632 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.632 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.632 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2419200", 2023-10-06T01:40:06.632 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.632 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.632 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.632 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-06T01:40:06.633 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.633 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.633 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.633 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.633 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_name": { 2023-10-06T01:40:06.633 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_name", 2023-10-06T01:40:06.633 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.633 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.633 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.633 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "device_health_metrics", 2023-10-06T01:40:06.633 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.633 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.634 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.634 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-06T01:40:06.634 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.634 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.634 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.634 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.634 INFO:teuthology.orchestra.run.smithi069.stdout: "retention_period": { 2023-10-06T01:40:06.634 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retention_period", 2023-10-06T01:40:06.634 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.634 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.634 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.635 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15552000", 2023-10-06T01:40:06.635 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.635 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.635 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.635 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain device health metrics", 2023-10-06T01:40:06.635 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.635 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.635 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.635 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.635 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_frequency": { 2023-10-06T01:40:06.635 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_frequency", 2023-10-06T01:40:06.635 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.636 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.636 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.636 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2023-10-06T01:40:06.636 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.636 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.636 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.636 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-06T01:40:06.636 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.636 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.636 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.636 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.637 INFO:teuthology.orchestra.run.smithi069.stdout: "self_heal": { 2023-10-06T01:40:06.637 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "self_heal", 2023-10-06T01:40:06.637 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.637 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.637 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.637 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.637 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.637 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.637 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.637 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-06T01:40:06.637 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.637 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.638 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.638 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.638 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-10-06T01:40:06.638 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-10-06T01:40:06.638 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.638 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.638 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.638 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-10-06T01:40:06.638 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.638 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.638 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.639 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and check device health", 2023-10-06T01:40:06.639 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.639 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.639 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.639 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.639 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_threshold": { 2023-10-06T01:40:06.639 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_threshold", 2023-10-06T01:40:06.639 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.639 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.639 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.639 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7257600", 2023-10-06T01:40:06.639 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.640 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.640 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.640 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-06T01:40:06.640 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.640 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.640 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.640 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.640 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.640 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.640 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.640 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "diskprediction_local", 2023-10-06T01:40:06.640 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.641 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.641 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.641 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.641 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.641 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.641 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.641 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.641 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.641 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.641 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.641 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.642 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.642 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.642 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.642 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.642 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.642 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.642 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.642 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.642 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.642 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.642 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.643 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.643 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.643 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.643 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.643 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.643 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.643 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.643 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.643 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.643 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.643 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.644 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.644 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.644 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.644 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.644 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.644 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.644 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.644 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.644 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.644 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.644 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.644 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.645 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.645 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.645 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.645 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.645 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.645 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.645 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.645 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.645 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.645 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.645 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.646 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.646 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.646 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.646 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.646 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.646 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.646 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.646 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.646 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.646 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.646 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.646 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.647 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.647 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.647 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.647 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.647 INFO:teuthology.orchestra.run.smithi069.stdout: "predict_interval": { 2023-10-06T01:40:06.647 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predict_interval", 2023-10-06T01:40:06.647 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.647 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.647 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.647 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2023-10-06T01:40:06.647 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.648 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.648 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.648 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.648 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.648 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.648 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.648 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.648 INFO:teuthology.orchestra.run.smithi069.stdout: "predictor_model": { 2023-10-06T01:40:06.648 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predictor_model", 2023-10-06T01:40:06.648 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.648 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.648 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.649 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "prophetstor", 2023-10-06T01:40:06.649 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.649 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.649 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.649 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.649 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.649 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.649 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.649 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.649 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-10-06T01:40:06.649 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-10-06T01:40:06.649 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.650 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.650 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.650 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-10-06T01:40:06.650 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.650 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.650 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.650 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.650 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.650 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.650 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.650 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.651 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.651 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.651 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.651 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "influx", 2023-10-06T01:40:06.651 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": false, 2023-10-06T01:40:06.651 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "influxdb python module not found", 2023-10-06T01:40:06.651 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.651 INFO:teuthology.orchestra.run.smithi069.stdout: "batch_size": { 2023-10-06T01:40:06.651 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "batch_size", 2023-10-06T01:40:06.651 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.651 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.651 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.652 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5000", 2023-10-06T01:40:06.652 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.652 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.652 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.652 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-06T01:40:06.652 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.652 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.652 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.652 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.652 INFO:teuthology.orchestra.run.smithi069.stdout: "database": { 2023-10-06T01:40:06.652 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "database", 2023-10-06T01:40:06.653 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.653 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.653 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.653 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "ceph", 2023-10-06T01:40:06.653 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.653 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.653 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.653 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-06T01:40:06.653 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.653 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.654 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.654 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.654 INFO:teuthology.orchestra.run.smithi069.stdout: "hostname": { 2023-10-06T01:40:06.654 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "hostname", 2023-10-06T01:40:06.654 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.654 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.654 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.654 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.654 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.654 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.654 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.655 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server hostname", 2023-10-06T01:40:06.655 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.655 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.655 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.655 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.655 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-10-06T01:40:06.655 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-10-06T01:40:06.655 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.655 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.655 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.655 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "30", 2023-10-06T01:40:06.655 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "5", 2023-10-06T01:40:06.656 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.656 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.656 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-06T01:40:06.656 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.656 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.656 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.656 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.656 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.656 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.656 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.656 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.657 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.657 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.657 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.657 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.657 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.657 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.657 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.657 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.657 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.657 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.657 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.657 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.658 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.658 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.658 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.658 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.658 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.658 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.658 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.658 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.658 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.658 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.658 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.659 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.659 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.659 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.659 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.659 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.659 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.659 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.659 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.659 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.659 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.659 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.660 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.660 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.660 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.660 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.660 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.660 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.660 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.660 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.660 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.660 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.660 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.660 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.661 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.661 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.661 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.661 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.661 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.661 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.661 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.661 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.661 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.661 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.661 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.661 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.662 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.662 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.662 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.662 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.662 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.662 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.662 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.662 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.662 INFO:teuthology.orchestra.run.smithi069.stdout: "password": { 2023-10-06T01:40:06.662 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "password", 2023-10-06T01:40:06.662 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.663 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.663 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.663 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.663 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.663 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.663 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.663 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "password of InfluxDB server user", 2023-10-06T01:40:06.663 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.663 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.663 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.663 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.663 INFO:teuthology.orchestra.run.smithi069.stdout: "port": { 2023-10-06T01:40:06.664 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "port", 2023-10-06T01:40:06.664 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.664 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.664 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.664 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8086", 2023-10-06T01:40:06.664 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.664 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.664 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.664 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server port", 2023-10-06T01:40:06.664 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.664 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.665 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.665 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.665 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2023-10-06T01:40:06.665 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2023-10-06T01:40:06.665 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.665 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.665 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.665 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "false", 2023-10-06T01:40:06.665 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.665 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.665 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.665 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-06T01:40:06.666 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.666 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.666 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.666 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.666 INFO:teuthology.orchestra.run.smithi069.stdout: "threads": { 2023-10-06T01:40:06.666 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threads", 2023-10-06T01:40:06.666 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.666 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.666 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.666 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-10-06T01:40:06.666 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-10-06T01:40:06.666 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "32", 2023-10-06T01:40:06.667 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.667 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-06T01:40:06.667 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.667 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.667 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.667 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.667 INFO:teuthology.orchestra.run.smithi069.stdout: "username": { 2023-10-06T01:40:06.667 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "username", 2023-10-06T01:40:06.667 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.667 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.667 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.667 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.668 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.668 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.668 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.668 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "username of InfluxDB server user", 2023-10-06T01:40:06.668 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.668 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.668 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.668 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.668 INFO:teuthology.orchestra.run.smithi069.stdout: "verify_ssl": { 2023-10-06T01:40:06.668 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "verify_ssl", 2023-10-06T01:40:06.668 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.669 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.669 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.669 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "true", 2023-10-06T01:40:06.669 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.669 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.669 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.669 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-06T01:40:06.669 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.669 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.669 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.669 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.669 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.670 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.670 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.670 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "insights", 2023-10-06T01:40:06.670 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.670 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.670 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.670 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.670 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.670 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.670 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.670 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.671 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.671 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.671 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.671 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.671 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.671 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.671 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.671 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.671 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.671 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.671 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.672 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.672 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.672 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.672 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.672 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.672 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.672 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.672 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.672 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.672 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.672 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.672 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.673 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.673 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.673 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.673 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.673 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.673 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.673 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.673 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.673 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.673 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.673 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.673 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.674 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.674 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.674 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.674 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.674 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.674 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.674 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.674 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.674 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.674 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.674 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.675 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.675 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.675 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.675 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.675 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.675 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.675 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.675 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.675 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.675 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.675 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.675 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.676 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.676 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.676 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.676 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.676 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.676 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.676 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.676 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.676 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.676 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.676 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "iostat", 2023-10-06T01:40:06.676 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.677 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.677 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.677 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.677 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.677 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.677 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.677 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.677 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.677 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.677 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.677 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.677 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.678 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.678 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.678 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.678 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.678 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.678 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.678 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.678 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.678 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.678 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.678 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.679 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.679 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.679 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.679 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.679 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.679 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.679 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.679 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.679 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.679 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.679 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.679 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.680 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.680 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.680 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.680 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.680 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.680 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.680 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.680 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.680 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.680 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.680 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.681 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.681 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.681 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.681 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.681 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.681 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.681 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.681 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.681 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.681 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.681 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.681 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.682 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.682 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.682 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.682 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.682 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.682 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.682 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.682 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.682 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.682 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.682 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.683 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.683 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.683 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.683 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.683 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.683 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.683 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "localpool", 2023-10-06T01:40:06.683 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.683 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.683 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.683 INFO:teuthology.orchestra.run.smithi069.stdout: "failure_domain": { 2023-10-06T01:40:06.683 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "failure_domain", 2023-10-06T01:40:06.684 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.684 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.684 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.684 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "host", 2023-10-06T01:40:06.684 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.684 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.684 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.684 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "failure domain for any created local pool", 2023-10-06T01:40:06.684 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-06T01:40:06.684 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.684 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.684 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.685 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.685 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.685 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.685 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.685 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.685 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.685 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.685 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.685 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.685 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.685 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.685 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.686 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.686 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.686 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.686 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.686 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.686 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.686 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.686 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.686 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.686 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.687 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.687 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.687 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.687 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.687 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.687 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.687 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.687 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.687 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.687 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.687 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.687 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.688 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.688 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.688 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.688 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.688 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.688 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.688 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.688 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.688 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.688 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.688 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.688 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.689 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.689 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.689 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.689 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.689 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.689 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.689 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.689 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.689 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.689 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.689 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.690 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.690 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.690 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.690 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.690 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.690 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.690 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.690 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.690 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.690 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.690 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.690 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.691 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.691 INFO:teuthology.orchestra.run.smithi069.stdout: "min_size": { 2023-10-06T01:40:06.691 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_size", 2023-10-06T01:40:06.691 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.691 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.691 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.691 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.691 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.691 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.691 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.691 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default min_size for any created local pool", 2023-10-06T01:40:06.691 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-06T01:40:06.692 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.692 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.692 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.692 INFO:teuthology.orchestra.run.smithi069.stdout: "num_rep": { 2023-10-06T01:40:06.692 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "num_rep", 2023-10-06T01:40:06.692 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.692 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.692 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.692 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3", 2023-10-06T01:40:06.692 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.692 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.693 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.693 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default replica count for any created local pool", 2023-10-06T01:40:06.693 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.693 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.693 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.693 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.693 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_num": { 2023-10-06T01:40:06.693 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_num", 2023-10-06T01:40:06.693 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.693 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.693 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.693 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "128", 2023-10-06T01:40:06.694 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.694 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.694 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.694 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default pg_num for any created local pool", 2023-10-06T01:40:06.694 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.694 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.694 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.694 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.694 INFO:teuthology.orchestra.run.smithi069.stdout: "prefix": { 2023-10-06T01:40:06.694 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prefix", 2023-10-06T01:40:06.694 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.695 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.695 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.695 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.695 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.695 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.695 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.695 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name prefix for any created local pool", 2023-10-06T01:40:06.695 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.695 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.695 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.695 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.696 INFO:teuthology.orchestra.run.smithi069.stdout: "subtree": { 2023-10-06T01:40:06.696 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "subtree", 2023-10-06T01:40:06.696 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.696 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.696 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.696 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "rack", 2023-10-06T01:40:06.696 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.696 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.696 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.696 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-06T01:40:06.696 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-06T01:40:06.696 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.697 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.697 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.697 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.697 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.697 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.697 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mds_autoscaler", 2023-10-06T01:40:06.697 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.697 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.697 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.697 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.697 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.697 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.698 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.698 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.698 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.698 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.698 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.698 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.698 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.698 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.698 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.698 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.698 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.699 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.699 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.699 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.699 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.699 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.699 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.699 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.699 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.699 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.699 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.699 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.699 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.700 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.700 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.700 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.700 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.700 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.700 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.700 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.700 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.700 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.700 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.700 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.701 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.701 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.701 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.701 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.701 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.701 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.701 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.701 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.701 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.701 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.701 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.701 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.702 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.702 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.702 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.702 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.702 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.702 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.702 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.702 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.702 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.702 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.702 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.703 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.703 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.703 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.703 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.703 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.703 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.703 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.703 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.703 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.703 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.703 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.703 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.704 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.704 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirroring", 2023-10-06T01:40:06.704 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.704 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.704 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.704 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.704 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.704 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.704 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.704 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.704 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.705 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.705 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.705 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.705 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.705 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.705 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.705 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.705 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.705 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.705 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.705 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.705 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.706 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.706 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.706 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.706 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.706 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.706 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.706 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.706 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.706 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.706 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.706 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.706 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.707 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.707 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.707 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.707 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.707 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.707 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.707 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.707 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.707 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.707 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.707 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.708 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.708 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.708 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.708 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.708 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.708 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.708 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.708 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.708 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.708 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.708 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.708 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.709 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.709 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.709 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.709 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.709 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.709 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.709 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.709 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.709 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.709 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.709 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.709 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.710 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.710 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.710 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.710 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.710 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.710 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.710 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.710 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.710 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "nfs", 2023-10-06T01:40:06.710 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.710 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.710 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.711 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.711 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.711 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.711 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.711 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.711 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.711 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.711 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.711 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.711 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.711 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.711 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.712 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.712 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.712 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.712 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.712 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.712 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.712 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.712 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.712 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.712 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.712 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.712 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.713 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.713 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.713 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.713 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.713 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.713 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.713 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.713 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.713 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.713 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.713 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.714 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.714 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.714 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.714 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.714 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.714 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.714 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.714 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.714 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.714 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.714 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.714 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.715 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.715 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.715 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.715 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.715 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.715 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.715 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.715 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.715 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.715 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.715 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.715 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.716 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.716 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.716 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.716 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.716 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.716 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.716 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.716 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.716 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.716 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.716 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.717 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.717 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.717 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.717 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2023-10-06T01:40:06.717 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.717 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.717 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.717 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.717 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.717 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.717 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.717 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.718 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.718 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.718 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.718 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.718 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.718 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.718 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.718 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.718 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.718 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.718 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.718 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.719 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.719 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.719 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.719 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.719 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.719 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.719 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.719 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.719 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.719 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.719 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.720 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.720 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.720 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.720 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.720 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.720 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.720 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.720 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.720 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.720 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.720 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.721 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.721 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.721 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.721 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.721 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.721 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.721 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.721 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.721 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.721 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.721 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.721 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.722 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.722 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.722 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.722 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.722 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.722 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.722 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.722 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.722 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.722 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.722 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.722 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.723 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.723 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.723 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.723 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.723 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.723 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.723 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.723 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator": { 2023-10-06T01:40:06.723 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2023-10-06T01:40:06.723 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.723 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.724 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.724 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.724 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.724 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.724 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.724 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm", 2023-10-06T01:40:06.724 INFO:teuthology.orchestra.run.smithi069.stdout: "rook", 2023-10-06T01:40:06.724 INFO:teuthology.orchestra.run.smithi069.stdout: "test_orchestrator" 2023-10-06T01:40:06.724 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.724 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Orchestrator backend", 2023-10-06T01:40:06.724 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.724 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.725 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.725 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.725 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.725 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.725 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.725 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_perf_query", 2023-10-06T01:40:06.725 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.725 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.725 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.725 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.725 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.726 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.726 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.726 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.726 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.726 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.726 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.726 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.726 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.726 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.726 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.726 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.727 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.727 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.727 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.727 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.727 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.727 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.727 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.727 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.727 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.727 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.727 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.727 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.728 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.728 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.728 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.728 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.728 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.728 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.728 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.728 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.728 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.728 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.728 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.729 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.729 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.729 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.729 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.729 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.729 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.729 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.729 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.729 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.729 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.729 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.729 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.730 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.730 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.730 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.730 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.730 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.730 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.730 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.730 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.730 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.730 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.730 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.731 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.731 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.731 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.731 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.731 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.731 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.731 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.731 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.731 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.731 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.731 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.731 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.732 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.732 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.732 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_support", 2023-10-06T01:40:06.732 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.732 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.732 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.732 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.732 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.732 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.732 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.732 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.733 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.733 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.733 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.733 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.733 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.733 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.733 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.733 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.733 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.733 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.733 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.734 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.734 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.734 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.734 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.734 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.734 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.734 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.734 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.734 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.734 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.734 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.735 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.735 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.735 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.735 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.735 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.735 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.735 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.735 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.735 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.735 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.735 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.735 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.736 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.736 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.736 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.736 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.736 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.736 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.736 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.736 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.736 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.736 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.736 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.737 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.737 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.737 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.737 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.737 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.737 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.737 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.737 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.737 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.737 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.737 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.737 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.738 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.738 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.738 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.738 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.738 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.738 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.738 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.738 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.738 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.738 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.738 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.739 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_autoscaler", 2023-10-06T01:40:06.739 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.739 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.739 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.739 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.739 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.739 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.739 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.739 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.739 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.739 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.739 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.740 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.740 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.740 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.740 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.740 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.740 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.740 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.740 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.740 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.740 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.740 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.740 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.741 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.741 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.741 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.741 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.741 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.741 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.741 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.741 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.741 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.741 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.741 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.742 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.742 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.742 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.742 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.742 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.742 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.742 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.742 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.742 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.742 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.742 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.742 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.743 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.743 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.743 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.743 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.743 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.743 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.743 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.743 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.743 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.743 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.743 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.743 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.744 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.744 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.744 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.744 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.744 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.744 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.744 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.744 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.744 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.744 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.744 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.745 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.745 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.745 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.745 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.745 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-10-06T01:40:06.745 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-10-06T01:40:06.745 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.745 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.745 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.745 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-10-06T01:40:06.745 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.745 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.746 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.746 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.746 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.746 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.746 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.746 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.746 INFO:teuthology.orchestra.run.smithi069.stdout: "threshold": { 2023-10-06T01:40:06.746 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threshold", 2023-10-06T01:40:06.746 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-10-06T01:40:06.746 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.746 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.747 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2023-10-06T01:40:06.747 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1.0", 2023-10-06T01:40:06.747 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.747 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.747 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "scaling threshold", 2023-10-06T01:40:06.747 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-06T01:40:06.747 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.747 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.747 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.747 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.747 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.747 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.748 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "progress", 2023-10-06T01:40:06.748 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.748 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.748 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.748 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_pg_recovery_event": { 2023-10-06T01:40:06.748 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_pg_recovery_event", 2023-10-06T01:40:06.748 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.748 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.748 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.748 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.748 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.748 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.749 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.749 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-06T01:40:06.749 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.749 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.749 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.749 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.749 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2023-10-06T01:40:06.749 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2023-10-06T01:40:06.749 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.749 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.749 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.750 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.750 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.750 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.750 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.750 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.750 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.750 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.750 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.750 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.750 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.750 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.750 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.751 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.751 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.751 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.751 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.751 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.751 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.751 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.751 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.751 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.751 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.751 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.751 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.752 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.752 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.752 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.752 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.752 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.752 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.752 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.752 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.752 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.752 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.752 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.752 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.753 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.753 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.753 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.753 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.753 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.753 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.753 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.753 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.753 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.753 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.753 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.754 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.754 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.754 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.754 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.754 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.754 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.754 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.754 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.754 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.754 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.754 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.755 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.755 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.755 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.755 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.755 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.755 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.755 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.755 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.755 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.755 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.755 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.756 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.756 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.756 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.756 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.756 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.756 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.756 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.756 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.756 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.756 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.756 INFO:teuthology.orchestra.run.smithi069.stdout: "max_completed_events": { 2023-10-06T01:40:06.756 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_completed_events", 2023-10-06T01:40:06.757 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.757 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.757 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.757 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "50", 2023-10-06T01:40:06.757 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.757 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.757 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.757 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "number of past completed events to remember", 2023-10-06T01:40:06.757 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.757 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.757 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.757 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.758 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-10-06T01:40:06.758 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-10-06T01:40:06.758 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.758 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.758 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.758 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-10-06T01:40:06.758 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.758 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.758 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.758 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long the module is going to sleep", 2023-10-06T01:40:06.758 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.758 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.759 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.759 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.759 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.759 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.759 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.759 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus", 2023-10-06T01:40:06.759 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.759 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.759 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.759 INFO:teuthology.orchestra.run.smithi069.stdout: "cache": { 2023-10-06T01:40:06.759 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cache", 2023-10-06T01:40:06.759 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.760 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.760 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.760 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.760 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.760 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.760 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.760 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.760 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.760 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.760 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.760 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.761 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.761 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.761 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.761 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.761 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.761 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.761 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.761 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.761 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.761 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.761 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.761 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.762 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.762 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.762 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.762 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.762 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.762 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.762 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.762 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.762 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.762 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.763 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.763 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.763 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.763 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.763 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.763 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.763 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.763 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.763 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.763 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.763 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.763 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.764 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.764 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.764 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.764 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.764 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.764 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.764 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.764 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.764 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.764 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.764 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.764 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.765 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.765 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.765 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.765 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.765 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.765 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.765 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.765 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.765 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.765 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.765 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.766 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.766 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.766 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.766 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.766 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.766 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.766 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.766 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.766 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.766 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.766 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.766 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.767 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.767 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools": { 2023-10-06T01:40:06.767 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools", 2023-10-06T01:40:06.767 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.767 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.767 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.767 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.767 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.767 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.767 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.767 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.767 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.768 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.768 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.768 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.768 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-06T01:40:06.768 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-06T01:40:06.768 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.768 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.768 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.768 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "300", 2023-10-06T01:40:06.768 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.768 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.769 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.769 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.769 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.769 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.769 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.769 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.769 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_interval": { 2023-10-06T01:40:06.769 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_interval", 2023-10-06T01:40:06.769 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-10-06T01:40:06.769 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.769 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.770 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15.0", 2023-10-06T01:40:06.770 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.770 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.770 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.770 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.770 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.770 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.770 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.770 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.770 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2023-10-06T01:40:06.770 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2023-10-06T01:40:06.771 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.771 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.771 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.771 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2023-10-06T01:40:06.771 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.771 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.771 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.771 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-06T01:40:06.771 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.771 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.771 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.771 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.772 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2023-10-06T01:40:06.772 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2023-10-06T01:40:06.772 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.772 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.772 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.772 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "9283", 2023-10-06T01:40:06.772 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.772 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.772 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.772 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-06T01:40:06.772 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.772 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.773 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.773 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.773 INFO:teuthology.orchestra.run.smithi069.stdout: "stale_cache_strategy": { 2023-10-06T01:40:06.773 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stale_cache_strategy", 2023-10-06T01:40:06.773 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.773 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.773 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.773 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "log", 2023-10-06T01:40:06.773 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.773 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.773 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.774 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.774 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.774 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.774 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.774 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.774 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2023-10-06T01:40:06.774 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2023-10-06T01:40:06.774 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.774 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.774 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.774 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "default", 2023-10-06T01:40:06.774 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.775 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.775 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.775 INFO:teuthology.orchestra.run.smithi069.stdout: "default", 2023-10-06T01:40:06.775 INFO:teuthology.orchestra.run.smithi069.stdout: "error" 2023-10-06T01:40:06.775 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.775 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.775 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.775 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.775 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.775 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.775 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2023-10-06T01:40:06.775 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2023-10-06T01:40:06.776 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.776 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.776 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.776 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2023-10-06T01:40:06.776 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2023-10-06T01:40:06.776 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2023-10-06T01:40:06.776 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.776 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.776 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.776 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.776 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.776 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.777 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.777 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.777 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.777 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_support", 2023-10-06T01:40:06.777 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.777 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.777 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.777 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.777 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.777 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.777 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.777 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.778 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.778 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.778 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.778 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.778 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.778 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.778 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.778 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.778 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.778 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.778 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.778 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.779 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.779 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.779 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.779 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.779 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.779 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.779 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.779 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.779 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.779 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.779 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.780 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.780 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.780 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.780 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.780 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.780 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.780 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.780 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.780 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.780 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.780 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.780 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.781 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.781 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.781 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.781 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.781 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.781 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.781 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.781 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.781 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.781 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.781 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.781 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.782 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.782 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.782 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.782 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.782 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.782 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.782 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.782 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.782 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.782 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.782 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.783 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.783 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.783 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.783 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.783 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.783 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.783 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.783 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_snap_create": { 2023-10-06T01:40:06.783 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_snap_create", 2023-10-06T01:40:06.783 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.783 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.783 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.784 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-10-06T01:40:06.784 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.784 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.784 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.784 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.784 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.784 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.784 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.784 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.784 INFO:teuthology.orchestra.run.smithi069.stdout: "mirror_snapshot_schedule": { 2023-10-06T01:40:06.784 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirror_snapshot_schedule", 2023-10-06T01:40:06.785 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.785 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.785 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.785 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.785 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.785 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.785 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.785 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.785 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.785 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.785 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.786 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.786 INFO:teuthology.orchestra.run.smithi069.stdout: "trash_purge_schedule": { 2023-10-06T01:40:06.786 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "trash_purge_schedule", 2023-10-06T01:40:06.786 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.786 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.786 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.786 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.786 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.786 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.786 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.786 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.787 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.787 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.787 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.787 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.787 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.787 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.787 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.787 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "restful", 2023-10-06T01:40:06.787 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.787 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.787 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.788 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_auth": { 2023-10-06T01:40:06.788 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_auth", 2023-10-06T01:40:06.788 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.788 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.788 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.788 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.788 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.788 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.788 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.788 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.788 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.788 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.789 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.789 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.789 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2023-10-06T01:40:06.789 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2023-10-06T01:40:06.789 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.789 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.789 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.789 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.789 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.789 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.789 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.789 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.790 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.790 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.790 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.790 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.790 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.790 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.790 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.790 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.790 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.790 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.790 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.791 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.791 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.791 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.791 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.791 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.791 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.791 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.791 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.791 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.791 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.791 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.792 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.792 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.792 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.792 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.792 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.792 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.792 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.792 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.792 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.792 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.792 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.792 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.793 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.793 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.793 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.793 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.793 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.793 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.793 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.793 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.793 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.793 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.793 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.793 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.794 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.794 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.794 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.794 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.794 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.794 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.794 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.794 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.794 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.794 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.794 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.794 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.795 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.795 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.795 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.795 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.795 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.795 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.797 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.797 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.797 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.797 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.797 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.797 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.798 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.798 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.798 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.798 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.798 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2023-10-06T01:40:06.798 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2023-10-06T01:40:06.798 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.798 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.798 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.798 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.798 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.798 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.799 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.799 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.799 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.799 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.799 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.799 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.799 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2023-10-06T01:40:06.799 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2023-10-06T01:40:06.799 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.799 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.799 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.800 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.800 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.800 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.800 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.800 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.800 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.800 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.800 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.800 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.800 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.800 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.800 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.801 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rgw", 2023-10-06T01:40:06.801 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.801 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.801 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.801 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.801 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.801 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.801 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.801 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.801 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.801 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.801 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.802 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.802 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.802 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.802 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.802 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.802 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.802 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.802 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.802 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.802 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.802 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.803 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.803 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.803 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.803 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.803 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.803 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.803 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.803 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.803 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.803 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.803 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.803 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.804 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.804 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.804 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.804 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.804 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.804 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.804 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.804 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.804 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.804 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.804 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.804 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.805 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.805 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.805 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.805 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.805 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.805 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.805 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.805 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.805 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.805 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.805 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.806 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.806 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.806 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.806 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.806 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.806 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.806 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.806 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.806 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.806 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.806 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.807 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.807 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.807 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.807 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.807 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.807 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.807 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.807 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.807 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rook", 2023-10-06T01:40:06.807 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.807 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.808 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.808 INFO:teuthology.orchestra.run.smithi069.stdout: "drive_group_interval": { 2023-10-06T01:40:06.808 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "drive_group_interval", 2023-10-06T01:40:06.808 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-10-06T01:40:06.808 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.808 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.808 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "300.0", 2023-10-06T01:40:06.808 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.808 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.808 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.808 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-06T01:40:06.808 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.809 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.809 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.809 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.809 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.809 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.809 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.809 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.809 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.809 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.809 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.809 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.810 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.810 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.810 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.810 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.810 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.810 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.810 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.810 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.810 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.810 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.810 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.811 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.811 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.811 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.811 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.811 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.811 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.811 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.811 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.811 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.811 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.811 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.812 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.812 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.812 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.812 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.812 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.812 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.812 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.812 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.812 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.812 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.812 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.812 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.813 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.813 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.813 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.813 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.813 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.813 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.813 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.813 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.813 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.813 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.813 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.814 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.814 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.814 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.814 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.814 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.814 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.814 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.814 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.814 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.814 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.814 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.815 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.815 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.815 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.815 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.815 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.815 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.815 INFO:teuthology.orchestra.run.smithi069.stdout: "storage_class": { 2023-10-06T01:40:06.815 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "storage_class", 2023-10-06T01:40:06.815 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.815 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.815 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.815 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "local", 2023-10-06T01:40:06.816 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.816 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.816 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.816 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-06T01:40:06.816 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.816 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.816 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.816 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.816 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.816 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.816 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.816 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "selftest", 2023-10-06T01:40:06.817 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.817 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.817 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.817 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.817 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.817 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.817 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.817 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.817 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.817 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.817 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.818 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.818 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.818 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.818 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.818 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.818 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.818 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.818 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.818 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.818 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.818 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.819 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.819 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.819 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.819 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.819 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.819 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.819 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.819 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.819 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.819 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.819 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.819 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.820 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.820 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.820 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.820 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.820 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.820 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.820 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.820 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.820 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.820 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.821 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.821 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.821 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.821 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.821 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.821 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.821 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.821 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.821 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.821 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.821 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.821 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.822 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.822 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.822 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.822 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.822 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.822 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.822 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.822 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.823 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.823 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.823 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.823 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.823 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.823 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.823 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.823 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.823 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.823 INFO:teuthology.orchestra.run.smithi069.stdout: "roption1": { 2023-10-06T01:40:06.823 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption1", 2023-10-06T01:40:06.824 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.824 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.824 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.824 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.824 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.824 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.824 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.824 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.824 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.824 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.824 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.824 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.824 INFO:teuthology.orchestra.run.smithi069.stdout: "roption2": { 2023-10-06T01:40:06.825 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption2", 2023-10-06T01:40:06.825 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.825 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.825 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.825 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "xyz", 2023-10-06T01:40:06.825 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.825 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.825 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.825 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.825 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.825 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.826 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.826 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.826 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption1": { 2023-10-06T01:40:06.826 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption1", 2023-10-06T01:40:06.826 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.826 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.826 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.826 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.826 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.826 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.826 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.826 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.827 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.827 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.827 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.827 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.827 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption2": { 2023-10-06T01:40:06.827 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption2", 2023-10-06T01:40:06.827 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.827 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.827 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.827 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.827 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.827 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.828 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.828 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.828 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.828 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.828 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.828 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.828 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption3": { 2023-10-06T01:40:06.828 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption3", 2023-10-06T01:40:06.828 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-10-06T01:40:06.828 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.828 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.829 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.829 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.829 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.829 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.829 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.829 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.829 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.829 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.829 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.829 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption4": { 2023-10-06T01:40:06.829 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption4", 2023-10-06T01:40:06.829 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.830 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.830 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.830 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.830 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.830 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.830 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.830 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.830 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.830 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.830 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.830 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.831 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption5": { 2023-10-06T01:40:06.831 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption5", 2023-10-06T01:40:06.831 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.831 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.831 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.831 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.831 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.831 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.831 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.831 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.831 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.832 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.832 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.832 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.832 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption6": { 2023-10-06T01:40:06.832 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption6", 2023-10-06T01:40:06.832 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.832 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.832 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.832 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.832 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.832 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.832 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.833 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.833 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.833 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.833 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.833 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.833 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption7": { 2023-10-06T01:40:06.833 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption7", 2023-10-06T01:40:06.833 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.833 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.833 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.833 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.834 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-10-06T01:40:06.834 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "42", 2023-10-06T01:40:06.834 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.834 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.834 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.834 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.834 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.834 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.834 INFO:teuthology.orchestra.run.smithi069.stdout: "testkey": { 2023-10-06T01:40:06.834 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testkey", 2023-10-06T01:40:06.834 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.834 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.835 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.835 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.835 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.835 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.835 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.835 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.835 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.835 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.835 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.835 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.835 INFO:teuthology.orchestra.run.smithi069.stdout: "testlkey": { 2023-10-06T01:40:06.835 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testlkey", 2023-10-06T01:40:06.836 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.836 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.836 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.836 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.836 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.836 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.836 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.836 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.836 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.836 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.836 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.836 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.837 INFO:teuthology.orchestra.run.smithi069.stdout: "testnewline": { 2023-10-06T01:40:06.837 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testnewline", 2023-10-06T01:40:06.837 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.837 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.837 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.837 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.837 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.837 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.837 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.837 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.837 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.837 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.838 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.838 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.838 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.838 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.838 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.838 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snap_schedule", 2023-10-06T01:40:06.838 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.838 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.838 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.838 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_m_granularity": { 2023-10-06T01:40:06.838 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_m_granularity", 2023-10-06T01:40:06.839 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.839 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.839 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.839 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.839 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.839 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.839 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.839 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow minute scheduled snapshots", 2023-10-06T01:40:06.839 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.839 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.839 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.839 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.840 INFO:teuthology.orchestra.run.smithi069.stdout: "dump_on_update": { 2023-10-06T01:40:06.840 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dump_on_update", 2023-10-06T01:40:06.840 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.840 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.840 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.840 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.840 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.840 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.840 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.840 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "dump database to debug log on update", 2023-10-06T01:40:06.840 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.840 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.841 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.841 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.841 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.841 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.841 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.841 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.841 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.841 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.841 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.841 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.841 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.841 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.842 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.842 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.842 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.842 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.842 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.842 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.842 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.842 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.842 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.842 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.842 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.843 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.843 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.843 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.843 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.843 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.843 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.843 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.843 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.843 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.843 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.843 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.843 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.844 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.844 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.844 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.844 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.844 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.844 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.844 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.844 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.844 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.844 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.844 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.845 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.845 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.845 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.845 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.845 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.845 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.845 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.845 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.845 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.845 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.845 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.845 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.846 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.846 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.846 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.846 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.846 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.846 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.846 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.846 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.846 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.846 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.846 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.847 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.847 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.847 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.847 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.847 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.847 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.847 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stats", 2023-10-06T01:40:06.847 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.847 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.847 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.847 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.847 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.848 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.848 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.848 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.848 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.848 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.848 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.848 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.848 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.848 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.848 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.848 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.848 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.849 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.849 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.849 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.849 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.849 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.849 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.849 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.849 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.849 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.849 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.849 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.849 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.850 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.850 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.850 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.850 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.850 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.850 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.850 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.850 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.850 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.850 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.850 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.851 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.851 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.851 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.851 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.851 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.851 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.851 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.851 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.851 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.851 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.851 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.851 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.852 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.852 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.852 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.852 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.852 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.852 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.852 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.852 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.852 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.852 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.852 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.852 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.853 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.853 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.853 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.853 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.853 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.853 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.853 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.853 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.853 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.853 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.853 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.854 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.854 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "status", 2023-10-06T01:40:06.854 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.854 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.854 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.854 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.854 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.854 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.854 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.854 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.854 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.855 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.855 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.855 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.855 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.855 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.855 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.855 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.855 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.855 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.855 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.855 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.855 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.855 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.856 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.856 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.856 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.856 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.856 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.856 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.856 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.856 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.856 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.856 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.856 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.857 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.857 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.857 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.857 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.857 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.857 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.857 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.857 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.857 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.857 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.857 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.857 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.858 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.858 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.858 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.858 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.858 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.858 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.858 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.858 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.858 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.858 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.858 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.859 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.859 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.859 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.859 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.859 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.859 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.859 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.859 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.859 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.859 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.859 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.860 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.860 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.860 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.860 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.860 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.860 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.860 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.860 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.860 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.860 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telegraf", 2023-10-06T01:40:06.860 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.861 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.861 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.861 INFO:teuthology.orchestra.run.smithi069.stdout: "address": { 2023-10-06T01:40:06.861 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "address", 2023-10-06T01:40:06.861 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.861 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.861 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.861 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-06T01:40:06.861 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.861 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.861 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.862 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.862 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.862 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.862 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.862 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.862 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-10-06T01:40:06.862 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-10-06T01:40:06.862 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.862 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.862 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.862 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15", 2023-10-06T01:40:06.863 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.863 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.863 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.863 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.863 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.863 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.863 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.863 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.863 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.863 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.863 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.863 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.864 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.864 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.864 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.864 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.864 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.864 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.864 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.864 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.864 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.864 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.865 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.865 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.865 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.865 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.865 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.865 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.865 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.865 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.865 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.865 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.865 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.866 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.866 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.866 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.866 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.866 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.866 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.866 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.866 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.866 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.866 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.866 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.866 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.867 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.867 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.867 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.867 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.867 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.867 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.867 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.867 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.867 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.867 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.867 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.867 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.868 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.868 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.868 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.868 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.868 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.868 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.868 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.868 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.868 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.868 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.868 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.869 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.869 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.869 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.869 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.869 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.869 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.869 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.869 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.869 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.869 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.869 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.869 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.870 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.870 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telemetry", 2023-10-06T01:40:06.870 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.870 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.870 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.870 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_basic": { 2023-10-06T01:40:06.870 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_basic", 2023-10-06T01:40:06.870 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.870 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.870 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.870 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.870 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.871 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.871 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.871 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-06T01:40:06.871 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.871 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.871 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.871 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.871 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_crash": { 2023-10-06T01:40:06.871 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_crash", 2023-10-06T01:40:06.871 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.871 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.872 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.872 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.872 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.872 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.872 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.872 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-06T01:40:06.872 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.872 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.872 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.872 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.872 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_device": { 2023-10-06T01:40:06.873 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_device", 2023-10-06T01:40:06.873 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.873 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.873 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.873 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.873 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.873 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.873 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.873 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-06T01:40:06.873 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.873 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.874 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.874 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.874 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_ident": { 2023-10-06T01:40:06.874 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_ident", 2023-10-06T01:40:06.874 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.874 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.874 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.874 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.874 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.874 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.874 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.875 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-06T01:40:06.875 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.875 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.875 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.875 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.875 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_perf": { 2023-10-06T01:40:06.875 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_perf", 2023-10-06T01:40:06.875 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.875 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.875 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.875 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.876 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.876 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.876 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.876 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-06T01:40:06.876 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.876 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.876 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.876 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.876 INFO:teuthology.orchestra.run.smithi069.stdout: "contact": { 2023-10-06T01:40:06.876 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "contact", 2023-10-06T01:40:06.876 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.876 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.877 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.877 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.877 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.877 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.877 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.877 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.877 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.877 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.877 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.877 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.877 INFO:teuthology.orchestra.run.smithi069.stdout: "description": { 2023-10-06T01:40:06.877 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "description", 2023-10-06T01:40:06.878 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.878 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.878 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.878 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.878 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.878 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.878 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.878 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.878 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.878 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.878 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.879 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.879 INFO:teuthology.orchestra.run.smithi069.stdout: "device_url": { 2023-10-06T01:40:06.879 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_url", 2023-10-06T01:40:06.879 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.879 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.879 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.879 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-06T01:40:06.879 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.879 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.879 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.879 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.880 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.880 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.880 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.880 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.880 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2023-10-06T01:40:06.880 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2023-10-06T01:40:06.880 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.880 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.880 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.880 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.880 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.881 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.881 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.881 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.881 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.881 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.881 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.881 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.881 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-10-06T01:40:06.881 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-10-06T01:40:06.881 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.881 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.881 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.882 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "24", 2023-10-06T01:40:06.882 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "8", 2023-10-06T01:40:06.882 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.882 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.882 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.882 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.882 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.882 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.882 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.882 INFO:teuthology.orchestra.run.smithi069.stdout: "last_opt_revision": { 2023-10-06T01:40:06.882 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "last_opt_revision", 2023-10-06T01:40:06.882 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.883 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.883 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.883 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1", 2023-10-06T01:40:06.883 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.883 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.883 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.883 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.883 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.883 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.883 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.883 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.884 INFO:teuthology.orchestra.run.smithi069.stdout: "leaderboard": { 2023-10-06T01:40:06.884 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "leaderboard", 2023-10-06T01:40:06.884 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.884 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.884 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.884 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.884 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.884 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.884 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.884 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.884 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.885 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.885 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.885 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.885 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.885 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.885 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.885 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.885 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.885 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.885 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.885 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.885 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.886 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.886 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.886 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.886 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.886 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.886 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.886 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.886 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.886 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.886 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.886 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.887 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.887 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.887 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.887 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.887 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.887 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.887 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.887 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.887 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.887 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.887 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.888 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.888 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.888 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.888 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.888 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.888 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.888 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.888 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.888 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.888 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.888 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.888 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.889 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.889 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.889 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.889 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.889 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.889 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.889 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.889 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.889 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.889 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.889 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.890 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.890 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.890 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.890 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.890 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.890 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.890 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.890 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.890 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.890 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.890 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.890 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.891 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.891 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.891 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.891 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.891 INFO:teuthology.orchestra.run.smithi069.stdout: "organization": { 2023-10-06T01:40:06.891 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "organization", 2023-10-06T01:40:06.891 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.891 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.891 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.891 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.891 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.891 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.892 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.892 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.892 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.892 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.892 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.892 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.892 INFO:teuthology.orchestra.run.smithi069.stdout: "proxy": { 2023-10-06T01:40:06.892 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "proxy", 2023-10-06T01:40:06.892 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.892 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.892 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.893 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.893 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.893 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.893 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.893 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.893 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.893 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.893 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.893 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.893 INFO:teuthology.orchestra.run.smithi069.stdout: "url": { 2023-10-06T01:40:06.893 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url", 2023-10-06T01:40:06.893 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.893 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.894 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.894 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-06T01:40:06.894 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.894 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.894 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.894 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.894 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.894 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.894 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.894 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.894 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.895 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.895 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.895 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "test_orchestrator", 2023-10-06T01:40:06.895 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.895 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.895 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.895 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.895 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.895 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.895 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.895 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.896 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.896 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.896 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.896 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.896 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.896 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.896 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.896 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.896 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.896 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.896 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.896 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.897 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.897 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.897 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.897 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.897 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.897 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.897 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.897 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.897 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.897 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.897 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.897 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.898 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.898 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.898 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.898 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.898 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.898 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.898 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.898 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.898 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.898 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.898 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.899 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.899 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.899 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.899 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.899 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.899 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.899 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.899 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.899 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.899 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.899 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.900 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.900 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.900 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.900 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.900 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.900 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.900 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.900 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.900 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.900 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.901 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.901 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.901 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.901 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.901 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.901 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.901 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.901 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.901 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.901 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.901 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.902 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.902 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "volumes", 2023-10-06T01:40:06.902 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.902 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.902 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.902 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.902 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.902 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.902 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.902 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.902 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.902 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.903 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.903 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.903 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.903 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.903 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.903 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.903 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.903 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.903 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.903 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.903 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.904 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.904 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.904 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.904 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.904 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.904 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.904 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.904 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.904 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.904 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.904 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.905 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.905 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.905 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.905 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.905 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.905 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.905 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.905 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.905 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.905 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.905 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.905 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.906 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.906 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.906 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.906 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.906 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.906 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.906 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.906 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.906 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.906 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.906 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.907 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.907 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.907 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.907 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.907 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.907 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.907 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.907 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.907 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.907 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.907 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.908 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.908 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.908 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.908 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.908 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.908 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.908 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.908 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_clones": { 2023-10-06T01:40:06.908 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_clones", 2023-10-06T01:40:06.908 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.908 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.908 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.909 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4", 2023-10-06T01:40:06.909 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.909 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.909 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.909 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-06T01:40:06.909 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.909 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.909 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.909 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.909 INFO:teuthology.orchestra.run.smithi069.stdout: "snapshot_clone_delay": { 2023-10-06T01:40:06.909 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snapshot_clone_delay", 2023-10-06T01:40:06.910 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.910 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.910 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.910 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-10-06T01:40:06.910 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.910 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.910 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.910 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-06T01:40:06.910 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.910 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.910 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.910 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.911 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.911 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.911 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.911 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix", 2023-10-06T01:40:06.911 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.911 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.911 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.911 INFO:teuthology.orchestra.run.smithi069.stdout: "discovery_interval": { 2023-10-06T01:40:06.911 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "discovery_interval", 2023-10-06T01:40:06.911 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-10-06T01:40:06.911 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.912 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.912 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "100", 2023-10-06T01:40:06.912 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.912 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.912 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.912 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.912 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.912 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.912 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.912 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.912 INFO:teuthology.orchestra.run.smithi069.stdout: "identifier": { 2023-10-06T01:40:06.913 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "identifier", 2023-10-06T01:40:06.913 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.913 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.913 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.913 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.913 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.913 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.913 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.913 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.913 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.913 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.914 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.914 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.914 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-10-06T01:40:06.914 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-10-06T01:40:06.914 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.914 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.914 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.914 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-10-06T01:40:06.914 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.914 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.914 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.915 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.915 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.915 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.915 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.915 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.915 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.915 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.915 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.915 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.915 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.915 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.915 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.916 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.916 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.916 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.916 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.916 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.916 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.916 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.916 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.916 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.916 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.916 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.917 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.917 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.917 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.917 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.917 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.917 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.917 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.917 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.917 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.917 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.917 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.917 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.918 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.918 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.918 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.918 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.918 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.918 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.918 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.918 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.918 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.918 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.918 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.919 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.919 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.919 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.919 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.919 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.919 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.919 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.919 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.919 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.919 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.919 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.919 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.920 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.920 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.920 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.920 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.920 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.920 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.920 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.920 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.920 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.920 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.920 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.921 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.921 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.921 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.921 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.921 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.921 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.921 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_host": { 2023-10-06T01:40:06.921 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_host", 2023-10-06T01:40:06.921 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.921 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.921 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.921 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.922 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.922 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.922 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.922 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.922 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.922 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.922 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.922 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.922 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_port": { 2023-10-06T01:40:06.922 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_port", 2023-10-06T01:40:06.922 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.923 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.923 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.923 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10051", 2023-10-06T01:40:06.923 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.923 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.923 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.923 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.923 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.923 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.923 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.923 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.923 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_sender": { 2023-10-06T01:40:06.924 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_sender", 2023-10-06T01:40:06.924 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.924 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.924 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.924 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-06T01:40:06.924 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.924 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.924 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.924 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.924 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.925 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.925 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.925 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.925 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.925 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.925 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-10-06T01:40:06.925 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.925 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.925 INFO:teuthology.orchestra.run.smithi069.stdout: "modules": [ 2023-10-06T01:40:06.925 INFO:teuthology.orchestra.run.smithi069.stdout: "iostat", 2023-10-06T01:40:06.925 INFO:teuthology.orchestra.run.smithi069.stdout: "nfs", 2023-10-06T01:40:06.925 INFO:teuthology.orchestra.run.smithi069.stdout: "restful" 2023-10-06T01:40:06.926 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.926 INFO:teuthology.orchestra.run.smithi069.stdout: "available_modules": [ 2023-10-06T01:40:06.926 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.926 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "alerts", 2023-10-06T01:40:06.926 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.926 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.926 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.926 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-10-06T01:40:06.926 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-10-06T01:40:06.926 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.926 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.927 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.927 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-10-06T01:40:06.927 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.927 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.927 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.927 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How frequently to reexamine health status", 2023-10-06T01:40:06.927 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.927 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.927 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.927 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.927 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.928 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.928 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.928 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.928 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.928 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.928 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.928 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.928 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.928 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.928 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.928 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.928 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.929 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.929 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.929 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.929 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.929 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.929 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.929 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.929 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.929 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.929 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.929 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.930 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.930 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.930 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.930 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.930 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.930 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.930 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.930 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.930 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.930 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.930 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.931 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.931 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.931 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.931 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.931 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.931 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.931 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.931 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.931 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.931 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.931 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.931 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.932 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.932 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.932 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.932 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.932 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.932 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.932 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.932 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.932 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.932 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.932 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.933 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.933 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.933 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.933 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.933 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.933 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.933 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.933 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.933 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.933 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.933 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.933 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.934 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_destination": { 2023-10-06T01:40:06.934 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_destination", 2023-10-06T01:40:06.934 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.934 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.934 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.934 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.934 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.934 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.934 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.934 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email address to send alerts to", 2023-10-06T01:40:06.934 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.934 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.935 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.935 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.935 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_from_name": { 2023-10-06T01:40:06.935 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_from_name", 2023-10-06T01:40:06.935 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.935 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.935 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.935 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "Ceph", 2023-10-06T01:40:06.935 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.935 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.935 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.936 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email From: name", 2023-10-06T01:40:06.936 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.936 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.936 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.936 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.936 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_host": { 2023-10-06T01:40:06.936 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_host", 2023-10-06T01:40:06.936 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.936 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.936 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.936 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.936 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.937 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.937 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.937 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP server", 2023-10-06T01:40:06.937 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.937 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.937 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.937 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.937 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_password": { 2023-10-06T01:40:06.937 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_password", 2023-10-06T01:40:06.937 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.937 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.937 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.938 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.938 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.938 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.938 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.938 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Password to authenticate with", 2023-10-06T01:40:06.938 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.938 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.938 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.938 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.938 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_port": { 2023-10-06T01:40:06.938 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_port", 2023-10-06T01:40:06.939 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.939 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.939 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.939 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "465", 2023-10-06T01:40:06.939 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.939 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.939 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.939 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP port", 2023-10-06T01:40:06.939 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.939 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.939 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.939 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.940 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_sender": { 2023-10-06T01:40:06.940 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_sender", 2023-10-06T01:40:06.940 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.940 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.940 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.940 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.940 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.940 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.940 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.940 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP envelope sender", 2023-10-06T01:40:06.940 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.940 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.941 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.941 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.941 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_ssl": { 2023-10-06T01:40:06.941 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_ssl", 2023-10-06T01:40:06.941 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.941 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.941 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.941 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.941 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.941 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.941 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.941 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use SSL to connect to SMTP server", 2023-10-06T01:40:06.942 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.942 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.942 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.942 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.942 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_user": { 2023-10-06T01:40:06.942 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_user", 2023-10-06T01:40:06.942 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.942 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.942 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.942 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.942 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.942 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.943 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.943 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "User to authenticate as", 2023-10-06T01:40:06.943 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.943 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.943 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.943 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.943 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.943 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.943 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.943 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "balancer", 2023-10-06T01:40:06.943 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.943 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.944 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.944 INFO:teuthology.orchestra.run.smithi069.stdout: "active": { 2023-10-06T01:40:06.944 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "active", 2023-10-06T01:40:06.944 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.944 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.944 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.944 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.944 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.944 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.944 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.944 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically balance PGs across cluster", 2023-10-06T01:40:06.945 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.945 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.945 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.945 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.945 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_time": { 2023-10-06T01:40:06.945 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_time", 2023-10-06T01:40:06.945 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.945 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.945 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.945 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0000", 2023-10-06T01:40:06.945 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.946 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.946 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.946 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "beginning time of day to automatically balance", 2023-10-06T01:40:06.946 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-06T01:40:06.946 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.946 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.946 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.946 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_weekday": { 2023-10-06T01:40:06.946 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_weekday", 2023-10-06T01:40:06.946 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-10-06T01:40:06.947 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.947 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.947 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-10-06T01:40:06.947 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2023-10-06T01:40:06.947 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "7", 2023-10-06T01:40:06.947 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.947 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2023-10-06T01:40:06.947 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2023-10-06T01:40:06.947 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.947 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.947 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.948 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_max_iterations": { 2023-10-06T01:40:06.948 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_max_iterations", 2023-10-06T01:40:06.948 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-10-06T01:40:06.948 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.948 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.948 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "25", 2023-10-06T01:40:06.948 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-10-06T01:40:06.948 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "250", 2023-10-06T01:40:06.948 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.948 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum number of iterations to attempt optimization", 2023-10-06T01:40:06.948 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.949 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.949 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.949 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.949 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_metrics": { 2023-10-06T01:40:06.949 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_metrics", 2023-10-06T01:40:06.949 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.949 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.949 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.949 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "pgs,objects,bytes", 2023-10-06T01:40:06.949 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.949 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.950 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.950 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "metrics with which to calculate OSD utilization", 2023-10-06T01:40:06.950 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2023-10-06T01:40:06.950 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.950 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.950 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.950 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_step": { 2023-10-06T01:40:06.950 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_step", 2023-10-06T01:40:06.950 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-10-06T01:40:06.950 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.950 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.951 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.5", 2023-10-06T01:40:06.951 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0.001", 2023-10-06T01:40:06.951 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "0.999", 2023-10-06T01:40:06.951 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.951 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "aggressiveness of optimization", 2023-10-06T01:40:06.951 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2023-10-06T01:40:06.951 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.951 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.951 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.951 INFO:teuthology.orchestra.run.smithi069.stdout: "end_time": { 2023-10-06T01:40:06.951 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_time", 2023-10-06T01:40:06.952 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.952 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.952 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.952 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2400", 2023-10-06T01:40:06.952 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.952 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.952 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.952 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ending time of day to automatically balance", 2023-10-06T01:40:06.952 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2023-10-06T01:40:06.952 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.952 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.953 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.953 INFO:teuthology.orchestra.run.smithi069.stdout: "end_weekday": { 2023-10-06T01:40:06.953 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_weekday", 2023-10-06T01:40:06.953 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-10-06T01:40:06.953 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.953 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.953 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7", 2023-10-06T01:40:06.953 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2023-10-06T01:40:06.953 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "7", 2023-10-06T01:40:06.953 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.953 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2023-10-06T01:40:06.954 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 or 7 = Sunday, 1 = Monday, etc.", 2023-10-06T01:40:06.954 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.954 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.954 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.954 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:06.954 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:06.954 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.954 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.954 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.954 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.954 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.955 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.955 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.955 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.955 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.955 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.955 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.955 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.955 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.955 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.955 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.955 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.956 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.956 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.956 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.956 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:06.956 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:06.956 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.956 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.956 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.956 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.956 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.956 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.957 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.957 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.957 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.957 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.957 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.957 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.957 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:06.957 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:06.957 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.957 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.957 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.958 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:06.958 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.958 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.958 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.958 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:06.958 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:06.958 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:06.958 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:06.958 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:06.958 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:06.958 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.959 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.959 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.959 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.959 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.959 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.959 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:06.959 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:06.959 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.959 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.959 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.959 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.960 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.960 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.960 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.960 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:06.960 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.960 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.960 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.960 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.960 INFO:teuthology.orchestra.run.smithi069.stdout: "min_score": { 2023-10-06T01:40:06.960 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_score", 2023-10-06T01:40:06.960 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-10-06T01:40:06.961 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.961 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.961 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-10-06T01:40:06.961 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.961 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.961 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.961 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "minimum score, below which no optimization is attempted", 2023-10-06T01:40:06.961 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.961 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.961 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.961 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.961 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2023-10-06T01:40:06.962 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2023-10-06T01:40:06.962 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.962 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.962 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.962 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "upmap", 2023-10-06T01:40:06.962 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.962 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.962 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:06.962 INFO:teuthology.orchestra.run.smithi069.stdout: "crush-compat", 2023-10-06T01:40:06.962 INFO:teuthology.orchestra.run.smithi069.stdout: "none", 2023-10-06T01:40:06.962 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap" 2023-10-06T01:40:06.963 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:06.963 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Balancer mode", 2023-10-06T01:40:06.963 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.963 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.963 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.963 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.963 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_ids": { 2023-10-06T01:40:06.963 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_ids", 2023-10-06T01:40:06.963 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.963 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.963 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.964 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:06.964 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.964 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.964 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.964 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "pools which the automatic balancing will be limited to", 2023-10-06T01:40:06.964 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.964 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.964 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.964 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.964 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-10-06T01:40:06.964 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-10-06T01:40:06.964 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.965 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.965 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.965 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-10-06T01:40:06.965 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.965 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.965 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.965 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and attempt optimization", 2023-10-06T01:40:06.965 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.965 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.965 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.965 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.966 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_deviation": { 2023-10-06T01:40:06.966 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_deviation", 2023-10-06T01:40:06.966 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.966 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.966 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.966 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-10-06T01:40:06.966 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-10-06T01:40:06.966 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.966 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.966 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "deviation below which no optimization is attempted", 2023-10-06T01:40:06.966 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2023-10-06T01:40:06.966 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.967 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.967 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.967 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_optimizations": { 2023-10-06T01:40:06.967 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_optimizations", 2023-10-06T01:40:06.967 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-10-06T01:40:06.967 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.967 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.967 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-10-06T01:40:06.967 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.967 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.967 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.968 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum upmap optimizations to make per attempt", 2023-10-06T01:40:06.968 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.968 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.968 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.968 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.968 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:06.968 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.968 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:06.968 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cephadm", 2023-10-06T01:40:06.968 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:06.968 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:06.968 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:06.969 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_down_multiplier": { 2023-10-06T01:40:06.969 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_down_multiplier", 2023-10-06T01:40:06.969 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-10-06T01:40:06.969 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.969 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.969 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2023-10-06T01:40:06.969 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.969 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.969 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.969 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2023-10-06T01:40:06.969 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.969 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.970 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.970 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.970 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_refresh_rate": { 2023-10-06T01:40:06.970 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_refresh_rate", 2023-10-06T01:40:06.970 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.970 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.970 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.970 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "20", 2023-10-06T01:40:06.970 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.970 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.970 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.970 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2023-10-06T01:40:06.971 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.971 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.971 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.971 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.971 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_starting_port": { 2023-10-06T01:40:06.971 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_starting_port", 2023-10-06T01:40:06.971 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:06.971 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.971 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.971 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4721", 2023-10-06T01:40:06.971 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.971 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.972 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.972 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2023-10-06T01:40:06.972 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.972 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.972 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.972 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.972 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_ptrace": { 2023-10-06T01:40:06.972 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_ptrace", 2023-10-06T01:40:06.972 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.972 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.972 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.972 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.973 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.973 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.973 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.973 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2023-10-06T01:40:06.973 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2023-10-06T01:40:06.973 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.973 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.973 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.973 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_interval": { 2023-10-06T01:40:06.973 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_interval", 2023-10-06T01:40:06.973 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.974 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.974 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.974 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-10-06T01:40:06.974 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.974 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.974 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.974 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to autotune daemon memory", 2023-10-06T01:40:06.974 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.974 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.974 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.975 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.975 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_memory_target_ratio": { 2023-10-06T01:40:06.975 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_memory_target_ratio", 2023-10-06T01:40:06.975 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-10-06T01:40:06.975 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.975 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.975 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.7", 2023-10-06T01:40:06.975 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.975 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.975 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.975 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2023-10-06T01:40:06.976 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.976 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.976 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.976 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.976 INFO:teuthology.orchestra.run.smithi069.stdout: "cgroups_split": { 2023-10-06T01:40:06.976 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cgroups_split", 2023-10-06T01:40:06.976 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.976 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.976 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.976 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.976 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.976 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.976 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.977 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2023-10-06T01:40:06.977 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.977 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.977 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.977 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.977 INFO:teuthology.orchestra.run.smithi069.stdout: "config_checks_enabled": { 2023-10-06T01:40:06.977 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_checks_enabled", 2023-10-06T01:40:06.977 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.977 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.977 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.977 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.977 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.978 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.978 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.978 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2023-10-06T01:40:06.978 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.978 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.978 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.978 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.978 INFO:teuthology.orchestra.run.smithi069.stdout: "config_dashboard": { 2023-10-06T01:40:06.978 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_dashboard", 2023-10-06T01:40:06.978 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.978 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.978 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.979 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.979 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.979 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.979 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.979 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2023-10-06T01:40:06.979 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.979 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.979 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.979 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.979 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_alertmanager": { 2023-10-06T01:40:06.979 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_alertmanager", 2023-10-06T01:40:06.979 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.980 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.980 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.980 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2023-10-06T01:40:06.980 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.980 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.980 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.980 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-10-06T01:40:06.980 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.980 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.980 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.980 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.980 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_base": { 2023-10-06T01:40:06.981 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_base", 2023-10-06T01:40:06.981 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.981 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.981 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:06.981 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/ceph", 2023-10-06T01:40:06.981 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.981 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.981 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.981 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Container image name, without the tag", 2023-10-06T01:40:06.981 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.981 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.982 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.982 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.982 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_grafana": { 2023-10-06T01:40:06.982 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_grafana", 2023-10-06T01:40:06.982 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.982 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.982 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.982 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/ceph-grafana:9.4.7", 2023-10-06T01:40:06.982 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.982 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.982 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.982 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-10-06T01:40:06.983 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.983 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.983 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.983 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.983 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_haproxy": { 2023-10-06T01:40:06.983 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_haproxy", 2023-10-06T01:40:06.983 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.983 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.983 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.983 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2023-10-06T01:40:06.983 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.983 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.984 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.984 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "HAproxy container image", 2023-10-06T01:40:06.984 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.984 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.984 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.984 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.984 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_keepalived": { 2023-10-06T01:40:06.984 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_keepalived", 2023-10-06T01:40:06.984 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.984 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.984 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.984 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/keepalived:2.1.5", 2023-10-06T01:40:06.985 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.985 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.985 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.985 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Keepalived container image", 2023-10-06T01:40:06.985 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.985 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.985 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.985 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.985 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_loki": { 2023-10-06T01:40:06.985 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_loki", 2023-10-06T01:40:06.986 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.986 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.986 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.986 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2023-10-06T01:40:06.986 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.986 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.986 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.986 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Loki container image", 2023-10-06T01:40:06.986 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.986 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.986 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.986 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.987 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_node_exporter": { 2023-10-06T01:40:06.987 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_node_exporter", 2023-10-06T01:40:06.987 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.987 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.987 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.987 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2023-10-06T01:40:06.987 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.987 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.987 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.987 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-10-06T01:40:06.987 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.987 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.988 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.988 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.988 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_prometheus": { 2023-10-06T01:40:06.988 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_prometheus", 2023-10-06T01:40:06.988 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.988 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.988 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.988 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2023-10-06T01:40:06.988 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.988 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.988 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.988 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2023-10-06T01:40:06.989 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.989 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.989 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.989 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.989 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_promtail": { 2023-10-06T01:40:06.989 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_promtail", 2023-10-06T01:40:06.989 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.989 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.989 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.989 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2023-10-06T01:40:06.989 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.989 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.990 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.990 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Promtail container image", 2023-10-06T01:40:06.990 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.990 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.990 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.990 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.990 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_snmp_gateway": { 2023-10-06T01:40:06.990 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_snmp_gateway", 2023-10-06T01:40:06.990 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.990 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.990 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.991 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2023-10-06T01:40:06.991 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.991 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.991 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.991 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SNMP Gateway container image", 2023-10-06T01:40:06.991 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.991 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.991 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.991 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.991 INFO:teuthology.orchestra.run.smithi069.stdout: "container_init": { 2023-10-06T01:40:06.991 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_init", 2023-10-06T01:40:06.991 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.992 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.992 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.992 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:06.992 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.992 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.992 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.992 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Run podman/docker with `--init`", 2023-10-06T01:40:06.992 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.992 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.992 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.992 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.992 INFO:teuthology.orchestra.run.smithi069.stdout: "daemon_cache_timeout": { 2023-10-06T01:40:06.993 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "daemon_cache_timeout", 2023-10-06T01:40:06.993 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.993 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.993 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.993 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-10-06T01:40:06.993 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.993 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.993 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.993 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache service (daemon) inventory", 2023-10-06T01:40:06.993 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.993 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.993 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.994 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.994 INFO:teuthology.orchestra.run.smithi069.stdout: "default_cephadm_command_timeout": { 2023-10-06T01:40:06.994 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_cephadm_command_timeout", 2023-10-06T01:40:06.994 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.994 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.994 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.994 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "900", 2023-10-06T01:40:06.994 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.994 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.994 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.994 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2023-10-06T01:40:06.994 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.995 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.995 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.995 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.995 INFO:teuthology.orchestra.run.smithi069.stdout: "default_registry": { 2023-10-06T01:40:06.995 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_registry", 2023-10-06T01:40:06.995 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:06.995 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.995 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.995 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io", 2023-10-06T01:40:06.995 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.995 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.995 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.996 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2023-10-06T01:40:06.996 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.996 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.996 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.996 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.996 INFO:teuthology.orchestra.run.smithi069.stdout: "device_cache_timeout": { 2023-10-06T01:40:06.996 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_cache_timeout", 2023-10-06T01:40:06.996 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.996 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.996 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.996 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1800", 2023-10-06T01:40:06.997 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.997 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.997 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.997 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache device inventory", 2023-10-06T01:40:06.997 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.997 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.997 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.997 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.997 INFO:teuthology.orchestra.run.smithi069.stdout: "device_enhanced_scan": { 2023-10-06T01:40:06.997 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_enhanced_scan", 2023-10-06T01:40:06.997 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:06.997 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.998 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.998 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:06.998 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.998 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.998 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.998 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use libstoragemgmt during device scans", 2023-10-06T01:40:06.998 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:06.998 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:06.998 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:06.998 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:06.998 INFO:teuthology.orchestra.run.smithi069.stdout: "facts_cache_timeout": { 2023-10-06T01:40:06.999 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "facts_cache_timeout", 2023-10-06T01:40:06.999 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:06.999 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:06.999 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:06.999 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-10-06T01:40:06.999 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:06.999 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:06.999 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:06.999 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache host facts data", 2023-10-06T01:40:06.999 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.001 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.002 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.002 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.002 INFO:teuthology.orchestra.run.smithi069.stdout: "host_check_interval": { 2023-10-06T01:40:07.002 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "host_check_interval", 2023-10-06T01:40:07.002 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:07.002 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.002 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.002 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-10-06T01:40:07.002 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.002 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.002 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.003 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to perform a host check", 2023-10-06T01:40:07.003 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.003 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.003 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.003 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.003 INFO:teuthology.orchestra.run.smithi069.stdout: "inventory_list_all": { 2023-10-06T01:40:07.003 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "inventory_list_all", 2023-10-06T01:40:07.003 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.003 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.003 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.003 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.003 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.004 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.004 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.004 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2023-10-06T01:40:07.004 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.004 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.004 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.004 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.004 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.004 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.004 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.004 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.004 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.005 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.005 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.005 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.005 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.005 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.005 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.005 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.005 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.005 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.005 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.005 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.005 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.006 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.006 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.006 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.006 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.006 INFO:teuthology.orchestra.run.smithi069.stdout: "log_refresh_metadata": { 2023-10-06T01:40:07.006 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_refresh_metadata", 2023-10-06T01:40:07.006 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.006 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.006 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.006 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.006 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.006 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.007 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.007 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2023-10-06T01:40:07.007 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.007 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.007 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.007 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.007 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.007 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.007 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.007 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.007 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.007 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.008 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.008 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.008 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.008 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2023-10-06T01:40:07.008 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.008 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.008 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.008 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.008 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.008 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.008 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.008 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.009 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.009 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.009 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.009 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.009 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.009 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.009 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.009 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.009 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.009 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.009 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.009 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.010 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.010 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.010 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.010 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.010 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.010 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.010 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.010 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.010 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.010 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.010 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.010 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.011 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.011 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.011 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.011 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.011 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.011 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.011 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.011 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf": { 2023-10-06T01:40:07.011 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf", 2023-10-06T01:40:07.011 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.011 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.011 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.012 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.012 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.012 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.012 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.012 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2023-10-06T01:40:07.012 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.012 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.012 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.012 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.012 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2023-10-06T01:40:07.012 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2023-10-06T01:40:07.012 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.013 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.013 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.013 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "*", 2023-10-06T01:40:07.013 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.013 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.013 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.013 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2023-10-06T01:40:07.013 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.013 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.013 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.013 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.014 INFO:teuthology.orchestra.run.smithi069.stdout: "max_count_per_host": { 2023-10-06T01:40:07.014 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_count_per_host", 2023-10-06T01:40:07.014 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.014 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.014 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.014 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-10-06T01:40:07.014 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.014 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.014 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.014 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of daemons per service per host", 2023-10-06T01:40:07.014 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.014 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.015 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.015 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.015 INFO:teuthology.orchestra.run.smithi069.stdout: "max_osd_draining_count": { 2023-10-06T01:40:07.015 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_osd_draining_count", 2023-10-06T01:40:07.015 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.015 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.015 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.015 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-10-06T01:40:07.015 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.015 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.015 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.015 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2023-10-06T01:40:07.015 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.016 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.016 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.016 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.016 INFO:teuthology.orchestra.run.smithi069.stdout: "migration_current": { 2023-10-06T01:40:07.016 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "migration_current", 2023-10-06T01:40:07.016 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.016 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.016 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.016 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.016 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.016 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.016 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.017 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "internal - do not modify", 2023-10-06T01:40:07.017 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.017 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.017 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.017 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.017 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2023-10-06T01:40:07.017 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2023-10-06T01:40:07.017 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.017 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.017 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.017 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "root", 2023-10-06T01:40:07.017 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.018 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.018 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.018 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm-package", 2023-10-06T01:40:07.018 INFO:teuthology.orchestra.run.smithi069.stdout: "root" 2023-10-06T01:40:07.018 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.018 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "mode for remote execution of cephadm", 2023-10-06T01:40:07.018 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.018 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.018 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.018 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.018 INFO:teuthology.orchestra.run.smithi069.stdout: "prometheus_alerts_path": { 2023-10-06T01:40:07.018 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus_alerts_path", 2023-10-06T01:40:07.019 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.019 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.019 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.019 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2023-10-06T01:40:07.019 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.019 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.019 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.019 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "location of alerts to include in prometheus deployments", 2023-10-06T01:40:07.019 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.019 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.019 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.019 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.020 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_insecure": { 2023-10-06T01:40:07.020 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_insecure", 2023-10-06T01:40:07.020 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.020 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.020 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.020 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.020 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.020 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.020 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.020 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2023-10-06T01:40:07.020 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.020 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.021 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.021 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.021 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_password": { 2023-10-06T01:40:07.021 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_password", 2023-10-06T01:40:07.021 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.021 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.021 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.021 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.021 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.021 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.021 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.021 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2023-10-06T01:40:07.022 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.022 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.022 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.022 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.022 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_url": { 2023-10-06T01:40:07.022 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_url", 2023-10-06T01:40:07.022 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.022 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.022 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.022 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.022 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.023 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.023 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.023 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2023-10-06T01:40:07.023 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.023 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.023 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.023 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.023 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_username": { 2023-10-06T01:40:07.023 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_username", 2023-10-06T01:40:07.023 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.023 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.023 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.024 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.024 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.024 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.024 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.024 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2023-10-06T01:40:07.024 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.024 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.024 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.024 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.024 INFO:teuthology.orchestra.run.smithi069.stdout: "ssh_config_file": { 2023-10-06T01:40:07.024 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssh_config_file", 2023-10-06T01:40:07.024 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.025 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.025 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.025 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.025 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.025 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.025 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.025 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "customized SSH config file to connect to managed hosts", 2023-10-06T01:40:07.025 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.025 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.025 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.025 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.025 INFO:teuthology.orchestra.run.smithi069.stdout: "use_agent": { 2023-10-06T01:40:07.026 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_agent", 2023-10-06T01:40:07.026 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.026 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.026 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.026 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.026 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.026 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.026 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.026 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2023-10-06T01:40:07.026 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.026 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.027 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.027 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.027 INFO:teuthology.orchestra.run.smithi069.stdout: "use_repo_digest": { 2023-10-06T01:40:07.027 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_repo_digest", 2023-10-06T01:40:07.027 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.027 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.027 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.027 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.027 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.027 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.027 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.027 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2023-10-06T01:40:07.028 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.028 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.028 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.028 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.028 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_failed_host_check": { 2023-10-06T01:40:07.028 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_failed_host_check", 2023-10-06T01:40:07.028 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.028 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.028 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.028 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.028 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.028 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.029 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.029 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if the host check fails", 2023-10-06T01:40:07.029 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.029 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.029 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.029 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.029 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_daemons": { 2023-10-06T01:40:07.029 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_daemons", 2023-10-06T01:40:07.029 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.029 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.029 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.029 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.030 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.030 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.030 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.030 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2023-10-06T01:40:07.030 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.030 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.030 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.030 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.030 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_hosts": { 2023-10-06T01:40:07.030 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_hosts", 2023-10-06T01:40:07.030 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.030 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.031 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.031 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.031 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.031 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.031 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.031 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2023-10-06T01:40:07.031 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.031 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.031 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.031 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.031 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.031 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.031 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.032 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crash", 2023-10-06T01:40:07.032 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.032 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.032 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.032 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.032 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.032 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.032 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.032 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.032 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.032 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.033 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.033 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.033 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.033 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.033 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.033 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.033 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.033 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.033 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.033 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.033 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.033 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.034 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.034 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.034 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.034 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.034 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.034 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.034 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.034 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.034 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.034 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.034 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.034 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.035 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.035 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.035 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.035 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.035 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.035 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.035 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.035 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.035 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.035 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.035 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.035 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.036 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.036 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.036 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.036 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.036 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.036 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.036 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.036 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.036 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.036 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.036 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.036 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.037 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.037 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.037 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.037 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.037 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.037 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.037 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.037 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.037 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.037 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.037 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.037 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.038 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.038 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.038 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.038 INFO:teuthology.orchestra.run.smithi069.stdout: "retain_interval": { 2023-10-06T01:40:07.038 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retain_interval", 2023-10-06T01:40:07.038 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:07.038 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.038 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.038 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "31536000", 2023-10-06T01:40:07.038 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.038 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.038 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.039 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain crashes before pruning them", 2023-10-06T01:40:07.039 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.039 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.039 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.039 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.039 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_recent_interval": { 2023-10-06T01:40:07.039 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_recent_interval", 2023-10-06T01:40:07.039 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:07.039 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.039 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.039 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1209600", 2023-10-06T01:40:07.039 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.040 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.040 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.040 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "time interval in which to warn about recent crashes", 2023-10-06T01:40:07.040 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.040 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.040 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.040 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.040 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.040 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.040 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.040 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dashboard", 2023-10-06T01:40:07.040 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.041 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.041 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.041 INFO:teuthology.orchestra.run.smithi069.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2023-10-06T01:40:07.041 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2023-10-06T01:40:07.041 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.041 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.041 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.041 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-10-06T01:40:07.041 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.041 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.041 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.041 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.042 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.042 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.042 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.042 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.042 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_HOST": { 2023-10-06T01:40:07.042 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_HOST", 2023-10-06T01:40:07.042 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.042 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.042 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.042 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.042 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.042 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.043 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.043 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.043 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.043 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.043 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.043 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.043 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2023-10-06T01:40:07.043 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2023-10-06T01:40:07.043 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.043 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.043 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.043 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.044 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.044 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.044 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.044 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.044 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.044 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.044 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.044 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.044 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_ENABLED": { 2023-10-06T01:40:07.044 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_ENABLED", 2023-10-06T01:40:07.044 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.044 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.045 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.045 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.045 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.045 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.045 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.045 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.045 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.045 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.045 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.045 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.045 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_LOG_PAYLOAD": { 2023-10-06T01:40:07.045 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2023-10-06T01:40:07.046 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.046 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.046 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.046 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.046 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.046 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.046 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.046 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.046 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.046 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.046 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.046 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.047 INFO:teuthology.orchestra.run.smithi069.stdout: "ENABLE_BROWSABLE_API": { 2023-10-06T01:40:07.047 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ENABLE_BROWSABLE_API", 2023-10-06T01:40:07.047 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.047 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.047 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.047 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.047 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.047 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.047 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.047 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.047 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.047 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.048 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.048 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.048 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_CEPHFS": { 2023-10-06T01:40:07.048 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2023-10-06T01:40:07.048 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.048 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.048 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.048 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.048 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.048 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.048 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.048 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.049 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.049 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.049 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.049 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.049 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2023-10-06T01:40:07.049 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2023-10-06T01:40:07.049 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.049 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.049 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.049 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.049 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.049 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.050 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.050 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.050 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.050 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.050 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.050 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.050 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_ISCSI": { 2023-10-06T01:40:07.050 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2023-10-06T01:40:07.050 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.050 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.050 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.051 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.051 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.051 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.051 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.051 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.051 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.051 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.051 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.051 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.051 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_MIRRORING": { 2023-10-06T01:40:07.051 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2023-10-06T01:40:07.051 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.052 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.052 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.052 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.052 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.052 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.052 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.052 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.052 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.052 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.052 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.052 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.052 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_NFS": { 2023-10-06T01:40:07.053 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_NFS", 2023-10-06T01:40:07.053 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.053 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.053 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.053 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.053 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.053 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.053 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.053 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.053 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.053 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.053 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.054 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.054 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RBD": { 2023-10-06T01:40:07.054 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RBD", 2023-10-06T01:40:07.054 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.054 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.054 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.054 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.054 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.054 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.054 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.054 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.054 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.055 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.055 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.055 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.055 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RGW": { 2023-10-06T01:40:07.055 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RGW", 2023-10-06T01:40:07.055 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.055 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.055 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.055 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.055 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.055 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.056 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.056 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.056 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.056 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.056 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.056 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.056 INFO:teuthology.orchestra.run.smithi069.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2023-10-06T01:40:07.056 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2023-10-06T01:40:07.056 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.056 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.057 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.057 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.057 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.057 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.057 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.057 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.057 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.057 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.057 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.057 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.057 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_PASSWORD": { 2023-10-06T01:40:07.057 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_PASSWORD", 2023-10-06T01:40:07.058 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.058 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.058 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.058 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-10-06T01:40:07.058 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.058 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.058 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.058 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.058 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.058 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.058 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.059 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.059 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_SSL_VERIFY": { 2023-10-06T01:40:07.059 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2023-10-06T01:40:07.059 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.059 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.059 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.059 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.059 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.059 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.059 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.059 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.059 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.060 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.060 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.060 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.060 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_URL": { 2023-10-06T01:40:07.060 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_URL", 2023-10-06T01:40:07.060 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.060 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.060 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.060 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.060 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.060 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.060 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.061 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.061 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.061 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.061 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.061 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.061 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_USERNAME": { 2023-10-06T01:40:07.061 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_USERNAME", 2023-10-06T01:40:07.061 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.061 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.061 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.061 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-10-06T01:40:07.061 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.062 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.062 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.062 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.062 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.062 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.062 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.062 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.062 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_FRONTEND_API_URL": { 2023-10-06T01:40:07.062 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2023-10-06T01:40:07.062 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.062 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.062 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.063 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.063 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.063 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.063 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.063 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.063 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.063 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.063 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.063 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.063 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2023-10-06T01:40:07.063 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2023-10-06T01:40:07.063 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.064 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.064 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.064 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.064 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.064 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.064 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.064 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.064 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.064 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.064 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.064 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.065 INFO:teuthology.orchestra.run.smithi069.stdout: "ISCSI_API_SSL_VERIFICATION": { 2023-10-06T01:40:07.065 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2023-10-06T01:40:07.065 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.065 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.065 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.065 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.065 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.065 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.065 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.065 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.065 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.065 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.066 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.066 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.066 INFO:teuthology.orchestra.run.smithi069.stdout: "ISSUE_TRACKER_API_KEY": { 2023-10-06T01:40:07.066 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISSUE_TRACKER_API_KEY", 2023-10-06T01:40:07.066 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.066 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.066 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.066 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.066 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.066 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.066 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.067 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.067 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.067 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.067 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.067 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.067 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_HOST": { 2023-10-06T01:40:07.067 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_HOST", 2023-10-06T01:40:07.067 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.067 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.067 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.067 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.067 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.068 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.068 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.068 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.068 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.068 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.068 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.068 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.068 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2023-10-06T01:40:07.068 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2023-10-06T01:40:07.068 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.068 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.068 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.069 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.069 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.069 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.069 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.069 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.069 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.069 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.069 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.069 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.069 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2023-10-06T01:40:07.069 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2023-10-06T01:40:07.070 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.070 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.070 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.070 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.070 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.070 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.070 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.070 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.070 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.070 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.070 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.070 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.071 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2023-10-06T01:40:07.071 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2023-10-06T01:40:07.071 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.071 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.071 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.071 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.071 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.071 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.071 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.071 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.071 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.071 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.072 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.072 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.072 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2023-10-06T01:40:07.072 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2023-10-06T01:40:07.072 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.072 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.072 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.072 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.072 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.072 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.072 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.073 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.073 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.073 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.073 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.073 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.073 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2023-10-06T01:40:07.073 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2023-10-06T01:40:07.073 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.073 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.073 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.073 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.073 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.073 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.074 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.074 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.074 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.074 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.074 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.074 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.074 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2023-10-06T01:40:07.074 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2023-10-06T01:40:07.074 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.074 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.075 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.075 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.075 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.075 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.075 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.075 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.075 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.075 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.075 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.075 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.075 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2023-10-06T01:40:07.076 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2023-10-06T01:40:07.076 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.076 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.076 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.076 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.076 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.076 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.076 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.076 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.076 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.076 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.076 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.077 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.077 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2023-10-06T01:40:07.077 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2023-10-06T01:40:07.077 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.077 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.077 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.077 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.077 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.077 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.077 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.077 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.077 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.078 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.078 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.078 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.078 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_ENABLED": { 2023-10-06T01:40:07.078 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_ENABLED", 2023-10-06T01:40:07.078 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.078 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.078 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.078 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.078 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.079 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.079 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.079 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.079 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.079 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.079 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.079 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.079 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2023-10-06T01:40:07.079 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2023-10-06T01:40:07.079 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.079 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.079 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.080 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2023-10-06T01:40:07.080 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.080 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.080 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.080 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.080 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.080 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.080 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.080 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.080 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2023-10-06T01:40:07.080 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2023-10-06T01:40:07.081 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.081 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.081 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.081 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-10-06T01:40:07.081 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.081 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.081 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.081 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.081 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.081 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.081 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.081 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.082 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_LENGTH": { 2023-10-06T01:40:07.082 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2023-10-06T01:40:07.082 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.082 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.082 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.082 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8", 2023-10-06T01:40:07.082 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.082 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.082 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.082 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.082 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.082 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.083 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.083 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.083 INFO:teuthology.orchestra.run.smithi069.stdout: "REST_REQUESTS_TIMEOUT": { 2023-10-06T01:40:07.083 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "REST_REQUESTS_TIMEOUT", 2023-10-06T01:40:07.083 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.083 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.083 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.083 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "45", 2023-10-06T01:40:07.083 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.083 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.083 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.083 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.084 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.084 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.084 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.084 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.084 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ACCESS_KEY": { 2023-10-06T01:40:07.084 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ACCESS_KEY", 2023-10-06T01:40:07.084 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.084 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.084 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.084 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.084 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.084 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.085 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.085 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.085 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.085 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.085 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.085 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.085 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ADMIN_RESOURCE": { 2023-10-06T01:40:07.085 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2023-10-06T01:40:07.085 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.085 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.085 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.085 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2023-10-06T01:40:07.086 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.086 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.086 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.086 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.086 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.086 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.086 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.086 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.086 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SECRET_KEY": { 2023-10-06T01:40:07.086 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SECRET_KEY", 2023-10-06T01:40:07.086 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.086 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.087 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.087 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.087 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.087 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.087 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.087 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.087 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.087 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.087 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.087 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.087 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SSL_VERIFY": { 2023-10-06T01:40:07.088 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SSL_VERIFY", 2023-10-06T01:40:07.088 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.088 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.088 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.088 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.088 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.088 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.088 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.088 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.088 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.088 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.089 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.089 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.089 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_SPAN": { 2023-10-06T01:40:07.089 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2023-10-06T01:40:07.089 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.089 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.089 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.089 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-10-06T01:40:07.089 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.089 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.089 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.089 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.089 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.090 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.090 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.090 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.090 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2023-10-06T01:40:07.090 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2023-10-06T01:40:07.090 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.090 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.090 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.090 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-10-06T01:40:07.090 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.091 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.091 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.091 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.091 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.091 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.091 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.091 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.091 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2023-10-06T01:40:07.091 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2023-10-06T01:40:07.091 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.091 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.091 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.092 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-10-06T01:40:07.092 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.092 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.092 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.092 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.092 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.092 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.092 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.092 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.092 INFO:teuthology.orchestra.run.smithi069.stdout: "cross_origin_url": { 2023-10-06T01:40:07.092 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cross_origin_url", 2023-10-06T01:40:07.092 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.093 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.093 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.093 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.093 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.093 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.093 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.093 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.093 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.093 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.093 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.093 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.093 INFO:teuthology.orchestra.run.smithi069.stdout: "crt_file": { 2023-10-06T01:40:07.094 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crt_file", 2023-10-06T01:40:07.094 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.094 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.094 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.094 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.094 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.094 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.094 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.094 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.094 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.094 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.095 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.095 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.095 INFO:teuthology.orchestra.run.smithi069.stdout: "debug": { 2023-10-06T01:40:07.095 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "debug", 2023-10-06T01:40:07.095 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.095 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.095 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.095 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.095 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.095 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.095 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.096 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable/disable debug options", 2023-10-06T01:40:07.096 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.096 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.096 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.096 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.096 INFO:teuthology.orchestra.run.smithi069.stdout: "jwt_token_ttl": { 2023-10-06T01:40:07.096 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "jwt_token_ttl", 2023-10-06T01:40:07.096 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.096 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.096 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.096 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "28800", 2023-10-06T01:40:07.096 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.097 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.097 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.097 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.097 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.097 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.097 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.097 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.097 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2023-10-06T01:40:07.097 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2023-10-06T01:40:07.097 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.097 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.097 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.098 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.098 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.098 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.098 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.098 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.098 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.098 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.098 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.098 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.098 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.098 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.099 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.099 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.099 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.099 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.099 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.099 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.099 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.099 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.099 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.099 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.099 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.099 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.100 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.100 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.100 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.100 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.100 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.100 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.100 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.100 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.100 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.100 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.100 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.100 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.101 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.101 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.101 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.101 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.101 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.101 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.101 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.101 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.101 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.101 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.101 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.102 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.102 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.102 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.102 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.102 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.102 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.102 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.102 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.102 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.102 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.102 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.102 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.103 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.103 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.103 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.103 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.103 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.103 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.103 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.103 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.103 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.103 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.103 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.103 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.104 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.104 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.104 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.104 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.104 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.104 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.104 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.104 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.104 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.104 INFO:teuthology.orchestra.run.smithi069.stdout: "motd": { 2023-10-06T01:40:07.104 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "motd", 2023-10-06T01:40:07.105 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.105 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.105 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.105 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.105 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.105 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.105 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.105 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "The message of the day", 2023-10-06T01:40:07.105 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.105 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.105 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.106 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.106 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect_resolve_ip_addr": { 2023-10-06T01:40:07.106 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "redirect_resolve_ip_addr", 2023-10-06T01:40:07.106 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.106 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.106 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.106 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.106 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.106 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.106 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.106 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.107 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.107 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.107 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.107 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.107 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2023-10-06T01:40:07.107 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2023-10-06T01:40:07.107 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.107 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.107 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.107 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2023-10-06T01:40:07.107 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.108 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.108 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.108 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.108 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.108 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.108 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.108 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.108 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2023-10-06T01:40:07.108 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2023-10-06T01:40:07.108 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.108 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.108 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.109 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8080", 2023-10-06T01:40:07.109 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.109 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.109 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.109 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.109 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.109 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.109 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.109 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.109 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2023-10-06T01:40:07.110 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2023-10-06T01:40:07.110 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.110 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.110 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.110 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.110 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.110 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.110 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.110 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.110 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.110 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.111 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.111 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.111 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl_server_port": { 2023-10-06T01:40:07.111 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl_server_port", 2023-10-06T01:40:07.111 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.111 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.111 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.111 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8443", 2023-10-06T01:40:07.111 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.111 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.111 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.112 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.112 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.112 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.112 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.112 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.112 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2023-10-06T01:40:07.112 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2023-10-06T01:40:07.112 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.112 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.112 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.112 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "redirect", 2023-10-06T01:40:07.112 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.113 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.113 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.113 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.113 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect" 2023-10-06T01:40:07.113 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.113 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.113 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.113 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.113 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.113 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.113 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2023-10-06T01:40:07.114 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2023-10-06T01:40:07.114 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.114 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.114 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.114 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2023-10-06T01:40:07.114 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2023-10-06T01:40:07.114 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2023-10-06T01:40:07.114 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.114 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.114 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.114 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.115 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.115 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.115 INFO:teuthology.orchestra.run.smithi069.stdout: "url_prefix": { 2023-10-06T01:40:07.115 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url_prefix", 2023-10-06T01:40:07.115 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.115 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.115 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.115 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.115 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.115 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.115 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.116 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.116 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.116 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.116 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.116 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.116 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.116 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.116 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.116 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "devicehealth", 2023-10-06T01:40:07.116 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.116 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.117 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.117 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_monitoring": { 2023-10-06T01:40:07.117 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_monitoring", 2023-10-06T01:40:07.117 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.117 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.117 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.117 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.117 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.117 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.117 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.117 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "monitor device health metrics", 2023-10-06T01:40:07.118 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.118 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.118 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.118 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.118 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.118 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.118 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.118 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.118 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.118 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.118 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.119 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.119 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.119 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.119 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.119 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.119 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.119 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.119 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.119 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.119 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.119 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.120 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.120 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.120 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.120 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.120 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.120 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.120 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.120 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.120 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.120 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.120 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.121 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.121 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.121 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.121 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.121 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.121 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.121 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.121 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.121 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.121 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.121 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.122 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.122 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.122 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.122 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.122 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.122 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.122 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.122 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.122 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.122 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.123 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.123 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.123 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.123 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.123 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.123 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.123 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.123 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.123 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.123 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.123 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.124 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.124 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.124 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.124 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.124 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.124 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.124 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.124 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.124 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.124 INFO:teuthology.orchestra.run.smithi069.stdout: "mark_out_threshold": { 2023-10-06T01:40:07.124 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mark_out_threshold", 2023-10-06T01:40:07.125 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:07.125 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.125 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.125 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2419200", 2023-10-06T01:40:07.125 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.125 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.125 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.125 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically mark OSD if it may fail before this long", 2023-10-06T01:40:07.125 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.125 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.125 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.126 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.126 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_name": { 2023-10-06T01:40:07.126 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_name", 2023-10-06T01:40:07.126 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.126 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.126 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.126 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "device_health_metrics", 2023-10-06T01:40:07.126 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.126 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.126 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.126 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name of pool in which to store device health metrics", 2023-10-06T01:40:07.127 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.127 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.127 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.127 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.127 INFO:teuthology.orchestra.run.smithi069.stdout: "retention_period": { 2023-10-06T01:40:07.127 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retention_period", 2023-10-06T01:40:07.127 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:07.127 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.127 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.127 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15552000", 2023-10-06T01:40:07.128 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.128 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.128 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.128 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain device health metrics", 2023-10-06T01:40:07.128 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.128 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.128 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.128 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.128 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_frequency": { 2023-10-06T01:40:07.128 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_frequency", 2023-10-06T01:40:07.128 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:07.128 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.129 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.129 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2023-10-06T01:40:07.129 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.129 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.129 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.129 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to scrape device health metrics", 2023-10-06T01:40:07.129 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.129 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.129 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.129 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.129 INFO:teuthology.orchestra.run.smithi069.stdout: "self_heal": { 2023-10-06T01:40:07.130 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "self_heal", 2023-10-06T01:40:07.130 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.130 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.130 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.130 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.130 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.130 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.130 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.130 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "preemptively heal cluster around devices that may fail", 2023-10-06T01:40:07.130 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.130 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.130 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.131 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.131 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-10-06T01:40:07.131 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-10-06T01:40:07.131 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:07.131 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.131 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.131 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-10-06T01:40:07.131 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.131 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.131 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.131 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and check device health", 2023-10-06T01:40:07.131 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.132 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.132 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.132 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.132 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_threshold": { 2023-10-06T01:40:07.132 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_threshold", 2023-10-06T01:40:07.132 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:07.132 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.132 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.132 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7257600", 2023-10-06T01:40:07.132 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.132 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.132 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.133 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise health warning if OSD may fail before this long", 2023-10-06T01:40:07.133 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.133 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.133 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.133 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.133 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.133 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.133 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.133 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "diskprediction_local", 2023-10-06T01:40:07.133 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.133 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.133 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.134 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.134 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.134 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.134 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.134 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.134 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.134 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.134 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.134 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.134 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.134 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.134 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.135 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.135 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.135 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.135 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.135 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.135 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.135 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.135 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.135 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.135 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.135 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.136 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.136 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.136 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.136 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.136 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.136 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.136 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.136 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.136 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.136 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.136 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.136 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.137 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.137 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.137 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.137 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.137 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.137 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.137 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.137 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.137 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.137 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.137 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.137 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.138 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.138 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.138 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.138 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.138 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.138 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.138 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.138 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.138 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.138 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.138 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.139 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.139 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.139 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.139 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.139 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.139 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.139 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.139 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.139 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.139 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.139 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.139 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.139 INFO:teuthology.orchestra.run.smithi069.stdout: "predict_interval": { 2023-10-06T01:40:07.140 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predict_interval", 2023-10-06T01:40:07.140 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.140 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.140 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.140 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2023-10-06T01:40:07.140 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.140 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.140 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.140 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.140 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.140 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.141 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.141 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.141 INFO:teuthology.orchestra.run.smithi069.stdout: "predictor_model": { 2023-10-06T01:40:07.141 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predictor_model", 2023-10-06T01:40:07.141 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.141 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.141 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.141 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "prophetstor", 2023-10-06T01:40:07.141 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.141 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.141 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.141 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.141 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.142 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.142 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.142 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.142 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-10-06T01:40:07.142 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-10-06T01:40:07.142 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.142 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.142 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.142 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2023-10-06T01:40:07.142 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.142 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.142 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.143 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.143 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.143 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.143 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.143 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.143 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.143 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.143 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.143 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "influx", 2023-10-06T01:40:07.143 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": false, 2023-10-06T01:40:07.143 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "influxdb python module not found", 2023-10-06T01:40:07.143 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.144 INFO:teuthology.orchestra.run.smithi069.stdout: "batch_size": { 2023-10-06T01:40:07.144 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "batch_size", 2023-10-06T01:40:07.144 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.144 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.144 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.144 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5000", 2023-10-06T01:40:07.144 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.144 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.144 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.144 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2023-10-06T01:40:07.144 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.144 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.145 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.145 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.145 INFO:teuthology.orchestra.run.smithi069.stdout: "database": { 2023-10-06T01:40:07.145 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "database", 2023-10-06T01:40:07.145 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.145 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.145 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.145 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "ceph", 2023-10-06T01:40:07.145 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.145 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.145 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.145 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2023-10-06T01:40:07.146 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.146 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.146 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.146 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.146 INFO:teuthology.orchestra.run.smithi069.stdout: "hostname": { 2023-10-06T01:40:07.146 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "hostname", 2023-10-06T01:40:07.146 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.146 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.146 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.146 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.146 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.146 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.147 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.147 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server hostname", 2023-10-06T01:40:07.147 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.147 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.147 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.147 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.147 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-10-06T01:40:07.147 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-10-06T01:40:07.147 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:07.147 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.147 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.148 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "30", 2023-10-06T01:40:07.148 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "5", 2023-10-06T01:40:07.148 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.148 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.148 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2023-10-06T01:40:07.148 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.148 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.148 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.148 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.148 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.148 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.148 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.149 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.149 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.149 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.149 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.149 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.149 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.149 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.149 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.149 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.149 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.149 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.150 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.150 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.150 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.150 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.150 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.150 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.150 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.150 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.150 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.150 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.150 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.150 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.151 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.151 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.151 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.151 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.151 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.151 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.151 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.151 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.151 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.151 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.151 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.152 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.152 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.152 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.152 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.152 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.152 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.152 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.152 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.152 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.152 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.152 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.153 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.153 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.153 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.153 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.153 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.153 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.153 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.153 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.153 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.153 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.153 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.153 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.154 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.154 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.154 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.154 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.154 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.154 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.154 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.154 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.154 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.154 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.154 INFO:teuthology.orchestra.run.smithi069.stdout: "password": { 2023-10-06T01:40:07.154 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "password", 2023-10-06T01:40:07.155 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.155 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.155 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.155 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.155 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.155 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.155 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.155 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "password of InfluxDB server user", 2023-10-06T01:40:07.155 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.155 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.155 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.155 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.156 INFO:teuthology.orchestra.run.smithi069.stdout: "port": { 2023-10-06T01:40:07.156 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "port", 2023-10-06T01:40:07.156 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.156 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.156 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.156 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8086", 2023-10-06T01:40:07.156 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.156 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.156 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.156 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server port", 2023-10-06T01:40:07.156 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.156 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.157 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.157 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.157 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2023-10-06T01:40:07.157 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2023-10-06T01:40:07.157 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.157 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.157 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.157 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "false", 2023-10-06T01:40:07.157 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.157 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.157 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.157 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2023-10-06T01:40:07.158 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.158 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.158 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.158 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.158 INFO:teuthology.orchestra.run.smithi069.stdout: "threads": { 2023-10-06T01:40:07.158 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threads", 2023-10-06T01:40:07.158 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.158 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.158 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.158 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-10-06T01:40:07.158 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-10-06T01:40:07.158 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "32", 2023-10-06T01:40:07.159 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.159 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2023-10-06T01:40:07.159 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.159 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.159 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.159 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.159 INFO:teuthology.orchestra.run.smithi069.stdout: "username": { 2023-10-06T01:40:07.159 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "username", 2023-10-06T01:40:07.159 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.159 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.159 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.159 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.160 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.160 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.160 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.160 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "username of InfluxDB server user", 2023-10-06T01:40:07.160 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.160 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.160 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.160 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.160 INFO:teuthology.orchestra.run.smithi069.stdout: "verify_ssl": { 2023-10-06T01:40:07.160 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "verify_ssl", 2023-10-06T01:40:07.160 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.160 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.161 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.161 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "true", 2023-10-06T01:40:07.161 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.161 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.161 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.161 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2023-10-06T01:40:07.161 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.161 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.161 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.161 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.161 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.161 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.162 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.162 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "insights", 2023-10-06T01:40:07.162 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.162 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.162 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.162 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.162 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.162 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.162 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.162 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.162 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.162 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.163 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.163 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.163 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.163 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.163 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.163 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.163 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.163 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.163 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.163 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.163 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.163 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.164 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.164 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.164 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.164 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.164 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.164 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.164 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.164 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.164 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.164 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.164 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.164 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.165 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.165 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.165 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.165 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.165 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.165 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.165 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.165 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.165 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.165 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.165 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.165 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.166 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.166 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.166 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.166 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.166 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.166 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.166 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.166 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.166 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.166 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.166 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.166 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.167 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.167 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.167 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.167 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.167 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.167 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.167 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.167 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.167 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.167 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.167 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.167 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.168 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.168 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.168 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.168 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.168 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.168 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.168 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "iostat", 2023-10-06T01:40:07.168 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.168 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.168 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.168 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.169 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.169 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.169 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.169 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.169 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.169 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.169 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.169 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.169 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.169 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.169 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.169 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.170 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.170 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.170 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.170 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.170 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.170 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.170 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.170 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.170 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.170 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.170 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.171 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.171 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.171 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.171 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.171 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.171 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.171 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.171 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.171 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.171 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.171 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.171 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.171 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.172 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.172 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.172 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.172 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.172 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.172 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.172 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.172 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.172 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.172 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.172 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.172 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.173 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.173 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.173 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.173 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.173 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.173 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.173 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.173 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.173 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.173 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.173 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.173 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.174 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.174 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.174 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.174 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.174 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.174 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.174 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.174 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.174 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.174 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.174 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.174 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.175 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "localpool", 2023-10-06T01:40:07.175 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.175 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.175 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.175 INFO:teuthology.orchestra.run.smithi069.stdout: "failure_domain": { 2023-10-06T01:40:07.175 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "failure_domain", 2023-10-06T01:40:07.175 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.175 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.175 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.175 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "host", 2023-10-06T01:40:07.175 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.175 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.176 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.176 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "failure domain for any created local pool", 2023-10-06T01:40:07.176 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2023-10-06T01:40:07.176 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.176 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.176 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.176 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.176 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.176 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.176 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.176 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.176 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.177 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.177 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.177 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.177 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.177 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.177 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.177 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.177 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.177 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.177 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.177 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.178 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.178 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.178 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.178 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.178 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.178 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.178 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.178 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.178 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.178 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.178 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.178 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.179 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.179 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.179 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.179 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.179 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.179 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.179 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.179 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.179 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.179 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.179 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.179 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.180 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.180 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.180 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.180 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.180 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.180 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.180 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.180 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.180 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.180 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.180 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.180 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.181 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.181 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.181 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.181 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.181 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.181 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.181 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.181 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.181 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.181 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.181 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.181 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.182 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.182 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.182 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.182 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.182 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.182 INFO:teuthology.orchestra.run.smithi069.stdout: "min_size": { 2023-10-06T01:40:07.182 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_size", 2023-10-06T01:40:07.182 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.182 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.182 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.182 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.182 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.183 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.183 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.183 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default min_size for any created local pool", 2023-10-06T01:40:07.183 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2023-10-06T01:40:07.183 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.183 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.183 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.183 INFO:teuthology.orchestra.run.smithi069.stdout: "num_rep": { 2023-10-06T01:40:07.183 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "num_rep", 2023-10-06T01:40:07.183 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.183 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.183 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.184 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3", 2023-10-06T01:40:07.184 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.184 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.184 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.184 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default replica count for any created local pool", 2023-10-06T01:40:07.184 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.184 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.184 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.184 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.184 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_num": { 2023-10-06T01:40:07.184 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_num", 2023-10-06T01:40:07.185 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.185 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.185 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.185 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "128", 2023-10-06T01:40:07.185 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.185 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.185 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.185 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default pg_num for any created local pool", 2023-10-06T01:40:07.185 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.185 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.185 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.185 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.185 INFO:teuthology.orchestra.run.smithi069.stdout: "prefix": { 2023-10-06T01:40:07.186 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prefix", 2023-10-06T01:40:07.186 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.186 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.186 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.186 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.186 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.186 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.186 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.186 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name prefix for any created local pool", 2023-10-06T01:40:07.186 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.186 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.186 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.187 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.187 INFO:teuthology.orchestra.run.smithi069.stdout: "subtree": { 2023-10-06T01:40:07.187 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "subtree", 2023-10-06T01:40:07.187 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.187 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.187 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.187 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "rack", 2023-10-06T01:40:07.187 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.187 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.187 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.187 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "CRUSH level for which to create a local pool", 2023-10-06T01:40:07.187 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2023-10-06T01:40:07.188 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.188 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.188 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.188 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.188 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.188 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.188 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mds_autoscaler", 2023-10-06T01:40:07.188 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.188 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.188 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.188 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.188 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.189 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.189 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.189 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.189 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.189 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.189 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.189 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.189 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.189 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.189 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.189 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.189 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.190 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.190 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.190 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.190 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.190 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.190 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.190 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.190 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.190 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.190 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.190 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.190 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.191 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.191 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.191 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.191 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.191 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.191 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.191 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.191 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.191 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.191 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.191 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.191 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.192 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.192 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.192 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.192 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.192 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.192 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.192 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.192 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.192 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.192 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.192 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.192 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.193 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.193 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.193 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.193 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.193 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.193 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.193 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.193 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.193 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.193 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.193 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.193 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.194 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.194 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.194 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.194 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.194 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.194 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.194 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.194 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.194 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.194 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.194 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.194 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirroring", 2023-10-06T01:40:07.195 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.195 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.195 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.195 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.195 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.195 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.195 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.195 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.195 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.195 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.195 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.195 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.196 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.196 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.196 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.196 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.196 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.196 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.196 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.196 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.196 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.196 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.196 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.196 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.197 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.197 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.197 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.197 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.197 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.197 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.197 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.197 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.197 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.197 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.197 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.197 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.198 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.198 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.198 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.198 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.198 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.198 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.198 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.198 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.198 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.198 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.198 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.198 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.199 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.199 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.199 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.199 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.199 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.199 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.199 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.199 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.199 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.199 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.199 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.199 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.200 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.200 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.200 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.200 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.200 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.200 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.200 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.200 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.200 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.200 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.200 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.200 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.201 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.201 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.201 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.201 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.201 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "nfs", 2023-10-06T01:40:07.201 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.201 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.201 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.201 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.201 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.201 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.202 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.202 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.202 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.202 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.202 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.202 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.202 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.202 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.202 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.202 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.202 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.202 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.203 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.203 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.203 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.203 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.203 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.203 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.203 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.203 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.203 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.203 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.203 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.203 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.203 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.203 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.204 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.204 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.205 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.205 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.205 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.205 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.205 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.205 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.206 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.206 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.206 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.206 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.206 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.206 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.206 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.206 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.206 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.206 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.206 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.206 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.207 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.207 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.207 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.207 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.207 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.207 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.207 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.207 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.207 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.207 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.207 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.207 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.208 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.208 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.208 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.208 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.208 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.208 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.208 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.208 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.208 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.208 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.208 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.209 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.209 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2023-10-06T01:40:07.209 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.209 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.209 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.209 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.209 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.209 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.209 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.209 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.209 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.209 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.210 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.210 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.210 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.210 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.210 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.210 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.210 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.210 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.210 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.210 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.210 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.210 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.211 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.211 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.211 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.211 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.211 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.211 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.211 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.211 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.211 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.211 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.211 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.211 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.212 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.212 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.212 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.212 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.212 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.212 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.212 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.212 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.212 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.212 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.212 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.212 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.213 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.214 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator": { 2023-10-06T01:40:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2023-10-06T01:40:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.215 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm", 2023-10-06T01:40:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: "rook", 2023-10-06T01:40:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: "test_orchestrator" 2023-10-06T01:40:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Orchestrator backend", 2023-10-06T01:40:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.216 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_perf_query", 2023-10-06T01:40:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.217 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.218 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.219 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.220 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.221 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.222 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_support", 2023-10-06T01:40:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.223 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.224 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.225 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.226 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.226 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.226 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.226 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.226 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.226 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.226 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.226 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.226 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.226 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.226 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.226 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.227 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.228 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.229 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_autoscaler", 2023-10-06T01:40:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.230 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.231 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.232 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.233 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.234 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.235 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-10-06T01:40:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-10-06T01:40:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-10-06T01:40:07.236 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: "threshold": { 2023-10-06T01:40:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threshold", 2023-10-06T01:40:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-10-06T01:40:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.237 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.238 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2023-10-06T01:40:07.238 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1.0", 2023-10-06T01:40:07.238 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.238 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.238 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "scaling threshold", 2023-10-06T01:40:07.238 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2023-10-06T01:40:07.238 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.238 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.238 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.238 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.238 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.239 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.239 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "progress", 2023-10-06T01:40:07.239 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.239 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.239 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.239 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_pg_recovery_event": { 2023-10-06T01:40:07.239 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_pg_recovery_event", 2023-10-06T01:40:07.239 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.239 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.239 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.239 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.239 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.240 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.240 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.240 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow the module to show pg recovery progress", 2023-10-06T01:40:07.240 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.240 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.240 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.240 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.240 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2023-10-06T01:40:07.240 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2023-10-06T01:40:07.240 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.240 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.240 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.241 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.241 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.241 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.241 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.241 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.241 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.241 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.241 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.241 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.241 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.241 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.241 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.242 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.242 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.242 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.242 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.242 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.242 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.242 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.242 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.242 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.242 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.242 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.243 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.243 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.243 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.243 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.243 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.243 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.243 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.243 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.243 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.243 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.243 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.243 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.244 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.244 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.244 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.244 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.244 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.244 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.244 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.244 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.244 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.244 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.244 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.245 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.245 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.245 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.245 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.245 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.245 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.245 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.245 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.245 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.245 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.245 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.245 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.245 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.246 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.246 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.246 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.246 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.246 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.246 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.246 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.246 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.246 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.246 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.246 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.247 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.247 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.247 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.247 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.247 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.247 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.247 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.247 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.247 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.247 INFO:teuthology.orchestra.run.smithi069.stdout: "max_completed_events": { 2023-10-06T01:40:07.247 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_completed_events", 2023-10-06T01:40:07.247 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.248 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.248 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.248 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "50", 2023-10-06T01:40:07.248 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.248 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.248 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.248 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "number of past completed events to remember", 2023-10-06T01:40:07.248 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.248 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.248 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.248 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.248 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2023-10-06T01:40:07.249 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2023-10-06T01:40:07.249 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:07.249 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.249 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.249 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2023-10-06T01:40:07.249 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.249 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.249 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.249 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long the module is going to sleep", 2023-10-06T01:40:07.249 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.249 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.249 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.250 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.250 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.250 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.250 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.250 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus", 2023-10-06T01:40:07.250 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.250 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.250 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.250 INFO:teuthology.orchestra.run.smithi069.stdout: "cache": { 2023-10-06T01:40:07.250 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cache", 2023-10-06T01:40:07.250 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.251 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.251 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.251 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.251 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.251 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.251 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.251 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.251 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.251 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.251 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.251 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.251 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.252 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.252 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.252 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.252 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.252 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.252 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.252 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.252 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.252 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.252 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.252 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.252 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.253 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.253 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.253 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.253 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.253 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.253 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.253 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.253 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.253 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.253 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.253 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.253 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.254 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.254 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.254 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.254 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.254 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.254 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.254 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.254 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.254 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.254 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.254 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.254 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.255 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.255 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.255 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.255 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.255 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.255 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.255 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.255 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.255 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.255 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.255 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.255 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.255 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.256 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.256 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.256 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.256 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.256 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.256 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.256 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.256 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.256 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.256 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.256 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.257 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.257 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.257 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.257 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.257 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.257 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.257 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.257 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.257 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.257 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools": { 2023-10-06T01:40:07.257 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools", 2023-10-06T01:40:07.257 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.258 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.258 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.258 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.258 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.258 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.258 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.258 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.258 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.258 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.258 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.258 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.258 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools_refresh_interval": { 2023-10-06T01:40:07.259 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools_refresh_interval", 2023-10-06T01:40:07.259 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.259 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.259 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.259 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "300", 2023-10-06T01:40:07.259 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.259 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.259 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.259 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.259 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.259 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.259 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.260 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.260 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_interval": { 2023-10-06T01:40:07.260 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_interval", 2023-10-06T01:40:07.260 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-10-06T01:40:07.260 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.260 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.260 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15.0", 2023-10-06T01:40:07.260 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.260 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.260 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.260 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.260 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.261 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.261 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.261 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.261 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2023-10-06T01:40:07.261 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2023-10-06T01:40:07.261 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.261 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.261 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.261 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2023-10-06T01:40:07.261 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.261 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.261 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.262 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2023-10-06T01:40:07.262 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.262 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.262 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.262 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.262 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2023-10-06T01:40:07.262 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2023-10-06T01:40:07.262 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.262 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.262 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.262 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "9283", 2023-10-06T01:40:07.262 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.263 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.263 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.263 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the port on which the module listens for HTTP requests", 2023-10-06T01:40:07.263 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.263 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.263 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.263 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.263 INFO:teuthology.orchestra.run.smithi069.stdout: "stale_cache_strategy": { 2023-10-06T01:40:07.263 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stale_cache_strategy", 2023-10-06T01:40:07.263 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.263 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.263 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.264 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "log", 2023-10-06T01:40:07.264 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.264 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.264 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.264 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.264 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.264 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.264 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.264 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.264 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2023-10-06T01:40:07.265 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2023-10-06T01:40:07.265 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.265 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.265 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.265 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "default", 2023-10-06T01:40:07.265 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.265 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.265 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.265 INFO:teuthology.orchestra.run.smithi069.stdout: "default", 2023-10-06T01:40:07.265 INFO:teuthology.orchestra.run.smithi069.stdout: "error" 2023-10-06T01:40:07.265 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.265 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.266 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.266 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.266 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.266 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.266 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2023-10-06T01:40:07.266 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2023-10-06T01:40:07.266 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.266 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.266 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.266 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2023-10-06T01:40:07.266 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2023-10-06T01:40:07.267 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2023-10-06T01:40:07.267 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.267 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.267 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.267 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.267 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.267 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.267 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.267 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.267 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.267 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_support", 2023-10-06T01:40:07.268 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.268 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.268 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.268 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.268 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.268 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.268 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.268 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.268 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.268 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.268 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.268 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.269 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.269 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.269 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.269 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.269 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.269 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.269 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.269 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.269 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.269 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.269 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.269 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.270 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.270 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.270 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.270 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.270 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.270 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.270 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.270 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.270 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.270 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.270 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.271 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.271 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.271 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.271 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.271 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.271 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.271 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.271 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.271 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.271 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.271 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.271 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.272 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.272 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.272 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.272 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.272 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.272 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.272 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.272 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.272 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.272 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.272 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.272 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.273 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.273 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.273 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.273 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.273 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.273 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.273 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.273 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.273 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.273 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.273 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.273 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.274 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.274 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.274 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_snap_create": { 2023-10-06T01:40:07.274 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_snap_create", 2023-10-06T01:40:07.274 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.274 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.274 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.274 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2023-10-06T01:40:07.274 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.274 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.274 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.275 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.275 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.275 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.275 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.275 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.275 INFO:teuthology.orchestra.run.smithi069.stdout: "mirror_snapshot_schedule": { 2023-10-06T01:40:07.275 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirror_snapshot_schedule", 2023-10-06T01:40:07.275 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.275 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.275 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.275 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.275 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.276 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.276 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.276 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.276 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.276 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.276 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.276 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.276 INFO:teuthology.orchestra.run.smithi069.stdout: "trash_purge_schedule": { 2023-10-06T01:40:07.276 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "trash_purge_schedule", 2023-10-06T01:40:07.276 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.276 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.276 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.277 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.277 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.277 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.277 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.277 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.277 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.277 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.277 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.277 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.277 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.277 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.277 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.278 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "restful", 2023-10-06T01:40:07.278 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.278 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.278 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.278 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_auth": { 2023-10-06T01:40:07.278 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_auth", 2023-10-06T01:40:07.278 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.278 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.278 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.278 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.278 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.278 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.279 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.279 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.279 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.279 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.279 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.279 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.279 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2023-10-06T01:40:07.279 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2023-10-06T01:40:07.279 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.279 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.279 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.279 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.280 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.280 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.280 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.280 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.280 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.280 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.280 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.280 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.280 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.280 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.280 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.280 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.281 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.281 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.281 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.281 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.281 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.281 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.281 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.281 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.281 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.281 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.281 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.281 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.282 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.282 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.282 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.282 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.282 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.282 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.282 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.282 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.282 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.282 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.282 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.282 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.283 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.283 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.283 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.283 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.283 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.283 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.283 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.283 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.283 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.283 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.283 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.283 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.284 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.284 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.284 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.284 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.284 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.284 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.284 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.284 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.284 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.284 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.284 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.284 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.284 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.285 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.285 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.285 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.285 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.285 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.285 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.285 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.285 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.285 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.285 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.285 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.285 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.286 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.286 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.286 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.286 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.286 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.286 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2023-10-06T01:40:07.286 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2023-10-06T01:40:07.286 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.286 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.286 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.286 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.286 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.287 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.287 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.287 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.287 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.287 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.287 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.287 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.287 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2023-10-06T01:40:07.287 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2023-10-06T01:40:07.287 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.287 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.287 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.288 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.288 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.288 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.288 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.288 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.288 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.288 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.288 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.288 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.288 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.288 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.288 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.288 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rgw", 2023-10-06T01:40:07.289 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.289 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.289 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.289 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.289 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.289 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.289 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.289 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.289 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.289 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.289 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.289 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.290 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.290 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.290 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.290 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.290 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.290 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.290 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.290 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.290 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.290 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.290 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.290 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.291 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.291 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.291 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.291 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.291 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.291 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.291 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.291 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.291 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.291 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.291 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.291 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.292 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.292 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.292 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.292 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.292 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.292 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.292 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.292 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.292 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.292 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.292 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.292 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.293 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.293 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.293 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.293 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.293 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.293 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.293 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.293 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.293 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.293 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.293 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.293 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.294 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.294 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.294 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.294 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.294 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.294 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.294 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.294 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.294 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.294 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.294 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.294 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.295 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.295 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.295 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.295 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.295 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rook", 2023-10-06T01:40:07.295 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.295 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.295 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.295 INFO:teuthology.orchestra.run.smithi069.stdout: "drive_group_interval": { 2023-10-06T01:40:07.295 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "drive_group_interval", 2023-10-06T01:40:07.295 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-10-06T01:40:07.295 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.296 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.296 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "300.0", 2023-10-06T01:40:07.296 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.296 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.296 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.296 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "interval in seconds between re-application of applied drive_groups", 2023-10-06T01:40:07.296 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.296 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.296 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.296 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.296 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.296 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.297 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.297 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.297 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.297 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.297 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.297 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.297 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.297 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.297 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.297 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.297 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.297 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.298 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.298 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.298 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.298 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.298 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.298 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.298 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.298 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.298 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.298 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.298 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.299 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.299 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.299 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.299 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.299 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.299 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.299 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.299 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.299 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.299 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.299 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.299 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.299 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.300 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.300 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.300 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.300 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.300 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.300 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.300 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.300 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.300 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.300 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.300 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.300 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.301 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.301 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.301 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.301 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.301 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.301 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.301 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.301 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.301 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.301 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.301 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.301 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.302 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.302 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.302 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.302 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.302 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.302 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.302 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.302 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.302 INFO:teuthology.orchestra.run.smithi069.stdout: "storage_class": { 2023-10-06T01:40:07.302 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "storage_class", 2023-10-06T01:40:07.302 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.302 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.303 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.303 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "local", 2023-10-06T01:40:07.303 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.303 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.303 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.303 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "storage class name for LSO-discovered PVs", 2023-10-06T01:40:07.303 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.303 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.303 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.303 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.303 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.303 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.304 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.304 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "selftest", 2023-10-06T01:40:07.304 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.304 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.304 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.304 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.304 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.304 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.304 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.304 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.304 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.304 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.305 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.305 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.305 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.305 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.305 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.305 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.305 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.305 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.305 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.305 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.305 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.305 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.306 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.306 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.306 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.306 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.306 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.306 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.306 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.306 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.306 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.306 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.306 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.307 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.307 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.307 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.307 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.307 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.307 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.307 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.307 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.307 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.307 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.307 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.307 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.308 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.308 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.308 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.308 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.308 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.308 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.308 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.308 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.308 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.308 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.308 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.308 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.309 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.309 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.309 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.309 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.309 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.309 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.309 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.309 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.309 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.309 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.309 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.309 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.310 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.310 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.310 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.310 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.310 INFO:teuthology.orchestra.run.smithi069.stdout: "roption1": { 2023-10-06T01:40:07.310 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption1", 2023-10-06T01:40:07.310 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.310 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.310 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.310 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.310 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.310 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.311 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.311 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.311 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.311 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.311 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.311 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.311 INFO:teuthology.orchestra.run.smithi069.stdout: "roption2": { 2023-10-06T01:40:07.311 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption2", 2023-10-06T01:40:07.311 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.311 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.311 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.311 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "xyz", 2023-10-06T01:40:07.312 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.312 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.312 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.312 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.312 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.312 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.312 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.312 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.312 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption1": { 2023-10-06T01:40:07.312 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption1", 2023-10-06T01:40:07.312 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.312 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.312 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.313 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.313 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.313 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.313 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.313 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.313 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.313 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.313 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.313 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.313 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption2": { 2023-10-06T01:40:07.313 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption2", 2023-10-06T01:40:07.313 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.314 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.314 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.314 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.314 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.314 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.314 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.314 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.314 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.314 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.314 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.314 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.314 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption3": { 2023-10-06T01:40:07.315 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption3", 2023-10-06T01:40:07.315 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2023-10-06T01:40:07.315 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.315 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.315 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.315 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.315 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.315 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.315 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.315 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.316 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.316 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.316 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.316 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption4": { 2023-10-06T01:40:07.316 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption4", 2023-10-06T01:40:07.316 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.316 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.316 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.316 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.316 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.316 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.317 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.317 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.317 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.317 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.317 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.317 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.317 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption5": { 2023-10-06T01:40:07.317 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption5", 2023-10-06T01:40:07.317 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.317 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.317 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.317 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.318 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.318 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.318 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.318 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.318 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.318 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.318 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.318 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.318 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption6": { 2023-10-06T01:40:07.318 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption6", 2023-10-06T01:40:07.318 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.318 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.319 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.319 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.319 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.319 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.319 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.319 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.319 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.319 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.319 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.319 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.319 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption7": { 2023-10-06T01:40:07.319 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption7", 2023-10-06T01:40:07.320 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.320 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.320 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.320 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.320 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2023-10-06T01:40:07.320 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "42", 2023-10-06T01:40:07.320 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.320 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.320 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.320 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.320 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.320 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.321 INFO:teuthology.orchestra.run.smithi069.stdout: "testkey": { 2023-10-06T01:40:07.321 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testkey", 2023-10-06T01:40:07.321 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.321 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.321 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.321 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.321 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.321 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.321 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.321 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.321 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.321 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.322 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.322 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.322 INFO:teuthology.orchestra.run.smithi069.stdout: "testlkey": { 2023-10-06T01:40:07.322 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testlkey", 2023-10-06T01:40:07.322 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.322 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.322 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.322 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.322 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.322 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.322 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.323 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.323 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.323 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.323 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.323 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.323 INFO:teuthology.orchestra.run.smithi069.stdout: "testnewline": { 2023-10-06T01:40:07.323 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testnewline", 2023-10-06T01:40:07.323 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.323 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.323 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.323 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.323 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.324 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.324 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.324 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.324 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.324 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.324 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.324 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.324 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.324 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.324 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.324 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snap_schedule", 2023-10-06T01:40:07.324 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.325 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.325 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.325 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_m_granularity": { 2023-10-06T01:40:07.325 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_m_granularity", 2023-10-06T01:40:07.325 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.325 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.325 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.325 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.325 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.325 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.325 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.325 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow minute scheduled snapshots", 2023-10-06T01:40:07.326 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.326 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.326 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.326 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.326 INFO:teuthology.orchestra.run.smithi069.stdout: "dump_on_update": { 2023-10-06T01:40:07.326 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dump_on_update", 2023-10-06T01:40:07.326 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.326 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.326 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.326 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.326 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.327 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.327 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.327 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "dump database to debug log on update", 2023-10-06T01:40:07.327 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.327 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.327 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.327 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.327 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.327 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.327 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.327 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.327 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.327 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.328 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.328 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.328 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.328 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.328 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.328 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.328 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.328 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.328 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.328 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.328 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.328 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.329 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.329 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.329 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.329 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.329 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.329 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.329 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.329 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.329 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.329 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.329 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.329 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.330 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.330 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.330 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.330 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.330 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.330 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.330 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.330 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.330 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.330 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.330 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.331 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.331 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.331 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.331 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.331 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.331 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.331 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.331 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.331 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.331 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.331 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.331 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.332 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.332 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.332 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.332 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.332 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.332 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.332 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.332 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.332 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.332 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.332 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.332 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.333 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.333 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.333 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.333 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.333 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.333 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.333 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.333 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.333 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stats", 2023-10-06T01:40:07.333 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.333 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.333 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.334 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.334 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.334 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.334 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.334 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.334 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.334 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.334 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.334 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.334 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.334 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.334 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.335 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.335 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.335 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.335 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.335 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.335 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.335 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.335 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.335 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.335 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.335 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.336 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.336 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.336 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.336 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.336 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.336 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.336 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.336 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.336 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.336 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.336 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.337 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.337 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.337 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.337 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.337 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.337 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.337 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.337 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.337 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.337 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.337 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.337 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.338 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.338 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.338 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.338 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.338 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.338 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.338 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.338 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.338 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.338 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.338 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.339 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.339 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.339 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.339 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.339 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.339 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.339 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.339 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.339 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.339 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.339 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.339 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.340 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.340 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.340 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.340 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.340 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "status", 2023-10-06T01:40:07.340 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.340 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.340 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.340 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.340 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.340 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.340 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.341 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.341 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.341 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.341 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.341 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.341 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.341 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.341 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.341 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.341 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.341 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.341 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.342 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.342 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.342 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.342 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.342 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.342 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.342 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.342 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.342 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.342 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.342 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.343 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.343 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.343 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.343 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.343 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.343 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.343 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.343 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.343 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.343 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.343 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.343 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.344 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.344 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.344 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.344 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.344 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.344 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.344 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.344 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.344 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.344 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.344 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.344 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.345 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.345 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.345 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.345 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.345 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.345 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.345 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.345 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.345 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.345 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.345 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.345 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.346 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.346 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.346 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.346 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.346 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.346 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.346 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.346 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.346 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.346 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.346 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telegraf", 2023-10-06T01:40:07.347 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.347 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.347 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.347 INFO:teuthology.orchestra.run.smithi069.stdout: "address": { 2023-10-06T01:40:07.347 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "address", 2023-10-06T01:40:07.347 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.347 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.347 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.347 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2023-10-06T01:40:07.347 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.347 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.347 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.348 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.348 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.348 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.348 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.348 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.348 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-10-06T01:40:07.348 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-10-06T01:40:07.348 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:07.348 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.348 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.348 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15", 2023-10-06T01:40:07.348 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.348 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.349 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.349 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.349 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.349 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.349 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.349 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.349 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.349 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.349 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.349 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.349 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.350 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.350 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.350 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.350 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.350 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.350 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.350 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.350 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.350 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.350 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.350 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.351 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.351 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.351 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.351 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.351 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.351 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.351 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.351 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.351 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.351 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.351 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.351 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.352 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.352 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.352 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.352 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.352 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.352 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.352 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.352 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.352 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.352 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.352 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.352 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.353 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.353 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.353 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.353 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.353 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.353 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.353 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.353 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.353 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.353 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.353 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.353 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.354 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.354 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.354 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.354 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.354 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.354 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.354 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.354 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.354 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.354 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.354 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.354 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.355 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.355 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.355 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.355 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.355 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.355 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.355 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.355 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.355 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.355 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telemetry", 2023-10-06T01:40:07.355 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.355 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.356 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.356 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_basic": { 2023-10-06T01:40:07.356 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_basic", 2023-10-06T01:40:07.356 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.356 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.356 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.356 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.356 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.356 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.356 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.356 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share basic cluster information (size, version)", 2023-10-06T01:40:07.356 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.356 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.357 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.357 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.357 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_crash": { 2023-10-06T01:40:07.357 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_crash", 2023-10-06T01:40:07.357 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.357 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.357 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.357 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.357 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.357 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.357 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.358 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2023-10-06T01:40:07.358 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.358 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.358 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.358 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.358 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_device": { 2023-10-06T01:40:07.358 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_device", 2023-10-06T01:40:07.358 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.358 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.358 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.358 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2023-10-06T01:40:07.358 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.359 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.359 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.359 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2023-10-06T01:40:07.359 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.359 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.359 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.359 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.359 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_ident": { 2023-10-06T01:40:07.359 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_ident", 2023-10-06T01:40:07.359 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.359 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.360 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.360 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.360 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.360 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.360 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.360 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2023-10-06T01:40:07.360 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.360 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.360 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.360 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.360 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_perf": { 2023-10-06T01:40:07.360 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_perf", 2023-10-06T01:40:07.361 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.361 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.361 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.361 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.361 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.361 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.361 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.361 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share various performance metrics of a cluster", 2023-10-06T01:40:07.361 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.361 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.361 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.361 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.362 INFO:teuthology.orchestra.run.smithi069.stdout: "contact": { 2023-10-06T01:40:07.362 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "contact", 2023-10-06T01:40:07.362 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.362 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.362 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.362 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.362 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.362 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.362 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.362 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.362 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.362 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.363 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.363 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.363 INFO:teuthology.orchestra.run.smithi069.stdout: "description": { 2023-10-06T01:40:07.363 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "description", 2023-10-06T01:40:07.363 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.363 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.363 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.363 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.363 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.363 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.363 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.364 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.364 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.364 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.364 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.364 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.364 INFO:teuthology.orchestra.run.smithi069.stdout: "device_url": { 2023-10-06T01:40:07.364 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_url", 2023-10-06T01:40:07.364 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.364 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.364 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.364 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/device", 2023-10-06T01:40:07.364 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.364 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.365 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.365 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.365 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.365 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.365 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.365 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.365 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2023-10-06T01:40:07.365 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2023-10-06T01:40:07.365 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.365 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.365 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.365 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.366 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.366 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.366 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.366 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.366 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.366 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.366 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.366 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.366 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-10-06T01:40:07.366 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-10-06T01:40:07.366 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.366 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.367 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.367 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "24", 2023-10-06T01:40:07.367 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "8", 2023-10-06T01:40:07.367 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.367 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.367 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.367 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.367 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.367 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.367 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.367 INFO:teuthology.orchestra.run.smithi069.stdout: "last_opt_revision": { 2023-10-06T01:40:07.367 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "last_opt_revision", 2023-10-06T01:40:07.368 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.368 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.368 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.368 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1", 2023-10-06T01:40:07.368 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.368 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.368 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.368 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.368 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.368 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.368 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.369 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.369 INFO:teuthology.orchestra.run.smithi069.stdout: "leaderboard": { 2023-10-06T01:40:07.369 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "leaderboard", 2023-10-06T01:40:07.369 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.369 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.369 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.369 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.369 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.369 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.369 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.369 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.369 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.370 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.370 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.370 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.370 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.370 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.370 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.370 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.370 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.370 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.370 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.370 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.370 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.371 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.371 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.371 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.371 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.371 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.371 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.371 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.371 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.371 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.371 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.371 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.372 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.372 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.372 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.372 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.372 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.372 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.372 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.372 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.372 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.372 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.372 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.372 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.373 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.373 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.373 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.373 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.373 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.373 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.373 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.373 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.373 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.373 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.373 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.373 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.374 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.374 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.374 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.374 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.374 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.374 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.374 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.374 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.374 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.374 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.374 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.375 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.375 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.375 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.375 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.375 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.375 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.375 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.375 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.375 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.375 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.375 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.375 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.375 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.376 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.376 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.376 INFO:teuthology.orchestra.run.smithi069.stdout: "organization": { 2023-10-06T01:40:07.376 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "organization", 2023-10-06T01:40:07.376 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.376 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.376 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.376 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.376 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.376 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.376 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.377 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.377 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.377 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.377 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.377 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.377 INFO:teuthology.orchestra.run.smithi069.stdout: "proxy": { 2023-10-06T01:40:07.377 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "proxy", 2023-10-06T01:40:07.377 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.377 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.377 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.377 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.377 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.378 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.378 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.378 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.378 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.378 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.378 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.378 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.378 INFO:teuthology.orchestra.run.smithi069.stdout: "url": { 2023-10-06T01:40:07.378 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url", 2023-10-06T01:40:07.378 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.378 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.378 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.379 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/report", 2023-10-06T01:40:07.379 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.379 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.379 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.379 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.379 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.379 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.379 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.379 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.379 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.379 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.380 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.380 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "test_orchestrator", 2023-10-06T01:40:07.380 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.380 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.380 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.380 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.380 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.380 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.380 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.380 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.380 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.380 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.381 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.381 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.381 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.381 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.381 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.381 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.381 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.381 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.381 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.381 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.381 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.381 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.382 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.382 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.382 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.382 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.382 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.382 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.382 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.382 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.382 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.382 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.382 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.382 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.383 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.383 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.383 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.383 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.383 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.383 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.383 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.383 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.383 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.383 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.383 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.383 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.384 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.384 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.384 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.384 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.384 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.384 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.384 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.384 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.384 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.384 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.384 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.384 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.385 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.385 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.385 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.385 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.385 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.385 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.385 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.385 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.385 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.385 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.385 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.386 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.386 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.386 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.386 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.386 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.386 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.386 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.386 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "volumes", 2023-10-06T01:40:07.386 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.386 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.386 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.386 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.387 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.387 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.387 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.387 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.387 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.387 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.387 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.387 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.387 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.387 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.387 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.387 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.388 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.388 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.388 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.388 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.388 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.388 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.388 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.388 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.388 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.388 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.388 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.388 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.389 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.389 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.389 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.389 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.389 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.389 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.389 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.389 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.389 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.389 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.389 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.389 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.390 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.390 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.390 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.390 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.390 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.390 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.390 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.390 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.390 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.390 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.390 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.390 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.391 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.391 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.391 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.391 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.391 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.391 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.391 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.391 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.391 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.391 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.391 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.391 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.391 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.392 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.392 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.392 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.392 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.392 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.392 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.392 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.392 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.392 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_clones": { 2023-10-06T01:40:07.392 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_clones", 2023-10-06T01:40:07.392 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.392 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.393 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.393 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4", 2023-10-06T01:40:07.393 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.393 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.393 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.393 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Number of asynchronous cloner threads", 2023-10-06T01:40:07.393 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.393 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.393 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.393 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.393 INFO:teuthology.orchestra.run.smithi069.stdout: "snapshot_clone_delay": { 2023-10-06T01:40:07.393 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snapshot_clone_delay", 2023-10-06T01:40:07.394 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.394 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.394 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.394 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2023-10-06T01:40:07.394 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.394 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.394 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.394 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2023-10-06T01:40:07.394 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.394 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.394 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.394 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.395 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.395 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.395 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.395 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix", 2023-10-06T01:40:07.395 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2023-10-06T01:40:07.395 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2023-10-06T01:40:07.395 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2023-10-06T01:40:07.395 INFO:teuthology.orchestra.run.smithi069.stdout: "discovery_interval": { 2023-10-06T01:40:07.395 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "discovery_interval", 2023-10-06T01:40:07.395 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2023-10-06T01:40:07.395 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.395 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.396 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "100", 2023-10-06T01:40:07.396 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.396 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.396 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.396 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.396 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.396 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.396 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.396 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.396 INFO:teuthology.orchestra.run.smithi069.stdout: "identifier": { 2023-10-06T01:40:07.396 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "identifier", 2023-10-06T01:40:07.396 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.397 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.397 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.397 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.397 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.397 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.397 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.397 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.397 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.397 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.397 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.397 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.397 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2023-10-06T01:40:07.398 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2023-10-06T01:40:07.398 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2023-10-06T01:40:07.398 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.398 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.398 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2023-10-06T01:40:07.398 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.398 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.398 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.398 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.398 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.398 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.399 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.399 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.399 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2023-10-06T01:40:07.399 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2023-10-06T01:40:07.399 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.399 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.399 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.399 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.399 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.399 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.399 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.399 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.400 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.400 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.400 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.400 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.400 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.400 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.400 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.400 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.400 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.400 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.400 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.400 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2023-10-06T01:40:07.401 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2023-10-06T01:40:07.401 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.401 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.401 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.401 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.401 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.401 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.401 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.401 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.401 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.401 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.401 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.402 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.402 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2023-10-06T01:40:07.402 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2023-10-06T01:40:07.402 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.402 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.402 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.402 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2023-10-06T01:40:07.402 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.402 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.402 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2023-10-06T01:40:07.402 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2023-10-06T01:40:07.403 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2023-10-06T01:40:07.403 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2023-10-06T01:40:07.403 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2023-10-06T01:40:07.403 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2023-10-06T01:40:07.403 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2023-10-06T01:40:07.403 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.403 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.403 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.403 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.403 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.403 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.403 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2023-10-06T01:40:07.404 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2023-10-06T01:40:07.404 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2023-10-06T01:40:07.404 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.404 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2023-10-06T01:40:07.404 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2023-10-06T01:40:07.404 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.404 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.404 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.404 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.404 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.404 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.404 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.405 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.405 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_host": { 2023-10-06T01:40:07.405 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_host", 2023-10-06T01:40:07.405 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.405 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.405 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.405 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2023-10-06T01:40:07.405 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.405 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.405 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.405 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.405 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.406 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.406 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.406 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.406 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_port": { 2023-10-06T01:40:07.406 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_port", 2023-10-06T01:40:07.406 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2023-10-06T01:40:07.406 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.406 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.406 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10051", 2023-10-06T01:40:07.406 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.406 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.406 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.406 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.409 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.409 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.409 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.409 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.409 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_sender": { 2023-10-06T01:40:07.410 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_sender", 2023-10-06T01:40:07.410 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2023-10-06T01:40:07.410 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2023-10-06T01:40:07.410 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2023-10-06T01:40:07.410 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/usr/bin/zabbix_sender", 2023-10-06T01:40:07.410 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2023-10-06T01:40:07.410 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2023-10-06T01:40:07.410 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2023-10-06T01:40:07.410 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2023-10-06T01:40:07.410 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2023-10-06T01:40:07.410 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2023-10-06T01:40:07.411 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2023-10-06T01:40:07.411 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.411 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.411 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.411 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.411 INFO:teuthology.orchestra.run.smithi069.stdout: "services": {}, 2023-10-06T01:40:07.411 INFO:teuthology.orchestra.run.smithi069.stdout: "always_on_modules": { 2023-10-06T01:40:07.411 INFO:teuthology.orchestra.run.smithi069.stdout: "octopus": [ 2023-10-06T01:40:07.411 INFO:teuthology.orchestra.run.smithi069.stdout: "balancer", 2023-10-06T01:40:07.411 INFO:teuthology.orchestra.run.smithi069.stdout: "crash", 2023-10-06T01:40:07.411 INFO:teuthology.orchestra.run.smithi069.stdout: "devicehealth", 2023-10-06T01:40:07.412 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator", 2023-10-06T01:40:07.412 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_autoscaler", 2023-10-06T01:40:07.412 INFO:teuthology.orchestra.run.smithi069.stdout: "progress", 2023-10-06T01:40:07.412 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_support", 2023-10-06T01:40:07.412 INFO:teuthology.orchestra.run.smithi069.stdout: "status", 2023-10-06T01:40:07.412 INFO:teuthology.orchestra.run.smithi069.stdout: "telemetry", 2023-10-06T01:40:07.412 INFO:teuthology.orchestra.run.smithi069.stdout: "volumes" 2023-10-06T01:40:07.412 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.412 INFO:teuthology.orchestra.run.smithi069.stdout: "pacific": [ 2023-10-06T01:40:07.412 INFO:teuthology.orchestra.run.smithi069.stdout: "balancer", 2023-10-06T01:40:07.412 INFO:teuthology.orchestra.run.smithi069.stdout: "crash", 2023-10-06T01:40:07.412 INFO:teuthology.orchestra.run.smithi069.stdout: "devicehealth", 2023-10-06T01:40:07.413 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator", 2023-10-06T01:40:07.413 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_autoscaler", 2023-10-06T01:40:07.413 INFO:teuthology.orchestra.run.smithi069.stdout: "progress", 2023-10-06T01:40:07.413 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_support", 2023-10-06T01:40:07.413 INFO:teuthology.orchestra.run.smithi069.stdout: "status", 2023-10-06T01:40:07.413 INFO:teuthology.orchestra.run.smithi069.stdout: "telemetry", 2023-10-06T01:40:07.413 INFO:teuthology.orchestra.run.smithi069.stdout: "volumes" 2023-10-06T01:40:07.413 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2023-10-06T01:40:07.413 INFO:teuthology.orchestra.run.smithi069.stdout: "quincy": [ 2023-10-06T01:40:07.413 INFO:teuthology.orchestra.run.smithi069.stdout: "balancer", 2023-10-06T01:40:07.413 INFO:teuthology.orchestra.run.smithi069.stdout: "crash", 2023-10-06T01:40:07.414 INFO:teuthology.orchestra.run.smithi069.stdout: "devicehealth", 2023-10-06T01:40:07.414 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator", 2023-10-06T01:40:07.414 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_autoscaler", 2023-10-06T01:40:07.414 INFO:teuthology.orchestra.run.smithi069.stdout: "progress", 2023-10-06T01:40:07.414 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_support", 2023-10-06T01:40:07.414 INFO:teuthology.orchestra.run.smithi069.stdout: "status", 2023-10-06T01:40:07.414 INFO:teuthology.orchestra.run.smithi069.stdout: "telemetry", 2023-10-06T01:40:07.414 INFO:teuthology.orchestra.run.smithi069.stdout: "volumes" 2023-10-06T01:40:07.414 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-10-06T01:40:07.414 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.414 INFO:teuthology.orchestra.run.smithi069.stdout: "last_failure_osd_epoch": 0, 2023-10-06T01:40:07.415 INFO:teuthology.orchestra.run.smithi069.stdout: "active_clients": [ 2023-10-06T01:40:07.415 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.415 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "devicehealth", 2023-10-06T01:40:07.415 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2023-10-06T01:40:07.415 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.415 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2023-10-06T01:40:07.415 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2023-10-06T01:40:07.415 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 480665317 2023-10-06T01:40:07.415 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.415 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-10-06T01:40:07.415 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.415 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.415 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "libcephsqlite", 2023-10-06T01:40:07.416 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2023-10-06T01:40:07.416 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.416 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2023-10-06T01:40:07.416 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2023-10-06T01:40:07.416 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 2636600286 2023-10-06T01:40:07.416 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.416 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-10-06T01:40:07.416 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.416 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.416 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_support", 2023-10-06T01:40:07.416 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2023-10-06T01:40:07.417 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.417 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2023-10-06T01:40:07.417 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2023-10-06T01:40:07.417 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 1850425677 2023-10-06T01:40:07.417 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.417 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-10-06T01:40:07.417 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.417 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.417 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "volumes", 2023-10-06T01:40:07.417 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2023-10-06T01:40:07.417 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.417 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2023-10-06T01:40:07.417 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2023-10-06T01:40:07.418 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 340606714 2023-10-06T01:40:07.418 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.418 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-10-06T01:40:07.418 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.418 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.418 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "volumes", 2023-10-06T01:40:07.418 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2023-10-06T01:40:07.418 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.418 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2023-10-06T01:40:07.418 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2023-10-06T01:40:07.418 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 3402279450 2023-10-06T01:40:07.419 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.419 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-10-06T01:40:07.419 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.419 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.419 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "volumes", 2023-10-06T01:40:07.419 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2023-10-06T01:40:07.419 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.419 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2023-10-06T01:40:07.419 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2023-10-06T01:40:07.419 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 33838714 2023-10-06T01:40:07.419 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.419 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-10-06T01:40:07.419 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.420 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.420 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "volumes", 2023-10-06T01:40:07.420 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2023-10-06T01:40:07.420 INFO:teuthology.orchestra.run.smithi069.stdout: { 2023-10-06T01:40:07.420 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2023-10-06T01:40:07.420 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2023-10-06T01:40:07.420 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 3897794158 2023-10-06T01:40:07.420 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.420 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-10-06T01:40:07.420 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.420 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2023-10-06T01:40:07.420 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-10-06T01:40:07.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.420+0000 7fd146a36700 1 -- 172.21.15.69:0/1836533759 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd12c0670e0 msgr2=0x7fd12c069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:07.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.420+0000 7fd146a36700 1 --2- 172.21.15.69:0/1836533759 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd12c0670e0 0x7fd12c069590 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd1300017b0 tx=0x7fd130009040 comp rx=0 tx=0).stop 2023-10-06T01:40:07.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.420+0000 7fd146a36700 1 -- 172.21.15.69:0/1836533759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1400a8d00 msgr2=0x7fd14014a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:07.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.420+0000 7fd146a36700 1 --2- 172.21.15.69:0/1836533759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1400a8d00 0x7fd14014a860 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fd134009160 tx=0x7fd134016000 comp rx=0 tx=0).stop 2023-10-06T01:40:07.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.420+0000 7fd146a36700 1 -- 172.21.15.69:0/1836533759 shutdown_connections 2023-10-06T01:40:07.422 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.420+0000 7fd146a36700 1 --2- 172.21.15.69:0/1836533759 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd12c0670e0 0x7fd12c069590 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:07.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.420+0000 7fd146a36700 1 --2- 172.21.15.69:0/1836533759 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd1400a90d0 0x7fd14015bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:07.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.420+0000 7fd146a36700 1 --2- 172.21.15.69:0/1836533759 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd14006e380 0x7fd14015fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:07.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.420+0000 7fd146a36700 1 --2- 172.21.15.69:0/1836533759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd1400a8d00 0x7fd14014a860 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:07.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.420+0000 7fd146a36700 1 -- 172.21.15.69:0/1836533759 >> 172.21.15.69:0/1836533759 conn(0x7fd14006ce80 msgr2=0x7fd1400cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:07.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.420+0000 7fd146a36700 1 -- 172.21.15.69:0/1836533759 shutdown_connections 2023-10-06T01:40:07.423 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:06.420+0000 7fd146a36700 1 -- 172.21.15.69:0/1836533759 wait complete. 2023-10-06T01:40:07.427 DEBUG:tasks.check_counter:Getting stats from y 2023-10-06T01:40:07.427 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mgr.y.asok perf dump 2023-10-06T01:40:07.546 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-10-06T01:40:07.547 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-0": { 2023-10-06T01:40:07.547 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 424, 2023-10-06T01:40:07.547 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 211, 2023-10-06T01:40:07.547 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 4097376, 2023-10-06T01:40:07.547 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 98368, 2023-10-06T01:40:07.547 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 72, 2023-10-06T01:40:07.547 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 19, 2023-10-06T01:40:07.548 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.060143671, 2023-10-06T01:40:07.548 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.005643238, 2023-10-06T01:40:07.548 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.058046652, 2023-10-06T01:40:07.548 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.000098573, 2023-10-06T01:40:07.548 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T01:40:07.548 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 189, 2023-10-06T01:40:07.548 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.011424403, 2023-10-06T01:40:07.548 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000060446 2023-10-06T01:40:07.548 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.548 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2023-10-06T01:40:07.548 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 280, 2023-10-06T01:40:07.549 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000029341, 2023-10-06T01:40:07.549 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000104 2023-10-06T01:40:07.549 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.549 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.549 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-1": { 2023-10-06T01:40:07.549 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 593, 2023-10-06T01:40:07.549 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 350, 2023-10-06T01:40:07.549 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 3106624, 2023-10-06T01:40:07.549 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 2508640, 2023-10-06T01:40:07.549 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 81, 2023-10-06T01:40:07.550 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 22, 2023-10-06T01:40:07.550 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.074260990, 2023-10-06T01:40:07.550 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.020269924, 2023-10-06T01:40:07.550 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.072115046, 2023-10-06T01:40:07.550 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.000074327, 2023-10-06T01:40:07.550 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T01:40:07.550 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 335, 2023-10-06T01:40:07.550 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.034579374, 2023-10-06T01:40:07.550 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000103222 2023-10-06T01:40:07.550 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.550 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2023-10-06T01:40:07.551 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.551 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.551 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.551 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.551 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.551 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-2": { 2023-10-06T01:40:07.551 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 454, 2023-10-06T01:40:07.551 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 350, 2023-10-06T01:40:07.551 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 1899415, 2023-10-06T01:40:07.551 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 6150262, 2023-10-06T01:40:07.551 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 180, 2023-10-06T01:40:07.551 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 17, 2023-10-06T01:40:07.552 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.097150005, 2023-10-06T01:40:07.552 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.010381483, 2023-10-06T01:40:07.552 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.088102160, 2023-10-06T01:40:07.552 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.002740980, 2023-10-06T01:40:07.552 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2023-10-06T01:40:07.552 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 337, 2023-10-06T01:40:07.552 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.018945581, 2023-10-06T01:40:07.552 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000056218 2023-10-06T01:40:07.552 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.552 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2023-10-06T01:40:07.552 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 206, 2023-10-06T01:40:07.552 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000021914, 2023-10-06T01:40:07.553 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000106 2023-10-06T01:40:07.553 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.553 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.553 INFO:teuthology.orchestra.run.smithi069.stdout: "cct": { 2023-10-06T01:40:07.553 INFO:teuthology.orchestra.run.smithi069.stdout: "total_workers": 0, 2023-10-06T01:40:07.553 INFO:teuthology.orchestra.run.smithi069.stdout: "unhealthy_workers": 0 2023-10-06T01:40:07.553 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.553 INFO:teuthology.orchestra.run.smithi069.stdout: "client": { 2023-10-06T01:40:07.553 INFO:teuthology.orchestra.run.smithi069.stdout: "reply": { 2023-10-06T01:40:07.553 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.553 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.554 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.554 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.554 INFO:teuthology.orchestra.run.smithi069.stdout: "lat": { 2023-10-06T01:40:07.554 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.554 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.554 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.554 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.554 INFO:teuthology.orchestra.run.smithi069.stdout: "wrlat": { 2023-10-06T01:40:07.554 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.554 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.554 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.555 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.555 INFO:teuthology.orchestra.run.smithi069.stdout: "rdlat": { 2023-10-06T01:40:07.555 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.555 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.555 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.555 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.555 INFO:teuthology.orchestra.run.smithi069.stdout: "fsync": { 2023-10-06T01:40:07.555 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.555 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.555 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.555 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.555 INFO:teuthology.orchestra.run.smithi069.stdout: "mdavg": 0.000000000, 2023-10-06T01:40:07.556 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsqsum": 0, 2023-10-06T01:40:07.556 INFO:teuthology.orchestra.run.smithi069.stdout: "mdops": 0, 2023-10-06T01:40:07.556 INFO:teuthology.orchestra.run.smithi069.stdout: "readavg": 0.000000000, 2023-10-06T01:40:07.556 INFO:teuthology.orchestra.run.smithi069.stdout: "readsqsum": 0, 2023-10-06T01:40:07.556 INFO:teuthology.orchestra.run.smithi069.stdout: "rdops": 0, 2023-10-06T01:40:07.556 INFO:teuthology.orchestra.run.smithi069.stdout: "writeavg": 0.000000000, 2023-10-06T01:40:07.556 INFO:teuthology.orchestra.run.smithi069.stdout: "writesqsum": 0, 2023-10-06T01:40:07.556 INFO:teuthology.orchestra.run.smithi069.stdout: "rdops": 0 2023-10-06T01:40:07.556 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.556 INFO:teuthology.orchestra.run.smithi069.stdout: "client-0x556f9c720000": { 2023-10-06T01:40:07.556 INFO:teuthology.orchestra.run.smithi069.stdout: "reply": { 2023-10-06T01:40:07.556 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 24, 2023-10-06T01:40:07.557 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.353792754, 2023-10-06T01:40:07.557 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.014741364 2023-10-06T01:40:07.557 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.557 INFO:teuthology.orchestra.run.smithi069.stdout: "lat": { 2023-10-06T01:40:07.557 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 24, 2023-10-06T01:40:07.557 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.353792754, 2023-10-06T01:40:07.557 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.014741364 2023-10-06T01:40:07.557 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.557 INFO:teuthology.orchestra.run.smithi069.stdout: "wrlat": { 2023-10-06T01:40:07.558 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.558 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.558 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.558 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.558 INFO:teuthology.orchestra.run.smithi069.stdout: "rdlat": { 2023-10-06T01:40:07.558 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.558 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.558 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.558 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.558 INFO:teuthology.orchestra.run.smithi069.stdout: "fsync": { 2023-10-06T01:40:07.558 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.559 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.559 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.559 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.559 INFO:teuthology.orchestra.run.smithi069.stdout: "mdavg": 0.014741360, 2023-10-06T01:40:07.559 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsqsum": 111066740775229792, 2023-10-06T01:40:07.559 INFO:teuthology.orchestra.run.smithi069.stdout: "mdops": 24, 2023-10-06T01:40:07.559 INFO:teuthology.orchestra.run.smithi069.stdout: "readavg": 0.000000000, 2023-10-06T01:40:07.559 INFO:teuthology.orchestra.run.smithi069.stdout: "readsqsum": 0, 2023-10-06T01:40:07.559 INFO:teuthology.orchestra.run.smithi069.stdout: "rdops": 0, 2023-10-06T01:40:07.559 INFO:teuthology.orchestra.run.smithi069.stdout: "writeavg": 0.000000000, 2023-10-06T01:40:07.559 INFO:teuthology.orchestra.run.smithi069.stdout: "writesqsum": 0, 2023-10-06T01:40:07.560 INFO:teuthology.orchestra.run.smithi069.stdout: "rdops": 0 2023-10-06T01:40:07.560 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.560 INFO:teuthology.orchestra.run.smithi069.stdout: "client-0x556f9c720500": { 2023-10-06T01:40:07.560 INFO:teuthology.orchestra.run.smithi069.stdout: "reply": { 2023-10-06T01:40:07.560 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 70, 2023-10-06T01:40:07.560 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.112182411, 2023-10-06T01:40:07.560 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.001602605 2023-10-06T01:40:07.560 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.560 INFO:teuthology.orchestra.run.smithi069.stdout: "lat": { 2023-10-06T01:40:07.560 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 70, 2023-10-06T01:40:07.560 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.112182411, 2023-10-06T01:40:07.560 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.001602605 2023-10-06T01:40:07.561 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.561 INFO:teuthology.orchestra.run.smithi069.stdout: "wrlat": { 2023-10-06T01:40:07.561 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 18, 2023-10-06T01:40:07.561 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000508487, 2023-10-06T01:40:07.561 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000028249 2023-10-06T01:40:07.561 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.561 INFO:teuthology.orchestra.run.smithi069.stdout: "rdlat": { 2023-10-06T01:40:07.561 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 18, 2023-10-06T01:40:07.561 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000350040, 2023-10-06T01:40:07.561 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000019446 2023-10-06T01:40:07.561 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.562 INFO:teuthology.orchestra.run.smithi069.stdout: "fsync": { 2023-10-06T01:40:07.562 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 3, 2023-10-06T01:40:07.562 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.014999767, 2023-10-06T01:40:07.562 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.004999922 2023-10-06T01:40:07.562 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.562 INFO:teuthology.orchestra.run.smithi069.stdout: "mdavg": 0.001602590, 2023-10-06T01:40:07.562 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsqsum": 279336019537721, 2023-10-06T01:40:07.562 INFO:teuthology.orchestra.run.smithi069.stdout: "mdops": 70, 2023-10-06T01:40:07.562 INFO:teuthology.orchestra.run.smithi069.stdout: "readavg": 0.000019442, 2023-10-06T01:40:07.562 INFO:teuthology.orchestra.run.smithi069.stdout: "readsqsum": 718899331, 2023-10-06T01:40:07.562 INFO:teuthology.orchestra.run.smithi069.stdout: "rdops": 18, 2023-10-06T01:40:07.562 INFO:teuthology.orchestra.run.smithi069.stdout: "writeavg": 0.000028245, 2023-10-06T01:40:07.563 INFO:teuthology.orchestra.run.smithi069.stdout: "writesqsum": 2885217747, 2023-10-06T01:40:07.563 INFO:teuthology.orchestra.run.smithi069.stdout: "rdops": 18 2023-10-06T01:40:07.563 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.563 INFO:teuthology.orchestra.run.smithi069.stdout: "client-0x556f9c7210e0": { 2023-10-06T01:40:07.563 INFO:teuthology.orchestra.run.smithi069.stdout: "reply": { 2023-10-06T01:40:07.563 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 54, 2023-10-06T01:40:07.563 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.082489654, 2023-10-06T01:40:07.563 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.001527586 2023-10-06T01:40:07.563 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.563 INFO:teuthology.orchestra.run.smithi069.stdout: "lat": { 2023-10-06T01:40:07.563 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 54, 2023-10-06T01:40:07.564 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.082489654, 2023-10-06T01:40:07.564 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.001527586 2023-10-06T01:40:07.564 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.564 INFO:teuthology.orchestra.run.smithi069.stdout: "wrlat": { 2023-10-06T01:40:07.564 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.564 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.564 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.564 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.564 INFO:teuthology.orchestra.run.smithi069.stdout: "rdlat": { 2023-10-06T01:40:07.564 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.564 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.564 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.565 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.565 INFO:teuthology.orchestra.run.smithi069.stdout: "fsync": { 2023-10-06T01:40:07.565 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.565 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.565 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.565 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.565 INFO:teuthology.orchestra.run.smithi069.stdout: "mdavg": 0.001527574, 2023-10-06T01:40:07.565 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsqsum": 168392500858631, 2023-10-06T01:40:07.565 INFO:teuthology.orchestra.run.smithi069.stdout: "mdops": 54, 2023-10-06T01:40:07.565 INFO:teuthology.orchestra.run.smithi069.stdout: "readavg": 0.000000000, 2023-10-06T01:40:07.565 INFO:teuthology.orchestra.run.smithi069.stdout: "readsqsum": 0, 2023-10-06T01:40:07.566 INFO:teuthology.orchestra.run.smithi069.stdout: "rdops": 0, 2023-10-06T01:40:07.566 INFO:teuthology.orchestra.run.smithi069.stdout: "writeavg": 0.000000000, 2023-10-06T01:40:07.566 INFO:teuthology.orchestra.run.smithi069.stdout: "writesqsum": 0, 2023-10-06T01:40:07.566 INFO:teuthology.orchestra.run.smithi069.stdout: "rdops": 0 2023-10-06T01:40:07.566 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.566 INFO:teuthology.orchestra.run.smithi069.stdout: "finisher-Mgr": { 2023-10-06T01:40:07.566 INFO:teuthology.orchestra.run.smithi069.stdout: "queue_len": 0, 2023-10-06T01:40:07.566 INFO:teuthology.orchestra.run.smithi069.stdout: "complete_latency": { 2023-10-06T01:40:07.566 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 2, 2023-10-06T01:40:07.566 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.046156211, 2023-10-06T01:40:07.566 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.023078105 2023-10-06T01:40:07.566 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.567 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.567 INFO:teuthology.orchestra.run.smithi069.stdout: "finisher-MgrStandby": { 2023-10-06T01:40:07.567 INFO:teuthology.orchestra.run.smithi069.stdout: "queue_len": 0, 2023-10-06T01:40:07.567 INFO:teuthology.orchestra.run.smithi069.stdout: "complete_latency": { 2023-10-06T01:40:07.567 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.567 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.567 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.567 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.567 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.567 INFO:teuthology.orchestra.run.smithi069.stdout: "finisher-balancer": { 2023-10-06T01:40:07.567 INFO:teuthology.orchestra.run.smithi069.stdout: "queue_len": 0, 2023-10-06T01:40:07.568 INFO:teuthology.orchestra.run.smithi069.stdout: "complete_latency": { 2023-10-06T01:40:07.568 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.568 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.568 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.568 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.568 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.568 INFO:teuthology.orchestra.run.smithi069.stdout: "finisher-cmd_finisher": { 2023-10-06T01:40:07.568 INFO:teuthology.orchestra.run.smithi069.stdout: "queue_len": 0, 2023-10-06T01:40:07.568 INFO:teuthology.orchestra.run.smithi069.stdout: "complete_latency": { 2023-10-06T01:40:07.568 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 14, 2023-10-06T01:40:07.568 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000782285, 2023-10-06T01:40:07.568 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000055877 2023-10-06T01:40:07.569 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.569 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.569 INFO:teuthology.orchestra.run.smithi069.stdout: "finisher-crash": { 2023-10-06T01:40:07.569 INFO:teuthology.orchestra.run.smithi069.stdout: "queue_len": 0, 2023-10-06T01:40:07.569 INFO:teuthology.orchestra.run.smithi069.stdout: "complete_latency": { 2023-10-06T01:40:07.569 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.569 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.569 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.569 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.569 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.569 INFO:teuthology.orchestra.run.smithi069.stdout: "finisher-devicehealth": { 2023-10-06T01:40:07.569 INFO:teuthology.orchestra.run.smithi069.stdout: "queue_len": 0, 2023-10-06T01:40:07.570 INFO:teuthology.orchestra.run.smithi069.stdout: "complete_latency": { 2023-10-06T01:40:07.570 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.570 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.570 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.570 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.570 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.570 INFO:teuthology.orchestra.run.smithi069.stdout: "finisher-iostat": { 2023-10-06T01:40:07.570 INFO:teuthology.orchestra.run.smithi069.stdout: "queue_len": 0, 2023-10-06T01:40:07.570 INFO:teuthology.orchestra.run.smithi069.stdout: "complete_latency": { 2023-10-06T01:40:07.570 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.570 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.570 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.571 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.571 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.571 INFO:teuthology.orchestra.run.smithi069.stdout: "finisher-nfs": { 2023-10-06T01:40:07.571 INFO:teuthology.orchestra.run.smithi069.stdout: "queue_len": 0, 2023-10-06T01:40:07.571 INFO:teuthology.orchestra.run.smithi069.stdout: "complete_latency": { 2023-10-06T01:40:07.571 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.571 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.571 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.571 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.571 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.571 INFO:teuthology.orchestra.run.smithi069.stdout: "finisher-orchestrator": { 2023-10-06T01:40:07.571 INFO:teuthology.orchestra.run.smithi069.stdout: "queue_len": 0, 2023-10-06T01:40:07.572 INFO:teuthology.orchestra.run.smithi069.stdout: "complete_latency": { 2023-10-06T01:40:07.572 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.572 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.572 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.572 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.572 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.572 INFO:teuthology.orchestra.run.smithi069.stdout: "finisher-pg_autoscaler": { 2023-10-06T01:40:07.572 INFO:teuthology.orchestra.run.smithi069.stdout: "queue_len": 0, 2023-10-06T01:40:07.572 INFO:teuthology.orchestra.run.smithi069.stdout: "complete_latency": { 2023-10-06T01:40:07.572 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.572 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.572 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.573 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.573 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.573 INFO:teuthology.orchestra.run.smithi069.stdout: "finisher-progress": { 2023-10-06T01:40:07.573 INFO:teuthology.orchestra.run.smithi069.stdout: "queue_len": 0, 2023-10-06T01:40:07.573 INFO:teuthology.orchestra.run.smithi069.stdout: "complete_latency": { 2023-10-06T01:40:07.573 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.573 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.573 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.573 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.573 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.573 INFO:teuthology.orchestra.run.smithi069.stdout: "finisher-rbd_support": { 2023-10-06T01:40:07.574 INFO:teuthology.orchestra.run.smithi069.stdout: "queue_len": 0, 2023-10-06T01:40:07.574 INFO:teuthology.orchestra.run.smithi069.stdout: "complete_latency": { 2023-10-06T01:40:07.574 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.574 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.574 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.574 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.574 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.574 INFO:teuthology.orchestra.run.smithi069.stdout: "finisher-restful": { 2023-10-06T01:40:07.574 INFO:teuthology.orchestra.run.smithi069.stdout: "queue_len": 0, 2023-10-06T01:40:07.574 INFO:teuthology.orchestra.run.smithi069.stdout: "complete_latency": { 2023-10-06T01:40:07.574 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 15, 2023-10-06T01:40:07.575 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.002889705, 2023-10-06T01:40:07.575 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000192647 2023-10-06T01:40:07.575 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.575 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.575 INFO:teuthology.orchestra.run.smithi069.stdout: "finisher-status": { 2023-10-06T01:40:07.575 INFO:teuthology.orchestra.run.smithi069.stdout: "queue_len": 0, 2023-10-06T01:40:07.575 INFO:teuthology.orchestra.run.smithi069.stdout: "complete_latency": { 2023-10-06T01:40:07.575 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.575 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.575 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.575 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.575 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.576 INFO:teuthology.orchestra.run.smithi069.stdout: "finisher-telemetry": { 2023-10-06T01:40:07.576 INFO:teuthology.orchestra.run.smithi069.stdout: "queue_len": 0, 2023-10-06T01:40:07.576 INFO:teuthology.orchestra.run.smithi069.stdout: "complete_latency": { 2023-10-06T01:40:07.576 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.576 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.576 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.576 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.576 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.576 INFO:teuthology.orchestra.run.smithi069.stdout: "finisher-volumes": { 2023-10-06T01:40:07.576 INFO:teuthology.orchestra.run.smithi069.stdout: "queue_len": 0, 2023-10-06T01:40:07.576 INFO:teuthology.orchestra.run.smithi069.stdout: "complete_latency": { 2023-10-06T01:40:07.576 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 9, 2023-10-06T01:40:07.577 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.166797831, 2023-10-06T01:40:07.577 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.018533092 2023-10-06T01:40:07.577 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.577 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.577 INFO:teuthology.orchestra.run.smithi069.stdout: "libcephsqlite_striper": { 2023-10-06T01:40:07.577 INFO:teuthology.orchestra.run.smithi069.stdout: "update_metadata": 8, 2023-10-06T01:40:07.577 INFO:teuthology.orchestra.run.smithi069.stdout: "update_allocated": 2, 2023-10-06T01:40:07.577 INFO:teuthology.orchestra.run.smithi069.stdout: "update_size": 6, 2023-10-06T01:40:07.577 INFO:teuthology.orchestra.run.smithi069.stdout: "update_version": 8, 2023-10-06T01:40:07.577 INFO:teuthology.orchestra.run.smithi069.stdout: "shrink": 0, 2023-10-06T01:40:07.577 INFO:teuthology.orchestra.run.smithi069.stdout: "shrink_bytes": 0, 2023-10-06T01:40:07.577 INFO:teuthology.orchestra.run.smithi069.stdout: "lock": 11, 2023-10-06T01:40:07.578 INFO:teuthology.orchestra.run.smithi069.stdout: "unlock": 11 2023-10-06T01:40:07.578 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.578 INFO:teuthology.orchestra.run.smithi069.stdout: "libcephsqlite_vfs": { 2023-10-06T01:40:07.578 INFO:teuthology.orchestra.run.smithi069.stdout: "op_open": { 2023-10-06T01:40:07.578 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 2, 2023-10-06T01:40:07.578 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.769983431, 2023-10-06T01:40:07.578 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.384991715 2023-10-06T01:40:07.578 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.579 INFO:teuthology.orchestra.run.smithi069.stdout: "op_delete": { 2023-10-06T01:40:07.579 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.579 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.579 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.579 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.579 INFO:teuthology.orchestra.run.smithi069.stdout: "op_access": { 2023-10-06T01:40:07.579 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.579 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.579 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.579 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.579 INFO:teuthology.orchestra.run.smithi069.stdout: "op_fullpathname": { 2023-10-06T01:40:07.579 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 1, 2023-10-06T01:40:07.580 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.580 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.580 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.580 INFO:teuthology.orchestra.run.smithi069.stdout: "op_currenttime": { 2023-10-06T01:40:07.580 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 4, 2023-10-06T01:40:07.580 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.580 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.580 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.580 INFO:teuthology.orchestra.run.smithi069.stdout: "opf_close": { 2023-10-06T01:40:07.580 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.580 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.581 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.581 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.581 INFO:teuthology.orchestra.run.smithi069.stdout: "opf_read": { 2023-10-06T01:40:07.581 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 20, 2023-10-06T01:40:07.581 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.008999809, 2023-10-06T01:40:07.581 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000449990 2023-10-06T01:40:07.581 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.581 INFO:teuthology.orchestra.run.smithi069.stdout: "opf_write": { 2023-10-06T01:40:07.581 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 85, 2023-10-06T01:40:07.581 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.002999935, 2023-10-06T01:40:07.581 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000035293 2023-10-06T01:40:07.582 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.582 INFO:teuthology.orchestra.run.smithi069.stdout: "opf_truncate": { 2023-10-06T01:40:07.582 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.582 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.582 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.582 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.582 INFO:teuthology.orchestra.run.smithi069.stdout: "opf_sync": { 2023-10-06T01:40:07.582 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 24, 2023-10-06T01:40:07.582 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.093997979, 2023-10-06T01:40:07.582 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.003916582 2023-10-06T01:40:07.582 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.583 INFO:teuthology.orchestra.run.smithi069.stdout: "opf_filesize": { 2023-10-06T01:40:07.583 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 20, 2023-10-06T01:40:07.583 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.583 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.583 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.583 INFO:teuthology.orchestra.run.smithi069.stdout: "opf_lock": { 2023-10-06T01:40:07.583 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 27, 2023-10-06T01:40:07.583 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.021999525, 2023-10-06T01:40:07.583 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000814797 2023-10-06T01:40:07.583 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.583 INFO:teuthology.orchestra.run.smithi069.stdout: "opf_unlock": { 2023-10-06T01:40:07.583 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 19, 2023-10-06T01:40:07.584 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.014999677, 2023-10-06T01:40:07.584 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000789456 2023-10-06T01:40:07.584 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.584 INFO:teuthology.orchestra.run.smithi069.stdout: "opf_checkreservedlock": { 2023-10-06T01:40:07.584 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 9, 2023-10-06T01:40:07.584 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.584 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.584 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.584 INFO:teuthology.orchestra.run.smithi069.stdout: "opf_filecontrol": { 2023-10-06T01:40:07.584 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 26, 2023-10-06T01:40:07.584 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.584 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.585 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.585 INFO:teuthology.orchestra.run.smithi069.stdout: "opf_sectorsize": { 2023-10-06T01:40:07.585 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.585 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.585 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.585 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.585 INFO:teuthology.orchestra.run.smithi069.stdout: "opf_devicecharacteristics": { 2023-10-06T01:40:07.585 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 30, 2023-10-06T01:40:07.585 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.585 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.585 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.585 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.586 INFO:teuthology.orchestra.run.smithi069.stdout: "mempool": { 2023-10-06T01:40:07.586 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_bytes": 0, 2023-10-06T01:40:07.586 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_items": 0, 2023-10-06T01:40:07.586 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_bytes": 0, 2023-10-06T01:40:07.586 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_items": 0, 2023-10-06T01:40:07.586 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_bytes": 0, 2023-10-06T01:40:07.586 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_items": 0, 2023-10-06T01:40:07.586 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_bytes": 0, 2023-10-06T01:40:07.586 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_items": 0, 2023-10-06T01:40:07.586 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_bytes": 0, 2023-10-06T01:40:07.586 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_items": 0, 2023-10-06T01:40:07.587 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_bytes": 0, 2023-10-06T01:40:07.587 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_items": 0, 2023-10-06T01:40:07.587 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_Buffer_bytes": 0, 2023-10-06T01:40:07.587 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_Buffer_items": 0, 2023-10-06T01:40:07.587 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_Extent_bytes": 0, 2023-10-06T01:40:07.587 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_Extent_items": 0, 2023-10-06T01:40:07.587 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_Blob_bytes": 0, 2023-10-06T01:40:07.587 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_Blob_items": 0, 2023-10-06T01:40:07.587 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_SharedBlob_bytes": 0, 2023-10-06T01:40:07.587 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_SharedBlob_items": 0, 2023-10-06T01:40:07.587 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_bytes": 0, 2023-10-06T01:40:07.587 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_items": 0, 2023-10-06T01:40:07.588 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_bytes": 0, 2023-10-06T01:40:07.588 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_items": 0, 2023-10-06T01:40:07.588 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_bytes": 0, 2023-10-06T01:40:07.588 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_items": 0, 2023-10-06T01:40:07.588 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_bytes": 0, 2023-10-06T01:40:07.588 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_items": 0, 2023-10-06T01:40:07.588 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_bytes": 0, 2023-10-06T01:40:07.588 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_items": 0, 2023-10-06T01:40:07.588 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_bytes": 0, 2023-10-06T01:40:07.588 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_items": 0, 2023-10-06T01:40:07.588 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_bytes": 0, 2023-10-06T01:40:07.588 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_items": 0, 2023-10-06T01:40:07.589 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_bytes": 0, 2023-10-06T01:40:07.589 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_items": 0, 2023-10-06T01:40:07.589 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_bytes": 1598549, 2023-10-06T01:40:07.589 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_items": 351, 2023-10-06T01:40:07.589 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_bytes": 1496, 2023-10-06T01:40:07.589 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_items": 17, 2023-10-06T01:40:07.589 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_bytes": 0, 2023-10-06T01:40:07.589 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_items": 0, 2023-10-06T01:40:07.589 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_bytes": 0, 2023-10-06T01:40:07.589 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_items": 0, 2023-10-06T01:40:07.589 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_bytes": 0, 2023-10-06T01:40:07.589 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_items": 0, 2023-10-06T01:40:07.590 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_bytes": 50008, 2023-10-06T01:40:07.590 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_items": 752, 2023-10-06T01:40:07.590 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_bytes": 0, 2023-10-06T01:40:07.590 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_items": 0, 2023-10-06T01:40:07.590 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_bytes": 22448, 2023-10-06T01:40:07.590 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_items": 341, 2023-10-06T01:40:07.590 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_bytes": 0, 2023-10-06T01:40:07.590 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_items": 0, 2023-10-06T01:40:07.590 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_bytes": 0, 2023-10-06T01:40:07.590 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_items": 0, 2023-10-06T01:40:07.590 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_bytes": 0, 2023-10-06T01:40:07.590 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_items": 0 2023-10-06T01:40:07.591 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.591 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr": { 2023-10-06T01:40:07.591 INFO:teuthology.orchestra.run.smithi069.stdout: "cache_hit": 0, 2023-10-06T01:40:07.591 INFO:teuthology.orchestra.run.smithi069.stdout: "cache_miss": 0 2023-10-06T01:40:07.591 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.591 INFO:teuthology.orchestra.run.smithi069.stdout: "objectcacher-libcephfs": { 2023-10-06T01:40:07.591 INFO:teuthology.orchestra.run.smithi069.stdout: "cache_ops_hit": 0, 2023-10-06T01:40:07.591 INFO:teuthology.orchestra.run.smithi069.stdout: "cache_ops_miss": 0, 2023-10-06T01:40:07.591 INFO:teuthology.orchestra.run.smithi069.stdout: "cache_bytes_hit": 0, 2023-10-06T01:40:07.591 INFO:teuthology.orchestra.run.smithi069.stdout: "cache_bytes_miss": 0, 2023-10-06T01:40:07.591 INFO:teuthology.orchestra.run.smithi069.stdout: "data_read": 0, 2023-10-06T01:40:07.591 INFO:teuthology.orchestra.run.smithi069.stdout: "data_written": 0, 2023-10-06T01:40:07.592 INFO:teuthology.orchestra.run.smithi069.stdout: "data_flushed": 0, 2023-10-06T01:40:07.592 INFO:teuthology.orchestra.run.smithi069.stdout: "data_overwritten_while_flushing": 0, 2023-10-06T01:40:07.592 INFO:teuthology.orchestra.run.smithi069.stdout: "write_ops_blocked": 0, 2023-10-06T01:40:07.592 INFO:teuthology.orchestra.run.smithi069.stdout: "write_bytes_blocked": 0, 2023-10-06T01:40:07.592 INFO:teuthology.orchestra.run.smithi069.stdout: "write_time_blocked": 0.000000000 2023-10-06T01:40:07.592 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.592 INFO:teuthology.orchestra.run.smithi069.stdout: "objectcacher-libcephfs-0x556f9c7203c0": { 2023-10-06T01:40:07.592 INFO:teuthology.orchestra.run.smithi069.stdout: "cache_ops_hit": 9, 2023-10-06T01:40:07.592 INFO:teuthology.orchestra.run.smithi069.stdout: "cache_ops_miss": 0, 2023-10-06T01:40:07.592 INFO:teuthology.orchestra.run.smithi069.stdout: "cache_bytes_hit": 1431, 2023-10-06T01:40:07.592 INFO:teuthology.orchestra.run.smithi069.stdout: "cache_bytes_miss": 0, 2023-10-06T01:40:07.593 INFO:teuthology.orchestra.run.smithi069.stdout: "data_read": 1431, 2023-10-06T01:40:07.593 INFO:teuthology.orchestra.run.smithi069.stdout: "data_written": 477, 2023-10-06T01:40:07.593 INFO:teuthology.orchestra.run.smithi069.stdout: "data_flushed": 477, 2023-10-06T01:40:07.593 INFO:teuthology.orchestra.run.smithi069.stdout: "data_overwritten_while_flushing": 0, 2023-10-06T01:40:07.593 INFO:teuthology.orchestra.run.smithi069.stdout: "write_ops_blocked": 0, 2023-10-06T01:40:07.593 INFO:teuthology.orchestra.run.smithi069.stdout: "write_bytes_blocked": 0, 2023-10-06T01:40:07.593 INFO:teuthology.orchestra.run.smithi069.stdout: "write_time_blocked": 0.000000000 2023-10-06T01:40:07.593 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.593 INFO:teuthology.orchestra.run.smithi069.stdout: "objectcacher-libcephfs-0x556f9c720d20": { 2023-10-06T01:40:07.593 INFO:teuthology.orchestra.run.smithi069.stdout: "cache_ops_hit": 0, 2023-10-06T01:40:07.593 INFO:teuthology.orchestra.run.smithi069.stdout: "cache_ops_miss": 0, 2023-10-06T01:40:07.593 INFO:teuthology.orchestra.run.smithi069.stdout: "cache_bytes_hit": 0, 2023-10-06T01:40:07.594 INFO:teuthology.orchestra.run.smithi069.stdout: "cache_bytes_miss": 0, 2023-10-06T01:40:07.594 INFO:teuthology.orchestra.run.smithi069.stdout: "data_read": 0, 2023-10-06T01:40:07.594 INFO:teuthology.orchestra.run.smithi069.stdout: "data_written": 0, 2023-10-06T01:40:07.594 INFO:teuthology.orchestra.run.smithi069.stdout: "data_flushed": 0, 2023-10-06T01:40:07.594 INFO:teuthology.orchestra.run.smithi069.stdout: "data_overwritten_while_flushing": 0, 2023-10-06T01:40:07.594 INFO:teuthology.orchestra.run.smithi069.stdout: "write_ops_blocked": 0, 2023-10-06T01:40:07.594 INFO:teuthology.orchestra.run.smithi069.stdout: "write_bytes_blocked": 0, 2023-10-06T01:40:07.594 INFO:teuthology.orchestra.run.smithi069.stdout: "write_time_blocked": 0.000000000 2023-10-06T01:40:07.594 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.594 INFO:teuthology.orchestra.run.smithi069.stdout: "objectcacher-libcephfs-0x556f9c721220": { 2023-10-06T01:40:07.594 INFO:teuthology.orchestra.run.smithi069.stdout: "cache_ops_hit": 0, 2023-10-06T01:40:07.595 INFO:teuthology.orchestra.run.smithi069.stdout: "cache_ops_miss": 0, 2023-10-06T01:40:07.595 INFO:teuthology.orchestra.run.smithi069.stdout: "cache_bytes_hit": 0, 2023-10-06T01:40:07.595 INFO:teuthology.orchestra.run.smithi069.stdout: "cache_bytes_miss": 0, 2023-10-06T01:40:07.595 INFO:teuthology.orchestra.run.smithi069.stdout: "data_read": 0, 2023-10-06T01:40:07.595 INFO:teuthology.orchestra.run.smithi069.stdout: "data_written": 0, 2023-10-06T01:40:07.595 INFO:teuthology.orchestra.run.smithi069.stdout: "data_flushed": 0, 2023-10-06T01:40:07.595 INFO:teuthology.orchestra.run.smithi069.stdout: "data_overwritten_while_flushing": 0, 2023-10-06T01:40:07.595 INFO:teuthology.orchestra.run.smithi069.stdout: "write_ops_blocked": 0, 2023-10-06T01:40:07.595 INFO:teuthology.orchestra.run.smithi069.stdout: "write_bytes_blocked": 0, 2023-10-06T01:40:07.595 INFO:teuthology.orchestra.run.smithi069.stdout: "write_time_blocked": 0.000000000 2023-10-06T01:40:07.595 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.595 INFO:teuthology.orchestra.run.smithi069.stdout: "objecter": { 2023-10-06T01:40:07.596 INFO:teuthology.orchestra.run.smithi069.stdout: "op_active": 0, 2023-10-06T01:40:07.596 INFO:teuthology.orchestra.run.smithi069.stdout: "op_laggy": 0, 2023-10-06T01:40:07.596 INFO:teuthology.orchestra.run.smithi069.stdout: "op_send": 0, 2023-10-06T01:40:07.596 INFO:teuthology.orchestra.run.smithi069.stdout: "op_send_bytes": 0, 2023-10-06T01:40:07.596 INFO:teuthology.orchestra.run.smithi069.stdout: "op_resend": 0, 2023-10-06T01:40:07.596 INFO:teuthology.orchestra.run.smithi069.stdout: "op_reply": 0, 2023-10-06T01:40:07.596 INFO:teuthology.orchestra.run.smithi069.stdout: "oplen_avg": { 2023-10-06T01:40:07.596 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.596 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0 2023-10-06T01:40:07.596 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.596 INFO:teuthology.orchestra.run.smithi069.stdout: "op": 0, 2023-10-06T01:40:07.596 INFO:teuthology.orchestra.run.smithi069.stdout: "op_r": 0, 2023-10-06T01:40:07.597 INFO:teuthology.orchestra.run.smithi069.stdout: "op_w": 0, 2023-10-06T01:40:07.597 INFO:teuthology.orchestra.run.smithi069.stdout: "op_rmw": 0, 2023-10-06T01:40:07.597 INFO:teuthology.orchestra.run.smithi069.stdout: "op_pg": 0, 2023-10-06T01:40:07.597 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_stat": 0, 2023-10-06T01:40:07.597 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_create": 0, 2023-10-06T01:40:07.597 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_read": 0, 2023-10-06T01:40:07.597 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_write": 0, 2023-10-06T01:40:07.597 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_writefull": 0, 2023-10-06T01:40:07.597 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_writesame": 0, 2023-10-06T01:40:07.597 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_append": 0, 2023-10-06T01:40:07.597 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_zero": 0, 2023-10-06T01:40:07.597 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_truncate": 0, 2023-10-06T01:40:07.598 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_delete": 0, 2023-10-06T01:40:07.598 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_mapext": 0, 2023-10-06T01:40:07.598 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_sparse_read": 0, 2023-10-06T01:40:07.598 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_clonerange": 0, 2023-10-06T01:40:07.598 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_getxattr": 0, 2023-10-06T01:40:07.598 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_setxattr": 0, 2023-10-06T01:40:07.598 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_cmpxattr": 0, 2023-10-06T01:40:07.598 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_rmxattr": 0, 2023-10-06T01:40:07.598 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_resetxattrs": 0, 2023-10-06T01:40:07.598 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_call": 0, 2023-10-06T01:40:07.598 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_watch": 0, 2023-10-06T01:40:07.598 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_notify": 0, 2023-10-06T01:40:07.599 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_src_cmpxattr": 0, 2023-10-06T01:40:07.599 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_pgls": 0, 2023-10-06T01:40:07.599 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_pgls_filter": 0, 2023-10-06T01:40:07.599 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_other": 0, 2023-10-06T01:40:07.599 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_active": 0, 2023-10-06T01:40:07.599 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_send": 0, 2023-10-06T01:40:07.599 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_resend": 0, 2023-10-06T01:40:07.599 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_ping": 0, 2023-10-06T01:40:07.599 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_active": 0, 2023-10-06T01:40:07.599 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_send": 0, 2023-10-06T01:40:07.599 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_resend": 0, 2023-10-06T01:40:07.600 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_active": 0, 2023-10-06T01:40:07.600 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_send": 0, 2023-10-06T01:40:07.600 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_resend": 0, 2023-10-06T01:40:07.600 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_active": 0, 2023-10-06T01:40:07.600 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_send": 0, 2023-10-06T01:40:07.600 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_resend": 0, 2023-10-06T01:40:07.600 INFO:teuthology.orchestra.run.smithi069.stdout: "command_active": 0, 2023-10-06T01:40:07.600 INFO:teuthology.orchestra.run.smithi069.stdout: "command_send": 8, 2023-10-06T01:40:07.600 INFO:teuthology.orchestra.run.smithi069.stdout: "command_resend": 0, 2023-10-06T01:40:07.600 INFO:teuthology.orchestra.run.smithi069.stdout: "map_epoch": 38, 2023-10-06T01:40:07.600 INFO:teuthology.orchestra.run.smithi069.stdout: "map_full": 0, 2023-10-06T01:40:07.600 INFO:teuthology.orchestra.run.smithi069.stdout: "map_inc": 37, 2023-10-06T01:40:07.601 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_sessions": 8, 2023-10-06T01:40:07.601 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_session_open": 8, 2023-10-06T01:40:07.601 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_session_close": 0, 2023-10-06T01:40:07.601 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_laggy": 0, 2023-10-06T01:40:07.601 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_wr": 0, 2023-10-06T01:40:07.601 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_rd": 0, 2023-10-06T01:40:07.601 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_del": 0 2023-10-06T01:40:07.601 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.601 INFO:teuthology.orchestra.run.smithi069.stdout: "objecter-0x556f9b81e320": { 2023-10-06T01:40:07.601 INFO:teuthology.orchestra.run.smithi069.stdout: "op_active": 0, 2023-10-06T01:40:07.601 INFO:teuthology.orchestra.run.smithi069.stdout: "op_laggy": 0, 2023-10-06T01:40:07.601 INFO:teuthology.orchestra.run.smithi069.stdout: "op_send": 163, 2023-10-06T01:40:07.602 INFO:teuthology.orchestra.run.smithi069.stdout: "op_send_bytes": 2434716, 2023-10-06T01:40:07.602 INFO:teuthology.orchestra.run.smithi069.stdout: "op_resend": 0, 2023-10-06T01:40:07.602 INFO:teuthology.orchestra.run.smithi069.stdout: "op_reply": 163, 2023-10-06T01:40:07.602 INFO:teuthology.orchestra.run.smithi069.stdout: "oplen_avg": { 2023-10-06T01:40:07.602 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 163, 2023-10-06T01:40:07.602 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 307 2023-10-06T01:40:07.602 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.602 INFO:teuthology.orchestra.run.smithi069.stdout: "op": 163, 2023-10-06T01:40:07.602 INFO:teuthology.orchestra.run.smithi069.stdout: "op_r": 46, 2023-10-06T01:40:07.602 INFO:teuthology.orchestra.run.smithi069.stdout: "op_w": 117, 2023-10-06T01:40:07.602 INFO:teuthology.orchestra.run.smithi069.stdout: "op_rmw": 0, 2023-10-06T01:40:07.602 INFO:teuthology.orchestra.run.smithi069.stdout: "op_pg": 0, 2023-10-06T01:40:07.603 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_stat": 0, 2023-10-06T01:40:07.603 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_create": 2, 2023-10-06T01:40:07.603 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_read": 20, 2023-10-06T01:40:07.603 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_write": 85, 2023-10-06T01:40:07.603 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_writefull": 0, 2023-10-06T01:40:07.603 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_writesame": 0, 2023-10-06T01:40:07.603 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_append": 0, 2023-10-06T01:40:07.603 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_zero": 0, 2023-10-06T01:40:07.603 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_truncate": 0, 2023-10-06T01:40:07.603 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_delete": 0, 2023-10-06T01:40:07.603 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_mapext": 0, 2023-10-06T01:40:07.603 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_sparse_read": 0, 2023-10-06T01:40:07.604 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_clonerange": 0, 2023-10-06T01:40:07.604 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_getxattr": 104, 2023-10-06T01:40:07.604 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_setxattr": 52, 2023-10-06T01:40:07.604 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_cmpxattr": 22, 2023-10-06T01:40:07.604 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_rmxattr": 0, 2023-10-06T01:40:07.604 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_resetxattrs": 0, 2023-10-06T01:40:07.604 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_call": 22, 2023-10-06T01:40:07.604 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_watch": 0, 2023-10-06T01:40:07.604 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_notify": 0, 2023-10-06T01:40:07.604 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_src_cmpxattr": 0, 2023-10-06T01:40:07.604 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_pgls": 0, 2023-10-06T01:40:07.605 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_pgls_filter": 0, 2023-10-06T01:40:07.605 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_other": 0, 2023-10-06T01:40:07.605 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_active": 0, 2023-10-06T01:40:07.605 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_send": 0, 2023-10-06T01:40:07.605 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_resend": 0, 2023-10-06T01:40:07.605 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_ping": 0, 2023-10-06T01:40:07.605 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_active": 0, 2023-10-06T01:40:07.605 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_send": 0, 2023-10-06T01:40:07.605 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_resend": 0, 2023-10-06T01:40:07.605 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_active": 0, 2023-10-06T01:40:07.605 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_send": 0, 2023-10-06T01:40:07.605 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_resend": 0, 2023-10-06T01:40:07.606 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_active": 0, 2023-10-06T01:40:07.606 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_send": 0, 2023-10-06T01:40:07.606 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_resend": 0, 2023-10-06T01:40:07.606 INFO:teuthology.orchestra.run.smithi069.stdout: "command_active": 0, 2023-10-06T01:40:07.606 INFO:teuthology.orchestra.run.smithi069.stdout: "command_send": 0, 2023-10-06T01:40:07.606 INFO:teuthology.orchestra.run.smithi069.stdout: "command_resend": 0, 2023-10-06T01:40:07.606 INFO:teuthology.orchestra.run.smithi069.stdout: "map_epoch": 17, 2023-10-06T01:40:07.606 INFO:teuthology.orchestra.run.smithi069.stdout: "map_full": 0, 2023-10-06T01:40:07.606 INFO:teuthology.orchestra.run.smithi069.stdout: "map_inc": 7, 2023-10-06T01:40:07.606 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_sessions": 1, 2023-10-06T01:40:07.606 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_session_open": 1, 2023-10-06T01:40:07.607 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_session_close": 0, 2023-10-06T01:40:07.607 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_laggy": 0, 2023-10-06T01:40:07.607 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_wr": 0, 2023-10-06T01:40:07.607 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_rd": 0, 2023-10-06T01:40:07.607 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_del": 0 2023-10-06T01:40:07.607 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.607 INFO:teuthology.orchestra.run.smithi069.stdout: "objecter-0x556f9b81e5a0": { 2023-10-06T01:40:07.607 INFO:teuthology.orchestra.run.smithi069.stdout: "op_active": 0, 2023-10-06T01:40:07.607 INFO:teuthology.orchestra.run.smithi069.stdout: "op_laggy": 0, 2023-10-06T01:40:07.607 INFO:teuthology.orchestra.run.smithi069.stdout: "op_send": 0, 2023-10-06T01:40:07.607 INFO:teuthology.orchestra.run.smithi069.stdout: "op_send_bytes": 0, 2023-10-06T01:40:07.607 INFO:teuthology.orchestra.run.smithi069.stdout: "op_resend": 0, 2023-10-06T01:40:07.608 INFO:teuthology.orchestra.run.smithi069.stdout: "op_reply": 0, 2023-10-06T01:40:07.608 INFO:teuthology.orchestra.run.smithi069.stdout: "oplen_avg": { 2023-10-06T01:40:07.608 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.608 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0 2023-10-06T01:40:07.608 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.608 INFO:teuthology.orchestra.run.smithi069.stdout: "op": 0, 2023-10-06T01:40:07.608 INFO:teuthology.orchestra.run.smithi069.stdout: "op_r": 0, 2023-10-06T01:40:07.608 INFO:teuthology.orchestra.run.smithi069.stdout: "op_w": 0, 2023-10-06T01:40:07.608 INFO:teuthology.orchestra.run.smithi069.stdout: "op_rmw": 0, 2023-10-06T01:40:07.608 INFO:teuthology.orchestra.run.smithi069.stdout: "op_pg": 0, 2023-10-06T01:40:07.608 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_stat": 0, 2023-10-06T01:40:07.608 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_create": 0, 2023-10-06T01:40:07.609 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_read": 0, 2023-10-06T01:40:07.609 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_write": 0, 2023-10-06T01:40:07.609 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_writefull": 0, 2023-10-06T01:40:07.609 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_writesame": 0, 2023-10-06T01:40:07.609 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_append": 0, 2023-10-06T01:40:07.609 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_zero": 0, 2023-10-06T01:40:07.609 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_truncate": 0, 2023-10-06T01:40:07.609 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_delete": 0, 2023-10-06T01:40:07.609 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_mapext": 0, 2023-10-06T01:40:07.609 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_sparse_read": 0, 2023-10-06T01:40:07.609 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_clonerange": 0, 2023-10-06T01:40:07.609 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_getxattr": 0, 2023-10-06T01:40:07.610 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_setxattr": 0, 2023-10-06T01:40:07.610 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_cmpxattr": 0, 2023-10-06T01:40:07.610 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_rmxattr": 0, 2023-10-06T01:40:07.610 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_resetxattrs": 0, 2023-10-06T01:40:07.610 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_call": 0, 2023-10-06T01:40:07.610 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_watch": 0, 2023-10-06T01:40:07.610 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_notify": 0, 2023-10-06T01:40:07.610 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_src_cmpxattr": 0, 2023-10-06T01:40:07.610 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_pgls": 0, 2023-10-06T01:40:07.610 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_pgls_filter": 0, 2023-10-06T01:40:07.610 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_other": 0, 2023-10-06T01:40:07.611 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_active": 0, 2023-10-06T01:40:07.611 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_send": 0, 2023-10-06T01:40:07.611 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_resend": 0, 2023-10-06T01:40:07.611 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_ping": 0, 2023-10-06T01:40:07.611 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_active": 0, 2023-10-06T01:40:07.611 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_send": 0, 2023-10-06T01:40:07.611 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_resend": 0, 2023-10-06T01:40:07.611 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_active": 0, 2023-10-06T01:40:07.611 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_send": 0, 2023-10-06T01:40:07.611 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_resend": 0, 2023-10-06T01:40:07.611 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_active": 0, 2023-10-06T01:40:07.612 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_send": 0, 2023-10-06T01:40:07.612 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_resend": 0, 2023-10-06T01:40:07.612 INFO:teuthology.orchestra.run.smithi069.stdout: "command_active": 0, 2023-10-06T01:40:07.612 INFO:teuthology.orchestra.run.smithi069.stdout: "command_send": 0, 2023-10-06T01:40:07.612 INFO:teuthology.orchestra.run.smithi069.stdout: "command_resend": 0, 2023-10-06T01:40:07.612 INFO:teuthology.orchestra.run.smithi069.stdout: "map_epoch": 0, 2023-10-06T01:40:07.612 INFO:teuthology.orchestra.run.smithi069.stdout: "map_full": 0, 2023-10-06T01:40:07.612 INFO:teuthology.orchestra.run.smithi069.stdout: "map_inc": 0, 2023-10-06T01:40:07.612 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_sessions": 0, 2023-10-06T01:40:07.612 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_session_open": 0, 2023-10-06T01:40:07.612 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_session_close": 0, 2023-10-06T01:40:07.612 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_laggy": 0, 2023-10-06T01:40:07.613 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_wr": 0, 2023-10-06T01:40:07.613 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_rd": 0, 2023-10-06T01:40:07.613 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_del": 0 2023-10-06T01:40:07.613 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.613 INFO:teuthology.orchestra.run.smithi069.stdout: "objecter-0x556f9b81e820": { 2023-10-06T01:40:07.613 INFO:teuthology.orchestra.run.smithi069.stdout: "op_active": 0, 2023-10-06T01:40:07.613 INFO:teuthology.orchestra.run.smithi069.stdout: "op_laggy": 0, 2023-10-06T01:40:07.613 INFO:teuthology.orchestra.run.smithi069.stdout: "op_send": 2, 2023-10-06T01:40:07.613 INFO:teuthology.orchestra.run.smithi069.stdout: "op_send_bytes": 32, 2023-10-06T01:40:07.613 INFO:teuthology.orchestra.run.smithi069.stdout: "op_resend": 0, 2023-10-06T01:40:07.613 INFO:teuthology.orchestra.run.smithi069.stdout: "op_reply": 2, 2023-10-06T01:40:07.614 INFO:teuthology.orchestra.run.smithi069.stdout: "oplen_avg": { 2023-10-06T01:40:07.614 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 2, 2023-10-06T01:40:07.614 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 2 2023-10-06T01:40:07.614 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.614 INFO:teuthology.orchestra.run.smithi069.stdout: "op": 2, 2023-10-06T01:40:07.614 INFO:teuthology.orchestra.run.smithi069.stdout: "op_r": 2, 2023-10-06T01:40:07.614 INFO:teuthology.orchestra.run.smithi069.stdout: "op_w": 0, 2023-10-06T01:40:07.614 INFO:teuthology.orchestra.run.smithi069.stdout: "op_rmw": 0, 2023-10-06T01:40:07.614 INFO:teuthology.orchestra.run.smithi069.stdout: "op_pg": 0, 2023-10-06T01:40:07.614 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_stat": 0, 2023-10-06T01:40:07.614 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_create": 0, 2023-10-06T01:40:07.615 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_read": 0, 2023-10-06T01:40:07.615 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_write": 0, 2023-10-06T01:40:07.615 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_writefull": 0, 2023-10-06T01:40:07.615 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_writesame": 0, 2023-10-06T01:40:07.615 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_append": 0, 2023-10-06T01:40:07.615 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_zero": 0, 2023-10-06T01:40:07.615 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_truncate": 0, 2023-10-06T01:40:07.615 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_delete": 0, 2023-10-06T01:40:07.615 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_mapext": 0, 2023-10-06T01:40:07.615 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_sparse_read": 0, 2023-10-06T01:40:07.615 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_clonerange": 0, 2023-10-06T01:40:07.616 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_getxattr": 0, 2023-10-06T01:40:07.616 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_setxattr": 0, 2023-10-06T01:40:07.616 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_cmpxattr": 0, 2023-10-06T01:40:07.616 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_rmxattr": 0, 2023-10-06T01:40:07.616 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_resetxattrs": 0, 2023-10-06T01:40:07.616 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_call": 0, 2023-10-06T01:40:07.616 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_watch": 0, 2023-10-06T01:40:07.616 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_notify": 0, 2023-10-06T01:40:07.616 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_src_cmpxattr": 0, 2023-10-06T01:40:07.616 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_pgls": 0, 2023-10-06T01:40:07.616 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_pgls_filter": 0, 2023-10-06T01:40:07.616 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_other": 0, 2023-10-06T01:40:07.617 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_active": 0, 2023-10-06T01:40:07.617 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_send": 0, 2023-10-06T01:40:07.617 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_resend": 0, 2023-10-06T01:40:07.617 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_ping": 0, 2023-10-06T01:40:07.617 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_active": 0, 2023-10-06T01:40:07.617 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_send": 0, 2023-10-06T01:40:07.617 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_resend": 0, 2023-10-06T01:40:07.617 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_active": 0, 2023-10-06T01:40:07.617 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_send": 0, 2023-10-06T01:40:07.617 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_resend": 0, 2023-10-06T01:40:07.617 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_active": 0, 2023-10-06T01:40:07.617 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_send": 0, 2023-10-06T01:40:07.618 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_resend": 0, 2023-10-06T01:40:07.618 INFO:teuthology.orchestra.run.smithi069.stdout: "command_active": 0, 2023-10-06T01:40:07.618 INFO:teuthology.orchestra.run.smithi069.stdout: "command_send": 0, 2023-10-06T01:40:07.618 INFO:teuthology.orchestra.run.smithi069.stdout: "command_resend": 0, 2023-10-06T01:40:07.618 INFO:teuthology.orchestra.run.smithi069.stdout: "map_epoch": 25, 2023-10-06T01:40:07.618 INFO:teuthology.orchestra.run.smithi069.stdout: "map_full": 0, 2023-10-06T01:40:07.618 INFO:teuthology.orchestra.run.smithi069.stdout: "map_inc": 15, 2023-10-06T01:40:07.618 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_sessions": 2, 2023-10-06T01:40:07.618 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_session_open": 2, 2023-10-06T01:40:07.618 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_session_close": 0, 2023-10-06T01:40:07.618 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_laggy": 0, 2023-10-06T01:40:07.618 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_wr": 0, 2023-10-06T01:40:07.619 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_rd": 2, 2023-10-06T01:40:07.619 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_del": 0 2023-10-06T01:40:07.619 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.619 INFO:teuthology.orchestra.run.smithi069.stdout: "objecter-0x556f9b81f400": { 2023-10-06T01:40:07.619 INFO:teuthology.orchestra.run.smithi069.stdout: "op_active": 0, 2023-10-06T01:40:07.619 INFO:teuthology.orchestra.run.smithi069.stdout: "op_laggy": 0, 2023-10-06T01:40:07.619 INFO:teuthology.orchestra.run.smithi069.stdout: "op_send": 1, 2023-10-06T01:40:07.619 INFO:teuthology.orchestra.run.smithi069.stdout: "op_send_bytes": 39, 2023-10-06T01:40:07.619 INFO:teuthology.orchestra.run.smithi069.stdout: "op_resend": 0, 2023-10-06T01:40:07.619 INFO:teuthology.orchestra.run.smithi069.stdout: "op_reply": 1, 2023-10-06T01:40:07.619 INFO:teuthology.orchestra.run.smithi069.stdout: "oplen_avg": { 2023-10-06T01:40:07.619 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 1, 2023-10-06T01:40:07.620 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 1 2023-10-06T01:40:07.620 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.620 INFO:teuthology.orchestra.run.smithi069.stdout: "op": 1, 2023-10-06T01:40:07.620 INFO:teuthology.orchestra.run.smithi069.stdout: "op_r": 1, 2023-10-06T01:40:07.620 INFO:teuthology.orchestra.run.smithi069.stdout: "op_w": 0, 2023-10-06T01:40:07.620 INFO:teuthology.orchestra.run.smithi069.stdout: "op_rmw": 0, 2023-10-06T01:40:07.620 INFO:teuthology.orchestra.run.smithi069.stdout: "op_pg": 0, 2023-10-06T01:40:07.620 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_stat": 0, 2023-10-06T01:40:07.620 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_create": 0, 2023-10-06T01:40:07.620 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_read": 0, 2023-10-06T01:40:07.620 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_write": 0, 2023-10-06T01:40:07.620 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_writefull": 0, 2023-10-06T01:40:07.621 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_writesame": 0, 2023-10-06T01:40:07.621 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_append": 0, 2023-10-06T01:40:07.621 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_zero": 0, 2023-10-06T01:40:07.621 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_truncate": 0, 2023-10-06T01:40:07.621 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_delete": 0, 2023-10-06T01:40:07.621 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_mapext": 0, 2023-10-06T01:40:07.621 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_sparse_read": 0, 2023-10-06T01:40:07.621 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_clonerange": 0, 2023-10-06T01:40:07.621 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_getxattr": 0, 2023-10-06T01:40:07.621 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_setxattr": 0, 2023-10-06T01:40:07.621 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_cmpxattr": 0, 2023-10-06T01:40:07.621 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_rmxattr": 0, 2023-10-06T01:40:07.622 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_resetxattrs": 0, 2023-10-06T01:40:07.622 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_call": 0, 2023-10-06T01:40:07.622 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_watch": 0, 2023-10-06T01:40:07.622 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_notify": 0, 2023-10-06T01:40:07.622 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_src_cmpxattr": 0, 2023-10-06T01:40:07.622 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_pgls": 0, 2023-10-06T01:40:07.622 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_pgls_filter": 0, 2023-10-06T01:40:07.622 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_other": 1, 2023-10-06T01:40:07.622 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_active": 0, 2023-10-06T01:40:07.622 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_send": 0, 2023-10-06T01:40:07.622 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_resend": 0, 2023-10-06T01:40:07.623 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_ping": 0, 2023-10-06T01:40:07.623 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_active": 0, 2023-10-06T01:40:07.623 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_send": 0, 2023-10-06T01:40:07.623 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_resend": 0, 2023-10-06T01:40:07.623 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_active": 0, 2023-10-06T01:40:07.623 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_send": 0, 2023-10-06T01:40:07.623 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_resend": 0, 2023-10-06T01:40:07.623 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_active": 0, 2023-10-06T01:40:07.623 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_send": 0, 2023-10-06T01:40:07.623 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_resend": 0, 2023-10-06T01:40:07.623 INFO:teuthology.orchestra.run.smithi069.stdout: "command_active": 0, 2023-10-06T01:40:07.623 INFO:teuthology.orchestra.run.smithi069.stdout: "command_send": 0, 2023-10-06T01:40:07.624 INFO:teuthology.orchestra.run.smithi069.stdout: "command_resend": 0, 2023-10-06T01:40:07.624 INFO:teuthology.orchestra.run.smithi069.stdout: "map_epoch": 0, 2023-10-06T01:40:07.624 INFO:teuthology.orchestra.run.smithi069.stdout: "map_full": 0, 2023-10-06T01:40:07.624 INFO:teuthology.orchestra.run.smithi069.stdout: "map_inc": 0, 2023-10-06T01:40:07.624 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_sessions": 1, 2023-10-06T01:40:07.624 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_session_open": 1, 2023-10-06T01:40:07.624 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_session_close": 0, 2023-10-06T01:40:07.624 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_laggy": 0, 2023-10-06T01:40:07.624 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_wr": 0, 2023-10-06T01:40:07.624 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_rd": 0, 2023-10-06T01:40:07.624 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_del": 0 2023-10-06T01:40:07.624 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.625 INFO:teuthology.orchestra.run.smithi069.stdout: "objecter-0x556f9c720460": { 2023-10-06T01:40:07.625 INFO:teuthology.orchestra.run.smithi069.stdout: "op_active": 0, 2023-10-06T01:40:07.625 INFO:teuthology.orchestra.run.smithi069.stdout: "op_laggy": 0, 2023-10-06T01:40:07.625 INFO:teuthology.orchestra.run.smithi069.stdout: "op_send": 3, 2023-10-06T01:40:07.625 INFO:teuthology.orchestra.run.smithi069.stdout: "op_send_bytes": 477, 2023-10-06T01:40:07.625 INFO:teuthology.orchestra.run.smithi069.stdout: "op_resend": 0, 2023-10-06T01:40:07.625 INFO:teuthology.orchestra.run.smithi069.stdout: "op_reply": 3, 2023-10-06T01:40:07.625 INFO:teuthology.orchestra.run.smithi069.stdout: "oplen_avg": { 2023-10-06T01:40:07.625 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 3, 2023-10-06T01:40:07.625 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 3 2023-10-06T01:40:07.625 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.626 INFO:teuthology.orchestra.run.smithi069.stdout: "op": 3, 2023-10-06T01:40:07.626 INFO:teuthology.orchestra.run.smithi069.stdout: "op_r": 0, 2023-10-06T01:40:07.626 INFO:teuthology.orchestra.run.smithi069.stdout: "op_w": 3, 2023-10-06T01:40:07.626 INFO:teuthology.orchestra.run.smithi069.stdout: "op_rmw": 0, 2023-10-06T01:40:07.626 INFO:teuthology.orchestra.run.smithi069.stdout: "op_pg": 0, 2023-10-06T01:40:07.626 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_stat": 0, 2023-10-06T01:40:07.626 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_create": 0, 2023-10-06T01:40:07.626 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_read": 0, 2023-10-06T01:40:07.626 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_write": 3, 2023-10-06T01:40:07.626 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_writefull": 0, 2023-10-06T01:40:07.626 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_writesame": 0, 2023-10-06T01:40:07.627 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_append": 0, 2023-10-06T01:40:07.627 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_zero": 0, 2023-10-06T01:40:07.627 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_truncate": 0, 2023-10-06T01:40:07.627 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_delete": 0, 2023-10-06T01:40:07.627 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_mapext": 0, 2023-10-06T01:40:07.627 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_sparse_read": 0, 2023-10-06T01:40:07.627 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_clonerange": 0, 2023-10-06T01:40:07.627 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_getxattr": 0, 2023-10-06T01:40:07.627 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_setxattr": 0, 2023-10-06T01:40:07.627 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_cmpxattr": 0, 2023-10-06T01:40:07.627 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_rmxattr": 0, 2023-10-06T01:40:07.628 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_resetxattrs": 0, 2023-10-06T01:40:07.628 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_call": 0, 2023-10-06T01:40:07.628 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_watch": 0, 2023-10-06T01:40:07.628 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_notify": 0, 2023-10-06T01:40:07.628 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_src_cmpxattr": 0, 2023-10-06T01:40:07.628 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_pgls": 0, 2023-10-06T01:40:07.628 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_pgls_filter": 0, 2023-10-06T01:40:07.628 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_other": 0, 2023-10-06T01:40:07.628 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_active": 0, 2023-10-06T01:40:07.628 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_send": 0, 2023-10-06T01:40:07.628 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_resend": 0, 2023-10-06T01:40:07.629 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_ping": 0, 2023-10-06T01:40:07.629 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_active": 0, 2023-10-06T01:40:07.629 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_send": 0, 2023-10-06T01:40:07.629 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_resend": 0, 2023-10-06T01:40:07.629 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_active": 0, 2023-10-06T01:40:07.629 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_send": 0, 2023-10-06T01:40:07.629 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_resend": 0, 2023-10-06T01:40:07.629 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_active": 0, 2023-10-06T01:40:07.629 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_send": 0, 2023-10-06T01:40:07.629 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_resend": 0, 2023-10-06T01:40:07.629 INFO:teuthology.orchestra.run.smithi069.stdout: "command_active": 0, 2023-10-06T01:40:07.629 INFO:teuthology.orchestra.run.smithi069.stdout: "command_send": 0, 2023-10-06T01:40:07.630 INFO:teuthology.orchestra.run.smithi069.stdout: "command_resend": 0, 2023-10-06T01:40:07.630 INFO:teuthology.orchestra.run.smithi069.stdout: "map_epoch": 0, 2023-10-06T01:40:07.630 INFO:teuthology.orchestra.run.smithi069.stdout: "map_full": 0, 2023-10-06T01:40:07.630 INFO:teuthology.orchestra.run.smithi069.stdout: "map_inc": 0, 2023-10-06T01:40:07.630 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_sessions": 3, 2023-10-06T01:40:07.630 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_session_open": 3, 2023-10-06T01:40:07.630 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_session_close": 0, 2023-10-06T01:40:07.630 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_laggy": 0, 2023-10-06T01:40:07.630 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_wr": 0, 2023-10-06T01:40:07.630 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_rd": 0, 2023-10-06T01:40:07.630 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_del": 0 2023-10-06T01:40:07.631 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.631 INFO:teuthology.orchestra.run.smithi069.stdout: "objecter-0x556f9c720dc0": { 2023-10-06T01:40:07.631 INFO:teuthology.orchestra.run.smithi069.stdout: "op_active": 0, 2023-10-06T01:40:07.631 INFO:teuthology.orchestra.run.smithi069.stdout: "op_laggy": 0, 2023-10-06T01:40:07.631 INFO:teuthology.orchestra.run.smithi069.stdout: "op_send": 0, 2023-10-06T01:40:07.631 INFO:teuthology.orchestra.run.smithi069.stdout: "op_send_bytes": 0, 2023-10-06T01:40:07.631 INFO:teuthology.orchestra.run.smithi069.stdout: "op_resend": 0, 2023-10-06T01:40:07.631 INFO:teuthology.orchestra.run.smithi069.stdout: "op_reply": 0, 2023-10-06T01:40:07.631 INFO:teuthology.orchestra.run.smithi069.stdout: "oplen_avg": { 2023-10-06T01:40:07.631 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.631 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0 2023-10-06T01:40:07.631 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.632 INFO:teuthology.orchestra.run.smithi069.stdout: "op": 0, 2023-10-06T01:40:07.632 INFO:teuthology.orchestra.run.smithi069.stdout: "op_r": 0, 2023-10-06T01:40:07.632 INFO:teuthology.orchestra.run.smithi069.stdout: "op_w": 0, 2023-10-06T01:40:07.632 INFO:teuthology.orchestra.run.smithi069.stdout: "op_rmw": 0, 2023-10-06T01:40:07.632 INFO:teuthology.orchestra.run.smithi069.stdout: "op_pg": 0, 2023-10-06T01:40:07.632 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_stat": 0, 2023-10-06T01:40:07.632 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_create": 0, 2023-10-06T01:40:07.632 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_read": 0, 2023-10-06T01:40:07.632 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_write": 0, 2023-10-06T01:40:07.632 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_writefull": 0, 2023-10-06T01:40:07.632 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_writesame": 0, 2023-10-06T01:40:07.633 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_append": 0, 2023-10-06T01:40:07.633 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_zero": 0, 2023-10-06T01:40:07.633 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_truncate": 0, 2023-10-06T01:40:07.633 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_delete": 0, 2023-10-06T01:40:07.633 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_mapext": 0, 2023-10-06T01:40:07.633 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_sparse_read": 0, 2023-10-06T01:40:07.633 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_clonerange": 0, 2023-10-06T01:40:07.633 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_getxattr": 0, 2023-10-06T01:40:07.633 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_setxattr": 0, 2023-10-06T01:40:07.633 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_cmpxattr": 0, 2023-10-06T01:40:07.633 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_rmxattr": 0, 2023-10-06T01:40:07.633 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_resetxattrs": 0, 2023-10-06T01:40:07.634 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_call": 0, 2023-10-06T01:40:07.634 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_watch": 0, 2023-10-06T01:40:07.634 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_notify": 0, 2023-10-06T01:40:07.634 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_src_cmpxattr": 0, 2023-10-06T01:40:07.634 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_pgls": 0, 2023-10-06T01:40:07.634 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_pgls_filter": 0, 2023-10-06T01:40:07.634 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_other": 0, 2023-10-06T01:40:07.634 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_active": 0, 2023-10-06T01:40:07.634 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_send": 0, 2023-10-06T01:40:07.634 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_resend": 0, 2023-10-06T01:40:07.634 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_ping": 0, 2023-10-06T01:40:07.635 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_active": 0, 2023-10-06T01:40:07.635 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_send": 0, 2023-10-06T01:40:07.635 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_resend": 0, 2023-10-06T01:40:07.635 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_active": 0, 2023-10-06T01:40:07.635 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_send": 0, 2023-10-06T01:40:07.635 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_resend": 0, 2023-10-06T01:40:07.635 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_active": 0, 2023-10-06T01:40:07.635 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_send": 0, 2023-10-06T01:40:07.635 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_resend": 0, 2023-10-06T01:40:07.635 INFO:teuthology.orchestra.run.smithi069.stdout: "command_active": 0, 2023-10-06T01:40:07.635 INFO:teuthology.orchestra.run.smithi069.stdout: "command_send": 0, 2023-10-06T01:40:07.635 INFO:teuthology.orchestra.run.smithi069.stdout: "command_resend": 0, 2023-10-06T01:40:07.636 INFO:teuthology.orchestra.run.smithi069.stdout: "map_epoch": 0, 2023-10-06T01:40:07.636 INFO:teuthology.orchestra.run.smithi069.stdout: "map_full": 0, 2023-10-06T01:40:07.636 INFO:teuthology.orchestra.run.smithi069.stdout: "map_inc": 0, 2023-10-06T01:40:07.636 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_sessions": 0, 2023-10-06T01:40:07.636 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_session_open": 0, 2023-10-06T01:40:07.636 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_session_close": 0, 2023-10-06T01:40:07.636 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_laggy": 0, 2023-10-06T01:40:07.636 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_wr": 0, 2023-10-06T01:40:07.636 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_rd": 0, 2023-10-06T01:40:07.636 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_del": 0 2023-10-06T01:40:07.636 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.637 INFO:teuthology.orchestra.run.smithi069.stdout: "objecter-0x556f9c721180": { 2023-10-06T01:40:07.637 INFO:teuthology.orchestra.run.smithi069.stdout: "op_active": 0, 2023-10-06T01:40:07.637 INFO:teuthology.orchestra.run.smithi069.stdout: "op_laggy": 0, 2023-10-06T01:40:07.637 INFO:teuthology.orchestra.run.smithi069.stdout: "op_send": 0, 2023-10-06T01:40:07.637 INFO:teuthology.orchestra.run.smithi069.stdout: "op_send_bytes": 0, 2023-10-06T01:40:07.637 INFO:teuthology.orchestra.run.smithi069.stdout: "op_resend": 0, 2023-10-06T01:40:07.637 INFO:teuthology.orchestra.run.smithi069.stdout: "op_reply": 0, 2023-10-06T01:40:07.637 INFO:teuthology.orchestra.run.smithi069.stdout: "oplen_avg": { 2023-10-06T01:40:07.637 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.637 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0 2023-10-06T01:40:07.637 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.638 INFO:teuthology.orchestra.run.smithi069.stdout: "op": 0, 2023-10-06T01:40:07.638 INFO:teuthology.orchestra.run.smithi069.stdout: "op_r": 0, 2023-10-06T01:40:07.638 INFO:teuthology.orchestra.run.smithi069.stdout: "op_w": 0, 2023-10-06T01:40:07.638 INFO:teuthology.orchestra.run.smithi069.stdout: "op_rmw": 0, 2023-10-06T01:40:07.638 INFO:teuthology.orchestra.run.smithi069.stdout: "op_pg": 0, 2023-10-06T01:40:07.638 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_stat": 0, 2023-10-06T01:40:07.638 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_create": 0, 2023-10-06T01:40:07.638 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_read": 0, 2023-10-06T01:40:07.638 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_write": 0, 2023-10-06T01:40:07.638 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_writefull": 0, 2023-10-06T01:40:07.638 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_writesame": 0, 2023-10-06T01:40:07.638 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_append": 0, 2023-10-06T01:40:07.639 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_zero": 0, 2023-10-06T01:40:07.639 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_truncate": 0, 2023-10-06T01:40:07.639 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_delete": 0, 2023-10-06T01:40:07.639 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_mapext": 0, 2023-10-06T01:40:07.639 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_sparse_read": 0, 2023-10-06T01:40:07.639 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_clonerange": 0, 2023-10-06T01:40:07.639 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_getxattr": 0, 2023-10-06T01:40:07.639 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_setxattr": 0, 2023-10-06T01:40:07.639 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_cmpxattr": 0, 2023-10-06T01:40:07.639 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_rmxattr": 0, 2023-10-06T01:40:07.639 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_resetxattrs": 0, 2023-10-06T01:40:07.640 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_call": 0, 2023-10-06T01:40:07.640 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_watch": 0, 2023-10-06T01:40:07.640 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_notify": 0, 2023-10-06T01:40:07.640 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_src_cmpxattr": 0, 2023-10-06T01:40:07.640 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_pgls": 0, 2023-10-06T01:40:07.640 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_pgls_filter": 0, 2023-10-06T01:40:07.640 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_other": 0, 2023-10-06T01:40:07.640 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_active": 0, 2023-10-06T01:40:07.640 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_send": 0, 2023-10-06T01:40:07.640 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_resend": 0, 2023-10-06T01:40:07.640 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_ping": 0, 2023-10-06T01:40:07.640 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_active": 0, 2023-10-06T01:40:07.641 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_send": 0, 2023-10-06T01:40:07.641 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_resend": 0, 2023-10-06T01:40:07.641 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_active": 0, 2023-10-06T01:40:07.641 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_send": 0, 2023-10-06T01:40:07.641 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_resend": 0, 2023-10-06T01:40:07.641 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_active": 0, 2023-10-06T01:40:07.641 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_send": 0, 2023-10-06T01:40:07.641 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_resend": 0, 2023-10-06T01:40:07.641 INFO:teuthology.orchestra.run.smithi069.stdout: "command_active": 0, 2023-10-06T01:40:07.641 INFO:teuthology.orchestra.run.smithi069.stdout: "command_send": 0, 2023-10-06T01:40:07.642 INFO:teuthology.orchestra.run.smithi069.stdout: "command_resend": 0, 2023-10-06T01:40:07.642 INFO:teuthology.orchestra.run.smithi069.stdout: "map_epoch": 0, 2023-10-06T01:40:07.642 INFO:teuthology.orchestra.run.smithi069.stdout: "map_full": 0, 2023-10-06T01:40:07.642 INFO:teuthology.orchestra.run.smithi069.stdout: "map_inc": 0, 2023-10-06T01:40:07.642 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_sessions": 0, 2023-10-06T01:40:07.642 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_session_open": 0, 2023-10-06T01:40:07.642 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_session_close": 0, 2023-10-06T01:40:07.642 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_laggy": 0, 2023-10-06T01:40:07.642 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_wr": 0, 2023-10-06T01:40:07.642 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_rd": 0, 2023-10-06T01:40:07.642 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_del": 0 2023-10-06T01:40:07.643 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.643 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-mgr_client_bytes": { 2023-10-06T01:40:07.643 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.643 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 134217728, 2023-10-06T01:40:07.643 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.643 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2023-10-06T01:40:07.643 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2023-10-06T01:40:07.643 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.643 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2023-10-06T01:40:07.643 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.643 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.643 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 0, 2023-10-06T01:40:07.644 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 0, 2023-10-06T01:40:07.644 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.644 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.644 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.644 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.644 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.644 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.644 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-mgr_client_messages": { 2023-10-06T01:40:07.644 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.644 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 512, 2023-10-06T01:40:07.644 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.644 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2023-10-06T01:40:07.645 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2023-10-06T01:40:07.645 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.645 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2023-10-06T01:40:07.645 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.645 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.645 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 0, 2023-10-06T01:40:07.645 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 0, 2023-10-06T01:40:07.645 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.645 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.645 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.645 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.645 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.646 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.646 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-mgr_mds_bytes": { 2023-10-06T01:40:07.646 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.646 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 134217728, 2023-10-06T01:40:07.646 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.646 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2023-10-06T01:40:07.646 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2023-10-06T01:40:07.646 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.646 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2023-10-06T01:40:07.646 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.646 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.647 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 0, 2023-10-06T01:40:07.647 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 0, 2023-10-06T01:40:07.647 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.647 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.647 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.647 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.647 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.647 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.647 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-mgr_mds_messsages": { 2023-10-06T01:40:07.647 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.647 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 128, 2023-10-06T01:40:07.647 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.648 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2023-10-06T01:40:07.648 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2023-10-06T01:40:07.648 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.648 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2023-10-06T01:40:07.648 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.648 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.648 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 0, 2023-10-06T01:40:07.648 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 0, 2023-10-06T01:40:07.648 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.648 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.648 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.648 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.649 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.649 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.649 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-mgr_mon_bytes": { 2023-10-06T01:40:07.649 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.649 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 134217728, 2023-10-06T01:40:07.649 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.649 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 557, 2023-10-06T01:40:07.649 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 6141967, 2023-10-06T01:40:07.649 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.649 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 557, 2023-10-06T01:40:07.649 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.650 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.650 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 557, 2023-10-06T01:40:07.650 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 6141967, 2023-10-06T01:40:07.650 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.650 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.650 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.650 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.650 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.650 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.650 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-mgr_mon_messsages": { 2023-10-06T01:40:07.650 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.650 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 128, 2023-10-06T01:40:07.651 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.651 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 557, 2023-10-06T01:40:07.651 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 557, 2023-10-06T01:40:07.651 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.651 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 557, 2023-10-06T01:40:07.651 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.651 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.651 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 557, 2023-10-06T01:40:07.651 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 557, 2023-10-06T01:40:07.651 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.651 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.651 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.652 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.652 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.652 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.652 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-mgr_osd_bytes": { 2023-10-06T01:40:07.652 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.652 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 536870912, 2023-10-06T01:40:07.652 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.652 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2023-10-06T01:40:07.652 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2023-10-06T01:40:07.652 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.652 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2023-10-06T01:40:07.652 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.653 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.653 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 0, 2023-10-06T01:40:07.653 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 0, 2023-10-06T01:40:07.653 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.653 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.653 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.653 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.653 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.653 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.653 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-mgr_osd_messsages": { 2023-10-06T01:40:07.653 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.653 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 8192, 2023-10-06T01:40:07.654 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.654 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2023-10-06T01:40:07.654 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2023-10-06T01:40:07.654 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.654 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2023-10-06T01:40:07.654 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.654 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.654 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 0, 2023-10-06T01:40:07.654 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 0, 2023-10-06T01:40:07.654 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.654 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.654 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.655 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.655 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.655 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.655 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-msgr_dispatch_throttler-client": { 2023-10-06T01:40:07.655 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.655 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2023-10-06T01:40:07.655 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.655 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 173, 2023-10-06T01:40:07.655 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 63657, 2023-10-06T01:40:07.655 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.655 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 173, 2023-10-06T01:40:07.656 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.656 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.656 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 173, 2023-10-06T01:40:07.656 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 63657, 2023-10-06T01:40:07.656 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.656 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.656 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.656 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.656 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.656 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.656 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-msgr_dispatch_throttler-client-0x556f9c7208c0": { 2023-10-06T01:40:07.656 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.657 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2023-10-06T01:40:07.657 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.657 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 43, 2023-10-06T01:40:07.657 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 22948, 2023-10-06T01:40:07.657 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.657 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 43, 2023-10-06T01:40:07.657 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.657 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.657 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 43, 2023-10-06T01:40:07.657 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 22948, 2023-10-06T01:40:07.657 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.658 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.658 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.658 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.658 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.658 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.658 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-msgr_dispatch_throttler-client-0x556f9c721400": { 2023-10-06T01:40:07.658 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.658 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2023-10-06T01:40:07.658 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.658 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 83, 2023-10-06T01:40:07.658 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 42166, 2023-10-06T01:40:07.658 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.659 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 83, 2023-10-06T01:40:07.659 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.659 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.659 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 83, 2023-10-06T01:40:07.659 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 42166, 2023-10-06T01:40:07.659 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.659 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.659 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.659 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.659 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.659 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.660 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-msgr_dispatch_throttler-mgr": { 2023-10-06T01:40:07.660 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.660 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2023-10-06T01:40:07.660 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.660 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 364, 2023-10-06T01:40:07.660 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 818790, 2023-10-06T01:40:07.660 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.660 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 364, 2023-10-06T01:40:07.660 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.660 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.660 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 364, 2023-10-06T01:40:07.660 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 818790, 2023-10-06T01:40:07.661 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.661 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.661 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.661 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.661 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.661 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.661 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-msgr_dispatch_throttler-mgr-0x556f97e89720": { 2023-10-06T01:40:07.661 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.661 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2023-10-06T01:40:07.661 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.661 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 557, 2023-10-06T01:40:07.661 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 6141967, 2023-10-06T01:40:07.662 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.662 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 557, 2023-10-06T01:40:07.662 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.662 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.662 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 557, 2023-10-06T01:40:07.662 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 6141967, 2023-10-06T01:40:07.662 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.662 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.662 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.662 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.662 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.662 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.663 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-msgr_dispatch_throttler-radosclient": { 2023-10-06T01:40:07.663 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.663 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2023-10-06T01:40:07.663 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.663 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 177, 2023-10-06T01:40:07.663 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 511626, 2023-10-06T01:40:07.663 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.663 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 177, 2023-10-06T01:40:07.663 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.663 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.663 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 177, 2023-10-06T01:40:07.664 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 511626, 2023-10-06T01:40:07.664 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.664 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.664 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.664 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.664 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.664 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.664 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x556f9b81e780": { 2023-10-06T01:40:07.664 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.664 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2023-10-06T01:40:07.664 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.664 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 11, 2023-10-06T01:40:07.665 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 468603, 2023-10-06T01:40:07.665 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.665 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 11, 2023-10-06T01:40:07.665 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.665 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.665 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 11, 2023-10-06T01:40:07.665 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 468603, 2023-10-06T01:40:07.665 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.665 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.665 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.665 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.665 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.666 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.666 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x556f9b81ea00": { 2023-10-06T01:40:07.666 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.666 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2023-10-06T01:40:07.666 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.666 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 16, 2023-10-06T01:40:07.666 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 481939, 2023-10-06T01:40:07.666 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.666 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 16, 2023-10-06T01:40:07.666 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.666 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.667 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 16, 2023-10-06T01:40:07.667 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 481939, 2023-10-06T01:40:07.667 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.667 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.667 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.667 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.667 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.667 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.667 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-msgr_dispatch_throttler-radosclient-0x556f9b81f5e0": { 2023-10-06T01:40:07.667 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.667 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2023-10-06T01:40:07.667 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.668 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 10, 2023-10-06T01:40:07.668 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 345178, 2023-10-06T01:40:07.668 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.668 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 10, 2023-10-06T01:40:07.668 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.668 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.668 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 10, 2023-10-06T01:40:07.668 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 345178, 2023-10-06T01:40:07.668 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.668 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.668 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.668 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.669 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.669 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.669 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-objecter_bytes": { 2023-10-06T01:40:07.669 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.669 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2023-10-06T01:40:07.669 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.669 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2023-10-06T01:40:07.669 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2023-10-06T01:40:07.669 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.669 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2023-10-06T01:40:07.669 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.669 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.670 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 0, 2023-10-06T01:40:07.670 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 0, 2023-10-06T01:40:07.670 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.670 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.670 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.670 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.670 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.670 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.670 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-objecter_bytes-0x556f9b81e1e0": { 2023-10-06T01:40:07.670 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.670 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2023-10-06T01:40:07.670 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.671 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 163, 2023-10-06T01:40:07.671 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 2433027, 2023-10-06T01:40:07.671 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.671 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 163, 2023-10-06T01:40:07.671 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.671 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.671 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 163, 2023-10-06T01:40:07.671 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 2433027, 2023-10-06T01:40:07.671 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.671 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.671 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.671 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.672 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.672 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.672 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-objecter_bytes-0x556f9b81e6e0": { 2023-10-06T01:40:07.672 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.672 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2023-10-06T01:40:07.672 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.672 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2023-10-06T01:40:07.672 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2023-10-06T01:40:07.672 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.672 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2023-10-06T01:40:07.672 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.672 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.673 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 0, 2023-10-06T01:40:07.673 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 0, 2023-10-06T01:40:07.673 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.673 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.673 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.673 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.673 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.673 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.673 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-objecter_bytes-0x556f9b81e960": { 2023-10-06T01:40:07.673 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.673 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2023-10-06T01:40:07.673 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.674 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 2, 2023-10-06T01:40:07.674 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2023-10-06T01:40:07.674 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.674 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 2, 2023-10-06T01:40:07.674 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.674 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.674 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 2, 2023-10-06T01:40:07.677 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 0, 2023-10-06T01:40:07.677 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.678 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.678 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.678 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.678 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.678 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.678 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-objecter_bytes-0x556f9b81f680": { 2023-10-06T01:40:07.678 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.678 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2023-10-06T01:40:07.678 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.678 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 1, 2023-10-06T01:40:07.678 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2023-10-06T01:40:07.679 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.679 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 1, 2023-10-06T01:40:07.679 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.679 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.679 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 1, 2023-10-06T01:40:07.679 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 0, 2023-10-06T01:40:07.679 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.679 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.679 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.679 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.679 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.679 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.680 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-objecter_bytes-0x556f9b81fc20": { 2023-10-06T01:40:07.680 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.680 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2023-10-06T01:40:07.680 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.680 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2023-10-06T01:40:07.680 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2023-10-06T01:40:07.680 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.680 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2023-10-06T01:40:07.680 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 3, 2023-10-06T01:40:07.680 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 477, 2023-10-06T01:40:07.680 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 3, 2023-10-06T01:40:07.680 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 477, 2023-10-06T01:40:07.681 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.681 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.681 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.681 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.681 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.681 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.681 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-objecter_bytes-0x556f9c720be0": { 2023-10-06T01:40:07.681 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.681 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2023-10-06T01:40:07.681 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.681 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2023-10-06T01:40:07.681 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2023-10-06T01:40:07.682 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.682 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2023-10-06T01:40:07.682 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.682 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.682 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 0, 2023-10-06T01:40:07.682 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 0, 2023-10-06T01:40:07.682 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.682 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.682 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.682 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.682 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.683 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.683 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-objecter_bytes-0x556f9c721360": { 2023-10-06T01:40:07.683 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.683 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2023-10-06T01:40:07.683 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.683 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2023-10-06T01:40:07.683 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2023-10-06T01:40:07.683 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.683 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2023-10-06T01:40:07.683 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.683 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.683 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 0, 2023-10-06T01:40:07.684 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 0, 2023-10-06T01:40:07.684 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.684 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.684 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.684 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.684 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.684 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.684 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-objecter_ops": { 2023-10-06T01:40:07.684 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.684 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 1024, 2023-10-06T01:40:07.684 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.684 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2023-10-06T01:40:07.685 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2023-10-06T01:40:07.685 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.685 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2023-10-06T01:40:07.685 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.685 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.685 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 0, 2023-10-06T01:40:07.685 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 0, 2023-10-06T01:40:07.685 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.685 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.685 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.685 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.685 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.686 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.686 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-objecter_ops-0x556f9b81e280": { 2023-10-06T01:40:07.686 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.686 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 1024, 2023-10-06T01:40:07.686 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.686 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 163, 2023-10-06T01:40:07.686 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 163, 2023-10-06T01:40:07.686 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.686 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 163, 2023-10-06T01:40:07.686 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.686 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.687 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 163, 2023-10-06T01:40:07.687 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 163, 2023-10-06T01:40:07.687 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.687 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.687 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.687 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.687 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.687 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.687 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-objecter_ops-0x556f9b81e640": { 2023-10-06T01:40:07.687 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.687 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 1024, 2023-10-06T01:40:07.687 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.688 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2023-10-06T01:40:07.688 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2023-10-06T01:40:07.688 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.688 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2023-10-06T01:40:07.688 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.688 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.688 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 0, 2023-10-06T01:40:07.688 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 0, 2023-10-06T01:40:07.688 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.688 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.688 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.688 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.689 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.689 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.689 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-objecter_ops-0x556f9b81e8c0": { 2023-10-06T01:40:07.689 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.689 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 1024, 2023-10-06T01:40:07.689 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.689 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 2, 2023-10-06T01:40:07.689 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 2, 2023-10-06T01:40:07.689 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.689 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 2, 2023-10-06T01:40:07.689 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.690 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.690 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 2, 2023-10-06T01:40:07.690 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 2, 2023-10-06T01:40:07.690 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.690 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.690 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.690 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.690 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.690 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.690 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-objecter_ops-0x556f9b81f720": { 2023-10-06T01:40:07.690 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.690 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 1024, 2023-10-06T01:40:07.691 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.691 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 1, 2023-10-06T01:40:07.691 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 1, 2023-10-06T01:40:07.691 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.691 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 1, 2023-10-06T01:40:07.691 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.691 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.691 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 1, 2023-10-06T01:40:07.691 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 1, 2023-10-06T01:40:07.691 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.691 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.692 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.692 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.692 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.692 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.692 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-objecter_ops-0x556f9c7206e0": { 2023-10-06T01:40:07.692 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.692 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 1024, 2023-10-06T01:40:07.692 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.692 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2023-10-06T01:40:07.692 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2023-10-06T01:40:07.692 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.692 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2023-10-06T01:40:07.693 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 3, 2023-10-06T01:40:07.693 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 3, 2023-10-06T01:40:07.693 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 3, 2023-10-06T01:40:07.693 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 3, 2023-10-06T01:40:07.693 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.693 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.693 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.693 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.693 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.693 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.693 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-objecter_ops-0x556f9c720c80": { 2023-10-06T01:40:07.693 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.694 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 1024, 2023-10-06T01:40:07.694 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.694 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2023-10-06T01:40:07.694 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2023-10-06T01:40:07.694 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.694 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2023-10-06T01:40:07.694 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.694 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.694 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 0, 2023-10-06T01:40:07.694 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 0, 2023-10-06T01:40:07.694 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.695 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.695 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.695 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.695 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.695 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2023-10-06T01:40:07.695 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-objecter_ops-0x556f9c7212c0": { 2023-10-06T01:40:07.695 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2023-10-06T01:40:07.695 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 1024, 2023-10-06T01:40:07.695 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2023-10-06T01:40:07.695 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2023-10-06T01:40:07.695 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2023-10-06T01:40:07.695 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2023-10-06T01:40:07.695 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2023-10-06T01:40:07.696 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2023-10-06T01:40:07.696 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2023-10-06T01:40:07.696 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 0, 2023-10-06T01:40:07.696 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 0, 2023-10-06T01:40:07.696 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2023-10-06T01:40:07.696 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2023-10-06T01:40:07.696 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2023-10-06T01:40:07.696 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2023-10-06T01:40:07.696 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.696 INFO:teuthology.orchestra.run.smithi069.stdout: } 2023-10-06T01:40:07.696 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-10-06T01:40:07.698 INFO:tasks.check_counter:Daemon mgr.y finisher-volumes.complete_latency.avgcount=9 2023-10-06T01:40:07.698 INFO:tasks.check_counter:Daemon mgr.y finisher-volumes.queue_len=0 2023-10-06T01:40:07.699 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-06T01:40:07.708 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-06T01:40:07.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:07.708 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2023-10-06T01:40:07.723 INFO:teuthology.orchestra.run.smithi069.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-06T01:40:07.723 INFO:teuthology.orchestra.run.smithi069.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-06T01:40:07.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:07.723 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-06T01:40:07.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:07.797 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-06T01:40:07.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:07.879 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link delete ceph-brx 2023-10-06T01:40:07.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:07.980 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2023-10-06T01:40:07.994 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:07.995 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link delete ceph-brx 2023-10-06T01:40:08.063 INFO:teuthology.orchestra.run.smithi069.stderr:Cannot find device "ceph-brx" 2023-10-06T01:40:08.063 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:40:08.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:08.064 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-10-06T01:40:08.082 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-06T01:40:08.082 INFO:teuthology.orchestra.run.smithi088.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-06T01:40:08.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:08.082 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-06T01:40:08.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:08.164 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-06T01:40:08.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:08.244 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2023-10-06T01:40:08.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:08.336 DEBUG:teuthology.orchestra.run.smithi088:> ip netns list 2023-10-06T01:40:08.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-06T01:40:08.351 DEBUG:teuthology.orchestra.run.smithi088:> sudo ip link delete ceph-brx 2023-10-06T01:40:08.419 INFO:teuthology.orchestra.run.smithi088.stderr:Cannot find device "ceph-brx" 2023-10-06T01:40:08.420 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:40:08.420 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-06T01:40:08.430 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-06T01:40:08.430 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:40:08.550 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.549+0000 7fcb4b148700 1 Processor -- start 2023-10-06T01:40:08.551 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.549+0000 7fcb4b148700 1 -- start start 2023-10-06T01:40:08.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.550+0000 7fcb4b148700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fcb44155b70 0x7fcb440b0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:08.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.550+0000 7fcb4b148700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fcb440add80 0x7fcb440b0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:08.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.550+0000 7fcb4b148700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb44157510 con 0x7fcb44159940 2023-10-06T01:40:08.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.550+0000 7fcb4b148700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb440ae2f0 con 0x7fcb440add80 2023-10-06T01:40:08.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.550+0000 7fcb4b148700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb440ae5d0 con 0x7fcb44155b70 2023-10-06T01:40:08.553 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.550+0000 7fcb43fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fcb440add80 0x7fcb440b0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:08.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.550+0000 7fcb43fff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fcb440add80 0x7fcb440b0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39996/0 (socket says 172.21.15.69:39996) 2023-10-06T01:40:08.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.550+0000 7fcb496e5700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fcb44159940 0x7fcb44155f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:60294/0 (socket says 172.21.15.69:60294) 2023-10-06T01:40:08.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.550+0000 7fcb43fff700 1 -- 172.21.15.69:0/3832941344 learned_addr learned my addr 172.21.15.69:0/3832941344 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:08.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.550+0000 7fcb43fff700 1 -- 172.21.15.69:0/3832941344 >> v2:172.21.15.88:3300/0 conn(0x7fcb44155b70 msgr2=0x7fcb440b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:08.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.550+0000 7fcb48ee4700 1 --2- 172.21.15.69:0/3832941344 >> v2:172.21.15.88:3300/0 conn(0x7fcb44155b70 0x7fcb440b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:08.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.550+0000 7fcb43fff700 1 --2- 172.21.15.69:0/3832941344 >> v2:172.21.15.88:3300/0 conn(0x7fcb44155b70 0x7fcb440b0200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:08.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.550+0000 7fcb437fe700 1 -- 172.21.15.69:0/3832941344 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1824303322 0 0) 0x7fcb44157510 con 0x7fcb44159940 2023-10-06T01:40:08.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.550+0000 7fcb43fff700 1 -- 172.21.15.69:0/3832941344 >> v1:172.21.15.69:6789/0 conn(0x7fcb44159940 legacy=0x7fcb44155f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:08.554 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.550+0000 7fcb43fff700 1 -- 172.21.15.69:0/3832941344 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb440ae8b0 con 0x7fcb440add80 2023-10-06T01:40:08.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.550+0000 7fcb43fff700 1 --2- 172.21.15.69:0/3832941344 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcb440add80 0x7fcb440b0740 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fcb440680d0 tx=0x7fcb30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8284570372ca0149 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:08.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.550+0000 7fcb437fe700 1 -- 172.21.15.69:0/3832941344 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3000b860 con 0x7fcb440add80 2023-10-06T01:40:08.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.550+0000 7fcb437fe700 1 -- 172.21.15.69:0/3832941344 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3000b9c0 con 0x7fcb440add80 2023-10-06T01:40:08.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.550+0000 7fcb437fe700 1 -- 172.21.15.69:0/3832941344 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3000bd60 con 0x7fcb440add80 2023-10-06T01:40:08.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.551+0000 7fcb4b148700 1 -- 172.21.15.69:0/3832941344 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcb440add80 msgr2=0x7fcb440b0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:08.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.551+0000 7fcb4b148700 1 --2- 172.21.15.69:0/3832941344 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcb440add80 0x7fcb440b0740 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fcb440680d0 tx=0x7fcb30009250 comp rx=0 tx=0).stop 2023-10-06T01:40:08.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.551+0000 7fcb4b148700 1 -- 172.21.15.69:0/3832941344 shutdown_connections 2023-10-06T01:40:08.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.551+0000 7fcb4b148700 1 --2- 172.21.15.69:0/3832941344 >> v2:172.21.15.88:3300/0 conn(0x7fcb44155b70 0x7fcb440b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:08.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.551+0000 7fcb4b148700 1 --2- 172.21.15.69:0/3832941344 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcb440add80 0x7fcb440b0740 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:08.555 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.551+0000 7fcb4b148700 1 -- 172.21.15.69:0/3832941344 >> 172.21.15.69:0/3832941344 conn(0x7fcb4406d170 msgr2=0x7fcb440cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:08.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.551+0000 7fcb4b148700 1 -- 172.21.15.69:0/3832941344 shutdown_connections 2023-10-06T01:40:08.556 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.551+0000 7fcb4b148700 1 -- 172.21.15.69:0/3832941344 wait complete. 2023-10-06T01:40:08.558 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.552+0000 7fcb4b148700 1 Processor -- start 2023-10-06T01:40:08.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.552+0000 7fcb4b148700 1 -- start start 2023-10-06T01:40:08.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.553+0000 7fcb4b148700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb440add80 0x7fcb4414add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:08.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.553+0000 7fcb4b148700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcb44155b70 0x7fcb441411a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:08.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.553+0000 7fcb4b148700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcb44159940 0x7fcb44146710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:08.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.553+0000 7fcb4b148700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb44146280 con 0x7fcb44159940 2023-10-06T01:40:08.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.553+0000 7fcb4b148700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb44145c70 con 0x7fcb440add80 2023-10-06T01:40:08.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.553+0000 7fcb4b148700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb44141cc0 con 0x7fcb44155b70 2023-10-06T01:40:08.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.553+0000 7fcb496e5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcb44159940 0x7fcb44146710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:08.559 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.553+0000 7fcb496e5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcb44159940 0x7fcb44146710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40012/0 (socket says 172.21.15.69:40012) 2023-10-06T01:40:08.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.553+0000 7fcb496e5700 1 -- 172.21.15.69:0/1881464421 learned_addr learned my addr 172.21.15.69:0/1881464421 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:08.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.553+0000 7fcb43fff700 1 --2- 172.21.15.69:0/1881464421 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcb44155b70 0x7fcb441411a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:08.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.553+0000 7fcb496e5700 1 -- 172.21.15.69:0/1881464421 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcb44155b70 msgr2=0x7fcb441411a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:08.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.553+0000 7fcb496e5700 1 --2- 172.21.15.69:0/1881464421 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcb44155b70 0x7fcb441411a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:08.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.553+0000 7fcb496e5700 1 -- 172.21.15.69:0/1881464421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb440add80 msgr2=0x7fcb4414add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:08.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.553+0000 7fcb48ee4700 1 --2- 172.21.15.69:0/1881464421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb440add80 0x7fcb4414add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:08.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.553+0000 7fcb496e5700 1 --2- 172.21.15.69:0/1881464421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb440add80 0x7fcb4414add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:08.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.553+0000 7fcb496e5700 1 -- 172.21.15.69:0/1881464421 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb300094f0 con 0x7fcb44159940 2023-10-06T01:40:08.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.554+0000 7fcb496e5700 1 --2- 172.21.15.69:0/1881464421 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcb44159940 0x7fcb44146710 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00cd50 tx=0x7fcb3c001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:08.560 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.554+0000 7fcb40ff9700 1 -- 172.21.15.69:0/1881464421 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c005df0 con 0x7fcb44159940 2023-10-06T01:40:08.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.554+0000 7fcb40ff9700 1 -- 172.21.15.69:0/1881464421 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3c00a960 con 0x7fcb44159940 2023-10-06T01:40:08.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.554+0000 7fcb40ff9700 1 -- 172.21.15.69:0/1881464421 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3c00ad20 con 0x7fcb44159940 2023-10-06T01:40:08.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.554+0000 7fcb4b148700 1 -- 172.21.15.69:0/1881464421 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb44148580 con 0x7fcb44159940 2023-10-06T01:40:08.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.554+0000 7fcb4b148700 1 -- 172.21.15.69:0/1881464421 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb44145f10 con 0x7fcb44159940 2023-10-06T01:40:08.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.555+0000 7fcb4b148700 1 -- 172.21.15.69:0/1881464421 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb44148a80 con 0x7fcb44159940 2023-10-06T01:40:08.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.555+0000 7fcb40ff9700 1 -- 172.21.15.69:0/1881464421 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fcb3c007300 con 0x7fcb44159940 2023-10-06T01:40:08.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.555+0000 7fcb40ff9700 1 --2- 172.21.15.69:0/1881464421 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fcb280670e0 0x7fcb28069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:08.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.555+0000 7fcb40ff9700 1 -- 172.21.15.69:0/1881464421 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fcb3c0848b0 con 0x7fcb44159940 2023-10-06T01:40:08.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.555+0000 7fcb48ee4700 1 --2- 172.21.15.69:0/1881464421 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fcb280670e0 0x7fcb28069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:08.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.556+0000 7fcb48ee4700 1 --2- 172.21.15.69:0/1881464421 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fcb280670e0 0x7fcb28069590 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcb38006fd0 tx=0x7fcb38008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:08.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.560+0000 7fcb40ff9700 1 -- 172.21.15.69:0/1881464421 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb44148a80 con 0x7fcb44159940 2023-10-06T01:40:08.743 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.742+0000 7fcb4b148700 1 -- 172.21.15.69:0/1881464421 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb44148a80 con 0x7fcb44159940 2023-10-06T01:40:08.744 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.743+0000 7fcb40ff9700 1 -- 172.21.15.69:0/1881464421 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+13731 (secure 0 0 0) 0x7fcb44148a80 con 0x7fcb44159940 2023-10-06T01:40:08.744 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:40:08.744 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":38,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:40:03.829639+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:38:43.046056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6834/3221701951":"2023-10-07T01:40:00.815980+0000","172.21.15.88:6832/3221701951":"2023-10-07T01:40:00.815980+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:40:08.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.745+0000 7fcb4b148700 1 -- 172.21.15.69:0/1881464421 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fcb280670e0 msgr2=0x7fcb28069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:08.746 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.745+0000 7fcb4b148700 1 --2- 172.21.15.69:0/1881464421 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fcb280670e0 0x7fcb28069590 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fcb38006fd0 tx=0x7fcb38008040 comp rx=0 tx=0).stop 2023-10-06T01:40:08.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.745+0000 7fcb4b148700 1 -- 172.21.15.69:0/1881464421 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcb44159940 msgr2=0x7fcb44146710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:08.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.745+0000 7fcb4b148700 1 --2- 172.21.15.69:0/1881464421 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcb44159940 0x7fcb44146710 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fcb3c00cd50 tx=0x7fcb3c001b10 comp rx=0 tx=0).stop 2023-10-06T01:40:08.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.745+0000 7fcb4b148700 1 -- 172.21.15.69:0/1881464421 shutdown_connections 2023-10-06T01:40:08.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.745+0000 7fcb4b148700 1 --2- 172.21.15.69:0/1881464421 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fcb280670e0 0x7fcb28069590 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:08.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.745+0000 7fcb4b148700 1 --2- 172.21.15.69:0/1881464421 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fcb44159940 0x7fcb44146710 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:08.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.745+0000 7fcb4b148700 1 --2- 172.21.15.69:0/1881464421 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fcb440add80 0x7fcb4414add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:08.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.745+0000 7fcb4b148700 1 --2- 172.21.15.69:0/1881464421 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fcb44155b70 0x7fcb441411a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:08.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.745+0000 7fcb4b148700 1 -- 172.21.15.69:0/1881464421 >> 172.21.15.69:0/1881464421 conn(0x7fcb4406d170 msgr2=0x7fcb4406f140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:08.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.745+0000 7fcb4b148700 1 -- 172.21.15.69:0/1881464421 shutdown_connections 2023-10-06T01:40:08.747 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.745+0000 7fcb4b148700 1 -- 172.21.15.69:0/1881464421 wait complete. 2023-10-06T01:40:08.759 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-06T01:40:08.759 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:40:08.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.873+0000 7f177d28d700 1 Processor -- start 2023-10-06T01:40:08.874 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.873+0000 7f177d28d700 1 -- start start 2023-10-06T01:40:08.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.874+0000 7f177d28d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1778143200 0x7f1778159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:08.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.874+0000 7f177d28d700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f17780c3250 0x7f177815a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:08.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.874+0000 7f177d28d700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f177815a850 0x7f177806cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:08.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.874+0000 7f177d28d700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17781171e0 con 0x7f17780c3250 2023-10-06T01:40:08.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.874+0000 7f177d28d700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f177806c7d0 con 0x7f177815a850 2023-10-06T01:40:08.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.874+0000 7f177d28d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177815acb0 con 0x7f1778143200 2023-10-06T01:40:08.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.874+0000 7f17767fc700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f17780c3250 0x7f177815a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:08.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.874+0000 7f17767fc700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f17780c3250 0x7f177815a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40026/0 (socket says 172.21.15.69:40026) 2023-10-06T01:40:08.877 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.874+0000 7f17767fc700 1 -- 172.21.15.69:0/1516969748 learned_addr learned my addr 172.21.15.69:0/1516969748 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:08.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.874+0000 7f17777fe700 1 --2- 172.21.15.69:0/1516969748 >> v2:172.21.15.88:3300/0 conn(0x7f177815a850 0x7f177806cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:08.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.874+0000 7f1776ffd700 1 --2- 172.21.15.69:0/1516969748 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1778143200 0x7f1778159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:08.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.874+0000 7f17767fc700 1 -- 172.21.15.69:0/1516969748 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1778143200 msgr2=0x7f1778159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:08.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.874+0000 7f17767fc700 1 --2- 172.21.15.69:0/1516969748 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1778143200 0x7f1778159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:08.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.874+0000 7f17767fc700 1 -- 172.21.15.69:0/1516969748 >> v2:172.21.15.88:3300/0 conn(0x7f177815a850 msgr2=0x7f177806cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:08.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.874+0000 7f17767fc700 1 --2- 172.21.15.69:0/1516969748 >> v2:172.21.15.88:3300/0 conn(0x7f177815a850 0x7f177806cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:08.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.874+0000 7f17767fc700 1 -- 172.21.15.69:0/1516969748 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17780c37a0 con 0x7f17780c3250 2023-10-06T01:40:08.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.874+0000 7f17777fe700 1 --2- 172.21.15.69:0/1516969748 >> v2:172.21.15.88:3300/0 conn(0x7f177815a850 0x7f177806cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:40:08.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.874+0000 7f17767fc700 1 --2- 172.21.15.69:0/1516969748 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17780c3250 0x7f177815a310 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f177806a2b0 tx=0x7f1760009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4485caf4c589150f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:08.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.874+0000 7f1775ffb700 1 -- 172.21.15.69:0/1516969748 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176000b860 con 0x7f17780c3250 2023-10-06T01:40:08.878 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.875+0000 7f1775ffb700 1 -- 172.21.15.69:0/1516969748 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f176000b9c0 con 0x7f17780c3250 2023-10-06T01:40:08.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.875+0000 7f1775ffb700 1 -- 172.21.15.69:0/1516969748 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176000bd60 con 0x7f17780c3250 2023-10-06T01:40:08.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.875+0000 7f177d28d700 1 -- 172.21.15.69:0/1516969748 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17780c3250 msgr2=0x7f177815a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:08.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.875+0000 7f177d28d700 1 --2- 172.21.15.69:0/1516969748 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17780c3250 0x7f177815a310 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f177806a2b0 tx=0x7f1760009250 comp rx=0 tx=0).stop 2023-10-06T01:40:08.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.875+0000 7f177d28d700 1 -- 172.21.15.69:0/1516969748 shutdown_connections 2023-10-06T01:40:08.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.875+0000 7f177d28d700 1 --2- 172.21.15.69:0/1516969748 >> v2:172.21.15.88:3300/0 conn(0x7f177815a850 0x7f177806cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:08.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.875+0000 7f177d28d700 1 --2- 172.21.15.69:0/1516969748 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1778143200 0x7f1778159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:08.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.875+0000 7f177d28d700 1 --2- 172.21.15.69:0/1516969748 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17780c3250 0x7f177815a310 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:08.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.875+0000 7f177d28d700 1 -- 172.21.15.69:0/1516969748 >> 172.21.15.69:0/1516969748 conn(0x7f17780ccb60 msgr2=0x7f17780ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:08.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.875+0000 7f177d28d700 1 -- 172.21.15.69:0/1516969748 shutdown_connections 2023-10-06T01:40:08.879 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.875+0000 7f177d28d700 1 -- 172.21.15.69:0/1516969748 wait complete. 2023-10-06T01:40:08.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.876+0000 7f177d28d700 1 Processor -- start 2023-10-06T01:40:08.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.876+0000 7f177d28d700 1 -- start start 2023-10-06T01:40:08.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.877+0000 7f177d28d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17780c3250 0x7f177815a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:08.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.877+0000 7f177d28d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1778143200 0x7f17780cb200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:08.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.877+0000 7f177d28d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f177815a850 0x7f17780cb740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:08.882 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.877+0000 7f177d28d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f177813baf0 con 0x7f17780c3250 2023-10-06T01:40:08.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.877+0000 7f177d28d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1778131930 con 0x7f1778143200 2023-10-06T01:40:08.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.877+0000 7f177d28d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f177815b600 con 0x7f177815a850 2023-10-06T01:40:08.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.877+0000 7f1776ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17780c3250 0x7f177815a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:08.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.877+0000 7f1776ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17780c3250 0x7f177815a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40042/0 (socket says 172.21.15.69:40042) 2023-10-06T01:40:08.883 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.877+0000 7f1776ffd700 1 -- 172.21.15.69:0/4098303133 learned_addr learned my addr 172.21.15.69:0/4098303133 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:08.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.877+0000 7f17777fe700 1 --2- 172.21.15.69:0/4098303133 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f177815a850 0x7f17780cb740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:08.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.877+0000 7f17767fc700 1 --2- 172.21.15.69:0/4098303133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1778143200 0x7f17780cb200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:08.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.878+0000 7f1776ffd700 1 -- 172.21.15.69:0/4098303133 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f177815a850 msgr2=0x7f17780cb740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:08.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.878+0000 7f1776ffd700 1 --2- 172.21.15.69:0/4098303133 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f177815a850 0x7f17780cb740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:08.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.878+0000 7f1776ffd700 1 -- 172.21.15.69:0/4098303133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1778143200 msgr2=0x7f17780cb200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:08.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.878+0000 7f1776ffd700 1 --2- 172.21.15.69:0/4098303133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1778143200 0x7f17780cb200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:08.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.878+0000 7f1776ffd700 1 -- 172.21.15.69:0/4098303133 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17600094f0 con 0x7f17780c3250 2023-10-06T01:40:08.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.878+0000 7f17767fc700 1 --2- 172.21.15.69:0/4098303133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1778143200 0x7f17780cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:40:08.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.878+0000 7f1776ffd700 1 --2- 172.21.15.69:0/4098303133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17780c3250 0x7f177815a110 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f176800e190 tx=0x7f1768009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:08.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.878+0000 7f176effd700 1 -- 172.21.15.69:0/4098303133 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f176800ee30 con 0x7f17780c3250 2023-10-06T01:40:08.884 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.878+0000 7f176effd700 1 -- 172.21.15.69:0/4098303133 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1768014420 con 0x7f17780c3250 2023-10-06T01:40:08.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.878+0000 7f177d28d700 1 -- 172.21.15.69:0/4098303133 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f177813b810 con 0x7f17780c3250 2023-10-06T01:40:08.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.878+0000 7f176effd700 1 -- 172.21.15.69:0/4098303133 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17680147e0 con 0x7f17780c3250 2023-10-06T01:40:08.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.878+0000 7f177d28d700 1 -- 172.21.15.69:0/4098303133 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f177815b290 con 0x7f17780c3250 2023-10-06T01:40:08.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.879+0000 7f177d28d700 1 -- 172.21.15.69:0/4098303133 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f177804c3c0 con 0x7f17780c3250 2023-10-06T01:40:08.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.879+0000 7f176effd700 1 -- 172.21.15.69:0/4098303133 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f1768014b50 con 0x7f17780c3250 2023-10-06T01:40:08.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.880+0000 7f176effd700 1 --2- 172.21.15.69:0/4098303133 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f17580670e0 0x7f1758069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:08.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.880+0000 7f176effd700 1 -- 172.21.15.69:0/4098303133 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f1768084ec0 con 0x7f17780c3250 2023-10-06T01:40:08.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.880+0000 7f17767fc700 1 --2- 172.21.15.69:0/4098303133 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f17580670e0 0x7f1758069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:08.885 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.880+0000 7f17767fc700 1 --2- 172.21.15.69:0/4098303133 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f17580670e0 0x7f1758069590 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f177806a2b0 tx=0x7f1760017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:08.886 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:08.884+0000 7f176effd700 1 -- 172.21.15.69:0/4098303133 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1768052050 con 0x7f17780c3250 2023-10-06T01:40:09.064 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.062+0000 7f177d28d700 1 -- 172.21.15.69:0/4098303133 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f177815b740 con 0x7f17580670e0 2023-10-06T01:40:09.066 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.065+0000 7f176effd700 1 -- 172.21.15.69:0/4098303133 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72322 (secure 0 0 0) 0x7f176000bc50 con 0x7f17580670e0 2023-10-06T01:40:09.067 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:40:09.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.067+0000 7f177d28d700 1 -- 172.21.15.69:0/4098303133 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f17580670e0 msgr2=0x7f1758069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:09.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.067+0000 7f177d28d700 1 --2- 172.21.15.69:0/4098303133 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f17580670e0 0x7f1758069590 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f177806a2b0 tx=0x7f1760017000 comp rx=0 tx=0).stop 2023-10-06T01:40:09.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.067+0000 7f177d28d700 1 -- 172.21.15.69:0/4098303133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17780c3250 msgr2=0x7f177815a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:09.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.067+0000 7f177d28d700 1 --2- 172.21.15.69:0/4098303133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17780c3250 0x7f177815a110 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f176800e190 tx=0x7f1768009920 comp rx=0 tx=0).stop 2023-10-06T01:40:09.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.067+0000 7f177d28d700 1 -- 172.21.15.69:0/4098303133 shutdown_connections 2023-10-06T01:40:09.069 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.067+0000 7f177d28d700 1 --2- 172.21.15.69:0/4098303133 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f17580670e0 0x7f1758069590 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.067+0000 7f177d28d700 1 --2- 172.21.15.69:0/4098303133 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f177815a850 0x7f17780cb740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.067+0000 7f177d28d700 1 --2- 172.21.15.69:0/4098303133 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f17780c3250 0x7f177815a110 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.067+0000 7f177d28d700 1 --2- 172.21.15.69:0/4098303133 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1778143200 0x7f17780cb200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.067+0000 7f177d28d700 1 -- 172.21.15.69:0/4098303133 >> 172.21.15.69:0/4098303133 conn(0x7f17780ccb60 msgr2=0x7f1778142480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:09.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.068+0000 7f177d28d700 1 -- 172.21.15.69:0/4098303133 shutdown_connections 2023-10-06T01:40:09.070 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.068+0000 7f177d28d700 1 -- 172.21.15.69:0/4098303133 wait complete. 2023-10-06T01:40:09.070 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-10-06T01:40:09.081 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2023-10-06T01:40:08.275911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2382920,"kb_used_data":4616,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591800,"statfs":{"total":773094113280,"available":770654003200,"internally_reserved":0,"allocated":4726784,"data_stored":2618808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-132226,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-86,"num_write_kb":-160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.457652"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:03.625392+0000","last_change":"2023-10-06T01:38:44.533111+0000","last_active":"2023-10-06T01:40:03.625392+0000","last_peered":"2023-10-06T01:40:03.625392+0000","last_clean":"2023-10-06T01:40:03.625392+0000","last_became_active":"2023-10-06T01:38:44.532838+0000","last_became_peered":"2023-10-06T01:38:44.532838+0000","last_unstale":"2023-10-06T01:40:03.625392+0000","last_undegraded":"2023-10-06T01:40:03.625392+0000","last_fullsized":"2023-10-06T01:40:03.625392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:02.833069+0000","last_change":"2023-10-06T01:38:44.533897+0000","last_active":"2023-10-06T01:40:02.833069+0000","last_peered":"2023-10-06T01:40:02.833069+0000","last_clean":"2023-10-06T01:40:02.833069+0000","last_became_active":"2023-10-06T01:38:44.533611+0000","last_became_peered":"2023-10-06T01:38:44.533611+0000","last_unstale":"2023-10-06T01:40:02.833069+0000","last_undegraded":"2023-10-06T01:40:02.833069+0000","last_fullsized":"2023-10-06T01:40:02.833069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:24.411408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:02.831702+0000","last_change":"2023-10-06T01:38:45.307814+0000","last_active":"2023-10-06T01:40:02.831702+0000","last_peered":"2023-10-06T01:40:02.831702+0000","last_clean":"2023-10-06T01:40:02.831702+0000","last_became_active":"2023-10-06T01:38:45.307536+0000","last_became_peered":"2023-10-06T01:38:45.307536+0000","last_unstale":"2023-10-06T01:40:02.831702+0000","last_undegraded":"2023-10-06T01:40:02.831702+0000","last_fullsized":"2023-10-06T01:40:02.831702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:09.503713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:02.834665+0000","last_change":"2023-10-06T01:38:44.534507+0000","last_active":"2023-10-06T01:40:02.834665+0000","last_peered":"2023-10-06T01:40:02.834665+0000","last_clean":"2023-10-06T01:40:02.834665+0000","last_became_active":"2023-10-06T01:38:44.534191+0000","last_became_peered":"2023-10-06T01:38:44.534191+0000","last_unstale":"2023-10-06T01:40:02.834665+0000","last_undegraded":"2023-10-06T01:40:02.834665+0000","last_fullsized":"2023-10-06T01:40:02.834665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:02.834037+0000","last_change":"2023-10-06T01:38:40.115117+0000","last_active":"2023-10-06T01:40:02.834037+0000","last_peered":"2023-10-06T01:40:02.834037+0000","last_clean":"2023-10-06T01:40:02.834037+0000","last_became_active":"2023-10-06T01:38:40.114142+0000","last_became_peered":"2023-10-06T01:38:40.114142+0000","last_unstale":"2023-10-06T01:40:02.834037+0000","last_undegraded":"2023-10-06T01:40:02.834037+0000","last_fullsized":"2023-10-06T01:40:02.834037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_clean_scrub_stamp":"2023-10-06T01:38:38.338797+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:52.870262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:02.834146+0000","last_change":"2023-10-06T01:38:44.531831+0000","last_active":"2023-10-06T01:40:02.834146+0000","last_peered":"2023-10-06T01:40:02.834146+0000","last_clean":"2023-10-06T01:40:02.834146+0000","last_became_active":"2023-10-06T01:38:44.531496+0000","last_became_peered":"2023-10-06T01:38:44.531496+0000","last_unstale":"2023-10-06T01:40:02.834146+0000","last_undegraded":"2023-10-06T01:40:02.834146+0000","last_fullsized":"2023-10-06T01:40:02.834146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:28.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:02.833169+0000","last_change":"2023-10-06T01:38:44.531335+0000","last_active":"2023-10-06T01:40:02.833169+0000","last_peered":"2023-10-06T01:40:02.833169+0000","last_clean":"2023-10-06T01:40:02.833169+0000","last_became_active":"2023-10-06T01:38:44.530966+0000","last_became_peered":"2023-10-06T01:38:44.530966+0000","last_unstale":"2023-10-06T01:40:02.833169+0000","last_undegraded":"2023-10-06T01:40:02.833169+0000","last_fullsized":"2023-10-06T01:40:02.833169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:33.926180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:03.626012+0000","last_change":"2023-10-06T01:38:44.533582+0000","last_active":"2023-10-06T01:40:03.626012+0000","last_peered":"2023-10-06T01:40:03.626012+0000","last_clean":"2023-10-06T01:40:03.626012+0000","last_became_active":"2023-10-06T01:38:44.533324+0000","last_became_peered":"2023-10-06T01:38:44.533324+0000","last_unstale":"2023-10-06T01:40:03.626012+0000","last_undegraded":"2023-10-06T01:40:03.626012+0000","last_fullsized":"2023-10-06T01:40:03.626012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:03.625047+0000","last_change":"2023-10-06T01:38:44.533765+0000","last_active":"2023-10-06T01:40:03.625047+0000","last_peered":"2023-10-06T01:40:03.625047+0000","last_clean":"2023-10-06T01:40:03.625047+0000","last_became_active":"2023-10-06T01:38:44.533406+0000","last_became_peered":"2023-10-06T01:38:44.533406+0000","last_unstale":"2023-10-06T01:40:03.625047+0000","last_undegraded":"2023-10-06T01:40:03.625047+0000","last_fullsized":"2023-10-06T01:40:03.625047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":1036288,"data_stored":770127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.621},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.50700000000000001}]},{"osd":1,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.57199999999999995}]},{"osd":2,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.54600000000000004}]},{"osd":3,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.60599999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.35799999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.44},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.38}]},{"osd":6,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.41299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.441},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.57599999999999996}]},{"osd":1,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.497}]},{"osd":2,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.46600000000000003}]},{"osd":3,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.52700000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.35099999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.372},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.51000000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.56499999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.36799999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":0.47299999999999998}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.40000000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.82999999999999996}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.77000000000000002}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.74099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":1036288,"data_stored":770127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"last":0.41099999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.307}]},{"osd":3,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.373},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.38500000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.64600000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.58899999999999997}]},{"osd":7,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.67400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.47299999999999998}]},{"osd":1,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.55900000000000005}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.58499999999999996}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.751}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.214},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.30199999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.28399999999999997}]},{"osd":2,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.32300000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.40799999999999997}]},{"osd":5,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.37},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.46200000000000002}]},{"osd":6,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.39100000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.55300000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.4289999999999998,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.41399999999999998}]},{"osd":1,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":4.2270000000000003,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.2789999999999999,"5min":4.2789999999999999,"15min":4.2789999999999999},"last":0.377}]},{"osd":2,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":12.359,"5min":12.359,"15min":12.359},"last":0.45700000000000002},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":12.326000000000001,"5min":12.326000000000001,"15min":12.326000000000001},"last":0.47099999999999997}]},{"osd":3,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":3.448,"5min":3.448,"15min":3.448},"last":0.44500000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":12.282,"5min":12.282,"15min":12.282},"last":0.48899999999999999}]},{"osd":5,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.35199999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.504}]},{"osd":7,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.56699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.44},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.69899999999999995}]},{"osd":1,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.622}]},{"osd":2,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.58699999999999997}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.52200000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.78200000000000003}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.71499999999999997}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.68000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:40:09.083 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:40:09.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.196+0000 7f9f7842e700 1 Processor -- start 2023-10-06T01:40:09.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.196+0000 7f9f7842e700 1 -- start start 2023-10-06T01:40:09.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.197+0000 7f9f7842e700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f9f700b1040 0x7f9f700c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:09.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.197+0000 7f9f7842e700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f700adb20 con 0x7f9f70159850 2023-10-06T01:40:09.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.197+0000 7f9f7842e700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f700acf10 con 0x7f9f70159c20 2023-10-06T01:40:09.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.197+0000 7f9f7842e700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f700ccdc0 con 0x7f9f700b1040 2023-10-06T01:40:09.201 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.197+0000 7f9f761ca700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f9f70159850 0x7f9f700adfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:60310/0 (socket says 172.21.15.69:60310) 2023-10-06T01:40:09.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.198+0000 7f9f761ca700 1 -- 172.21.15.69:0/4050030020 learned_addr learned my addr 172.21.15.69:0/4050030020 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:40:09.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.198+0000 7f9f769cb700 1 --2- 172.21.15.69:0/4050030020 >> v2:172.21.15.88:3300/0 conn(0x7f9f700b1040 0x7f9f700c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:09.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.198+0000 7f9f751c8700 1 -- 172.21.15.69:0/4050030020 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1672003377 0 0) 0x7f9f700adb20 con 0x7f9f70159850 2023-10-06T01:40:09.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.198+0000 7f9f751c8700 1 -- 172.21.15.69:0/4050030020 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f5c003570 con 0x7f9f70159850 2023-10-06T01:40:09.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.198+0000 7f9f751c8700 1 -- 172.21.15.69:0/4050030020 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2756420256 0 0) 0x7f9f5c003570 con 0x7f9f70159850 2023-10-06T01:40:09.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.198+0000 7f9f751c8700 1 -- 172.21.15.69:0/4050030020 >> v2:172.21.15.88:3300/0 conn(0x7f9f700b1040 msgr2=0x7f9f700c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:09.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.198+0000 7f9f751c8700 1 --2- 172.21.15.69:0/4050030020 >> v2:172.21.15.88:3300/0 conn(0x7f9f700b1040 0x7f9f700c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.198+0000 7f9f751c8700 1 -- 172.21.15.69:0/4050030020 >> v1:172.21.15.88:6789/0 conn(0x7f9f70159c20 legacy=0x7f9f700b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:09.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.198+0000 7f9f751c8700 1 -- 172.21.15.69:0/4050030020 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f700ad1f0 con 0x7f9f70159850 2023-10-06T01:40:09.202 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.198+0000 7f9f751c8700 1 -- 172.21.15.69:0/4050030020 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f9f6c0017f0 con 0x7f9f70159850 2023-10-06T01:40:09.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.198+0000 7f9f751c8700 1 -- 172.21.15.69:0/4050030020 >> v1:172.21.15.69:6789/0 conn(0x7f9f70159850 legacy=0x7f9f700adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:09.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.198+0000 7f9f751c8700 1 --2- 172.21.15.69:0/4050030020 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9f5c003ab0 0x7f9f5c003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:09.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.198+0000 7f9f751c8700 1 --2- 172.21.15.69:0/4050030020 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9f5c004810 0x7f9f5c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:09.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.198+0000 7f9f751c8700 1 --2- 172.21.15.69:0/4050030020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f5c005210 0x7f9f5c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:09.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.198+0000 7f9f751c8700 1 -- 172.21.15.69:0/4050030020 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f700ccdc0 con 0x7f9f5c004810 2023-10-06T01:40:09.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.198+0000 7f9f751c8700 1 -- 172.21.15.69:0/4050030020 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c00c130 con 0x7f9f5c005210 2023-10-06T01:40:09.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.198+0000 7f9f751c8700 1 -- 172.21.15.69:0/4050030020 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5c00c2f0 con 0x7f9f5c003ab0 2023-10-06T01:40:09.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.198+0000 7f9f759c9700 1 --2- 172.21.15.69:0/4050030020 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9f5c004810 0x7f9f5c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:09.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.198+0000 7f9f761ca700 1 --2- 172.21.15.69:0/4050030020 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9f5c003ab0 0x7f9f5c003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:09.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.198+0000 7f9f769cb700 1 --2- 172.21.15.69:0/4050030020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f5c005210 0x7f9f5c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:09.203 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.198+0000 7f9f759c9700 1 -- 172.21.15.69:0/4050030020 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9f5c003ab0 msgr2=0x7f9f5c003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:09.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.198+0000 7f9f759c9700 1 --2- 172.21.15.69:0/4050030020 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9f5c003ab0 0x7f9f5c003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.198+0000 7f9f759c9700 1 -- 172.21.15.69:0/4050030020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f5c005210 msgr2=0x7f9f5c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:09.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.198+0000 7f9f759c9700 1 --2- 172.21.15.69:0/4050030020 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f5c005210 0x7f9f5c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.198+0000 7f9f759c9700 1 -- 172.21.15.69:0/4050030020 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5c003570 con 0x7f9f5c004810 2023-10-06T01:40:09.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.199+0000 7f9f769cb700 1 -- 172.21.15.69:0/4050030020 reap_dead start 2023-10-06T01:40:09.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.199+0000 7f9f759c9700 1 --2- 172.21.15.69:0/4050030020 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9f5c004810 0x7f9f5c004c80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9f600018b0 tx=0x7f9f60007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=683dd3ee4553bff7 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:09.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.199+0000 7f9f751c8700 1 -- 172.21.15.69:0/4050030020 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f60012420 con 0x7f9f5c004810 2023-10-06T01:40:09.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.199+0000 7f9f751c8700 1 -- 172.21.15.69:0/4050030020 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f600125a0 con 0x7f9f5c004810 2023-10-06T01:40:09.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.199+0000 7f9f751c8700 1 -- 172.21.15.69:0/4050030020 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f60012960 con 0x7f9f5c004810 2023-10-06T01:40:09.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.199+0000 7f9f7842e700 1 -- 172.21.15.69:0/4050030020 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9f5c004810 msgr2=0x7f9f5c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:09.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.199+0000 7f9f7842e700 1 --2- 172.21.15.69:0/4050030020 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9f5c004810 0x7f9f5c004c80 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f9f600018b0 tx=0x7f9f60007d30 comp rx=0 tx=0).stop 2023-10-06T01:40:09.204 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.199+0000 7f9f7842e700 1 -- 172.21.15.69:0/4050030020 shutdown_connections 2023-10-06T01:40:09.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.199+0000 7f9f7842e700 1 --2- 172.21.15.69:0/4050030020 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9f5c004810 0x7f9f5c004c80 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.199+0000 7f9f7842e700 1 -- 172.21.15.69:0/4050030020 >> 172.21.15.69:0/4050030020 conn(0x7f9f7006d170 msgr2=0x7f9f700cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:09.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.199+0000 7f9f7842e700 1 -- 172.21.15.69:0/4050030020 shutdown_connections 2023-10-06T01:40:09.205 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.199+0000 7f9f7842e700 1 -- 172.21.15.69:0/4050030020 wait complete. 2023-10-06T01:40:09.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.200+0000 7f9f7842e700 1 Processor -- start 2023-10-06T01:40:09.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.201+0000 7f9f7842e700 1 -- start start 2023-10-06T01:40:09.207 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.201+0000 7f9f7842e700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9f5c004810 0x7f9f70146e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:09.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.201+0000 7f9f7842e700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9f70157b50 0x7f9f70168aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:09.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.201+0000 7f9f7842e700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f700b00d0 0x7f9f700b0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:09.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.201+0000 7f9f7842e700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f701473a0 con 0x7f9f5c004810 2023-10-06T01:40:09.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.201+0000 7f9f7842e700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f700b0ab0 con 0x7f9f700b00d0 2023-10-06T01:40:09.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.201+0000 7f9f7842e700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f700a7c00 con 0x7f9f70157b50 2023-10-06T01:40:09.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.201+0000 7f9f761ca700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9f5c004810 0x7f9f70146e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:09.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.201+0000 7f9f761ca700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9f5c004810 0x7f9f70146e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40054/0 (socket says 172.21.15.69:40054) 2023-10-06T01:40:09.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.201+0000 7f9f761ca700 1 -- 172.21.15.69:0/1873506852 learned_addr learned my addr 172.21.15.69:0/1873506852 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:09.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.201+0000 7f9f759c9700 1 --2- 172.21.15.69:0/1873506852 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9f70157b50 0x7f9f70168aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:09.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.201+0000 7f9f769cb700 1 --2- 172.21.15.69:0/1873506852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f700b00d0 0x7f9f700b0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:09.208 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.202+0000 7f9f761ca700 1 -- 172.21.15.69:0/1873506852 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9f70157b50 msgr2=0x7f9f70168aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:09.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.202+0000 7f9f761ca700 1 --2- 172.21.15.69:0/1873506852 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9f70157b50 0x7f9f70168aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.202+0000 7f9f761ca700 1 -- 172.21.15.69:0/1873506852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f700b00d0 msgr2=0x7f9f700b0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:09.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.202+0000 7f9f761ca700 1 --2- 172.21.15.69:0/1873506852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f700b00d0 0x7f9f700b0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.202+0000 7f9f761ca700 1 -- 172.21.15.69:0/1873506852 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f70169410 con 0x7f9f5c004810 2023-10-06T01:40:09.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.202+0000 7f9f761ca700 1 --2- 172.21.15.69:0/1873506852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9f5c004810 0x7f9f70146e60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c007ac0 tx=0x7f9f6c002100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:09.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.202+0000 7f9f667fc700 1 -- 172.21.15.69:0/1873506852 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c00acc0 con 0x7f9f5c004810 2023-10-06T01:40:09.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.202+0000 7f9f667fc700 1 -- 172.21.15.69:0/1873506852 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f6c00ae20 con 0x7f9f5c004810 2023-10-06T01:40:09.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.202+0000 7f9f7842e700 1 -- 172.21.15.69:0/1873506852 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f701696f0 con 0x7f9f5c004810 2023-10-06T01:40:09.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.202+0000 7f9f667fc700 1 -- 172.21.15.69:0/1873506852 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f6c013640 con 0x7f9f5c004810 2023-10-06T01:40:09.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.202+0000 7f9f7842e700 1 -- 172.21.15.69:0/1873506852 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f70168fe0 con 0x7f9f5c004810 2023-10-06T01:40:09.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.203+0000 7f9f7842e700 1 -- 172.21.15.69:0/1873506852 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f701691d0 con 0x7f9f5c004810 2023-10-06T01:40:09.209 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.203+0000 7f9f667fc700 1 -- 172.21.15.69:0/1873506852 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f9f6c013a30 con 0x7f9f5c004810 2023-10-06T01:40:09.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.204+0000 7f9f667fc700 1 --2- 172.21.15.69:0/1873506852 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9f540670d0 0x7f9f54069580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:09.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.204+0000 7f9f667fc700 1 -- 172.21.15.69:0/1873506852 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f9f6c0853e0 con 0x7f9f5c004810 2023-10-06T01:40:09.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.204+0000 7f9f759c9700 1 --2- 172.21.15.69:0/1873506852 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9f540670d0 0x7f9f54069580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:09.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.204+0000 7f9f759c9700 1 --2- 172.21.15.69:0/1873506852 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9f540670d0 0x7f9f54069580 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9f70157f20 tx=0x7f9f60015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:09.210 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.208+0000 7f9f667fc700 1 -- 172.21.15.69:0/1873506852 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f701691d0 con 0x7f9f5c004810 2023-10-06T01:40:09.389 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.388+0000 7f9f7842e700 1 -- 172.21.15.69:0/1873506852 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9f700a7d40 con 0x7f9f540670d0 2023-10-06T01:40:09.392 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.391+0000 7f9f667fc700 1 -- 172.21.15.69:0/1873506852 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72322 (secure 0 0 0) 0x7f9f60024070 con 0x7f9f540670d0 2023-10-06T01:40:09.393 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:40:09.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.393+0000 7f9f7842e700 1 -- 172.21.15.69:0/1873506852 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9f540670d0 msgr2=0x7f9f54069580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:09.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.393+0000 7f9f7842e700 1 --2- 172.21.15.69:0/1873506852 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9f540670d0 0x7f9f54069580 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9f70157f20 tx=0x7f9f60015000 comp rx=0 tx=0).stop 2023-10-06T01:40:09.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.393+0000 7f9f7842e700 1 -- 172.21.15.69:0/1873506852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9f5c004810 msgr2=0x7f9f70146e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:09.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.393+0000 7f9f7842e700 1 --2- 172.21.15.69:0/1873506852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9f5c004810 0x7f9f70146e60 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f9f6c007ac0 tx=0x7f9f6c002100 comp rx=0 tx=0).stop 2023-10-06T01:40:09.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.393+0000 7f9f7842e700 1 -- 172.21.15.69:0/1873506852 shutdown_connections 2023-10-06T01:40:09.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.393+0000 7f9f7842e700 1 --2- 172.21.15.69:0/1873506852 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f9f540670d0 0x7f9f54069580 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.393+0000 7f9f7842e700 1 --2- 172.21.15.69:0/1873506852 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f9f700b00d0 0x7f9f700b0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.395 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.393+0000 7f9f7842e700 1 --2- 172.21.15.69:0/1873506852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9f5c004810 0x7f9f70146e60 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.393+0000 7f9f7842e700 1 --2- 172.21.15.69:0/1873506852 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f9f70157b50 0x7f9f70168aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.393+0000 7f9f7842e700 1 -- 172.21.15.69:0/1873506852 >> 172.21.15.69:0/1873506852 conn(0x7f9f7006d170 msgr2=0x7f9f7006e370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:09.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.393+0000 7f9f7842e700 1 -- 172.21.15.69:0/1873506852 shutdown_connections 2023-10-06T01:40:09.396 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.393+0000 7f9f7842e700 1 -- 172.21.15.69:0/1873506852 wait complete. 2023-10-06T01:40:09.396 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-10-06T01:40:09.406 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2023-10-06T01:40:08.275911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2382920,"kb_used_data":4616,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591800,"statfs":{"total":773094113280,"available":770654003200,"internally_reserved":0,"allocated":4726784,"data_stored":2618808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-132226,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-86,"num_write_kb":-160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.457652"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:03.625392+0000","last_change":"2023-10-06T01:38:44.533111+0000","last_active":"2023-10-06T01:40:03.625392+0000","last_peered":"2023-10-06T01:40:03.625392+0000","last_clean":"2023-10-06T01:40:03.625392+0000","last_became_active":"2023-10-06T01:38:44.532838+0000","last_became_peered":"2023-10-06T01:38:44.532838+0000","last_unstale":"2023-10-06T01:40:03.625392+0000","last_undegraded":"2023-10-06T01:40:03.625392+0000","last_fullsized":"2023-10-06T01:40:03.625392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:02.833069+0000","last_change":"2023-10-06T01:38:44.533897+0000","last_active":"2023-10-06T01:40:02.833069+0000","last_peered":"2023-10-06T01:40:02.833069+0000","last_clean":"2023-10-06T01:40:02.833069+0000","last_became_active":"2023-10-06T01:38:44.533611+0000","last_became_peered":"2023-10-06T01:38:44.533611+0000","last_unstale":"2023-10-06T01:40:02.833069+0000","last_undegraded":"2023-10-06T01:40:02.833069+0000","last_fullsized":"2023-10-06T01:40:02.833069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:24.411408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:02.831702+0000","last_change":"2023-10-06T01:38:45.307814+0000","last_active":"2023-10-06T01:40:02.831702+0000","last_peered":"2023-10-06T01:40:02.831702+0000","last_clean":"2023-10-06T01:40:02.831702+0000","last_became_active":"2023-10-06T01:38:45.307536+0000","last_became_peered":"2023-10-06T01:38:45.307536+0000","last_unstale":"2023-10-06T01:40:02.831702+0000","last_undegraded":"2023-10-06T01:40:02.831702+0000","last_fullsized":"2023-10-06T01:40:02.831702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:09.503713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:02.834665+0000","last_change":"2023-10-06T01:38:44.534507+0000","last_active":"2023-10-06T01:40:02.834665+0000","last_peered":"2023-10-06T01:40:02.834665+0000","last_clean":"2023-10-06T01:40:02.834665+0000","last_became_active":"2023-10-06T01:38:44.534191+0000","last_became_peered":"2023-10-06T01:38:44.534191+0000","last_unstale":"2023-10-06T01:40:02.834665+0000","last_undegraded":"2023-10-06T01:40:02.834665+0000","last_fullsized":"2023-10-06T01:40:02.834665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:02.834037+0000","last_change":"2023-10-06T01:38:40.115117+0000","last_active":"2023-10-06T01:40:02.834037+0000","last_peered":"2023-10-06T01:40:02.834037+0000","last_clean":"2023-10-06T01:40:02.834037+0000","last_became_active":"2023-10-06T01:38:40.114142+0000","last_became_peered":"2023-10-06T01:38:40.114142+0000","last_unstale":"2023-10-06T01:40:02.834037+0000","last_undegraded":"2023-10-06T01:40:02.834037+0000","last_fullsized":"2023-10-06T01:40:02.834037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_clean_scrub_stamp":"2023-10-06T01:38:38.338797+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:52.870262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:02.834146+0000","last_change":"2023-10-06T01:38:44.531831+0000","last_active":"2023-10-06T01:40:02.834146+0000","last_peered":"2023-10-06T01:40:02.834146+0000","last_clean":"2023-10-06T01:40:02.834146+0000","last_became_active":"2023-10-06T01:38:44.531496+0000","last_became_peered":"2023-10-06T01:38:44.531496+0000","last_unstale":"2023-10-06T01:40:02.834146+0000","last_undegraded":"2023-10-06T01:40:02.834146+0000","last_fullsized":"2023-10-06T01:40:02.834146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:28.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:02.833169+0000","last_change":"2023-10-06T01:38:44.531335+0000","last_active":"2023-10-06T01:40:02.833169+0000","last_peered":"2023-10-06T01:40:02.833169+0000","last_clean":"2023-10-06T01:40:02.833169+0000","last_became_active":"2023-10-06T01:38:44.530966+0000","last_became_peered":"2023-10-06T01:38:44.530966+0000","last_unstale":"2023-10-06T01:40:02.833169+0000","last_undegraded":"2023-10-06T01:40:02.833169+0000","last_fullsized":"2023-10-06T01:40:02.833169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:33.926180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:03.626012+0000","last_change":"2023-10-06T01:38:44.533582+0000","last_active":"2023-10-06T01:40:03.626012+0000","last_peered":"2023-10-06T01:40:03.626012+0000","last_clean":"2023-10-06T01:40:03.626012+0000","last_became_active":"2023-10-06T01:38:44.533324+0000","last_became_peered":"2023-10-06T01:38:44.533324+0000","last_unstale":"2023-10-06T01:40:03.626012+0000","last_undegraded":"2023-10-06T01:40:03.626012+0000","last_fullsized":"2023-10-06T01:40:03.626012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:03.625047+0000","last_change":"2023-10-06T01:38:44.533765+0000","last_active":"2023-10-06T01:40:03.625047+0000","last_peered":"2023-10-06T01:40:03.625047+0000","last_clean":"2023-10-06T01:40:03.625047+0000","last_became_active":"2023-10-06T01:38:44.533406+0000","last_became_peered":"2023-10-06T01:38:44.533406+0000","last_unstale":"2023-10-06T01:40:03.625047+0000","last_undegraded":"2023-10-06T01:40:03.625047+0000","last_fullsized":"2023-10-06T01:40:03.625047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":1036288,"data_stored":770127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.621},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.50700000000000001}]},{"osd":1,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.57199999999999995}]},{"osd":2,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.54600000000000004}]},{"osd":3,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.60599999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.35799999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.44},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.38}]},{"osd":6,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.41299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.441},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.57599999999999996}]},{"osd":1,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.497}]},{"osd":2,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.46600000000000003}]},{"osd":3,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.52700000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.35099999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.372},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.51000000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.56499999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.36799999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":0.47299999999999998}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.40000000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.82999999999999996}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.77000000000000002}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.74099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":1036288,"data_stored":770127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"last":0.41099999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.307}]},{"osd":3,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.373},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.38500000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.64600000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.58899999999999997}]},{"osd":7,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.67400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.47299999999999998}]},{"osd":1,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.55900000000000005}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.58499999999999996}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.751}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.214},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.30199999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.28399999999999997}]},{"osd":2,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.32300000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.40799999999999997}]},{"osd":5,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.37},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.46200000000000002}]},{"osd":6,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.39100000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.55300000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.4289999999999998,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.41399999999999998}]},{"osd":1,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":4.2270000000000003,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.2789999999999999,"5min":4.2789999999999999,"15min":4.2789999999999999},"last":0.377}]},{"osd":2,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":12.359,"5min":12.359,"15min":12.359},"last":0.45700000000000002},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":12.326000000000001,"5min":12.326000000000001,"15min":12.326000000000001},"last":0.47099999999999997}]},{"osd":3,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":3.448,"5min":3.448,"15min":3.448},"last":0.44500000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":12.282,"5min":12.282,"15min":12.282},"last":0.48899999999999999}]},{"osd":5,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.35199999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.504}]},{"osd":7,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.56699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.44},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.69899999999999995}]},{"osd":1,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.622}]},{"osd":2,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.58699999999999997}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.52200000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.78200000000000003}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.71499999999999997}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.68000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:40:09.408 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-06T01:40:09.409 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:40:09.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.522+0000 7fbecc8b9700 1 Processor -- start 2023-10-06T01:40:09.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.522+0000 7fbecc8b9700 1 -- start start 2023-10-06T01:40:09.531 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.523+0000 7fbecc8b9700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbec815a5d0 0x7fbec8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:09.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.523+0000 7fbecc8b9700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec815ae40 con 0x7fbec80cb970 2023-10-06T01:40:09.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.523+0000 7fbecc8b9700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbec815ab60 con 0x7fbec80cb5a0 2023-10-06T01:40:09.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.523+0000 7fbecc8b9700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec80ce0f0 con 0x7fbec815a5d0 2023-10-06T01:40:09.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.523+0000 7fbebdd9b700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fbec80cb970 0x7fbec8159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:60312/0 (socket says 172.21.15.69:60312) 2023-10-06T01:40:09.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.523+0000 7fbebdd9b700 1 -- 172.21.15.69:0/2842800516 learned_addr learned my addr 172.21.15.69:0/2842800516 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:40:09.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.523+0000 7fbec6d9d700 1 --2- 172.21.15.69:0/2842800516 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbec815a5d0 0x7fbec8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:09.532 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.523+0000 7fbec5d9b700 1 -- 172.21.15.69:0/2842800516 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049366185 0 0) 0x7fbec815ae40 con 0x7fbec80cb970 2023-10-06T01:40:09.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.523+0000 7fbec5d9b700 1 -- 172.21.15.69:0/2842800516 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbeb4003570 con 0x7fbec80cb970 2023-10-06T01:40:09.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbec5d9b700 1 -- 172.21.15.69:0/2842800516 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1604365044 0 0) 0x7fbec815ab60 con 0x7fbec80cb5a0 2023-10-06T01:40:09.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbec5d9b700 1 -- 172.21.15.69:0/2842800516 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbec815ae40 con 0x7fbec80cb5a0 2023-10-06T01:40:09.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbec5d9b700 1 -- 172.21.15.69:0/2842800516 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3005529750 0 0) 0x7fbeb4003570 con 0x7fbec80cb970 2023-10-06T01:40:09.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbec5d9b700 1 -- 172.21.15.69:0/2842800516 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbec815a5d0 msgr2=0x7fbec8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:09.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbec5d9b700 1 --2- 172.21.15.69:0/2842800516 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbec815a5d0 0x7fbec8156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbec5d9b700 1 -- 172.21.15.69:0/2842800516 >> v1:172.21.15.88:6789/0 conn(0x7fbec80cb5a0 legacy=0x7fbec80cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:09.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbec5d9b700 1 -- 172.21.15.69:0/2842800516 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec80ccf00 con 0x7fbec80cb970 2023-10-06T01:40:09.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbec5d9b700 1 -- 172.21.15.69:0/2842800516 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7fbeb0001470 con 0x7fbec80cb970 2023-10-06T01:40:09.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbec5d9b700 1 -- 172.21.15.69:0/2842800516 >> v1:172.21.15.69:6789/0 conn(0x7fbec80cb970 legacy=0x7fbec8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:09.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbec5d9b700 1 --2- 172.21.15.69:0/2842800516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbeb4003c20 0x7fbeb4004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:09.533 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbec5d9b700 1 --2- 172.21.15.69:0/2842800516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbeb4004810 0x7fbeb4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:09.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbec5d9b700 1 --2- 172.21.15.69:0/2842800516 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbec815a5d0 0x7fbeb4005220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:09.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbec5d9b700 1 -- 172.21.15.69:0/2842800516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec80ce0f0 con 0x7fbeb4004810 2023-10-06T01:40:09.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbec5d9b700 1 -- 172.21.15.69:0/2842800516 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb400bbf0 con 0x7fbeb4003c20 2023-10-06T01:40:09.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbec5d9b700 1 -- 172.21.15.69:0/2842800516 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb400bdb0 con 0x7fbec815a5d0 2023-10-06T01:40:09.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbebdd9b700 1 --2- 172.21.15.69:0/2842800516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbeb4004810 0x7fbeb4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:09.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbec659c700 1 --2- 172.21.15.69:0/2842800516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbeb4003c20 0x7fbeb4004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:09.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbec6d9d700 1 --2- 172.21.15.69:0/2842800516 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbec815a5d0 0x7fbeb4005220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:09.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbebdd9b700 1 -- 172.21.15.69:0/2842800516 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbec815a5d0 msgr2=0x7fbeb4005220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:09.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbebdd9b700 1 --2- 172.21.15.69:0/2842800516 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbec815a5d0 0x7fbeb4005220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbebdd9b700 1 -- 172.21.15.69:0/2842800516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbeb4003c20 msgr2=0x7fbeb4004010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:09.534 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbebdd9b700 1 --2- 172.21.15.69:0/2842800516 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbeb4003c20 0x7fbeb4004010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbebdd9b700 1 -- 172.21.15.69:0/2842800516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb4003570 con 0x7fbeb4004810 2023-10-06T01:40:09.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbec6d9d700 1 --2- 172.21.15.69:0/2842800516 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbec815a5d0 0x7fbeb4005220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:09.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbebdd9b700 1 --2- 172.21.15.69:0/2842800516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbeb4004810 0x7fbeb4004c80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fbeb000c210 tx=0x7fbeb0001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a12a3112ad51595a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:09.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbec5d9b700 1 -- 172.21.15.69:0/2842800516 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb000cae0 con 0x7fbeb4004810 2023-10-06T01:40:09.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbec5d9b700 1 -- 172.21.15.69:0/2842800516 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb000cc60 con 0x7fbeb4004810 2023-10-06T01:40:09.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.524+0000 7fbec5d9b700 1 -- 172.21.15.69:0/2842800516 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb0005920 con 0x7fbeb4004810 2023-10-06T01:40:09.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.525+0000 7fbecc8b9700 1 -- 172.21.15.69:0/2842800516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbeb4004810 msgr2=0x7fbeb4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:09.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.525+0000 7fbecc8b9700 1 --2- 172.21.15.69:0/2842800516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbeb4004810 0x7fbeb4004c80 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fbeb000c210 tx=0x7fbeb0001d40 comp rx=0 tx=0).stop 2023-10-06T01:40:09.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.525+0000 7fbec6d9d700 1 -- 172.21.15.69:0/2842800516 reap_dead start 2023-10-06T01:40:09.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.525+0000 7fbecc8b9700 1 -- 172.21.15.69:0/2842800516 shutdown_connections 2023-10-06T01:40:09.535 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.525+0000 7fbecc8b9700 1 -- 172.21.15.69:0/2842800516 >> 172.21.15.69:0/2842800516 conn(0x7fbec8070e30 msgr2=0x7fbec80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:09.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.525+0000 7fbecc8b9700 1 -- 172.21.15.69:0/2842800516 shutdown_connections 2023-10-06T01:40:09.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.525+0000 7fbecc8b9700 1 -- 172.21.15.69:0/2842800516 wait complete. 2023-10-06T01:40:09.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.526+0000 7fbecc8b9700 1 Processor -- start 2023-10-06T01:40:09.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.526+0000 7fbecc8b9700 1 -- start start 2023-10-06T01:40:09.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.527+0000 7fbecc8b9700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbeb4004810 0x7fbec8155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:09.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.527+0000 7fbecc8b9700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbec8158f90 0x7fbec8158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:09.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.527+0000 7fbecc8b9700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbec80b4520 0x7fbec80b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:09.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.527+0000 7fbecc8b9700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec80b4f00 con 0x7fbeb4004810 2023-10-06T01:40:09.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.527+0000 7fbecc8b9700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbec8157870 con 0x7fbec80b4520 2023-10-06T01:40:09.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.527+0000 7fbecc8b9700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbec8156120 con 0x7fbec8158f90 2023-10-06T01:40:09.536 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.527+0000 7fbec659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbeb4004810 0x7fbec8155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:09.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.527+0000 7fbec659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbeb4004810 0x7fbec8155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40074/0 (socket says 172.21.15.69:40074) 2023-10-06T01:40:09.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.527+0000 7fbec659c700 1 -- 172.21.15.69:0/3637490490 learned_addr learned my addr 172.21.15.69:0/3637490490 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:09.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.527+0000 7fbebdd9b700 1 --2- 172.21.15.69:0/3637490490 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbec8158f90 0x7fbec8158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:09.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.527+0000 7fbec6d9d700 1 --2- 172.21.15.69:0/3637490490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbec80b4520 0x7fbec80b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:09.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.527+0000 7fbec659c700 1 -- 172.21.15.69:0/3637490490 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbec8158f90 msgr2=0x7fbec8158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:09.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.527+0000 7fbec659c700 1 --2- 172.21.15.69:0/3637490490 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbec8158f90 0x7fbec8158590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.527+0000 7fbec659c700 1 -- 172.21.15.69:0/3637490490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbec80b4520 msgr2=0x7fbec80b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:09.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.527+0000 7fbec659c700 1 --2- 172.21.15.69:0/3637490490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbec80b4520 0x7fbec80b49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.527+0000 7fbec659c700 1 -- 172.21.15.69:0/3637490490 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbec8156c60 con 0x7fbeb4004810 2023-10-06T01:40:09.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.527+0000 7fbec659c700 1 --2- 172.21.15.69:0/3637490490 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbeb4004810 0x7fbec8155be0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8002c00 tx=0x7fbeb8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:09.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.528+0000 7fbebeffd700 1 -- 172.21.15.69:0/3637490490 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb800f920 con 0x7fbeb4004810 2023-10-06T01:40:09.537 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.528+0000 7fbebeffd700 1 -- 172.21.15.69:0/3637490490 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbeb800fa80 con 0x7fbeb4004810 2023-10-06T01:40:09.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.528+0000 7fbecc8b9700 1 -- 172.21.15.69:0/3637490490 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbec8156f40 con 0x7fbeb4004810 2023-10-06T01:40:09.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.528+0000 7fbebeffd700 1 -- 172.21.15.69:0/3637490490 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbeb800fe40 con 0x7fbeb4004810 2023-10-06T01:40:09.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.528+0000 7fbecc8b9700 1 -- 172.21.15.69:0/3637490490 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbec8157500 con 0x7fbeb4004810 2023-10-06T01:40:09.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.529+0000 7fbecc8b9700 1 -- 172.21.15.69:0/3637490490 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbec80cafc0 con 0x7fbeb4004810 2023-10-06T01:40:09.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.529+0000 7fbebeffd700 1 -- 172.21.15.69:0/3637490490 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fbeb8013600 con 0x7fbeb4004810 2023-10-06T01:40:09.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.529+0000 7fbebeffd700 1 --2- 172.21.15.69:0/3637490490 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fbea80670e0 0x7fbea8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:09.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.529+0000 7fbebeffd700 1 -- 172.21.15.69:0/3637490490 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fbeb8084d20 con 0x7fbeb4004810 2023-10-06T01:40:09.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.529+0000 7fbebdd9b700 1 --2- 172.21.15.69:0/3637490490 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fbea80670e0 0x7fbea8069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:09.538 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.530+0000 7fbebdd9b700 1 --2- 172.21.15.69:0/3637490490 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fbea80670e0 0x7fbea8069590 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbec80b5330 tx=0x7fbeb0015000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:09.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.534+0000 7fbebeffd700 1 -- 172.21.15.69:0/3637490490 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbeb8051eb0 con 0x7fbeb4004810 2023-10-06T01:40:09.712 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.711+0000 7fbecc8b9700 1 -- 172.21.15.69:0/3637490490 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbec804c3c0 con 0x7fbea80670e0 2023-10-06T01:40:09.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.714+0000 7fbebeffd700 1 -- 172.21.15.69:0/3637490490 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72322 (secure 0 0 0) 0x7fbec804c3c0 con 0x7fbea80670e0 2023-10-06T01:40:09.716 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:40:09.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.716+0000 7fbecc8b9700 1 -- 172.21.15.69:0/3637490490 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fbea80670e0 msgr2=0x7fbea8069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:09.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.716+0000 7fbecc8b9700 1 --2- 172.21.15.69:0/3637490490 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fbea80670e0 0x7fbea8069590 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbec80b5330 tx=0x7fbeb0015000 comp rx=0 tx=0).stop 2023-10-06T01:40:09.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.716+0000 7fbecc8b9700 1 -- 172.21.15.69:0/3637490490 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbeb4004810 msgr2=0x7fbec8155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:09.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.716+0000 7fbecc8b9700 1 --2- 172.21.15.69:0/3637490490 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbeb4004810 0x7fbec8155be0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fbeb8002c00 tx=0x7fbeb8007d30 comp rx=0 tx=0).stop 2023-10-06T01:40:09.717 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.716+0000 7fbecc8b9700 1 -- 172.21.15.69:0/3637490490 shutdown_connections 2023-10-06T01:40:09.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.716+0000 7fbecc8b9700 1 --2- 172.21.15.69:0/3637490490 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fbea80670e0 0x7fbea8069590 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.716+0000 7fbecc8b9700 1 --2- 172.21.15.69:0/3637490490 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fbec80b4520 0x7fbec80b49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.716+0000 7fbecc8b9700 1 --2- 172.21.15.69:0/3637490490 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbeb4004810 0x7fbec8155be0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.716+0000 7fbecc8b9700 1 --2- 172.21.15.69:0/3637490490 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fbec8158f90 0x7fbec8158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.716+0000 7fbecc8b9700 1 -- 172.21.15.69:0/3637490490 >> 172.21.15.69:0/3637490490 conn(0x7fbec8070e30 msgr2=0x7fbec80b2700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:09.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.716+0000 7fbecc8b9700 1 -- 172.21.15.69:0/3637490490 shutdown_connections 2023-10-06T01:40:09.718 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.716+0000 7fbecc8b9700 1 -- 172.21.15.69:0/3637490490 wait complete. 2023-10-06T01:40:09.718 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-10-06T01:40:09.729 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":77,"stamp":"2023-10-06T01:40:08.275911+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":71,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2382920,"kb_used_data":4616,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591800,"statfs":{"total":773094113280,"available":770654003200,"internally_reserved":0,"allocated":4726784,"data_stored":2618808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-132226,"num_objects":-25,"num_object_clones":0,"num_object_copies":-50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-86,"num_write_kb":-160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.457652"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:03.625392+0000","last_change":"2023-10-06T01:38:44.533111+0000","last_active":"2023-10-06T01:40:03.625392+0000","last_peered":"2023-10-06T01:40:03.625392+0000","last_clean":"2023-10-06T01:40:03.625392+0000","last_became_active":"2023-10-06T01:38:44.532838+0000","last_became_peered":"2023-10-06T01:38:44.532838+0000","last_unstale":"2023-10-06T01:40:03.625392+0000","last_undegraded":"2023-10-06T01:40:03.625392+0000","last_fullsized":"2023-10-06T01:40:03.625392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:02.833069+0000","last_change":"2023-10-06T01:38:44.533897+0000","last_active":"2023-10-06T01:40:02.833069+0000","last_peered":"2023-10-06T01:40:02.833069+0000","last_clean":"2023-10-06T01:40:02.833069+0000","last_became_active":"2023-10-06T01:38:44.533611+0000","last_became_peered":"2023-10-06T01:38:44.533611+0000","last_unstale":"2023-10-06T01:40:02.833069+0000","last_undegraded":"2023-10-06T01:40:02.833069+0000","last_fullsized":"2023-10-06T01:40:02.833069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:24.411408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:02.831702+0000","last_change":"2023-10-06T01:38:45.307814+0000","last_active":"2023-10-06T01:40:02.831702+0000","last_peered":"2023-10-06T01:40:02.831702+0000","last_clean":"2023-10-06T01:40:02.831702+0000","last_became_active":"2023-10-06T01:38:45.307536+0000","last_became_peered":"2023-10-06T01:38:45.307536+0000","last_unstale":"2023-10-06T01:40:02.831702+0000","last_undegraded":"2023-10-06T01:40:02.831702+0000","last_fullsized":"2023-10-06T01:40:02.831702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:09.503713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:02.834665+0000","last_change":"2023-10-06T01:38:44.534507+0000","last_active":"2023-10-06T01:40:02.834665+0000","last_peered":"2023-10-06T01:40:02.834665+0000","last_clean":"2023-10-06T01:40:02.834665+0000","last_became_active":"2023-10-06T01:38:44.534191+0000","last_became_peered":"2023-10-06T01:38:44.534191+0000","last_unstale":"2023-10-06T01:40:02.834665+0000","last_undegraded":"2023-10-06T01:40:02.834665+0000","last_fullsized":"2023-10-06T01:40:02.834665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:02.834037+0000","last_change":"2023-10-06T01:38:40.115117+0000","last_active":"2023-10-06T01:40:02.834037+0000","last_peered":"2023-10-06T01:40:02.834037+0000","last_clean":"2023-10-06T01:40:02.834037+0000","last_became_active":"2023-10-06T01:38:40.114142+0000","last_became_peered":"2023-10-06T01:38:40.114142+0000","last_unstale":"2023-10-06T01:40:02.834037+0000","last_undegraded":"2023-10-06T01:40:02.834037+0000","last_fullsized":"2023-10-06T01:40:02.834037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_clean_scrub_stamp":"2023-10-06T01:38:38.338797+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:52.870262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:02.834146+0000","last_change":"2023-10-06T01:38:44.531831+0000","last_active":"2023-10-06T01:40:02.834146+0000","last_peered":"2023-10-06T01:40:02.834146+0000","last_clean":"2023-10-06T01:40:02.834146+0000","last_became_active":"2023-10-06T01:38:44.531496+0000","last_became_peered":"2023-10-06T01:38:44.531496+0000","last_unstale":"2023-10-06T01:40:02.834146+0000","last_undegraded":"2023-10-06T01:40:02.834146+0000","last_fullsized":"2023-10-06T01:40:02.834146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:28.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:02.833169+0000","last_change":"2023-10-06T01:38:44.531335+0000","last_active":"2023-10-06T01:40:02.833169+0000","last_peered":"2023-10-06T01:40:02.833169+0000","last_clean":"2023-10-06T01:40:02.833169+0000","last_became_active":"2023-10-06T01:38:44.530966+0000","last_became_peered":"2023-10-06T01:38:44.530966+0000","last_unstale":"2023-10-06T01:40:02.833169+0000","last_undegraded":"2023-10-06T01:40:02.833169+0000","last_fullsized":"2023-10-06T01:40:02.833169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:33.926180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:03.626012+0000","last_change":"2023-10-06T01:38:44.533582+0000","last_active":"2023-10-06T01:40:03.626012+0000","last_peered":"2023-10-06T01:40:03.626012+0000","last_clean":"2023-10-06T01:40:03.626012+0000","last_became_active":"2023-10-06T01:38:44.533324+0000","last_became_peered":"2023-10-06T01:38:44.533324+0000","last_unstale":"2023-10-06T01:40:03.626012+0000","last_undegraded":"2023-10-06T01:40:03.626012+0000","last_fullsized":"2023-10-06T01:40:03.626012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:03.625047+0000","last_change":"2023-10-06T01:38:44.533765+0000","last_active":"2023-10-06T01:40:03.625047+0000","last_peered":"2023-10-06T01:40:03.625047+0000","last_clean":"2023-10-06T01:40:03.625047+0000","last_became_active":"2023-10-06T01:38:44.533406+0000","last_became_peered":"2023-10-06T01:38:44.533406+0000","last_unstale":"2023-10-06T01:40:03.625047+0000","last_undegraded":"2023-10-06T01:40:03.625047+0000","last_fullsized":"2023-10-06T01:40:03.625047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":1036288,"data_stored":770127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.621},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.50700000000000001}]},{"osd":1,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.57199999999999995}]},{"osd":2,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.54600000000000004}]},{"osd":3,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.60599999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.35799999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.44},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.38}]},{"osd":6,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.41299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.441},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.57599999999999996}]},{"osd":1,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.497}]},{"osd":2,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.46600000000000003}]},{"osd":3,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.52700000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.35099999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.372},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.51000000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.56499999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.36799999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":0.47299999999999998}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.40000000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.82999999999999996}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.89400000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.77000000000000002}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.74099999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":1036288,"data_stored":770127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"last":0.41099999999999998}]},{"osd":2,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.307}]},{"osd":3,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.373},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.38500000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.64600000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.58899999999999997}]},{"osd":7,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.67400000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.47299999999999998}]},{"osd":1,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.55900000000000005}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.58499999999999996}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.68200000000000005}]},{"osd":5,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.67000000000000004}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.64000000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.751}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.214},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.30199999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.28399999999999997}]},{"osd":2,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.32300000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.40799999999999997}]},{"osd":5,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.37},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.46200000000000002}]},{"osd":6,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.39100000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.55300000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.4289999999999998,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.41399999999999998}]},{"osd":1,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":4.2270000000000003,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.2789999999999999,"5min":4.2789999999999999,"15min":4.2789999999999999},"last":0.377}]},{"osd":2,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":12.359,"5min":12.359,"15min":12.359},"last":0.45700000000000002},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":12.326000000000001,"5min":12.326000000000001,"15min":12.326000000000001},"last":0.47099999999999997}]},{"osd":3,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":3.448,"5min":3.448,"15min":3.448},"last":0.44500000000000001},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":12.282,"5min":12.282,"15min":12.282},"last":0.48899999999999999}]},{"osd":5,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.35199999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.504}]},{"osd":7,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.56699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574869,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.44},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.69899999999999995}]},{"osd":1,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.622}]},{"osd":2,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.58699999999999997}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.52200000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.78200000000000003}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.71499999999999997}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.68000000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:40:09.731 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-06T01:40:09.844 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.843+0000 7faee41cf700 1 Processor -- start 2023-10-06T01:40:09.845 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.843+0000 7faee41cf700 1 -- start start 2023-10-06T01:40:09.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.844+0000 7faee41cf700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faedc0cb5a0 0x7faedc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:09.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.844+0000 7faee41cf700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7faedc0cd9e0 0x7faedc159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:09.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.844+0000 7faee41cf700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7faedc0cde50 0x7faedc15a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:09.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.844+0000 7faee41cf700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faedc0d13f0 con 0x7faedc0cd9e0 2023-10-06T01:40:09.847 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.844+0000 7faee41cf700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faedc15a940 con 0x7faedc0cde50 2023-10-06T01:40:09.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.844+0000 7faee41cf700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faedc15ae40 con 0x7faedc0cb5a0 2023-10-06T01:40:09.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.844+0000 7faee176a700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7faedc0cd9e0 0x7faedc159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:09.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.844+0000 7faee176a700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7faedc0cd9e0 0x7faedc159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40076/0 (socket says 172.21.15.69:40076) 2023-10-06T01:40:09.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.844+0000 7faee176a700 1 -- 172.21.15.69:0/105296815 learned_addr learned my addr 172.21.15.69:0/105296815 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:09.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.844+0000 7faee1f6b700 1 --2- 172.21.15.69:0/105296815 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faedc0cb5a0 0x7faedc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:09.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.844+0000 7faee276c700 1 --2- 172.21.15.69:0/105296815 >> v2:172.21.15.88:3300/0 conn(0x7faedc0cde50 0x7faedc15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:09.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.845+0000 7faee176a700 1 -- 172.21.15.69:0/105296815 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faedc0cb5a0 msgr2=0x7faedc0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:09.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.845+0000 7faee176a700 1 --2- 172.21.15.69:0/105296815 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faedc0cb5a0 0x7faedc0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.845+0000 7faee176a700 1 -- 172.21.15.69:0/105296815 >> v2:172.21.15.88:3300/0 conn(0x7faedc0cde50 msgr2=0x7faedc15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:09.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.845+0000 7faee176a700 1 --2- 172.21.15.69:0/105296815 >> v2:172.21.15.88:3300/0 conn(0x7faedc0cde50 0x7faedc15a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.848 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.845+0000 7faee176a700 1 -- 172.21.15.69:0/105296815 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faedc15ab60 con 0x7faedc0cd9e0 2023-10-06T01:40:09.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.845+0000 7faee276c700 1 --2- 172.21.15.69:0/105296815 >> v2:172.21.15.88:3300/0 conn(0x7faedc0cde50 0x7faedc15a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:09.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.845+0000 7faee176a700 1 --2- 172.21.15.69:0/105296815 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faedc0cd9e0 0x7faedc159ec0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7faedc0cbeb0 tx=0x7faecc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81567a4da397531d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:09.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.845+0000 7faee0f69700 1 -- 172.21.15.69:0/105296815 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc009ea0 con 0x7faedc0cd9e0 2023-10-06T01:40:09.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.845+0000 7faee0f69700 1 -- 172.21.15.69:0/105296815 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faecc00b820 con 0x7faedc0cd9e0 2023-10-06T01:40:09.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.845+0000 7faee0f69700 1 -- 172.21.15.69:0/105296815 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faecc00bbc0 con 0x7faedc0cd9e0 2023-10-06T01:40:09.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.845+0000 7faee41cf700 1 -- 172.21.15.69:0/105296815 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faedc0cd9e0 msgr2=0x7faedc159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:09.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.845+0000 7faee41cf700 1 --2- 172.21.15.69:0/105296815 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faedc0cd9e0 0x7faedc159ec0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7faedc0cbeb0 tx=0x7faecc009250 comp rx=0 tx=0).stop 2023-10-06T01:40:09.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.845+0000 7faee41cf700 1 -- 172.21.15.69:0/105296815 shutdown_connections 2023-10-06T01:40:09.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.845+0000 7faee41cf700 1 --2- 172.21.15.69:0/105296815 >> v2:172.21.15.88:3300/0 conn(0x7faedc0cde50 0x7faedc15a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.845+0000 7faee41cf700 1 --2- 172.21.15.69:0/105296815 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faedc0cb5a0 0x7faedc0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.845+0000 7faee41cf700 1 --2- 172.21.15.69:0/105296815 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faedc0cd9e0 0x7faedc159ec0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.845+0000 7faee41cf700 1 -- 172.21.15.69:0/105296815 >> 172.21.15.69:0/105296815 conn(0x7faedc070e30 msgr2=0x7faedc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:09.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.845+0000 7faee41cf700 1 -- 172.21.15.69:0/105296815 shutdown_connections 2023-10-06T01:40:09.850 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.845+0000 7faee41cf700 1 -- 172.21.15.69:0/105296815 wait complete. 2023-10-06T01:40:09.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.846+0000 7faee41cf700 1 Processor -- start 2023-10-06T01:40:09.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.847+0000 7faee41cf700 1 -- start start 2023-10-06T01:40:09.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.847+0000 7faee41cf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faedc0cb5a0 0x7faedc159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:09.852 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.847+0000 7faee41cf700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faedc0cd9e0 0x7faedc14c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:09.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.847+0000 7faee41cf700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faedc0b4630 0x7faedc0b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:09.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.847+0000 7faee41cf700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc0b4ff0 con 0x7faedc0cb5a0 2023-10-06T01:40:09.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.847+0000 7faee41cf700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc15bf60 con 0x7faedc0cd9e0 2023-10-06T01:40:09.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.847+0000 7faee41cf700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faedc159f90 con 0x7faedc0b4630 2023-10-06T01:40:09.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.847+0000 7faee1f6b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faedc0cb5a0 0x7faedc159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:09.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.847+0000 7faee1f6b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faedc0cb5a0 0x7faedc159a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40090/0 (socket says 172.21.15.69:40090) 2023-10-06T01:40:09.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.847+0000 7faee1f6b700 1 -- 172.21.15.69:0/575810349 learned_addr learned my addr 172.21.15.69:0/575810349 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:09.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.848+0000 7faee176a700 1 --2- 172.21.15.69:0/575810349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faedc0cd9e0 0x7faedc14c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:09.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.848+0000 7faee276c700 1 --2- 172.21.15.69:0/575810349 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faedc0b4630 0x7faedc0b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:09.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.848+0000 7faee1f6b700 1 -- 172.21.15.69:0/575810349 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faedc0b4630 msgr2=0x7faedc0b4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:09.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.848+0000 7faee1f6b700 1 --2- 172.21.15.69:0/575810349 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faedc0b4630 0x7faedc0b4ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.848+0000 7faee1f6b700 1 -- 172.21.15.69:0/575810349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faedc0cd9e0 msgr2=0x7faedc14c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:09.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.848+0000 7faee1f6b700 1 --2- 172.21.15.69:0/575810349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faedc0cd9e0 0x7faedc14c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:09.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.848+0000 7faee1f6b700 1 -- 172.21.15.69:0/575810349 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faecc0094f0 con 0x7faedc0cb5a0 2023-10-06T01:40:09.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.848+0000 7faee1f6b700 1 --2- 172.21.15.69:0/575810349 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faedc0cb5a0 0x7faedc159a50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7faed800ec80 tx=0x7faed80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:09.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.848+0000 7faed1ffb700 1 -- 172.21.15.69:0/575810349 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed800c9d0 con 0x7faedc0cb5a0 2023-10-06T01:40:09.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.848+0000 7faed1ffb700 1 -- 172.21.15.69:0/575810349 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed800cb30 con 0x7faedc0cb5a0 2023-10-06T01:40:09.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.848+0000 7faed1ffb700 1 -- 172.21.15.69:0/575810349 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed8013470 con 0x7faedc0cb5a0 2023-10-06T01:40:09.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.848+0000 7faee41cf700 1 -- 172.21.15.69:0/575810349 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faedc15b070 con 0x7faedc0cb5a0 2023-10-06T01:40:09.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.848+0000 7faee41cf700 1 -- 172.21.15.69:0/575810349 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faedc15b630 con 0x7faedc0cb5a0 2023-10-06T01:40:09.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.849+0000 7faee41cf700 1 -- 172.21.15.69:0/575810349 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faedc04c3c0 con 0x7faedc0cb5a0 2023-10-06T01:40:09.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.849+0000 7faed1ffb700 1 -- 172.21.15.69:0/575810349 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7faed8013820 con 0x7faedc0cb5a0 2023-10-06T01:40:09.854 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.850+0000 7faed1ffb700 1 --2- 172.21.15.69:0/575810349 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7faec00670e0 0x7faec0069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:09.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.850+0000 7faed1ffb700 1 -- 172.21.15.69:0/575810349 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7faed8084a30 con 0x7faedc0cb5a0 2023-10-06T01:40:09.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.850+0000 7faee176a700 1 --2- 172.21.15.69:0/575810349 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7faec00670e0 0x7faec0069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:09.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.850+0000 7faee176a700 1 --2- 172.21.15.69:0/575810349 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7faec00670e0 0x7faec0069590 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faedc0cbeb0 tx=0x7faecc017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:09.855 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:09.854+0000 7faed1ffb700 1 -- 172.21.15.69:0/575810349 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faed8051bc0 con 0x7faedc0cb5a0 2023-10-06T01:40:10.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:10.039+0000 7faee41cf700 1 -- 172.21.15.69:0/575810349 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faedc0ccf00 con 0x7faedc0cb5a0 2023-10-06T01:40:10.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:10.040+0000 7faed1ffb700 1 -- 172.21.15.69:0/575810349 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+13731 (secure 0 0 0) 0x7faed80551e0 con 0x7faedc0cb5a0 2023-10-06T01:40:10.041 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:40:10.041 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":38,"fsid":"c67d45f1-e8f7-4e89-8335-6ccfeab9b2d6","created":"2023-10-06T01:38:24.733553+0000","modified":"2023-10-06T01:40:03.829639+0000","last_up_change":"2023-10-06T01:38:36.283664+0000","last_in_change":"2023-10-06T01:38:27.153763+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-06T01:38:38.288642+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-10-06T01:38:43.046056+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9bf77b60-3401-4ba3-a7ec-830047c16cd4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":90682},{"type":"v1","addr":"172.21.15.69:6817","nonce":90682}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":90682},{"type":"v1","addr":"172.21.15.69:6819","nonce":90682}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":90682},{"type":"v1","addr":"172.21.15.69:6823","nonce":90682}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":90682},{"type":"v1","addr":"172.21.15.69:6821","nonce":90682}]},"public_addr":"172.21.15.69:6817/90682","cluster_addr":"172.21.15.69:6819/90682","heartbeat_back_addr":"172.21.15.69:6823/90682","heartbeat_front_addr":"172.21.15.69:6821/90682","state":["exists","up"]},{"osd":1,"uuid":"c6ccaba1-6768-4136-8097-abdb827a4bb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":90673},{"type":"v1","addr":"172.21.15.69:6801","nonce":90673}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":90673},{"type":"v1","addr":"172.21.15.69:6803","nonce":90673}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":90673},{"type":"v1","addr":"172.21.15.69:6807","nonce":90673}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":90673},{"type":"v1","addr":"172.21.15.69:6805","nonce":90673}]},"public_addr":"172.21.15.69:6801/90673","cluster_addr":"172.21.15.69:6803/90673","heartbeat_back_addr":"172.21.15.69:6807/90673","heartbeat_front_addr":"172.21.15.69:6805/90673","state":["exists","up"]},{"osd":2,"uuid":"c05201ad-d3f4-464c-b785-cec1e887e930","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":90674},{"type":"v1","addr":"172.21.15.69:6809","nonce":90674}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":90674},{"type":"v1","addr":"172.21.15.69:6811","nonce":90674}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":90674},{"type":"v1","addr":"172.21.15.69:6815","nonce":90674}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":90674},{"type":"v1","addr":"172.21.15.69:6813","nonce":90674}]},"public_addr":"172.21.15.69:6809/90674","cluster_addr":"172.21.15.69:6811/90674","heartbeat_back_addr":"172.21.15.69:6815/90674","heartbeat_front_addr":"172.21.15.69:6813/90674","state":["exists","up"]},{"osd":3,"uuid":"3f4b5214-7d97-479b-8056-ee79660aa29f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":90698},{"type":"v1","addr":"172.21.15.69:6825","nonce":90698}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":90698},{"type":"v1","addr":"172.21.15.69:6827","nonce":90698}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":90698},{"type":"v1","addr":"172.21.15.69:6831","nonce":90698}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":90698},{"type":"v1","addr":"172.21.15.69:6829","nonce":90698}]},"public_addr":"172.21.15.69:6825/90698","cluster_addr":"172.21.15.69:6827/90698","heartbeat_back_addr":"172.21.15.69:6831/90698","heartbeat_front_addr":"172.21.15.69:6829/90698","state":["exists","up"]},{"osd":4,"uuid":"1fbfbf3d-cba6-4dc4-837e-791dd43836c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":90870},{"type":"v1","addr":"172.21.15.88:6809","nonce":90870}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":90870},{"type":"v1","addr":"172.21.15.88:6811","nonce":90870}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":90870},{"type":"v1","addr":"172.21.15.88:6815","nonce":90870}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":90870},{"type":"v1","addr":"172.21.15.88:6813","nonce":90870}]},"public_addr":"172.21.15.88:6809/90870","cluster_addr":"172.21.15.88:6811/90870","heartbeat_back_addr":"172.21.15.88:6815/90870","heartbeat_front_addr":"172.21.15.88:6813/90870","state":["exists","up"]},{"osd":5,"uuid":"36532a3d-5055-4dbc-8cb0-c8de8f687d58","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":90871},{"type":"v1","addr":"172.21.15.88:6801","nonce":90871}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":90871},{"type":"v1","addr":"172.21.15.88:6803","nonce":90871}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":90871},{"type":"v1","addr":"172.21.15.88:6807","nonce":90871}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":90871},{"type":"v1","addr":"172.21.15.88:6805","nonce":90871}]},"public_addr":"172.21.15.88:6801/90871","cluster_addr":"172.21.15.88:6803/90871","heartbeat_back_addr":"172.21.15.88:6807/90871","heartbeat_front_addr":"172.21.15.88:6805/90871","state":["exists","up"]},{"osd":6,"uuid":"67635a24-61ff-457f-aa95-006b03b707ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6817","nonce":90900},{"type":"v1","addr":"172.21.15.88:6819","nonce":90900}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6821","nonce":90900},{"type":"v1","addr":"172.21.15.88:6823","nonce":90900}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6829","nonce":90900},{"type":"v1","addr":"172.21.15.88:6831","nonce":90900}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6825","nonce":90900},{"type":"v1","addr":"172.21.15.88:6827","nonce":90900}]},"public_addr":"172.21.15.88:6819/90900","cluster_addr":"172.21.15.88:6823/90900","heartbeat_back_addr":"172.21.15.88:6831/90900","heartbeat_front_addr":"172.21.15.88:6827/90900","state":["exists","up"]},{"osd":7,"uuid":"125b9ba4-f842-4f56-8e97-2c9e89367bca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":90901},{"type":"v1","addr":"172.21.15.88:6818","nonce":90901}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":90901},{"type":"v1","addr":"172.21.15.88:6822","nonce":90901}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":90901},{"type":"v1","addr":"172.21.15.88:6830","nonce":90901}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":90901},{"type":"v1","addr":"172.21.15.88:6826","nonce":90901}]},"public_addr":"172.21.15.88:6818/90901","cluster_addr":"172.21.15.88:6822/90901","heartbeat_back_addr":"172.21.15.88:6830/90901","heartbeat_front_addr":"172.21.15.88:6826/90901","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.309749+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.268896+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.311279+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.361570+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.358182+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.318826+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.436853+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-06T01:38:32.378159+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:6834/3221701951":"2023-10-07T01:40:00.815980+0000","172.21.15.88:6832/3221701951":"2023-10-07T01:40:00.815980+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-06T01:40:10.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:10.042+0000 7faee41cf700 1 -- 172.21.15.69:0/575810349 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7faec00670e0 msgr2=0x7faec0069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:10.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:10.042+0000 7faee41cf700 1 --2- 172.21.15.69:0/575810349 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7faec00670e0 0x7faec0069590 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faedc0cbeb0 tx=0x7faecc017000 comp rx=0 tx=0).stop 2023-10-06T01:40:10.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:10.042+0000 7faee41cf700 1 -- 172.21.15.69:0/575810349 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faedc0cb5a0 msgr2=0x7faedc159a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:10.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:10.042+0000 7faee41cf700 1 --2- 172.21.15.69:0/575810349 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faedc0cb5a0 0x7faedc159a50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7faed800ec80 tx=0x7faed80091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:10.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:10.042+0000 7faee41cf700 1 -- 172.21.15.69:0/575810349 shutdown_connections 2023-10-06T01:40:10.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:10.042+0000 7faee41cf700 1 --2- 172.21.15.69:0/575810349 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7faec00670e0 0x7faec0069590 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:10.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:10.042+0000 7faee41cf700 1 --2- 172.21.15.69:0/575810349 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7faedc0b4630 0x7faedc0b4ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:10.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:10.042+0000 7faee41cf700 1 --2- 172.21.15.69:0/575810349 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faedc0cb5a0 0x7faedc159a50 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:10.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:10.042+0000 7faee41cf700 1 --2- 172.21.15.69:0/575810349 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7faedc0cd9e0 0x7faedc14c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:10.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:10.042+0000 7faee41cf700 1 -- 172.21.15.69:0/575810349 >> 172.21.15.69:0/575810349 conn(0x7faedc070e30 msgr2=0x7faedc0ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:10.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:10.042+0000 7faee41cf700 1 -- 172.21.15.69:0/575810349 shutdown_connections 2023-10-06T01:40:10.044 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:10.042+0000 7faee41cf700 1 -- 172.21.15.69:0/575810349 wait complete. 2023-10-06T01:40:11.056 INFO:tasks.ceph:Scrubbing osd.0 2023-10-06T01:40:11.056 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-06T01:40:11.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.175+0000 7f513a2fd700 1 Processor -- start 2023-10-06T01:40:11.177 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.175+0000 7f513a2fd700 1 -- start start 2023-10-06T01:40:11.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.176+0000 7f513a2fd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f51340cd200 0x7f51340cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.176+0000 7f513a2fd700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f51340caeb0 0x7f51340cb320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.176+0000 7f513a2fd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f51341502c0 0x7f5134150720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.176+0000 7f513a2fd700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51340ce360 con 0x7f51340caeb0 2023-10-06T01:40:11.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.176+0000 7f513a2fd700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51340cb970 con 0x7f51340cd200 2023-10-06T01:40:11.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.176+0000 7f513a2fd700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51340cbc50 con 0x7f51341502c0 2023-10-06T01:40:11.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.176+0000 7f51337fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f51340caeb0 0x7f51340cb320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.176+0000 7f51337fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f51340caeb0 0x7f51340cb320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40106/0 (socket says 172.21.15.69:40106) 2023-10-06T01:40:11.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.176+0000 7f51337fe700 1 -- 172.21.15.69:0/2833632160 learned_addr learned my addr 172.21.15.69:0/2833632160 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:11.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.176+0000 7f5133fff700 1 --2- 172.21.15.69:0/2833632160 >> v2:172.21.15.88:3300/0 conn(0x7f51340cd200 0x7f51340cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.176+0000 7f513889a700 1 --2- 172.21.15.69:0/2833632160 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f51341502c0 0x7f5134150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.176+0000 7f51337fe700 1 -- 172.21.15.69:0/2833632160 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f51341502c0 msgr2=0x7f5134150720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:11.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.176+0000 7f51337fe700 1 --2- 172.21.15.69:0/2833632160 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f51341502c0 0x7f5134150720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.180 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.176+0000 7f51337fe700 1 -- 172.21.15.69:0/2833632160 >> v2:172.21.15.88:3300/0 conn(0x7f51340cd200 msgr2=0x7f51340cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:11.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.176+0000 7f51337fe700 1 --2- 172.21.15.69:0/2833632160 >> v2:172.21.15.88:3300/0 conn(0x7f51340cd200 0x7f51340cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.177+0000 7f51337fe700 1 -- 172.21.15.69:0/2833632160 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51340cbf30 con 0x7f51340caeb0 2023-10-06T01:40:11.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.177+0000 7f51337fe700 1 --2- 172.21.15.69:0/2833632160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51340caeb0 0x7f51340cb320 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f5134088800 tx=0x7f5128009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=825bcead294e9644 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:11.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.177+0000 7f5132ffd700 1 -- 172.21.15.69:0/2833632160 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512800b640 con 0x7f51340caeb0 2023-10-06T01:40:11.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.177+0000 7f5132ffd700 1 -- 172.21.15.69:0/2833632160 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512800b7a0 con 0x7f51340caeb0 2023-10-06T01:40:11.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.177+0000 7f5132ffd700 1 -- 172.21.15.69:0/2833632160 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512800bb60 con 0x7f51340caeb0 2023-10-06T01:40:11.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.177+0000 7f513a2fd700 1 -- 172.21.15.69:0/2833632160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51340caeb0 msgr2=0x7f51340cb320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:11.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.177+0000 7f513a2fd700 1 --2- 172.21.15.69:0/2833632160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51340caeb0 0x7f51340cb320 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f5134088800 tx=0x7f5128009250 comp rx=0 tx=0).stop 2023-10-06T01:40:11.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.177+0000 7f513a2fd700 1 -- 172.21.15.69:0/2833632160 shutdown_connections 2023-10-06T01:40:11.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.177+0000 7f513a2fd700 1 --2- 172.21.15.69:0/2833632160 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f51341502c0 0x7f5134150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.182 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.177+0000 7f513a2fd700 1 --2- 172.21.15.69:0/2833632160 >> v2:172.21.15.88:3300/0 conn(0x7f51340cd200 0x7f51340cd5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.177+0000 7f513a2fd700 1 --2- 172.21.15.69:0/2833632160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51340caeb0 0x7f51340cb320 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.177+0000 7f513a2fd700 1 -- 172.21.15.69:0/2833632160 >> 172.21.15.69:0/2833632160 conn(0x7f51340999c0 msgr2=0x7f5134070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:11.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.177+0000 7f513a2fd700 1 -- 172.21.15.69:0/2833632160 shutdown_connections 2023-10-06T01:40:11.183 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.177+0000 7f513a2fd700 1 -- 172.21.15.69:0/2833632160 wait complete. 2023-10-06T01:40:11.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.178+0000 7f513a2fd700 1 Processor -- start 2023-10-06T01:40:11.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.179+0000 7f513a2fd700 1 -- start start 2023-10-06T01:40:11.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.179+0000 7f513a2fd700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f51340caeb0 0x7f513416a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.179+0000 7f513a2fd700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51340cd200 0x7f51341637a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.179+0000 7f513a2fd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51341502c0 0x7f5134152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.186 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.179+0000 7f513a2fd700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f513416a820 con 0x7f51341502c0 2023-10-06T01:40:11.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.179+0000 7f513a2fd700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5134152910 con 0x7f51340cd200 2023-10-06T01:40:11.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.179+0000 7f513a2fd700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5134163ce0 con 0x7f51340caeb0 2023-10-06T01:40:11.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.179+0000 7f513889a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51341502c0 0x7f5134152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.179+0000 7f513889a700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51341502c0 0x7f5134152da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40108/0 (socket says 172.21.15.69:40108) 2023-10-06T01:40:11.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.179+0000 7f513889a700 1 -- 172.21.15.69:0/4138951331 learned_addr learned my addr 172.21.15.69:0/4138951331 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:11.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.180+0000 7f513889a700 1 -- 172.21.15.69:0/4138951331 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f51340caeb0 msgr2=0x7f513416a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:11.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.180+0000 7f513889a700 1 --2- 172.21.15.69:0/4138951331 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f51340caeb0 0x7f513416a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.180+0000 7f513889a700 1 -- 172.21.15.69:0/4138951331 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51340cd200 msgr2=0x7f51341637a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:11.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.180+0000 7f513889a700 1 --2- 172.21.15.69:0/4138951331 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f51340cd200 0x7f51341637a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.180+0000 7f513889a700 1 -- 172.21.15.69:0/4138951331 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51280094f0 con 0x7f51341502c0 2023-10-06T01:40:11.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.180+0000 7f513889a700 1 --2- 172.21.15.69:0/4138951331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51341502c0 0x7f5134152da0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f512c009df0 tx=0x7f512c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:11.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.180+0000 7f511bfff700 1 -- 172.21.15.69:0/4138951331 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c00cb50 con 0x7f51341502c0 2023-10-06T01:40:11.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.180+0000 7f511bfff700 1 -- 172.21.15.69:0/4138951331 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f512c00f040 con 0x7f51341502c0 2023-10-06T01:40:11.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.180+0000 7f513a2fd700 1 -- 172.21.15.69:0/4138951331 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5134151d00 con 0x7f51341502c0 2023-10-06T01:40:11.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.180+0000 7f511bfff700 1 -- 172.21.15.69:0/4138951331 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f512c014480 con 0x7f51341502c0 2023-10-06T01:40:11.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.180+0000 7f513a2fd700 1 -- 172.21.15.69:0/4138951331 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51341522c0 con 0x7f51341502c0 2023-10-06T01:40:11.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.181+0000 7f513a2fd700 1 -- 172.21.15.69:0/4138951331 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f513404c3c0 con 0x7f51341502c0 2023-10-06T01:40:11.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.181+0000 7f511bfff700 1 -- 172.21.15.69:0/4138951331 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f512c014830 con 0x7f51341502c0 2023-10-06T01:40:11.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.182+0000 7f511bfff700 1 --2- 172.21.15.69:0/4138951331 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f51200670e0 0x7f5120069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.182+0000 7f511bfff700 1 -- 172.21.15.69:0/4138951331 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f512c0851f0 con 0x7f51341502c0 2023-10-06T01:40:11.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.182+0000 7f5133fff700 1 --2- 172.21.15.69:0/4138951331 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f51200670e0 0x7f5120069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.182+0000 7f511bfff700 1 --2- 172.21.15.69:0/4138951331 >> [v2:172.21.15.69:6816/90682,v1:172.21.15.69:6817/90682] conn(0x7f512006d550 0x7f512006f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.182+0000 7f511bfff700 1 -- 172.21.15.69:0/4138951331 --> [v2:172.21.15.69:6816/90682,v1:172.21.15.69:6817/90682] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5120070030 con 0x7f512006d550 2023-10-06T01:40:11.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.182+0000 7f511bfff700 1 -- 172.21.15.69:0/4138951331 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f512c087810 con 0x7f51341502c0 2023-10-06T01:40:11.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.182+0000 7f51337fe700 1 --2- 172.21.15.69:0/4138951331 >> [v2:172.21.15.69:6816/90682,v1:172.21.15.69:6817/90682] conn(0x7f512006d550 0x7f512006f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.182+0000 7f5133fff700 1 --2- 172.21.15.69:0/4138951331 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f51200670e0 0x7f5120069590 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f51340ca970 tx=0x7f5124009120 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:11.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.182+0000 7f51337fe700 1 --2- 172.21.15.69:0/4138951331 >> [v2:172.21.15.69:6816/90682,v1:172.21.15.69:6817/90682] conn(0x7f512006d550 0x7f512006f960 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:11.189 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.183+0000 7f511bfff700 1 -- 172.21.15.69:0/4138951331 <== osd.0 v2:172.21.15.69:6816/90682 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5120070030 con 0x7f512006d550 2023-10-06T01:40:11.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.196+0000 7f513a2fd700 1 -- 172.21.15.69:0/4138951331 --> [v2:172.21.15.69:6816/90682,v1:172.21.15.69:6817/90682] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f51340cc210 con 0x7f512006d550 2023-10-06T01:40:11.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.196+0000 7f511bfff700 1 -- 172.21.15.69:0/4138951331 <== osd.0 v2:172.21.15.69:6816/90682 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f51340cc210 con 0x7f512006d550 2023-10-06T01:40:11.198 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-10-06T01:40:11.198 INFO:teuthology.orchestra.run.smithi069.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T01:40:11.198 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-10-06T01:40:11.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.197+0000 7f513a2fd700 1 -- 172.21.15.69:0/4138951331 >> [v2:172.21.15.69:6816/90682,v1:172.21.15.69:6817/90682] conn(0x7f512006d550 msgr2=0x7f512006f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:11.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.197+0000 7f513a2fd700 1 --2- 172.21.15.69:0/4138951331 >> [v2:172.21.15.69:6816/90682,v1:172.21.15.69:6817/90682] conn(0x7f512006d550 0x7f512006f960 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.199 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.197+0000 7f513a2fd700 1 -- 172.21.15.69:0/4138951331 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f51200670e0 msgr2=0x7f5120069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:11.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.197+0000 7f513a2fd700 1 --2- 172.21.15.69:0/4138951331 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f51200670e0 0x7f5120069590 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f51340ca970 tx=0x7f5124009120 comp rx=0 tx=0).stop 2023-10-06T01:40:11.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.197+0000 7f513a2fd700 1 -- 172.21.15.69:0/4138951331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51341502c0 msgr2=0x7f5134152da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:11.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.197+0000 7f513a2fd700 1 --2- 172.21.15.69:0/4138951331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51341502c0 0x7f5134152da0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f512c009df0 tx=0x7f512c00b040 comp rx=0 tx=0).stop 2023-10-06T01:40:11.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.197+0000 7f513889a700 1 -- 172.21.15.69:0/4138951331 reap_dead start 2023-10-06T01:40:11.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.197+0000 7f513a2fd700 1 -- 172.21.15.69:0/4138951331 shutdown_connections 2023-10-06T01:40:11.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.197+0000 7f513a2fd700 1 -- 172.21.15.69:0/4138951331 >> 172.21.15.69:0/4138951331 conn(0x7f51340999c0 msgr2=0x7f513406e750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:11.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.197+0000 7f513a2fd700 1 -- 172.21.15.69:0/4138951331 shutdown_connections 2023-10-06T01:40:11.200 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.197+0000 7f513a2fd700 1 -- 172.21.15.69:0/4138951331 wait complete. 2023-10-06T01:40:11.210 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-06T01:40:11.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.323+0000 7f1b464ac700 1 Processor -- start 2023-10-06T01:40:11.325 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.323+0000 7f1b464ac700 1 -- start start 2023-10-06T01:40:11.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.324+0000 7f1b464ac700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1b400cb970 0x7f1b40159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.324+0000 7f1b464ac700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1b4015a400 0x7f1b40156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.324+0000 7f1b464ac700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b4015ae40 con 0x7f1b400cb5a0 2023-10-06T01:40:11.327 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.324+0000 7f1b464ac700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b400ce0f0 con 0x7f1b400cb970 2023-10-06T01:40:11.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.324+0000 7f1b464ac700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b400d13f0 con 0x7f1b4015a400 2023-10-06T01:40:11.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.324+0000 7f1b3f7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1b400cb970 0x7f1b40159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.324+0000 7f1b3f7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f1b400cb970 0x7f1b40159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40112/0 (socket says 172.21.15.69:40112) 2023-10-06T01:40:11.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.324+0000 7f1b3f7fe700 1 -- 172.21.15.69:0/3871911170 learned_addr learned my addr 172.21.15.69:0/3871911170 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:11.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.325+0000 7f1b44a49700 1 --2- 172.21.15.69:0/3871911170 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1b4015a400 0x7f1b40156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.325+0000 7f1b3f7fe700 1 -- 172.21.15.69:0/3871911170 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1b4015a400 msgr2=0x7f1b40156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:11.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.325+0000 7f1b3f7fe700 1 --2- 172.21.15.69:0/3871911170 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1b4015a400 0x7f1b40156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.325+0000 7f1b3f7fe700 1 -- 172.21.15.69:0/3871911170 >> v1:172.21.15.88:6789/0 conn(0x7f1b400cb5a0 legacy=0x7f1b400cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:11.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.325+0000 7f1b3f7fe700 1 -- 172.21.15.69:0/3871911170 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b4015ab60 con 0x7f1b400cb970 2023-10-06T01:40:11.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.325+0000 7f1b3f7fe700 1 --2- 172.21.15.69:0/3871911170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b400cb970 0x7f1b40159ec0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1b340099b0 tx=0x7f1b34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4641199d9f1aabe server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:11.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.325+0000 7f1b3effd700 1 -- 172.21.15.69:0/3871911170 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3400b820 con 0x7f1b400cb970 2023-10-06T01:40:11.328 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.325+0000 7f1b3effd700 1 -- 172.21.15.69:0/3871911170 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b3400b980 con 0x7f1b400cb970 2023-10-06T01:40:11.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.325+0000 7f1b3effd700 1 -- 172.21.15.69:0/3871911170 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b3400bd20 con 0x7f1b400cb970 2023-10-06T01:40:11.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.325+0000 7f1b464ac700 1 -- 172.21.15.69:0/3871911170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b400cb970 msgr2=0x7f1b40159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:11.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.325+0000 7f1b464ac700 1 --2- 172.21.15.69:0/3871911170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b400cb970 0x7f1b40159ec0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f1b340099b0 tx=0x7f1b34009250 comp rx=0 tx=0).stop 2023-10-06T01:40:11.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.326+0000 7f1b464ac700 1 -- 172.21.15.69:0/3871911170 shutdown_connections 2023-10-06T01:40:11.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.326+0000 7f1b464ac700 1 --2- 172.21.15.69:0/3871911170 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1b4015a400 0x7f1b40156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.326+0000 7f1b464ac700 1 --2- 172.21.15.69:0/3871911170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b400cb970 0x7f1b40159ec0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.326+0000 7f1b464ac700 1 -- 172.21.15.69:0/3871911170 >> 172.21.15.69:0/3871911170 conn(0x7f1b40070e30 msgr2=0x7f1b400d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:11.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.326+0000 7f1b464ac700 1 -- 172.21.15.69:0/3871911170 shutdown_connections 2023-10-06T01:40:11.329 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.326+0000 7f1b464ac700 1 -- 172.21.15.69:0/3871911170 wait complete. 2023-10-06T01:40:11.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.327+0000 7f1b464ac700 1 Processor -- start 2023-10-06T01:40:11.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.327+0000 7f1b464ac700 1 -- start start 2023-10-06T01:40:11.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.328+0000 7f1b464ac700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b400cb5a0 0x7f1b4016c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.332 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.328+0000 7f1b464ac700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1b400cb970 0x7f1b400c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.328+0000 7f1b464ac700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b4015a400 0x7f1b400ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.328+0000 7f1b464ac700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b40156d70 con 0x7f1b400cb5a0 2023-10-06T01:40:11.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.328+0000 7f1b464ac700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b400b40c0 con 0x7f1b4015a400 2023-10-06T01:40:11.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.328+0000 7f1b464ac700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b400b34b0 con 0x7f1b400cb970 2023-10-06T01:40:11.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.328+0000 7f1b3ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b400cb5a0 0x7f1b4016c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.328+0000 7f1b3ffff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b400cb5a0 0x7f1b4016c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40114/0 (socket says 172.21.15.69:40114) 2023-10-06T01:40:11.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.328+0000 7f1b3ffff700 1 -- 172.21.15.69:0/2353592228 learned_addr learned my addr 172.21.15.69:0/2353592228 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:11.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.328+0000 7f1b3f7fe700 1 --2- 172.21.15.69:0/2353592228 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1b400cb970 0x7f1b400c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.328+0000 7f1b44a49700 1 --2- 172.21.15.69:0/2353592228 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b4015a400 0x7f1b400ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.328+0000 7f1b3ffff700 1 -- 172.21.15.69:0/2353592228 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1b400cb970 msgr2=0x7f1b400c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:11.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.328+0000 7f1b3ffff700 1 --2- 172.21.15.69:0/2353592228 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1b400cb970 0x7f1b400c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.328+0000 7f1b3ffff700 1 -- 172.21.15.69:0/2353592228 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b4015a400 msgr2=0x7f1b400ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:11.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.328+0000 7f1b3ffff700 1 --2- 172.21.15.69:0/2353592228 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b4015a400 0x7f1b400ce9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.328+0000 7f1b3ffff700 1 -- 172.21.15.69:0/2353592228 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b340094f0 con 0x7f1b400cb5a0 2023-10-06T01:40:11.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.328+0000 7f1b3ffff700 1 --2- 172.21.15.69:0/2353592228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b400cb5a0 0x7f1b4016c4f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1b3000c5d0 tx=0x7f1b30007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:11.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.328+0000 7f1b27fff700 1 -- 172.21.15.69:0/2353592228 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30011590 con 0x7f1b400cb5a0 2023-10-06T01:40:11.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.328+0000 7f1b27fff700 1 -- 172.21.15.69:0/2353592228 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b30011710 con 0x7f1b400cb5a0 2023-10-06T01:40:11.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.328+0000 7f1b464ac700 1 -- 172.21.15.69:0/2353592228 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b400b3790 con 0x7f1b400cb5a0 2023-10-06T01:40:11.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.328+0000 7f1b27fff700 1 -- 172.21.15.69:0/2353592228 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b30011ad0 con 0x7f1b400cb5a0 2023-10-06T01:40:11.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.328+0000 7f1b464ac700 1 -- 172.21.15.69:0/2353592228 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b400b3d50 con 0x7f1b400cb5a0 2023-10-06T01:40:11.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.329+0000 7f1b464ac700 1 -- 172.21.15.69:0/2353592228 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b4004c3c0 con 0x7f1b400cb5a0 2023-10-06T01:40:11.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.330+0000 7f1b27fff700 1 -- 172.21.15.69:0/2353592228 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f1b3001c460 con 0x7f1b400cb5a0 2023-10-06T01:40:11.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.330+0000 7f1b27fff700 1 --2- 172.21.15.69:0/2353592228 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1b2c0670e0 0x7f1b2c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.330+0000 7f1b27fff700 1 -- 172.21.15.69:0/2353592228 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f1b30084360 con 0x7f1b400cb5a0 2023-10-06T01:40:11.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.330+0000 7f1b3f7fe700 1 --2- 172.21.15.69:0/2353592228 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1b2c0670e0 0x7f1b2c069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.330+0000 7f1b3f7fe700 1 --2- 172.21.15.69:0/2353592228 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1b2c0670e0 0x7f1b2c069590 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1b340099b0 tx=0x7f1b34016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:11.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.334+0000 7f1b27fff700 1 -- 172.21.15.69:0/2353592228 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b300514f0 con 0x7f1b400cb5a0 2023-10-06T01:40:11.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.517+0000 7f1b464ac700 1 -- 172.21.15.69:0/2353592228 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f1b400cda10 con 0x7f1b2c0670e0 2023-10-06T01:40:11.518 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.517+0000 7f1b27fff700 1 -- 172.21.15.69:0/2353592228 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1b400cda10 con 0x7f1b2c0670e0 2023-10-06T01:40:11.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.519+0000 7f1b464ac700 1 -- 172.21.15.69:0/2353592228 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1b2c0670e0 msgr2=0x7f1b2c069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:11.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.519+0000 7f1b464ac700 1 --2- 172.21.15.69:0/2353592228 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1b2c0670e0 0x7f1b2c069590 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1b340099b0 tx=0x7f1b34016000 comp rx=0 tx=0).stop 2023-10-06T01:40:11.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.519+0000 7f1b464ac700 1 -- 172.21.15.69:0/2353592228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b400cb5a0 msgr2=0x7f1b4016c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:11.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.519+0000 7f1b464ac700 1 --2- 172.21.15.69:0/2353592228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b400cb5a0 0x7f1b4016c4f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1b3000c5d0 tx=0x7f1b30007f60 comp rx=0 tx=0).stop 2023-10-06T01:40:11.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.519+0000 7f1b464ac700 1 -- 172.21.15.69:0/2353592228 shutdown_connections 2023-10-06T01:40:11.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.519+0000 7f1b464ac700 1 --2- 172.21.15.69:0/2353592228 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1b2c0670e0 0x7f1b2c069590 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.519+0000 7f1b464ac700 1 --2- 172.21.15.69:0/2353592228 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1b4015a400 0x7f1b400ce9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.519+0000 7f1b464ac700 1 --2- 172.21.15.69:0/2353592228 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1b400cb5a0 0x7f1b4016c4f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.519+0000 7f1b464ac700 1 --2- 172.21.15.69:0/2353592228 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1b400cb970 0x7f1b400c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.519+0000 7f1b464ac700 1 -- 172.21.15.69:0/2353592228 >> 172.21.15.69:0/2353592228 conn(0x7f1b40070e30 msgr2=0x7f1b400b0ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:11.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.519+0000 7f1b464ac700 1 -- 172.21.15.69:0/2353592228 shutdown_connections 2023-10-06T01:40:11.522 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.519+0000 7f1b464ac700 1 -- 172.21.15.69:0/2353592228 wait complete. 2023-10-06T01:40:11.523 INFO:teuthology.orchestra.run.smithi069.stderr:instructed osd(s) 0 to deep-scrub 2023-10-06T01:40:11.533 INFO:tasks.ceph:Scrubbing osd.1 2023-10-06T01:40:11.533 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-06T01:40:11.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.650+0000 7f14f66cf700 1 Processor -- start 2023-10-06T01:40:11.651 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.650+0000 7f14f66cf700 1 -- start start 2023-10-06T01:40:11.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.651+0000 7f14f66cf700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f14f0159530 0x7f14f00ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.651+0000 7f14f66cf700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f14f006dcf0 0x7f14f0159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.651+0000 7f14f66cf700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14f00ccfd0 con 0x7f14f0159e40 2023-10-06T01:40:11.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.651+0000 7f14f66cf700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14f015a410 con 0x7f14f006dcf0 2023-10-06T01:40:11.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.651+0000 7f14f66cf700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f015a6f0 con 0x7f14f0159530 2023-10-06T01:40:11.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.651+0000 7f14f4c6c700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f14f0159e40 0x7f14f00cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:60318/0 (socket says 172.21.15.69:60318) 2023-10-06T01:40:11.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.651+0000 7f14f4c6c700 1 -- 172.21.15.69:0/2338801439 learned_addr learned my addr 172.21.15.69:0/2338801439 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:40:11.655 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.651+0000 7f14ef7fe700 1 --2- 172.21.15.69:0/2338801439 >> v2:172.21.15.88:3300/0 conn(0x7f14f006dcf0 0x7f14f0159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.651+0000 7f14effff700 1 --2- 172.21.15.69:0/2338801439 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f14f0159530 0x7f14f00ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.651+0000 7f14eeffd700 1 -- 172.21.15.69:0/2338801439 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4136168030 0 0) 0x7f14f00ccfd0 con 0x7f14f0159e40 2023-10-06T01:40:11.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.651+0000 7f14eeffd700 1 -- 172.21.15.69:0/2338801439 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14d8003570 con 0x7f14f0159e40 2023-10-06T01:40:11.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.651+0000 7f14eeffd700 1 -- 172.21.15.69:0/2338801439 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1533231106 0 0) 0x7f14d8003570 con 0x7f14f0159e40 2023-10-06T01:40:11.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.651+0000 7f14eeffd700 1 -- 172.21.15.69:0/2338801439 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f14f0159530 msgr2=0x7f14f00ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:11.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.651+0000 7f14eeffd700 1 --2- 172.21.15.69:0/2338801439 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f14f0159530 0x7f14f00ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.651+0000 7f14eeffd700 1 -- 172.21.15.69:0/2338801439 >> v2:172.21.15.88:3300/0 conn(0x7f14f006dcf0 msgr2=0x7f14f0159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:11.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.651+0000 7f14eeffd700 1 --2- 172.21.15.69:0/2338801439 >> v2:172.21.15.88:3300/0 conn(0x7f14f006dcf0 0x7f14f0159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.651+0000 7f14eeffd700 1 -- 172.21.15.69:0/2338801439 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f015a9d0 con 0x7f14f0159e40 2023-10-06T01:40:11.656 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.651+0000 7f14eeffd700 1 -- 172.21.15.69:0/2338801439 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f14e80017f0 con 0x7f14f0159e40 2023-10-06T01:40:11.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.651+0000 7f14eeffd700 1 -- 172.21.15.69:0/2338801439 >> v1:172.21.15.69:6789/0 conn(0x7f14f0159e40 legacy=0x7f14f00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:11.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.651+0000 7f14eeffd700 1 --2- 172.21.15.69:0/2338801439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14d8003a60 0x7f14d8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.651+0000 7f14eeffd700 1 --2- 172.21.15.69:0/2338801439 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14d8004810 0x7f14d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.651+0000 7f14eeffd700 1 --2- 172.21.15.69:0/2338801439 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f14f0159530 0x7f14d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.651+0000 7f14eeffd700 1 -- 172.21.15.69:0/2338801439 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f015a410 con 0x7f14d8004810 2023-10-06T01:40:11.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.651+0000 7f14eeffd700 1 -- 172.21.15.69:0/2338801439 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f015a6f0 con 0x7f14d8003a60 2023-10-06T01:40:11.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.651+0000 7f14eeffd700 1 -- 172.21.15.69:0/2338801439 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14d800ba60 con 0x7f14f0159530 2023-10-06T01:40:11.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.651+0000 7f14ef7fe700 1 --2- 172.21.15.69:0/2338801439 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14d8004810 0x7f14d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.651+0000 7f14effff700 1 --2- 172.21.15.69:0/2338801439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14d8003a60 0x7f14d8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.657 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.652+0000 7f14f4c6c700 1 --2- 172.21.15.69:0/2338801439 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f14f0159530 0x7f14d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.652+0000 7f14ef7fe700 1 -- 172.21.15.69:0/2338801439 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f14f0159530 msgr2=0x7f14d80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:11.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.652+0000 7f14ef7fe700 1 --2- 172.21.15.69:0/2338801439 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f14f0159530 0x7f14d80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.652+0000 7f14ef7fe700 1 -- 172.21.15.69:0/2338801439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14d8003a60 msgr2=0x7f14d8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:11.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.652+0000 7f14ef7fe700 1 --2- 172.21.15.69:0/2338801439 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14d8003a60 0x7f14d8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.652+0000 7f14ef7fe700 1 -- 172.21.15.69:0/2338801439 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14d8003570 con 0x7f14d8004810 2023-10-06T01:40:11.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.652+0000 7f14ef7fe700 1 --2- 172.21.15.69:0/2338801439 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14d8004810 0x7f14d8004c80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f14e4009c30 tx=0x7f14e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee8f1180ab53977b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:11.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.652+0000 7f14eeffd700 1 -- 172.21.15.69:0/2338801439 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e400e710 con 0x7f14d8004810 2023-10-06T01:40:11.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.652+0000 7f14eeffd700 1 -- 172.21.15.69:0/2338801439 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e400e870 con 0x7f14d8004810 2023-10-06T01:40:11.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.652+0000 7f14eeffd700 1 -- 172.21.15.69:0/2338801439 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e400ec30 con 0x7f14d8004810 2023-10-06T01:40:11.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.652+0000 7f14f66cf700 1 -- 172.21.15.69:0/2338801439 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14d8004810 msgr2=0x7f14d8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:11.658 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.652+0000 7f14f66cf700 1 --2- 172.21.15.69:0/2338801439 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14d8004810 0x7f14d8004c80 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f14e4009c30 tx=0x7f14e40091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.652+0000 7f14f4c6c700 1 -- 172.21.15.69:0/2338801439 reap_dead start 2023-10-06T01:40:11.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.652+0000 7f14f66cf700 1 -- 172.21.15.69:0/2338801439 shutdown_connections 2023-10-06T01:40:11.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.652+0000 7f14f66cf700 1 -- 172.21.15.69:0/2338801439 >> 172.21.15.69:0/2338801439 conn(0x7f14f00703a0 msgr2=0x7f14f00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:11.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.652+0000 7f14f66cf700 1 -- 172.21.15.69:0/2338801439 shutdown_connections 2023-10-06T01:40:11.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.652+0000 7f14f66cf700 1 -- 172.21.15.69:0/2338801439 wait complete. 2023-10-06T01:40:11.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.653+0000 7f14f66cf700 1 Processor -- start 2023-10-06T01:40:11.659 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.654+0000 7f14f66cf700 1 -- start start 2023-10-06T01:40:11.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.654+0000 7f14f66cf700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14d8004810 0x7f14f014a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.654+0000 7f14f66cf700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f14f00c8990 0x7f14f00c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.654+0000 7f14f66cf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14f015e6a0 0x7f14f015eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.654+0000 7f14f66cf700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f014a900 con 0x7f14f015e6a0 2023-10-06T01:40:11.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.654+0000 7f14f66cf700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14f015e210 con 0x7f14d8004810 2023-10-06T01:40:11.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.654+0000 7f14f66cf700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14f00c85c0 con 0x7f14f00c8990 2023-10-06T01:40:11.662 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.655+0000 7f14f4c6c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14f015e6a0 0x7f14f015eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.655+0000 7f14f4c6c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14f015e6a0 0x7f14f015eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40142/0 (socket says 172.21.15.69:40142) 2023-10-06T01:40:11.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.655+0000 7f14f4c6c700 1 -- 172.21.15.69:0/3337498416 learned_addr learned my addr 172.21.15.69:0/3337498416 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:11.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.655+0000 7f14ef7fe700 1 --2- 172.21.15.69:0/3337498416 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f14f00c8990 0x7f14f00c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.655+0000 7f14effff700 1 --2- 172.21.15.69:0/3337498416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14d8004810 0x7f14f014a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.655+0000 7f14f4c6c700 1 -- 172.21.15.69:0/3337498416 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f14f00c8990 msgr2=0x7f14f00c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:11.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.655+0000 7f14f4c6c700 1 --2- 172.21.15.69:0/3337498416 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f14f00c8990 0x7f14f00c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.655+0000 7f14f4c6c700 1 -- 172.21.15.69:0/3337498416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14d8004810 msgr2=0x7f14f014a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:11.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.655+0000 7f14f4c6c700 1 --2- 172.21.15.69:0/3337498416 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f14d8004810 0x7f14f014a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.663 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.655+0000 7f14f4c6c700 1 -- 172.21.15.69:0/3337498416 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14f015dbc0 con 0x7f14f015e6a0 2023-10-06T01:40:11.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.655+0000 7f14f4c6c700 1 --2- 172.21.15.69:0/3337498416 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14f015e6a0 0x7f14f015eb40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f14f00caef0 tx=0x7f14e8002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:11.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.655+0000 7f14d7fff700 1 -- 172.21.15.69:0/3337498416 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e8001ea0 con 0x7f14f015e6a0 2023-10-06T01:40:11.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.655+0000 7f14d7fff700 1 -- 172.21.15.69:0/3337498416 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14e800acd0 con 0x7f14f015e6a0 2023-10-06T01:40:11.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.655+0000 7f14f66cf700 1 -- 172.21.15.69:0/3337498416 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14f015dea0 con 0x7f14f015e6a0 2023-10-06T01:40:11.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.655+0000 7f14d7fff700 1 -- 172.21.15.69:0/3337498416 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14e8013620 con 0x7f14f015e6a0 2023-10-06T01:40:11.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.655+0000 7f14f66cf700 1 -- 172.21.15.69:0/3337498416 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14f00ceb80 con 0x7f14f015e6a0 2023-10-06T01:40:11.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.656+0000 7f14f66cf700 1 -- 172.21.15.69:0/3337498416 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f14f004c3c0 con 0x7f14f015e6a0 2023-10-06T01:40:11.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.657+0000 7f14d7fff700 1 -- 172.21.15.69:0/3337498416 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f14e8013a10 con 0x7f14f015e6a0 2023-10-06T01:40:11.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.657+0000 7f14d7fff700 1 --2- 172.21.15.69:0/3337498416 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f14dc0670e0 0x7f14dc069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.657+0000 7f14d7fff700 1 -- 172.21.15.69:0/3337498416 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f14e8084f00 con 0x7f14f015e6a0 2023-10-06T01:40:11.664 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.657+0000 7f14effff700 1 --2- 172.21.15.69:0/3337498416 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f14dc0670e0 0x7f14dc069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.657+0000 7f14d7fff700 1 --2- 172.21.15.69:0/3337498416 >> [v2:172.21.15.69:6800/90673,v1:172.21.15.69:6801/90673] conn(0x7f14dc06d550 0x7f14dc06f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.657+0000 7f14d7fff700 1 -- 172.21.15.69:0/3337498416 --> [v2:172.21.15.69:6800/90673,v1:172.21.15.69:6801/90673] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f14dc070030 con 0x7f14dc06d550 2023-10-06T01:40:11.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.657+0000 7f14d7fff700 1 -- 172.21.15.69:0/3337498416 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f14e8087520 con 0x7f14f015e6a0 2023-10-06T01:40:11.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.657+0000 7f14ef7fe700 1 --2- 172.21.15.69:0/3337498416 >> [v2:172.21.15.69:6800/90673,v1:172.21.15.69:6801/90673] conn(0x7f14dc06d550 0x7f14dc06f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.657+0000 7f14effff700 1 --2- 172.21.15.69:0/3337498416 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f14dc0670e0 0x7f14dc069590 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f14f00cdef0 tx=0x7f14e00091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:11.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.658+0000 7f14ef7fe700 1 --2- 172.21.15.69:0/3337498416 >> [v2:172.21.15.69:6800/90673,v1:172.21.15.69:6801/90673] conn(0x7f14dc06d550 0x7f14dc06f960 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:11.665 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.658+0000 7f14d7fff700 1 -- 172.21.15.69:0/3337498416 <== osd.1 v2:172.21.15.69:6800/90673 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f14dc070030 con 0x7f14dc06d550 2023-10-06T01:40:11.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.671+0000 7f14f66cf700 1 -- 172.21.15.69:0/3337498416 --> [v2:172.21.15.69:6800/90673,v1:172.21.15.69:6801/90673] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f14f015acb0 con 0x7f14dc06d550 2023-10-06T01:40:11.673 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.672+0000 7f14d7fff700 1 -- 172.21.15.69:0/3337498416 <== osd.1 v2:172.21.15.69:6800/90673 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f14f015acb0 con 0x7f14dc06d550 2023-10-06T01:40:11.673 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-10-06T01:40:11.673 INFO:teuthology.orchestra.run.smithi069.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T01:40:11.674 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-10-06T01:40:11.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.672+0000 7f14f66cf700 1 -- 172.21.15.69:0/3337498416 >> [v2:172.21.15.69:6800/90673,v1:172.21.15.69:6801/90673] conn(0x7f14dc06d550 msgr2=0x7f14dc06f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:11.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.672+0000 7f14f66cf700 1 --2- 172.21.15.69:0/3337498416 >> [v2:172.21.15.69:6800/90673,v1:172.21.15.69:6801/90673] conn(0x7f14dc06d550 0x7f14dc06f960 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.672+0000 7f14f66cf700 1 -- 172.21.15.69:0/3337498416 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f14dc0670e0 msgr2=0x7f14dc069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:11.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.672+0000 7f14f66cf700 1 --2- 172.21.15.69:0/3337498416 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f14dc0670e0 0x7f14dc069590 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f14f00cdef0 tx=0x7f14e00091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.672+0000 7f14f66cf700 1 -- 172.21.15.69:0/3337498416 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14f015e6a0 msgr2=0x7f14f015eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:11.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.672+0000 7f14f66cf700 1 --2- 172.21.15.69:0/3337498416 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f14f015e6a0 0x7f14f015eb40 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f14f00caef0 tx=0x7f14e8002210 comp rx=0 tx=0).stop 2023-10-06T01:40:11.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.672+0000 7f14f4c6c700 1 -- 172.21.15.69:0/3337498416 reap_dead start 2023-10-06T01:40:11.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.672+0000 7f14f66cf700 1 -- 172.21.15.69:0/3337498416 shutdown_connections 2023-10-06T01:40:11.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.672+0000 7f14f66cf700 1 -- 172.21.15.69:0/3337498416 >> 172.21.15.69:0/3337498416 conn(0x7f14f00703a0 msgr2=0x7f14f01581b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:11.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.672+0000 7f14f66cf700 1 -- 172.21.15.69:0/3337498416 shutdown_connections 2023-10-06T01:40:11.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.672+0000 7f14f66cf700 1 -- 172.21.15.69:0/3337498416 wait complete. 2023-10-06T01:40:11.685 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-06T01:40:11.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.799+0000 7fa28e1d5700 1 Processor -- start 2023-10-06T01:40:11.801 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.799+0000 7fa28e1d5700 1 -- start start 2023-10-06T01:40:11.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.800+0000 7fa28e1d5700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa2880cb5a0 0x7fa2880cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.800+0000 7fa28e1d5700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2880cd9e0 0x7fa288159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.800+0000 7fa28e1d5700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa28815ae40 con 0x7fa2880cde50 2023-10-06T01:40:11.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.800+0000 7fa28e1d5700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2880d13f0 con 0x7fa2880cb5a0 2023-10-06T01:40:11.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.800+0000 7fa28e1d5700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28815ab60 con 0x7fa2880cd9e0 2023-10-06T01:40:11.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.800+0000 7fa287fff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fa2880cde50 0x7fa288156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:60330/0 (socket says 172.21.15.69:60330) 2023-10-06T01:40:11.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.800+0000 7fa287fff700 1 -- 172.21.15.69:0/3380263574 learned_addr learned my addr 172.21.15.69:0/3380263574 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:40:11.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa2877fe700 1 --2- 172.21.15.69:0/3380263574 >> v2:172.21.15.88:3300/0 conn(0x7fa2880cb5a0 0x7fa2880cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.805 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa286ffd700 1 --2- 172.21.15.69:0/3380263574 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2880cd9e0 0x7fa288159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa2867fc700 1 -- 172.21.15.69:0/3380263574 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1378490753 0 0) 0x7fa28815ae40 con 0x7fa2880cde50 2023-10-06T01:40:11.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa2867fc700 1 -- 172.21.15.69:0/3380263574 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa270003570 con 0x7fa2880cde50 2023-10-06T01:40:11.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa2867fc700 1 -- 172.21.15.69:0/3380263574 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2585925194 0 0) 0x7fa270003570 con 0x7fa2880cde50 2023-10-06T01:40:11.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa2867fc700 1 -- 172.21.15.69:0/3380263574 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2880cd9e0 msgr2=0x7fa288159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:11.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa2867fc700 1 --2- 172.21.15.69:0/3380263574 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2880cd9e0 0x7fa288159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa2867fc700 1 -- 172.21.15.69:0/3380263574 >> v2:172.21.15.88:3300/0 conn(0x7fa2880cb5a0 msgr2=0x7fa2880cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:11.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa2867fc700 1 --2- 172.21.15.69:0/3380263574 >> v2:172.21.15.88:3300/0 conn(0x7fa2880cb5a0 0x7fa2880cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa2867fc700 1 -- 172.21.15.69:0/3380263574 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2880ccf00 con 0x7fa2880cde50 2023-10-06T01:40:11.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa2867fc700 1 -- 172.21.15.69:0/3380263574 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7fa280001470 con 0x7fa2880cde50 2023-10-06T01:40:11.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa2867fc700 1 -- 172.21.15.69:0/3380263574 >> v1:172.21.15.69:6789/0 conn(0x7fa2880cde50 legacy=0x7fa288156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:11.806 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa2867fc700 1 --2- 172.21.15.69:0/3380263574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa270003a60 0x7fa270003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa2867fc700 1 --2- 172.21.15.69:0/3380263574 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa270004810 0x7fa270004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa2867fc700 1 --2- 172.21.15.69:0/3380263574 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2880cd9e0 0x7fa2700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa2867fc700 1 -- 172.21.15.69:0/3380263574 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28815ab60 con 0x7fa270004810 2023-10-06T01:40:11.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa2867fc700 1 -- 172.21.15.69:0/3380263574 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27000ba60 con 0x7fa270003a60 2023-10-06T01:40:11.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa2867fc700 1 -- 172.21.15.69:0/3380263574 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27000bba0 con 0x7fa2880cd9e0 2023-10-06T01:40:11.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa286ffd700 1 --2- 172.21.15.69:0/3380263574 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa270004810 0x7fa270004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa2877fe700 1 --2- 172.21.15.69:0/3380263574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa270003a60 0x7fa270003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa287fff700 1 --2- 172.21.15.69:0/3380263574 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2880cd9e0 0x7fa2700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa286ffd700 1 -- 172.21.15.69:0/3380263574 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2880cd9e0 msgr2=0x7fa2700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:11.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa286ffd700 1 --2- 172.21.15.69:0/3380263574 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2880cd9e0 0x7fa2700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.807 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa286ffd700 1 -- 172.21.15.69:0/3380263574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa270003a60 msgr2=0x7fa270003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:11.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa286ffd700 1 --2- 172.21.15.69:0/3380263574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa270003a60 0x7fa270003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa286ffd700 1 -- 172.21.15.69:0/3380263574 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa270003570 con 0x7fa270004810 2023-10-06T01:40:11.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa2877fe700 1 --2- 172.21.15.69:0/3380263574 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa270003a60 0x7fa270003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:11.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.801+0000 7fa287fff700 1 --2- 172.21.15.69:0/3380263574 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa2880cd9e0 0x7fa2700051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:11.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.802+0000 7fa286ffd700 1 --2- 172.21.15.69:0/3380263574 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa270004810 0x7fa270004c80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa27c009c30 tx=0x7fa27c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a0800419e85712 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:11.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.802+0000 7fa2867fc700 1 -- 172.21.15.69:0/3380263574 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c00e710 con 0x7fa270004810 2023-10-06T01:40:11.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.802+0000 7fa2867fc700 1 -- 172.21.15.69:0/3380263574 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27c00e870 con 0x7fa270004810 2023-10-06T01:40:11.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.802+0000 7fa2867fc700 1 -- 172.21.15.69:0/3380263574 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27c00ec30 con 0x7fa270004810 2023-10-06T01:40:11.808 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.802+0000 7fa28e1d5700 1 -- 172.21.15.69:0/3380263574 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa270004810 msgr2=0x7fa270004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:11.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.802+0000 7fa28e1d5700 1 --2- 172.21.15.69:0/3380263574 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa270004810 0x7fa270004c80 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fa27c009c30 tx=0x7fa27c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.802+0000 7fa287fff700 1 -- 172.21.15.69:0/3380263574 reap_dead start 2023-10-06T01:40:11.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.802+0000 7fa28e1d5700 1 -- 172.21.15.69:0/3380263574 shutdown_connections 2023-10-06T01:40:11.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.802+0000 7fa28e1d5700 1 -- 172.21.15.69:0/3380263574 >> 172.21.15.69:0/3380263574 conn(0x7fa288070e30 msgr2=0x7fa2880d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:11.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.802+0000 7fa28e1d5700 1 -- 172.21.15.69:0/3380263574 shutdown_connections 2023-10-06T01:40:11.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.802+0000 7fa28e1d5700 1 -- 172.21.15.69:0/3380263574 wait complete. 2023-10-06T01:40:11.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.803+0000 7fa28e1d5700 1 Processor -- start 2023-10-06T01:40:11.809 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.804+0000 7fa28e1d5700 1 -- start start 2023-10-06T01:40:11.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.804+0000 7fa28e1d5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa270004810 0x7fa2880c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.804+0000 7fa28e1d5700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa28816ca50 0x7fa28815d7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.804+0000 7fa28e1d5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa28815b070 0x7fa2880b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.804+0000 7fa28e1d5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28816cf50 con 0x7fa270004810 2023-10-06T01:40:11.812 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.804+0000 7fa28e1d5700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa28816d230 con 0x7fa28815b070 2023-10-06T01:40:11.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.804+0000 7fa28e1d5700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa28816d510 con 0x7fa28816ca50 2023-10-06T01:40:11.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.804+0000 7fa2877fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa270004810 0x7fa2880c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.804+0000 7fa2877fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa270004810 0x7fa2880c8e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40168/0 (socket says 172.21.15.69:40168) 2023-10-06T01:40:11.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.804+0000 7fa2877fe700 1 -- 172.21.15.69:0/3489115476 learned_addr learned my addr 172.21.15.69:0/3489115476 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:11.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.805+0000 7fa287fff700 1 --2- 172.21.15.69:0/3489115476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa28815b070 0x7fa2880b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.805+0000 7fa286ffd700 1 --2- 172.21.15.69:0/3489115476 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa28816ca50 0x7fa28815d7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.805+0000 7fa2877fe700 1 -- 172.21.15.69:0/3489115476 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa28816ca50 msgr2=0x7fa28815d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:11.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.805+0000 7fa2877fe700 1 --2- 172.21.15.69:0/3489115476 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa28816ca50 0x7fa28815d7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.805+0000 7fa2877fe700 1 -- 172.21.15.69:0/3489115476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa28815b070 msgr2=0x7fa2880b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:11.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.805+0000 7fa2877fe700 1 --2- 172.21.15.69:0/3489115476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa28815b070 0x7fa2880b4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:11.813 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.805+0000 7fa2877fe700 1 -- 172.21.15.69:0/3489115476 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28816d7f0 con 0x7fa270004810 2023-10-06T01:40:11.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.805+0000 7fa287fff700 1 --2- 172.21.15.69:0/3489115476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa28815b070 0x7fa2880b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:40:11.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.805+0000 7fa2877fe700 1 --2- 172.21.15.69:0/3489115476 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa270004810 0x7fa2880c8e20 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa278010570 tx=0x7fa27800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:11.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.805+0000 7fa26f7fe700 1 -- 172.21.15.69:0/3489115476 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27800e050 con 0x7fa270004810 2023-10-06T01:40:11.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.805+0000 7fa26f7fe700 1 -- 172.21.15.69:0/3489115476 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27800f040 con 0x7fa270004810 2023-10-06T01:40:11.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.805+0000 7fa28e1d5700 1 -- 172.21.15.69:0/3489115476 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2880c9360 con 0x7fa270004810 2023-10-06T01:40:11.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.805+0000 7fa26f7fe700 1 -- 172.21.15.69:0/3489115476 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa278015860 con 0x7fa270004810 2023-10-06T01:40:11.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.805+0000 7fa28e1d5700 1 -- 172.21.15.69:0/3489115476 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa28815dd10 con 0x7fa270004810 2023-10-06T01:40:11.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.806+0000 7fa28e1d5700 1 -- 172.21.15.69:0/3489115476 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2880afba0 con 0x7fa270004810 2023-10-06T01:40:11.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.806+0000 7fa26f7fe700 1 -- 172.21.15.69:0/3489115476 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fa278003020 con 0x7fa270004810 2023-10-06T01:40:11.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.807+0000 7fa26f7fe700 1 --2- 172.21.15.69:0/3489115476 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa2740670e0 0x7fa274069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:11.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.807+0000 7fa26f7fe700 1 -- 172.21.15.69:0/3489115476 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fa278085500 con 0x7fa270004810 2023-10-06T01:40:11.814 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.807+0000 7fa286ffd700 1 --2- 172.21.15.69:0/3489115476 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa2740670e0 0x7fa274069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:11.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.807+0000 7fa286ffd700 1 --2- 172.21.15.69:0/3489115476 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa2740670e0 0x7fa274069590 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa28815a6a0 tx=0x7fa27c01a000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:11.815 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.811+0000 7fa26f7fe700 1 -- 172.21.15.69:0/3489115476 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa278052580 con 0x7fa270004810 2023-10-06T01:40:11.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.996+0000 7fa28e1d5700 1 -- 172.21.15.69:0/3489115476 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7fa288169640 con 0x7fa2740670e0 2023-10-06T01:40:11.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.996+0000 7fa26f7fe700 1 -- 172.21.15.69:0/3489115476 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fa288169640 con 0x7fa2740670e0 2023-10-06T01:40:12.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.998+0000 7fa28e1d5700 1 -- 172.21.15.69:0/3489115476 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa2740670e0 msgr2=0x7fa274069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.998+0000 7fa28e1d5700 1 --2- 172.21.15.69:0/3489115476 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa2740670e0 0x7fa274069590 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa28815a6a0 tx=0x7fa27c01a000 comp rx=0 tx=0).stop 2023-10-06T01:40:12.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.998+0000 7fa28e1d5700 1 -- 172.21.15.69:0/3489115476 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa270004810 msgr2=0x7fa2880c8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.998+0000 7fa28e1d5700 1 --2- 172.21.15.69:0/3489115476 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa270004810 0x7fa2880c8e20 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fa278010570 tx=0x7fa27800b040 comp rx=0 tx=0).stop 2023-10-06T01:40:12.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.998+0000 7fa28e1d5700 1 -- 172.21.15.69:0/3489115476 shutdown_connections 2023-10-06T01:40:12.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.998+0000 7fa28e1d5700 1 --2- 172.21.15.69:0/3489115476 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa2740670e0 0x7fa274069590 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.000 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.998+0000 7fa28e1d5700 1 --2- 172.21.15.69:0/3489115476 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa28815b070 0x7fa2880b4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.998+0000 7fa28e1d5700 1 --2- 172.21.15.69:0/3489115476 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa270004810 0x7fa2880c8e20 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.998+0000 7fa28e1d5700 1 --2- 172.21.15.69:0/3489115476 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa28816ca50 0x7fa28815d7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.998+0000 7fa28e1d5700 1 -- 172.21.15.69:0/3489115476 >> 172.21.15.69:0/3489115476 conn(0x7fa288070e30 msgr2=0x7fa2880b10a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:12.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.998+0000 7fa28e1d5700 1 -- 172.21.15.69:0/3489115476 shutdown_connections 2023-10-06T01:40:12.001 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:11.998+0000 7fa28e1d5700 1 -- 172.21.15.69:0/3489115476 wait complete. 2023-10-06T01:40:12.001 INFO:teuthology.orchestra.run.smithi069.stderr:instructed osd(s) 1 to deep-scrub 2023-10-06T01:40:12.011 INFO:tasks.ceph:Scrubbing osd.2 2023-10-06T01:40:12.011 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-06T01:40:12.129 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.128+0000 7fd168ed5700 1 Processor -- start 2023-10-06T01:40:12.130 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.128+0000 7fd168ed5700 1 -- start start 2023-10-06T01:40:12.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.129+0000 7fd168ed5700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fd1641598f0 0x7fd1640cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.129+0000 7fd168ed5700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd164159d50 con 0x7fd1640cb880 2023-10-06T01:40:12.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.129+0000 7fd168ed5700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1640cf330 con 0x7fd1640cd770 2023-10-06T01:40:12.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.129+0000 7fd168ed5700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1640cead0 con 0x7fd1641598f0 2023-10-06T01:40:12.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.129+0000 7fd16259c700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fd1640cb880 0x7fd1640cd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:60340/0 (socket says 172.21.15.69:60340) 2023-10-06T01:40:12.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.129+0000 7fd16259c700 1 -- 172.21.15.69:0/3206358935 learned_addr learned my addr 172.21.15.69:0/3206358935 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:40:12.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.129+0000 7fd16159a700 1 -- 172.21.15.69:0/3206358935 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2284312885 0 0) 0x7fd164159d50 con 0x7fd1640cb880 2023-10-06T01:40:12.133 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.129+0000 7fd16159a700 1 -- 172.21.15.69:0/3206358935 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd150003570 con 0x7fd1640cb880 2023-10-06T01:40:12.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.129+0000 7fd162d9d700 1 --2- 172.21.15.69:0/3206358935 >> v2:172.21.15.88:3300/0 conn(0x7fd1641598f0 0x7fd1640cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.129+0000 7fd16159a700 1 -- 172.21.15.69:0/3206358935 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 791469970 0 0) 0x7fd150003570 con 0x7fd1640cb880 2023-10-06T01:40:12.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.129+0000 7fd16159a700 1 -- 172.21.15.69:0/3206358935 >> v2:172.21.15.88:3300/0 conn(0x7fd1641598f0 msgr2=0x7fd1640cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:12.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.129+0000 7fd16159a700 1 --2- 172.21.15.69:0/3206358935 >> v2:172.21.15.88:3300/0 conn(0x7fd1641598f0 0x7fd1640cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.129+0000 7fd16159a700 1 -- 172.21.15.69:0/3206358935 >> v1:172.21.15.88:6789/0 conn(0x7fd1640cd770 legacy=0x7fd1641591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.130+0000 7fd16159a700 1 -- 172.21.15.69:0/3206358935 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1640cddd0 con 0x7fd1640cb880 2023-10-06T01:40:12.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.130+0000 7fd16159a700 1 -- 172.21.15.69:0/3206358935 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7fd1540017f0 con 0x7fd1640cb880 2023-10-06T01:40:12.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.130+0000 7fd162d9d700 1 --2- 172.21.15.69:0/3206358935 >> v2:172.21.15.88:3300/0 conn(0x7fd1641598f0 0x7fd1640cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:12.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.130+0000 7fd16159a700 1 -- 172.21.15.69:0/3206358935 >> v1:172.21.15.69:6789/0 conn(0x7fd1640cb880 legacy=0x7fd1640cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.134 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.130+0000 7fd16159a700 1 --2- 172.21.15.69:0/3206358935 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd150003a60 0x7fd150003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.130+0000 7fd16159a700 1 --2- 172.21.15.69:0/3206358935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd150004810 0x7fd150004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.130+0000 7fd16159a700 1 --2- 172.21.15.69:0/3206358935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1500052e0 0x7fd15000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.130+0000 7fd16159a700 1 -- 172.21.15.69:0/3206358935 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1640cead0 con 0x7fd150004810 2023-10-06T01:40:12.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.130+0000 7fd16159a700 1 -- 172.21.15.69:0/3206358935 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd15000c230 con 0x7fd1500052e0 2023-10-06T01:40:12.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.130+0000 7fd16159a700 1 -- 172.21.15.69:0/3206358935 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd15000c3f0 con 0x7fd150003a60 2023-10-06T01:40:12.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.130+0000 7fd161d9b700 1 --2- 172.21.15.69:0/3206358935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd150004810 0x7fd150004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.130+0000 7fd16259c700 1 --2- 172.21.15.69:0/3206358935 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd150003a60 0x7fd150003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.130+0000 7fd162d9d700 1 --2- 172.21.15.69:0/3206358935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1500052e0 0x7fd15000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.130+0000 7fd161d9b700 1 -- 172.21.15.69:0/3206358935 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd150003a60 msgr2=0x7fd150003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:12.135 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.130+0000 7fd161d9b700 1 --2- 172.21.15.69:0/3206358935 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd150003a60 0x7fd150003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.130+0000 7fd161d9b700 1 -- 172.21.15.69:0/3206358935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1500052e0 msgr2=0x7fd15000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:12.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.130+0000 7fd161d9b700 1 --2- 172.21.15.69:0/3206358935 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1500052e0 0x7fd15000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.130+0000 7fd162d9d700 1 -- 172.21.15.69:0/3206358935 reap_dead start 2023-10-06T01:40:12.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.130+0000 7fd161d9b700 1 -- 172.21.15.69:0/3206358935 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd150003570 con 0x7fd150004810 2023-10-06T01:40:12.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.130+0000 7fd161d9b700 1 --2- 172.21.15.69:0/3206358935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd150004810 0x7fd150004c80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd14c0018b0 tx=0x7fd14c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89bc552e3009821f server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:12.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.130+0000 7fd16159a700 1 -- 172.21.15.69:0/3206358935 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c012420 con 0x7fd150004810 2023-10-06T01:40:12.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.130+0000 7fd16159a700 1 -- 172.21.15.69:0/3206358935 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14c0125a0 con 0x7fd150004810 2023-10-06T01:40:12.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.130+0000 7fd16159a700 1 -- 172.21.15.69:0/3206358935 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c012960 con 0x7fd150004810 2023-10-06T01:40:12.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.131+0000 7fd168ed5700 1 -- 172.21.15.69:0/3206358935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd150004810 msgr2=0x7fd150004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.136 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.131+0000 7fd168ed5700 1 --2- 172.21.15.69:0/3206358935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd150004810 0x7fd150004c80 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fd14c0018b0 tx=0x7fd14c007d30 comp rx=0 tx=0).stop 2023-10-06T01:40:12.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.131+0000 7fd168ed5700 1 -- 172.21.15.69:0/3206358935 shutdown_connections 2023-10-06T01:40:12.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.131+0000 7fd168ed5700 1 --2- 172.21.15.69:0/3206358935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd150004810 0x7fd150004c80 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.131+0000 7fd168ed5700 1 -- 172.21.15.69:0/3206358935 >> 172.21.15.69:0/3206358935 conn(0x7fd1640703a0 msgr2=0x7fd1640707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:12.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.131+0000 7fd168ed5700 1 -- 172.21.15.69:0/3206358935 shutdown_connections 2023-10-06T01:40:12.137 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.131+0000 7fd168ed5700 1 -- 172.21.15.69:0/3206358935 wait complete. 2023-10-06T01:40:12.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.132+0000 7fd168ed5700 1 Processor -- start 2023-10-06T01:40:12.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.132+0000 7fd168ed5700 1 -- start start 2023-10-06T01:40:12.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.133+0000 7fd168ed5700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd150004810 0x7fd16416ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.140 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.133+0000 7fd168ed5700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd164169be0 0x7fd1640ae800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.133+0000 7fd168ed5700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd16415b890 0x7fd1640c6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.133+0000 7fd168ed5700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1640b3480 con 0x7fd164169be0 2023-10-06T01:40:12.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.133+0000 7fd168ed5700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16416a160 con 0x7fd150004810 2023-10-06T01:40:12.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.133+0000 7fd168ed5700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd16416a440 con 0x7fd16415b890 2023-10-06T01:40:12.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.133+0000 7fd161d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd164169be0 0x7fd1640ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.133+0000 7fd161d9b700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd164169be0 0x7fd1640ae800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40194/0 (socket says 172.21.15.69:40194) 2023-10-06T01:40:12.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.133+0000 7fd161d9b700 1 -- 172.21.15.69:0/1808052517 learned_addr learned my addr 172.21.15.69:0/1808052517 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:12.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.133+0000 7fd16259c700 1 --2- 172.21.15.69:0/1808052517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd150004810 0x7fd16416ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.133+0000 7fd162d9d700 1 --2- 172.21.15.69:0/1808052517 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd16415b890 0x7fd1640c6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.141 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.133+0000 7fd161d9b700 1 -- 172.21.15.69:0/1808052517 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd16415b890 msgr2=0x7fd1640c6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.133+0000 7fd161d9b700 1 --2- 172.21.15.69:0/1808052517 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd16415b890 0x7fd1640c6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.133+0000 7fd161d9b700 1 -- 172.21.15.69:0/1808052517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd150004810 msgr2=0x7fd16416ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.133+0000 7fd161d9b700 1 --2- 172.21.15.69:0/1808052517 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd150004810 0x7fd16416ae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.133+0000 7fd161d9b700 1 -- 172.21.15.69:0/1808052517 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd16416a720 con 0x7fd164169be0 2023-10-06T01:40:12.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.133+0000 7fd161d9b700 1 --2- 172.21.15.69:0/1808052517 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd164169be0 0x7fd1640ae800 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd15000c200 tx=0x7fd14c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:12.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.133+0000 7fd15a7fc700 1 -- 172.21.15.69:0/1808052517 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c01f620 con 0x7fd164169be0 2023-10-06T01:40:12.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.133+0000 7fd15a7fc700 1 -- 172.21.15.69:0/1808052517 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd14c01f780 con 0x7fd164169be0 2023-10-06T01:40:12.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.133+0000 7fd15a7fc700 1 -- 172.21.15.69:0/1808052517 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14c01fb20 con 0x7fd164169be0 2023-10-06T01:40:12.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.133+0000 7fd168ed5700 1 -- 172.21.15.69:0/1808052517 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd16416aa00 con 0x7fd164169be0 2023-10-06T01:40:12.142 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.134+0000 7fd168ed5700 1 -- 172.21.15.69:0/1808052517 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1640aed40 con 0x7fd164169be0 2023-10-06T01:40:12.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.134+0000 7fd168ed5700 1 -- 172.21.15.69:0/1808052517 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd1640b3480 con 0x7fd164169be0 2023-10-06T01:40:12.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.135+0000 7fd15a7fc700 1 -- 172.21.15.69:0/1808052517 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fd14c00c420 con 0x7fd164169be0 2023-10-06T01:40:12.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.135+0000 7fd15a7fc700 1 --2- 172.21.15.69:0/1808052517 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd144067110 0x7fd1440695c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.135+0000 7fd15a7fc700 1 -- 172.21.15.69:0/1808052517 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fd14c086470 con 0x7fd164169be0 2023-10-06T01:40:12.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.135+0000 7fd16259c700 1 --2- 172.21.15.69:0/1808052517 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd144067110 0x7fd1440695c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.135+0000 7fd15a7fc700 1 --2- 172.21.15.69:0/1808052517 >> [v2:172.21.15.69:6808/90674,v1:172.21.15.69:6809/90674] conn(0x7fd14406d580 0x7fd14406f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.135+0000 7fd15a7fc700 1 -- 172.21.15.69:0/1808052517 --> [v2:172.21.15.69:6808/90674,v1:172.21.15.69:6809/90674] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd144070060 con 0x7fd14406d580 2023-10-06T01:40:12.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.135+0000 7fd15a7fc700 1 -- 172.21.15.69:0/1808052517 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd14c086760 con 0x7fd164169be0 2023-10-06T01:40:12.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.135+0000 7fd162d9d700 1 --2- 172.21.15.69:0/1808052517 >> [v2:172.21.15.69:6808/90674,v1:172.21.15.69:6809/90674] conn(0x7fd14406d580 0x7fd14406f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.136+0000 7fd16259c700 1 --2- 172.21.15.69:0/1808052517 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd144067110 0x7fd1440695c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd1540011d0 tx=0x7fd154006040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:12.143 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.136+0000 7fd162d9d700 1 --2- 172.21.15.69:0/1808052517 >> [v2:172.21.15.69:6808/90674,v1:172.21.15.69:6809/90674] conn(0x7fd14406d580 0x7fd14406f990 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:12.144 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.136+0000 7fd15a7fc700 1 -- 172.21.15.69:0/1808052517 <== osd.2 v2:172.21.15.69:6808/90674 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd144070060 con 0x7fd14406d580 2023-10-06T01:40:12.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.150+0000 7fd168ed5700 1 -- 172.21.15.69:0/1808052517 --> [v2:172.21.15.69:6808/90674,v1:172.21.15.69:6809/90674] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd16404c3c0 con 0x7fd14406d580 2023-10-06T01:40:12.151 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.150+0000 7fd15a7fc700 1 -- 172.21.15.69:0/1808052517 <== osd.2 v2:172.21.15.69:6808/90674 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd16404c3c0 con 0x7fd14406d580 2023-10-06T01:40:12.151 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-10-06T01:40:12.152 INFO:teuthology.orchestra.run.smithi069.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T01:40:12.152 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-10-06T01:40:12.152 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.150+0000 7fd168ed5700 1 -- 172.21.15.69:0/1808052517 >> [v2:172.21.15.69:6808/90674,v1:172.21.15.69:6809/90674] conn(0x7fd14406d580 msgr2=0x7fd14406f990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.150+0000 7fd168ed5700 1 --2- 172.21.15.69:0/1808052517 >> [v2:172.21.15.69:6808/90674,v1:172.21.15.69:6809/90674] conn(0x7fd14406d580 0x7fd14406f990 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.150+0000 7fd168ed5700 1 -- 172.21.15.69:0/1808052517 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd144067110 msgr2=0x7fd1440695c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.150+0000 7fd168ed5700 1 --2- 172.21.15.69:0/1808052517 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd144067110 0x7fd1440695c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fd1540011d0 tx=0x7fd154006040 comp rx=0 tx=0).stop 2023-10-06T01:40:12.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.150+0000 7fd168ed5700 1 -- 172.21.15.69:0/1808052517 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd164169be0 msgr2=0x7fd1640ae800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.150+0000 7fd168ed5700 1 --2- 172.21.15.69:0/1808052517 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd164169be0 0x7fd1640ae800 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fd15000c200 tx=0x7fd14c015000 comp rx=0 tx=0).stop 2023-10-06T01:40:12.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.150+0000 7fd162d9d700 1 -- 172.21.15.69:0/1808052517 reap_dead start 2023-10-06T01:40:12.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.150+0000 7fd168ed5700 1 -- 172.21.15.69:0/1808052517 shutdown_connections 2023-10-06T01:40:12.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.150+0000 7fd168ed5700 1 -- 172.21.15.69:0/1808052517 >> 172.21.15.69:0/1808052517 conn(0x7fd1640703a0 msgr2=0x7fd164070980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:12.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.150+0000 7fd168ed5700 1 -- 172.21.15.69:0/1808052517 shutdown_connections 2023-10-06T01:40:12.153 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.150+0000 7fd168ed5700 1 -- 172.21.15.69:0/1808052517 wait complete. 2023-10-06T01:40:12.163 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-06T01:40:12.278 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.277+0000 7f1c3b53d700 1 Processor -- start 2023-10-06T01:40:12.279 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.277+0000 7f1c3b53d700 1 -- start start 2023-10-06T01:40:12.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.278+0000 7f1c3b53d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1c340cb970 0x7f1c34159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.278+0000 7f1c3b53d700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c3415ae40 con 0x7f1c340cb5a0 2023-10-06T01:40:12.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.278+0000 7f1c3b53d700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c3415ab60 con 0x7f1c3415a400 2023-10-06T01:40:12.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.278+0000 7f1c3b53d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c340ce0f0 con 0x7f1c340cb970 2023-10-06T01:40:12.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.278+0000 7f1c392d9700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f1c340cb5a0 0x7f1c340cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:60356/0 (socket says 172.21.15.69:60356) 2023-10-06T01:40:12.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.278+0000 7f1c392d9700 1 -- 172.21.15.69:0/2510587981 learned_addr learned my addr 172.21.15.69:0/2510587981 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:40:12.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.278+0000 7f1c2bfff700 1 -- 172.21.15.69:0/2510587981 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1783087039 0 0) 0x7f1c3415ae40 con 0x7f1c340cb5a0 2023-10-06T01:40:12.282 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.278+0000 7f1c2bfff700 1 -- 172.21.15.69:0/2510587981 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c20003570 con 0x7f1c340cb5a0 2023-10-06T01:40:12.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.278+0000 7f1c38ad8700 1 --2- 172.21.15.69:0/2510587981 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1c340cb970 0x7f1c34159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.279+0000 7f1c2bfff700 1 -- 172.21.15.69:0/2510587981 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1088608050 0 0) 0x7f1c20003570 con 0x7f1c340cb5a0 2023-10-06T01:40:12.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.279+0000 7f1c2bfff700 1 -- 172.21.15.69:0/2510587981 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1c340cb970 msgr2=0x7f1c34159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:12.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.279+0000 7f1c2bfff700 1 --2- 172.21.15.69:0/2510587981 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1c340cb970 0x7f1c34159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.279+0000 7f1c2bfff700 1 -- 172.21.15.69:0/2510587981 >> v1:172.21.15.88:6789/0 conn(0x7f1c3415a400 legacy=0x7f1c34156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.279+0000 7f1c2bfff700 1 -- 172.21.15.69:0/2510587981 --> v1:172.21.15.69:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c340ccf00 con 0x7f1c340cb5a0 2023-10-06T01:40:12.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.279+0000 7f1c2bfff700 1 -- 172.21.15.69:0/2510587981 <== mon.0 v1:172.21.15.69:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2429641438 0 0) 0x7f1c30001470 con 0x7f1c340cb5a0 2023-10-06T01:40:12.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.279+0000 7f1c2bfff700 1 -- 172.21.15.69:0/2510587981 >> v1:172.21.15.69:6789/0 conn(0x7f1c340cb5a0 legacy=0x7f1c340cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.279+0000 7f1c2bfff700 1 --2- 172.21.15.69:0/2510587981 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1c340cb970 0x7f1c20003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.279+0000 7f1c2bfff700 1 --2- 172.21.15.69:0/2510587981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c200040c0 0x7f1c20004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.279+0000 7f1c2bfff700 1 --2- 172.21.15.69:0/2510587981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c20004da0 0x7f1c200051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.283 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.279+0000 7f1c2bfff700 1 -- 172.21.15.69:0/2510587981 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c340ce0f0 con 0x7f1c20004da0 2023-10-06T01:40:12.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.279+0000 7f1c2bfff700 1 -- 172.21.15.69:0/2510587981 --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2000bc70 con 0x7f1c200040c0 2023-10-06T01:40:12.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.279+0000 7f1c2bfff700 1 -- 172.21.15.69:0/2510587981 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c2000be30 con 0x7f1c340cb970 2023-10-06T01:40:12.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.279+0000 7f1c39ada700 1 --2- 172.21.15.69:0/2510587981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c20004da0 0x7f1c200051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.279+0000 7f1c38ad8700 1 --2- 172.21.15.69:0/2510587981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c200040c0 0x7f1c20004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.279+0000 7f1c392d9700 1 --2- 172.21.15.69:0/2510587981 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1c340cb970 0x7f1c20003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.279+0000 7f1c39ada700 1 -- 172.21.15.69:0/2510587981 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1c340cb970 msgr2=0x7f1c20003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:12.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.279+0000 7f1c39ada700 1 --2- 172.21.15.69:0/2510587981 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1c340cb970 0x7f1c20003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.279+0000 7f1c39ada700 1 -- 172.21.15.69:0/2510587981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c200040c0 msgr2=0x7f1c20004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:12.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.279+0000 7f1c39ada700 1 --2- 172.21.15.69:0/2510587981 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c200040c0 0x7f1c20004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.279+0000 7f1c39ada700 1 -- 172.21.15.69:0/2510587981 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c20003570 con 0x7f1c20004da0 2023-10-06T01:40:12.284 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.279+0000 7f1c39ada700 1 --2- 172.21.15.69:0/2510587981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c20004da0 0x7f1c200051f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c001fc0 tx=0x7f1c2c001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=273c5a4039a1820b server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:12.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.279+0000 7f1c2bfff700 1 -- 172.21.15.69:0/2510587981 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c001950 con 0x7f1c20004da0 2023-10-06T01:40:12.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.279+0000 7f1c2bfff700 1 -- 172.21.15.69:0/2510587981 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2c00c8b0 con 0x7f1c20004da0 2023-10-06T01:40:12.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.279+0000 7f1c2bfff700 1 -- 172.21.15.69:0/2510587981 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c00cc50 con 0x7f1c20004da0 2023-10-06T01:40:12.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.280+0000 7f1c3b53d700 1 -- 172.21.15.69:0/2510587981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c20004da0 msgr2=0x7f1c200051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.280+0000 7f1c3b53d700 1 --2- 172.21.15.69:0/2510587981 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c20004da0 0x7f1c200051f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c001fc0 tx=0x7f1c2c001640 comp rx=0 tx=0).stop 2023-10-06T01:40:12.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.280+0000 7f1c39ada700 1 -- 172.21.15.69:0/2510587981 reap_dead start 2023-10-06T01:40:12.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.280+0000 7f1c3b53d700 1 -- 172.21.15.69:0/2510587981 shutdown_connections 2023-10-06T01:40:12.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.280+0000 7f1c3b53d700 1 -- 172.21.15.69:0/2510587981 >> 172.21.15.69:0/2510587981 conn(0x7f1c34070e30 msgr2=0x7f1c340d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:12.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.280+0000 7f1c3b53d700 1 -- 172.21.15.69:0/2510587981 shutdown_connections 2023-10-06T01:40:12.285 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.280+0000 7f1c3b53d700 1 -- 172.21.15.69:0/2510587981 wait complete. 2023-10-06T01:40:12.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.281+0000 7f1c3b53d700 1 Processor -- start 2023-10-06T01:40:12.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.281+0000 7f1c3b53d700 1 -- start start 2023-10-06T01:40:12.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.282+0000 7f1c3b53d700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c20004da0 0x7f1c3415c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.282+0000 7f1c3b53d700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1c340b34b0 0x7f1c340b3920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.282+0000 7f1c3b53d700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c340b59a0 0x7f1c340b5e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.288 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.282+0000 7f1c3b53d700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c340cbde0 con 0x7f1c340b59a0 2023-10-06T01:40:12.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.282+0000 7f1c3b53d700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3415def0 con 0x7f1c20004da0 2023-10-06T01:40:12.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.282+0000 7f1c3b53d700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3415da60 con 0x7f1c340b34b0 2023-10-06T01:40:12.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.282+0000 7f1c39ada700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c340b59a0 0x7f1c340b5e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.282+0000 7f1c39ada700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c340b59a0 0x7f1c340b5e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40208/0 (socket says 172.21.15.69:40208) 2023-10-06T01:40:12.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.282+0000 7f1c39ada700 1 -- 172.21.15.69:0/2181128258 learned_addr learned my addr 172.21.15.69:0/2181128258 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:12.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.282+0000 7f1c392d9700 1 --2- 172.21.15.69:0/2181128258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c20004da0 0x7f1c3415c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.282+0000 7f1c38ad8700 1 --2- 172.21.15.69:0/2181128258 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1c340b34b0 0x7f1c340b3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.282+0000 7f1c39ada700 1 -- 172.21.15.69:0/2181128258 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1c340b34b0 msgr2=0x7f1c340b3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.282+0000 7f1c39ada700 1 --2- 172.21.15.69:0/2181128258 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1c340b34b0 0x7f1c340b3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.282+0000 7f1c39ada700 1 -- 172.21.15.69:0/2181128258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c20004da0 msgr2=0x7f1c3415c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.282+0000 7f1c39ada700 1 --2- 172.21.15.69:0/2181128258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c20004da0 0x7f1c3415c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.289 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.282+0000 7f1c39ada700 1 -- 172.21.15.69:0/2181128258 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c3415ce50 con 0x7f1c340b59a0 2023-10-06T01:40:12.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.283+0000 7f1c39ada700 1 --2- 172.21.15.69:0/2181128258 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c340b59a0 0x7f1c340b5e40 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f1c2000bc40 tx=0x7f1c2c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:12.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.283+0000 7f1c297fa700 1 -- 172.21.15.69:0/2181128258 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c00c6d0 con 0x7f1c340b59a0 2023-10-06T01:40:12.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.283+0000 7f1c297fa700 1 -- 172.21.15.69:0/2181128258 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c2c012dd0 con 0x7f1c340b59a0 2023-10-06T01:40:12.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.283+0000 7f1c297fa700 1 -- 172.21.15.69:0/2181128258 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c2c006dd0 con 0x7f1c340b59a0 2023-10-06T01:40:12.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.283+0000 7f1c3b53d700 1 -- 172.21.15.69:0/2181128258 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c3415d130 con 0x7f1c340b59a0 2023-10-06T01:40:12.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.283+0000 7f1c3b53d700 1 -- 172.21.15.69:0/2181128258 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c3415d6f0 con 0x7f1c340b59a0 2023-10-06T01:40:12.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.284+0000 7f1c3b53d700 1 -- 172.21.15.69:0/2181128258 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c3415dc10 con 0x7f1c340b59a0 2023-10-06T01:40:12.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.284+0000 7f1c297fa700 1 -- 172.21.15.69:0/2181128258 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f1c2c01f620 con 0x7f1c340b59a0 2023-10-06T01:40:12.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.284+0000 7f1c297fa700 1 --2- 172.21.15.69:0/2181128258 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1c180670e0 0x7f1c18069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.284+0000 7f1c297fa700 1 -- 172.21.15.69:0/2181128258 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f1c2c085830 con 0x7f1c340b59a0 2023-10-06T01:40:12.290 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.284+0000 7f1c392d9700 1 --2- 172.21.15.69:0/2181128258 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1c180670e0 0x7f1c18069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.285+0000 7f1c392d9700 1 --2- 172.21.15.69:0/2181128258 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1c180670e0 0x7f1c18069590 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1c340cfcc0 tx=0x7f1c30001e50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:12.291 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.289+0000 7f1c297fa700 1 -- 172.21.15.69:0/2181128258 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1c3415dc10 con 0x7f1c340b59a0 2023-10-06T01:40:12.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.472+0000 7f1c3b53d700 1 -- 172.21.15.69:0/2181128258 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c3415dbd0 con 0x7f1c180670e0 2023-10-06T01:40:12.474 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.472+0000 7f1c297fa700 1 -- 172.21.15.69:0/2181128258 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1c3415dbd0 con 0x7f1c180670e0 2023-10-06T01:40:12.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.474+0000 7f1c3b53d700 1 -- 172.21.15.69:0/2181128258 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1c180670e0 msgr2=0x7f1c18069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.474+0000 7f1c3b53d700 1 --2- 172.21.15.69:0/2181128258 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1c180670e0 0x7f1c18069590 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1c340cfcc0 tx=0x7f1c30001e50 comp rx=0 tx=0).stop 2023-10-06T01:40:12.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.474+0000 7f1c3b53d700 1 -- 172.21.15.69:0/2181128258 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c340b59a0 msgr2=0x7f1c340b5e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.474+0000 7f1c3b53d700 1 --2- 172.21.15.69:0/2181128258 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c340b59a0 0x7f1c340b5e40 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f1c2000bc40 tx=0x7f1c2c015000 comp rx=0 tx=0).stop 2023-10-06T01:40:12.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.474+0000 7f1c3b53d700 1 -- 172.21.15.69:0/2181128258 shutdown_connections 2023-10-06T01:40:12.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.474+0000 7f1c3b53d700 1 --2- 172.21.15.69:0/2181128258 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f1c180670e0 0x7f1c18069590 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.474+0000 7f1c3b53d700 1 --2- 172.21.15.69:0/2181128258 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1c340b59a0 0x7f1c340b5e40 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.474+0000 7f1c3b53d700 1 --2- 172.21.15.69:0/2181128258 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f1c20004da0 0x7f1c3415c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.476 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.474+0000 7f1c3b53d700 1 --2- 172.21.15.69:0/2181128258 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f1c340b34b0 0x7f1c340b3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.474+0000 7f1c3b53d700 1 -- 172.21.15.69:0/2181128258 >> 172.21.15.69:0/2181128258 conn(0x7f1c34070e30 msgr2=0x7f1c340b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:12.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.474+0000 7f1c3b53d700 1 -- 172.21.15.69:0/2181128258 shutdown_connections 2023-10-06T01:40:12.477 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.474+0000 7f1c3b53d700 1 -- 172.21.15.69:0/2181128258 wait complete. 2023-10-06T01:40:12.477 INFO:teuthology.orchestra.run.smithi069.stderr:instructed osd(s) 2 to deep-scrub 2023-10-06T01:40:12.487 INFO:tasks.ceph:Scrubbing osd.3 2023-10-06T01:40:12.488 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-06T01:40:12.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.606+0000 7fb5704fa700 1 Processor -- start 2023-10-06T01:40:12.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.606+0000 7fb5704fa700 1 -- start start 2023-10-06T01:40:12.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.607+0000 7fb5704fa700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb568159940 0x7fb5680b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.608 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.607+0000 7fb5704fa700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb56806cdb0 0x7fb5680aa740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.607+0000 7fb5704fa700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5680af670 con 0x7fb5680b0e00 2023-10-06T01:40:12.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.607+0000 7fb5704fa700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5680aa2b0 con 0x7fb568159940 2023-10-06T01:40:12.609 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.607+0000 7fb5704fa700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5680b12a0 con 0x7fb56806cdb0 2023-10-06T01:40:12.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.608+0000 7fb56e296700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb568159940 0x7fb5680b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.608+0000 7fb56ea97700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb56806cdb0 0x7fb5680aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.608+0000 7fb56e296700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fb568159940 0x7fb5680b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.69:58656/0 (socket says 172.21.15.69:58656) 2023-10-06T01:40:12.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.608+0000 7fb56e296700 1 -- 172.21.15.69:0/1920065709 learned_addr learned my addr 172.21.15.69:0/1920065709 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:12.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.608+0000 7fb56e296700 1 -- 172.21.15.69:0/1920065709 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb56806cdb0 msgr2=0x7fb5680aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:12.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.608+0000 7fb56e296700 1 --2- 172.21.15.69:0/1920065709 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb56806cdb0 0x7fb5680aa740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.608+0000 7fb56e296700 1 -- 172.21.15.69:0/1920065709 >> v1:172.21.15.88:6789/0 conn(0x7fb5680b0e00 legacy=0x7fb56806c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.611 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.608+0000 7fb56e296700 1 -- 172.21.15.69:0/1920065709 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb568159d10 con 0x7fb568159940 2023-10-06T01:40:12.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.608+0000 7fb56ea97700 1 --2- 172.21.15.69:0/1920065709 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb56806cdb0 0x7fb5680aa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:40:12.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.608+0000 7fb56e296700 1 --2- 172.21.15.69:0/1920065709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb568159940 0x7fb5680b08c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb564009990 tx=0x7fb564009220 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b04ee5df567b099 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:12.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.609+0000 7fb56d294700 1 -- 172.21.15.69:0/1920065709 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb564009e80 con 0x7fb568159940 2023-10-06T01:40:12.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.609+0000 7fb56d294700 1 -- 172.21.15.69:0/1920065709 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb564005c10 con 0x7fb568159940 2023-10-06T01:40:12.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.609+0000 7fb56d294700 1 -- 172.21.15.69:0/1920065709 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56400b650 con 0x7fb568159940 2023-10-06T01:40:12.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.609+0000 7fb5704fa700 1 -- 172.21.15.69:0/1920065709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb568159940 msgr2=0x7fb5680b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.612 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.609+0000 7fb5704fa700 1 --2- 172.21.15.69:0/1920065709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb568159940 0x7fb5680b08c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb564009990 tx=0x7fb564009220 comp rx=0 tx=0).stop 2023-10-06T01:40:12.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.609+0000 7fb5704fa700 1 -- 172.21.15.69:0/1920065709 shutdown_connections 2023-10-06T01:40:12.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.609+0000 7fb5704fa700 1 --2- 172.21.15.69:0/1920065709 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb56806cdb0 0x7fb5680aa740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.609+0000 7fb5704fa700 1 --2- 172.21.15.69:0/1920065709 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb568159940 0x7fb5680b08c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.609+0000 7fb5704fa700 1 -- 172.21.15.69:0/1920065709 >> 172.21.15.69:0/1920065709 conn(0x7fb5680cd3e0 msgr2=0x7fb5680cd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:12.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.609+0000 7fb5704fa700 1 -- 172.21.15.69:0/1920065709 shutdown_connections 2023-10-06T01:40:12.613 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.609+0000 7fb5704fa700 1 -- 172.21.15.69:0/1920065709 wait complete. 2023-10-06T01:40:12.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.610+0000 7fb5704fa700 1 Processor -- start 2023-10-06T01:40:12.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.610+0000 7fb5704fa700 1 -- start start 2023-10-06T01:40:12.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.611+0000 7fb5704fa700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb56806cdb0 0x7fb5680c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.611+0000 7fb5704fa700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb5680b0e00 0x7fb56815ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.611+0000 7fb5704fa700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb568159940 0x7fb568157b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.617 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.611+0000 7fb5704fa700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56815bf90 con 0x7fb56806cdb0 2023-10-06T01:40:12.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.611+0000 7fb5704fa700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5680c3e30 con 0x7fb568159940 2023-10-06T01:40:12.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.611+0000 7fb5704fa700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb568158090 con 0x7fb5680b0e00 2023-10-06T01:40:12.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.611+0000 7fb56e296700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb56806cdb0 0x7fb5680c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.611+0000 7fb56e296700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb56806cdb0 0x7fb5680c2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40210/0 (socket says 172.21.15.69:40210) 2023-10-06T01:40:12.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.611+0000 7fb56e296700 1 -- 172.21.15.69:0/4114694715 learned_addr learned my addr 172.21.15.69:0/4114694715 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:12.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.611+0000 7fb56ea97700 1 --2- 172.21.15.69:0/4114694715 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb568159940 0x7fb568157b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.618 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.611+0000 7fb56da95700 1 --2- 172.21.15.69:0/4114694715 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb5680b0e00 0x7fb56815ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.611+0000 7fb56e296700 1 -- 172.21.15.69:0/4114694715 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb5680b0e00 msgr2=0x7fb56815ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.611+0000 7fb56e296700 1 --2- 172.21.15.69:0/4114694715 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fb5680b0e00 0x7fb56815ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.611+0000 7fb56e296700 1 -- 172.21.15.69:0/4114694715 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb568159940 msgr2=0x7fb568157b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.611+0000 7fb56e296700 1 --2- 172.21.15.69:0/4114694715 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fb568159940 0x7fb568157b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.611+0000 7fb56e296700 1 -- 172.21.15.69:0/4114694715 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb560009a20 con 0x7fb56806cdb0 2023-10-06T01:40:12.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.612+0000 7fb56e296700 1 --2- 172.21.15.69:0/4114694715 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb56806cdb0 0x7fb5680c2b40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb5680696f0 tx=0x7fb564016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:12.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.612+0000 7fb55e7fc700 1 -- 172.21.15.69:0/4114694715 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb564011ce0 con 0x7fb56806cdb0 2023-10-06T01:40:12.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.612+0000 7fb55e7fc700 1 -- 172.21.15.69:0/4114694715 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb564011e40 con 0x7fb56806cdb0 2023-10-06T01:40:12.619 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.612+0000 7fb5704fa700 1 -- 172.21.15.69:0/4114694715 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb564009480 con 0x7fb56806cdb0 2023-10-06T01:40:12.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.612+0000 7fb55e7fc700 1 -- 172.21.15.69:0/4114694715 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56401b660 con 0x7fb56806cdb0 2023-10-06T01:40:12.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.612+0000 7fb5704fa700 1 -- 172.21.15.69:0/4114694715 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5680c3500 con 0x7fb56806cdb0 2023-10-06T01:40:12.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.612+0000 7fb5704fa700 1 -- 172.21.15.69:0/4114694715 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb5680aecb0 con 0x7fb56806cdb0 2023-10-06T01:40:12.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.613+0000 7fb55e7fc700 1 -- 172.21.15.69:0/4114694715 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fb56401ba50 con 0x7fb56806cdb0 2023-10-06T01:40:12.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.613+0000 7fb55e7fc700 1 --2- 172.21.15.69:0/4114694715 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb54c0670e0 0x7fb54c069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.613+0000 7fb55e7fc700 1 -- 172.21.15.69:0/4114694715 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fb564085ff0 con 0x7fb56806cdb0 2023-10-06T01:40:12.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.613+0000 7fb56da95700 1 --2- 172.21.15.69:0/4114694715 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb54c0670e0 0x7fb54c069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.614+0000 7fb55e7fc700 1 --2- 172.21.15.69:0/4114694715 >> [v2:172.21.15.69:6824/90698,v1:172.21.15.69:6825/90698] conn(0x7fb54c06d550 0x7fb54c06f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.614+0000 7fb55e7fc700 1 -- 172.21.15.69:0/4114694715 --> [v2:172.21.15.69:6824/90698,v1:172.21.15.69:6825/90698] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb54c070030 con 0x7fb54c06d550 2023-10-06T01:40:12.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.614+0000 7fb55e7fc700 1 -- 172.21.15.69:0/4114694715 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb564088610 con 0x7fb56806cdb0 2023-10-06T01:40:12.620 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.614+0000 7fb56ea97700 1 --2- 172.21.15.69:0/4114694715 >> [v2:172.21.15.69:6824/90698,v1:172.21.15.69:6825/90698] conn(0x7fb54c06d550 0x7fb54c06f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.614+0000 7fb56da95700 1 --2- 172.21.15.69:0/4114694715 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb54c0670e0 0x7fb54c069590 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb56806d720 tx=0x7fb558007ec0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:12.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.614+0000 7fb56ea97700 1 --2- 172.21.15.69:0/4114694715 >> [v2:172.21.15.69:6824/90698,v1:172.21.15.69:6825/90698] conn(0x7fb54c06d550 0x7fb54c06f960 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:12.621 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.615+0000 7fb55e7fc700 1 -- 172.21.15.69:0/4114694715 <== osd.3 v2:172.21.15.69:6824/90698 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb54c070030 con 0x7fb54c06d550 2023-10-06T01:40:12.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.628+0000 7fb5704fa700 1 -- 172.21.15.69:0/4114694715 --> [v2:172.21.15.69:6824/90698,v1:172.21.15.69:6825/90698] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb56804c3c0 con 0x7fb54c06d550 2023-10-06T01:40:12.629 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.628+0000 7fb55e7fc700 1 -- 172.21.15.69:0/4114694715 <== osd.3 v2:172.21.15.69:6824/90698 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb56804c3c0 con 0x7fb54c06d550 2023-10-06T01:40:12.630 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-10-06T01:40:12.630 INFO:teuthology.orchestra.run.smithi069.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T01:40:12.630 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-10-06T01:40:12.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.629+0000 7fb5704fa700 1 -- 172.21.15.69:0/4114694715 >> [v2:172.21.15.69:6824/90698,v1:172.21.15.69:6825/90698] conn(0x7fb54c06d550 msgr2=0x7fb54c06f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.629+0000 7fb5704fa700 1 --2- 172.21.15.69:0/4114694715 >> [v2:172.21.15.69:6824/90698,v1:172.21.15.69:6825/90698] conn(0x7fb54c06d550 0x7fb54c06f960 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.629+0000 7fb5704fa700 1 -- 172.21.15.69:0/4114694715 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb54c0670e0 msgr2=0x7fb54c069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.629+0000 7fb5704fa700 1 --2- 172.21.15.69:0/4114694715 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fb54c0670e0 0x7fb54c069590 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fb56806d720 tx=0x7fb558007ec0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.629+0000 7fb5704fa700 1 -- 172.21.15.69:0/4114694715 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb56806cdb0 msgr2=0x7fb5680c2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.631 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.629+0000 7fb5704fa700 1 --2- 172.21.15.69:0/4114694715 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb56806cdb0 0x7fb5680c2b40 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fb5680696f0 tx=0x7fb564016000 comp rx=0 tx=0).stop 2023-10-06T01:40:12.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.629+0000 7fb56ea97700 1 -- 172.21.15.69:0/4114694715 reap_dead start 2023-10-06T01:40:12.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.629+0000 7fb5704fa700 1 -- 172.21.15.69:0/4114694715 shutdown_connections 2023-10-06T01:40:12.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.629+0000 7fb5704fa700 1 -- 172.21.15.69:0/4114694715 >> 172.21.15.69:0/4114694715 conn(0x7fb5680cd3e0 msgr2=0x7fb5680ab980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:12.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.629+0000 7fb5704fa700 1 -- 172.21.15.69:0/4114694715 shutdown_connections 2023-10-06T01:40:12.632 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.629+0000 7fb5704fa700 1 -- 172.21.15.69:0/4114694715 wait complete. 2023-10-06T01:40:12.641 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-06T01:40:12.757 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.756+0000 7feea216c700 1 Processor -- start 2023-10-06T01:40:12.758 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.756+0000 7feea216c700 1 -- start start 2023-10-06T01:40:12.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.757+0000 7feea216c700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fee9c0cb970 0x7fee9c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.757+0000 7feea216c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fee9c15a400 0x7fee9c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.757+0000 7feea216c700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee9c15ae40 con 0x7fee9c0cb5a0 2023-10-06T01:40:12.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.757+0000 7feea216c700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee9c0ce0f0 con 0x7fee9c0cb970 2023-10-06T01:40:12.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.757+0000 7feea216c700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c0d13f0 con 0x7fee9c15a400 2023-10-06T01:40:12.761 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.757+0000 7fee9b7fe700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fee9c0cb5a0 0x7fee9c0cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:60358/0 (socket says 172.21.15.69:60358) 2023-10-06T01:40:12.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.757+0000 7fee9b7fe700 1 -- 172.21.15.69:0/1722131416 learned_addr learned my addr 172.21.15.69:0/1722131416 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:40:12.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.757+0000 7fee9bfff700 1 --2- 172.21.15.69:0/1722131416 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fee9c15a400 0x7fee9c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.757+0000 7fee9affd700 1 --2- 172.21.15.69:0/1722131416 >> v2:172.21.15.88:3300/0 conn(0x7fee9c0cb970 0x7fee9c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.757+0000 7fee9a7fc700 1 -- 172.21.15.69:0/1722131416 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19732673 0 0) 0x7fee9c15ae40 con 0x7fee9c0cb5a0 2023-10-06T01:40:12.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.758+0000 7fee9a7fc700 1 -- 172.21.15.69:0/1722131416 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee84003570 con 0x7fee9c0cb5a0 2023-10-06T01:40:12.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.758+0000 7fee9bfff700 1 -- 172.21.15.69:0/1722131416 >> v2:172.21.15.88:3300/0 conn(0x7fee9c0cb970 msgr2=0x7fee9c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:12.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.758+0000 7fee9bfff700 1 --2- 172.21.15.69:0/1722131416 >> v2:172.21.15.88:3300/0 conn(0x7fee9c0cb970 0x7fee9c159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.762 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.758+0000 7fee9bfff700 1 -- 172.21.15.69:0/1722131416 >> v1:172.21.15.69:6789/0 conn(0x7fee9c0cb5a0 legacy=0x7fee9c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.758+0000 7fee9bfff700 1 -- 172.21.15.69:0/1722131416 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee9c15ab60 con 0x7fee9c15a400 2023-10-06T01:40:12.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.758+0000 7fee9affd700 1 --2- 172.21.15.69:0/1722131416 >> v2:172.21.15.88:3300/0 conn(0x7fee9c0cb970 0x7fee9c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:40:12.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.758+0000 7fee9bfff700 1 --2- 172.21.15.69:0/1722131416 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fee9c15a400 0x7fee9c156e90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fee940098e0 tx=0x7fee940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f8e032ddaada1f98 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:12.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.758+0000 7fee9a7fc700 1 -- 172.21.15.69:0/1722131416 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee94011630 con 0x7fee9c15a400 2023-10-06T01:40:12.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.758+0000 7fee9a7fc700 1 -- 172.21.15.69:0/1722131416 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee94011790 con 0x7fee9c15a400 2023-10-06T01:40:12.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.758+0000 7fee9a7fc700 1 -- 172.21.15.69:0/1722131416 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee94011b30 con 0x7fee9c15a400 2023-10-06T01:40:12.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.758+0000 7feea216c700 1 -- 172.21.15.69:0/1722131416 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fee9c15a400 msgr2=0x7fee9c156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.758+0000 7feea216c700 1 --2- 172.21.15.69:0/1722131416 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fee9c15a400 0x7fee9c156e90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fee940098e0 tx=0x7fee940091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.763 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.759+0000 7feea216c700 1 -- 172.21.15.69:0/1722131416 shutdown_connections 2023-10-06T01:40:12.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.759+0000 7feea216c700 1 --2- 172.21.15.69:0/1722131416 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fee9c15a400 0x7fee9c156e90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.759+0000 7feea216c700 1 --2- 172.21.15.69:0/1722131416 >> v2:172.21.15.88:3300/0 conn(0x7fee9c0cb970 0x7fee9c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.759+0000 7feea216c700 1 -- 172.21.15.69:0/1722131416 >> 172.21.15.69:0/1722131416 conn(0x7fee9c070e30 msgr2=0x7fee9c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:12.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.759+0000 7feea216c700 1 -- 172.21.15.69:0/1722131416 shutdown_connections 2023-10-06T01:40:12.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.759+0000 7feea216c700 1 -- 172.21.15.69:0/1722131416 wait complete. 2023-10-06T01:40:12.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.760+0000 7feea216c700 1 Processor -- start 2023-10-06T01:40:12.764 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.760+0000 7feea216c700 1 -- start start 2023-10-06T01:40:12.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.760+0000 7feea216c700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fee9c0cb5a0 0x7fee9c15cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.760+0000 7feea216c700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee9c0cb970 0x7fee9c15bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.760+0000 7feea216c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee9c15a400 0x7fee9c151e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.760+0000 7feea216c700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c15c180 con 0x7fee9c15a400 2023-10-06T01:40:12.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.761+0000 7feea216c700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c1510f0 con 0x7fee9c0cb970 2023-10-06T01:40:12.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.761+0000 7feea216c700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9c151990 con 0x7fee9c0cb5a0 2023-10-06T01:40:12.767 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.761+0000 7fee9bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee9c15a400 0x7fee9c151e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.761+0000 7fee9bfff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee9c15a400 0x7fee9c151e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40222/0 (socket says 172.21.15.69:40222) 2023-10-06T01:40:12.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.761+0000 7fee9bfff700 1 -- 172.21.15.69:0/390955488 learned_addr learned my addr 172.21.15.69:0/390955488 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:12.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.761+0000 7fee9affd700 1 --2- 172.21.15.69:0/390955488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee9c0cb970 0x7fee9c15bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.761+0000 7fee9b7fe700 1 --2- 172.21.15.69:0/390955488 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fee9c0cb5a0 0x7fee9c15cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.761+0000 7fee9bfff700 1 -- 172.21.15.69:0/390955488 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fee9c0cb5a0 msgr2=0x7fee9c15cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.761+0000 7fee9bfff700 1 --2- 172.21.15.69:0/390955488 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fee9c0cb5a0 0x7fee9c15cca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.761+0000 7fee9bfff700 1 -- 172.21.15.69:0/390955488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee9c0cb970 msgr2=0x7fee9c15bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.761+0000 7fee9bfff700 1 --2- 172.21.15.69:0/390955488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee9c0cb970 0x7fee9c15bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.768 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.761+0000 7fee9bfff700 1 -- 172.21.15.69:0/390955488 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee90009420 con 0x7fee9c15a400 2023-10-06T01:40:12.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.761+0000 7fee9bfff700 1 --2- 172.21.15.69:0/390955488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee9c15a400 0x7fee9c151e20 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fee94009ed0 tx=0x7fee94017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:12.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.761+0000 7fee837fe700 1 -- 172.21.15.69:0/390955488 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee940253f0 con 0x7fee9c15a400 2023-10-06T01:40:12.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.761+0000 7fee837fe700 1 -- 172.21.15.69:0/390955488 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee94025570 con 0x7fee9c15a400 2023-10-06T01:40:12.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.761+0000 7feea216c700 1 -- 172.21.15.69:0/390955488 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee94009420 con 0x7fee9c15a400 2023-10-06T01:40:12.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.761+0000 7fee837fe700 1 -- 172.21.15.69:0/390955488 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee94025930 con 0x7fee9c15a400 2023-10-06T01:40:12.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.761+0000 7feea216c700 1 -- 172.21.15.69:0/390955488 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee9c151340 con 0x7fee9c15a400 2023-10-06T01:40:12.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.762+0000 7feea216c700 1 -- 172.21.15.69:0/390955488 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee9c04c3c0 con 0x7fee9c15a400 2023-10-06T01:40:12.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.762+0000 7fee837fe700 1 -- 172.21.15.69:0/390955488 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fee94025d20 con 0x7fee9c15a400 2023-10-06T01:40:12.769 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.763+0000 7fee837fe700 1 --2- 172.21.15.69:0/390955488 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fee880670e0 0x7fee88069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:12.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.763+0000 7fee9b7fe700 1 --2- 172.21.15.69:0/390955488 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fee880670e0 0x7fee88069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:12.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.763+0000 7fee837fe700 1 -- 172.21.15.69:0/390955488 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fee94086170 con 0x7fee9c15a400 2023-10-06T01:40:12.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.763+0000 7fee9b7fe700 1 --2- 172.21.15.69:0/390955488 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fee880670e0 0x7fee88069590 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fee8c005c50 tx=0x7fee8c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:12.770 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.767+0000 7fee837fe700 1 -- 172.21.15.69:0/390955488 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee94053300 con 0x7fee9c15a400 2023-10-06T01:40:12.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.951+0000 7feea216c700 1 -- 172.21.15.69:0/390955488 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7fee9c156510 con 0x7fee880670e0 2023-10-06T01:40:12.953 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.951+0000 7fee837fe700 1 -- 172.21.15.69:0/390955488 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fee9c156510 con 0x7fee880670e0 2023-10-06T01:40:12.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.954+0000 7feea216c700 1 -- 172.21.15.69:0/390955488 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fee880670e0 msgr2=0x7fee88069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.955 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.954+0000 7feea216c700 1 --2- 172.21.15.69:0/390955488 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fee880670e0 0x7fee88069590 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fee8c005c50 tx=0x7fee8c009040 comp rx=0 tx=0).stop 2023-10-06T01:40:12.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.954+0000 7feea216c700 1 -- 172.21.15.69:0/390955488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee9c15a400 msgr2=0x7fee9c151e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:12.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.954+0000 7feea216c700 1 --2- 172.21.15.69:0/390955488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee9c15a400 0x7fee9c151e20 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fee94009ed0 tx=0x7fee94017000 comp rx=0 tx=0).stop 2023-10-06T01:40:12.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.954+0000 7feea216c700 1 -- 172.21.15.69:0/390955488 shutdown_connections 2023-10-06T01:40:12.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.954+0000 7feea216c700 1 --2- 172.21.15.69:0/390955488 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fee880670e0 0x7fee88069590 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.954+0000 7feea216c700 1 --2- 172.21.15.69:0/390955488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee9c15a400 0x7fee9c151e20 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.954+0000 7feea216c700 1 --2- 172.21.15.69:0/390955488 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fee9c0cb5a0 0x7fee9c15cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.954+0000 7feea216c700 1 --2- 172.21.15.69:0/390955488 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fee9c0cb970 0x7fee9c15bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:12.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.954+0000 7feea216c700 1 -- 172.21.15.69:0/390955488 >> 172.21.15.69:0/390955488 conn(0x7fee9c070e30 msgr2=0x7fee9c0b0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:12.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.954+0000 7feea216c700 1 -- 172.21.15.69:0/390955488 shutdown_connections 2023-10-06T01:40:12.956 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:12.954+0000 7feea216c700 1 -- 172.21.15.69:0/390955488 wait complete. 2023-10-06T01:40:12.957 INFO:teuthology.orchestra.run.smithi069.stderr:instructed osd(s) 3 to deep-scrub 2023-10-06T01:40:12.967 INFO:tasks.ceph:Scrubbing osd.4 2023-10-06T01:40:12.967 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-06T01:40:13.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.083+0000 7f210cd31700 1 Processor -- start 2023-10-06T01:40:13.084 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.083+0000 7f210cd31700 1 -- start start 2023-10-06T01:40:13.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.084+0000 7f210cd31700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2108159fb0 0x7f210815a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:13.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.084+0000 7f210cd31700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f210815a8c0 0x7f21080cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:13.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.084+0000 7f210cd31700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21080cd830 con 0x7f21080cd3d0 2023-10-06T01:40:13.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.084+0000 7f210cd31700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f210815e180 con 0x7f210815a8c0 2023-10-06T01:40:13.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.084+0000 7f210cd31700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f210815d570 con 0x7f2108159fb0 2023-10-06T01:40:13.087 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.084+0000 7f21077fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2108159fb0 0x7f210815a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:13.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.084+0000 7f20feffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f210815a8c0 0x7f21080cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:13.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.084+0000 7f21077fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2108159fb0 0x7f210815a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.69:33002/0 (socket says 172.21.15.69:33002) 2023-10-06T01:40:13.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.084+0000 7f20feffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7f210815a8c0 0x7f21080cce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.69:58692/0 (socket says 172.21.15.69:58692) 2023-10-06T01:40:13.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.084+0000 7f21077fe700 1 -- 172.21.15.69:0/3661604788 learned_addr learned my addr 172.21.15.69:0/3661604788 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:13.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.084+0000 7f2107fff700 1 --1- 172.21.15.69:0/3661604788 >> v1:172.21.15.88:6789/0 conn(0x7f21080cd3d0 0x7f210806d830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.69:58484/0 (socket says 172.21.15.69:58484) 2023-10-06T01:40:13.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.084+0000 7f20feffd700 1 -- 172.21.15.69:0/3661604788 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2108159fb0 msgr2=0x7f210815a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:13.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.084+0000 7f20feffd700 1 --2- 172.21.15.69:0/3661604788 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2108159fb0 0x7f210815a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.084+0000 7f20feffd700 1 -- 172.21.15.69:0/3661604788 >> v1:172.21.15.88:6789/0 conn(0x7f21080cd3d0 legacy=0x7f210806d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:13.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.084+0000 7f2106ffd700 1 -- 172.21.15.69:0/3661604788 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 289063504 0 0) 0x7f2100001490 con 0x7f21080cd3d0 2023-10-06T01:40:13.088 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.084+0000 7f20feffd700 1 -- 172.21.15.69:0/3661604788 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f210815d850 con 0x7f210815a8c0 2023-10-06T01:40:13.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.084+0000 7f21077fe700 1 --2- 172.21.15.69:0/3661604788 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2108159fb0 0x7f210815a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:40:13.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.085+0000 7f20feffd700 1 --2- 172.21.15.69:0/3661604788 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f210815a8c0 0x7f21080cce90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f20f00098e0 tx=0x7f20f00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=472914c917842cb1 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:13.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.085+0000 7f2106ffd700 1 -- 172.21.15.69:0/3661604788 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f000b640 con 0x7f210815a8c0 2023-10-06T01:40:13.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.085+0000 7f2106ffd700 1 -- 172.21.15.69:0/3661604788 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f000b7a0 con 0x7f210815a8c0 2023-10-06T01:40:13.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.085+0000 7f2106ffd700 1 -- 172.21.15.69:0/3661604788 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f000bb40 con 0x7f210815a8c0 2023-10-06T01:40:13.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.085+0000 7f210cd31700 1 -- 172.21.15.69:0/3661604788 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f210815a8c0 msgr2=0x7f21080cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:13.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.085+0000 7f210cd31700 1 --2- 172.21.15.69:0/3661604788 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f210815a8c0 0x7f21080cce90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f20f00098e0 tx=0x7f20f00091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.085+0000 7f210cd31700 1 -- 172.21.15.69:0/3661604788 shutdown_connections 2023-10-06T01:40:13.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.085+0000 7f210cd31700 1 --2- 172.21.15.69:0/3661604788 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f2108159fb0 0x7f210815a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.089 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.085+0000 7f210cd31700 1 --2- 172.21.15.69:0/3661604788 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f210815a8c0 0x7f21080cce90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.085+0000 7f210cd31700 1 -- 172.21.15.69:0/3661604788 >> 172.21.15.69:0/3661604788 conn(0x7f21080703a0 msgr2=0x7f21080707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:13.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.085+0000 7f210cd31700 1 -- 172.21.15.69:0/3661604788 shutdown_connections 2023-10-06T01:40:13.090 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.085+0000 7f210cd31700 1 -- 172.21.15.69:0/3661604788 wait complete. 2023-10-06T01:40:13.093 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.086+0000 7f210cd31700 1 Processor -- start 2023-10-06T01:40:13.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.087+0000 7f210cd31700 1 -- start start 2023-10-06T01:40:13.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.087+0000 7f210cd31700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21080cd3d0 0x7f21080b5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:13.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.087+0000 7f210cd31700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2108159fb0 0x7f21080b3770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:13.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.087+0000 7f210cd31700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f210815a8c0 0x7f21080c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:13.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.087+0000 7f210cd31700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21080b5bb0 con 0x7f210815a8c0 2023-10-06T01:40:13.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.087+0000 7f210cd31700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21080b13c0 con 0x7f2108159fb0 2023-10-06T01:40:13.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.087+0000 7f210cd31700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21080b3cb0 con 0x7f21080cd3d0 2023-10-06T01:40:13.094 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.087+0000 7f2107fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f210815a8c0 0x7f21080c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:13.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.087+0000 7f2107fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f210815a8c0 0x7f21080c8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40232/0 (socket says 172.21.15.69:40232) 2023-10-06T01:40:13.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.087+0000 7f2107fff700 1 -- 172.21.15.69:0/3216782719 learned_addr learned my addr 172.21.15.69:0/3216782719 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:13.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.088+0000 7f20feffd700 1 --2- 172.21.15.69:0/3216782719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2108159fb0 0x7f21080b3770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:13.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.088+0000 7f21077fe700 1 --2- 172.21.15.69:0/3216782719 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21080cd3d0 0x7f21080b5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:13.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.088+0000 7f2107fff700 1 -- 172.21.15.69:0/3216782719 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21080cd3d0 msgr2=0x7f21080b5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:13.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.088+0000 7f2107fff700 1 --2- 172.21.15.69:0/3216782719 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21080cd3d0 0x7f21080b5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.088+0000 7f2107fff700 1 -- 172.21.15.69:0/3216782719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2108159fb0 msgr2=0x7f21080b3770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:13.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.088+0000 7f2107fff700 1 --2- 172.21.15.69:0/3216782719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2108159fb0 0x7f21080b3770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.088+0000 7f2107fff700 1 -- 172.21.15.69:0/3216782719 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f80094f0 con 0x7f210815a8c0 2023-10-06T01:40:13.095 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.088+0000 7f20feffd700 1 --2- 172.21.15.69:0/3216782719 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f2108159fb0 0x7f21080b3770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:13.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.088+0000 7f21077fe700 1 --2- 172.21.15.69:0/3216782719 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f21080cd3d0 0x7f21080b5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:13.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.088+0000 7f2107fff700 1 --2- 172.21.15.69:0/3216782719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f210815a8c0 0x7f21080c8fd0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f210000cd50 tx=0x7f2100001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:13.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.088+0000 7f20fffff700 1 -- 172.21.15.69:0/3216782719 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2100005df0 con 0x7f210815a8c0 2023-10-06T01:40:13.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.088+0000 7f20fffff700 1 -- 172.21.15.69:0/3216782719 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210000a900 con 0x7f210815a8c0 2023-10-06T01:40:13.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.088+0000 7f20fffff700 1 -- 172.21.15.69:0/3216782719 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210000acc0 con 0x7f210815a8c0 2023-10-06T01:40:13.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.088+0000 7f210cd31700 1 -- 172.21.15.69:0/3216782719 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f0009420 con 0x7f210815a8c0 2023-10-06T01:40:13.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.088+0000 7f210cd31700 1 -- 172.21.15.69:0/3216782719 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21080b0a90 con 0x7f210815a8c0 2023-10-06T01:40:13.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.089+0000 7f210cd31700 1 -- 172.21.15.69:0/3216782719 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f210804c3c0 con 0x7f210815a8c0 2023-10-06T01:40:13.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.089+0000 7f20fffff700 1 -- 172.21.15.69:0/3216782719 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f2100007300 con 0x7f210815a8c0 2023-10-06T01:40:13.096 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.090+0000 7f20fffff700 1 --2- 172.21.15.69:0/3216782719 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f20e80670e0 0x7f20e8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:13.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.090+0000 7f20fffff700 1 -- 172.21.15.69:0/3216782719 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f21000846c0 con 0x7f210815a8c0 2023-10-06T01:40:13.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.090+0000 7f21077fe700 1 --2- 172.21.15.69:0/3216782719 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f20e80670e0 0x7f20e8069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:13.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.090+0000 7f20fffff700 1 --2- 172.21.15.69:0/3216782719 >> [v2:172.21.15.88:6808/90870,v1:172.21.15.88:6809/90870] conn(0x7f20e806d550 0x7f20e806f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:13.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.090+0000 7f20fffff700 1 -- 172.21.15.69:0/3216782719 --> [v2:172.21.15.88:6808/90870,v1:172.21.15.88:6809/90870] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f20e8070030 con 0x7f20e806d550 2023-10-06T01:40:13.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.090+0000 7f20fffff700 1 -- 172.21.15.69:0/3216782719 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2100086c80 con 0x7f210815a8c0 2023-10-06T01:40:13.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.090+0000 7f20feffd700 1 --2- 172.21.15.69:0/3216782719 >> [v2:172.21.15.88:6808/90870,v1:172.21.15.88:6809/90870] conn(0x7f20e806d550 0x7f20e806f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:13.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.090+0000 7f21077fe700 1 --2- 172.21.15.69:0/3216782719 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f20e80670e0 0x7f20e8069590 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f20f8006d40 tx=0x7f20f8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:13.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.091+0000 7f20feffd700 1 --2- 172.21.15.69:0/3216782719 >> [v2:172.21.15.88:6808/90870,v1:172.21.15.88:6809/90870] conn(0x7f20e806d550 0x7f20e806f960 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:13.097 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.091+0000 7f20fffff700 1 -- 172.21.15.69:0/3216782719 <== osd.4 v2:172.21.15.88:6808/90870 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f20e8070030 con 0x7f20e806d550 2023-10-06T01:40:13.106 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.105+0000 7f210cd31700 1 -- 172.21.15.69:0/3216782719 --> [v2:172.21.15.88:6808/90870,v1:172.21.15.88:6809/90870] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f21080cd830 con 0x7f20e806d550 2023-10-06T01:40:13.107 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.105+0000 7f20fffff700 1 -- 172.21.15.69:0/3216782719 <== osd.4 v2:172.21.15.88:6808/90870 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f21080cd830 con 0x7f20e806d550 2023-10-06T01:40:13.108 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-10-06T01:40:13.108 INFO:teuthology.orchestra.run.smithi069.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T01:40:13.108 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-10-06T01:40:13.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.106+0000 7f210cd31700 1 -- 172.21.15.69:0/3216782719 >> [v2:172.21.15.88:6808/90870,v1:172.21.15.88:6809/90870] conn(0x7f20e806d550 msgr2=0x7f20e806f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:13.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.106+0000 7f210cd31700 1 --2- 172.21.15.69:0/3216782719 >> [v2:172.21.15.88:6808/90870,v1:172.21.15.88:6809/90870] conn(0x7f20e806d550 0x7f20e806f960 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.106+0000 7f210cd31700 1 -- 172.21.15.69:0/3216782719 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f20e80670e0 msgr2=0x7f20e8069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:13.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.106+0000 7f210cd31700 1 --2- 172.21.15.69:0/3216782719 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f20e80670e0 0x7f20e8069590 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f20f8006d40 tx=0x7f20f8008040 comp rx=0 tx=0).stop 2023-10-06T01:40:13.109 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.106+0000 7f210cd31700 1 -- 172.21.15.69:0/3216782719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f210815a8c0 msgr2=0x7f21080c8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:13.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.106+0000 7f210cd31700 1 --2- 172.21.15.69:0/3216782719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f210815a8c0 0x7f21080c8fd0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f210000cd50 tx=0x7f2100001b10 comp rx=0 tx=0).stop 2023-10-06T01:40:13.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.106+0000 7f2107fff700 1 -- 172.21.15.69:0/3216782719 reap_dead start 2023-10-06T01:40:13.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.106+0000 7f210cd31700 1 -- 172.21.15.69:0/3216782719 shutdown_connections 2023-10-06T01:40:13.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.106+0000 7f210cd31700 1 -- 172.21.15.69:0/3216782719 >> 172.21.15.69:0/3216782719 conn(0x7f21080703a0 msgr2=0x7f210815b290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:13.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.106+0000 7f210cd31700 1 -- 172.21.15.69:0/3216782719 shutdown_connections 2023-10-06T01:40:13.110 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.106+0000 7f210cd31700 1 -- 172.21.15.69:0/3216782719 wait complete. 2023-10-06T01:40:13.119 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-06T01:40:13.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.232+0000 7fde624c1700 1 Processor -- start 2023-10-06T01:40:13.233 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.232+0000 7fde624c1700 1 -- start start 2023-10-06T01:40:13.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.232+0000 7fde624c1700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fde5c0cb5a0 0x7fde5c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:13.235 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.232+0000 7fde624c1700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fde5c0cd9e0 0x7fde5c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:13.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.233+0000 7fde624c1700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde5c15ae40 con 0x7fde5c0cde50 2023-10-06T01:40:13.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.233+0000 7fde624c1700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde5c0d13f0 con 0x7fde5c0cd9e0 2023-10-06T01:40:13.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.233+0000 7fde624c1700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c15ab60 con 0x7fde5c0cb5a0 2023-10-06T01:40:13.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.233+0000 7fde5b7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fde5c0cd9e0 0x7fde5c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:13.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.233+0000 7fde60a5e700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fde5c0cde50 0x7fde5c156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:60368/0 (socket says 172.21.15.69:60368) 2023-10-06T01:40:13.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.233+0000 7fde60a5e700 1 -- 172.21.15.69:0/2994489331 learned_addr learned my addr 172.21.15.69:0/2994489331 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:40:13.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.233+0000 7fde5b7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fde5c0cd9e0 0x7fde5c159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40242/0 (socket says 172.21.15.69:40242) 2023-10-06T01:40:13.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.233+0000 7fde5b7fe700 1 -- 172.21.15.69:0/2994489331 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fde5c0cb5a0 msgr2=0x7fde5c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:13.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.233+0000 7fde5bfff700 1 --2- 172.21.15.69:0/2994489331 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fde5c0cb5a0 0x7fde5c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:13.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.233+0000 7fde5b7fe700 1 --2- 172.21.15.69:0/2994489331 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fde5c0cb5a0 0x7fde5c0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.236 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.233+0000 7fde5affd700 1 -- 172.21.15.69:0/2994489331 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 364487185 0 0) 0x7fde5c15ae40 con 0x7fde5c0cde50 2023-10-06T01:40:13.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.233+0000 7fde5b7fe700 1 -- 172.21.15.69:0/2994489331 >> v1:172.21.15.69:6789/0 conn(0x7fde5c0cde50 legacy=0x7fde5c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:13.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.233+0000 7fde5b7fe700 1 -- 172.21.15.69:0/2994489331 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde5c0ccf00 con 0x7fde5c0cd9e0 2023-10-06T01:40:13.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.233+0000 7fde5b7fe700 1 --2- 172.21.15.69:0/2994489331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde5c0cd9e0 0x7fde5c159ec0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fde500098e0 tx=0x7fde500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842b56c261eead31 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:13.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.233+0000 7fde5affd700 1 -- 172.21.15.69:0/2994489331 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde50009e80 con 0x7fde5c0cd9e0 2023-10-06T01:40:13.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.233+0000 7fde5affd700 1 -- 172.21.15.69:0/2994489331 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde5000b860 con 0x7fde5c0cd9e0 2023-10-06T01:40:13.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.233+0000 7fde5affd700 1 -- 172.21.15.69:0/2994489331 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5000bbe0 con 0x7fde5c0cd9e0 2023-10-06T01:40:13.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.234+0000 7fde624c1700 1 -- 172.21.15.69:0/2994489331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde5c0cd9e0 msgr2=0x7fde5c159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:13.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.234+0000 7fde624c1700 1 --2- 172.21.15.69:0/2994489331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde5c0cd9e0 0x7fde5c159ec0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fde500098e0 tx=0x7fde500091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.234+0000 7fde624c1700 1 -- 172.21.15.69:0/2994489331 shutdown_connections 2023-10-06T01:40:13.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.234+0000 7fde624c1700 1 --2- 172.21.15.69:0/2994489331 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fde5c0cb5a0 0x7fde5c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.237 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.234+0000 7fde624c1700 1 --2- 172.21.15.69:0/2994489331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde5c0cd9e0 0x7fde5c159ec0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.234+0000 7fde624c1700 1 -- 172.21.15.69:0/2994489331 >> 172.21.15.69:0/2994489331 conn(0x7fde5c070e30 msgr2=0x7fde5c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:13.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.234+0000 7fde624c1700 1 -- 172.21.15.69:0/2994489331 shutdown_connections 2023-10-06T01:40:13.238 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.234+0000 7fde624c1700 1 -- 172.21.15.69:0/2994489331 wait complete. 2023-10-06T01:40:13.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.235+0000 7fde624c1700 1 Processor -- start 2023-10-06T01:40:13.240 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.235+0000 7fde624c1700 1 -- start start 2023-10-06T01:40:13.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.236+0000 7fde624c1700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fde5c0cb5a0 0x7fde5c156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:13.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.236+0000 7fde624c1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde5c0cd9e0 0x7fde5c0c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:13.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.236+0000 7fde624c1700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde5c0ca000 0x7fde5c0b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:13.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.236+0000 7fde624c1700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c0b5320 con 0x7fde5c0cd9e0 2023-10-06T01:40:13.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.236+0000 7fde624c1700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c0b4710 con 0x7fde5c0ca000 2023-10-06T01:40:13.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.236+0000 7fde624c1700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde5c0b49f0 con 0x7fde5c0cb5a0 2023-10-06T01:40:13.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.236+0000 7fde5b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde5c0cd9e0 0x7fde5c0c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:13.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.236+0000 7fde5b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde5c0cd9e0 0x7fde5c0c9ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40250/0 (socket says 172.21.15.69:40250) 2023-10-06T01:40:13.241 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.236+0000 7fde5b7fe700 1 -- 172.21.15.69:0/3109955660 learned_addr learned my addr 172.21.15.69:0/3109955660 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:13.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.236+0000 7fde5bfff700 1 --2- 172.21.15.69:0/3109955660 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fde5c0cb5a0 0x7fde5c156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:13.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.236+0000 7fde60a5e700 1 --2- 172.21.15.69:0/3109955660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde5c0ca000 0x7fde5c0b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:13.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.236+0000 7fde5b7fe700 1 -- 172.21.15.69:0/3109955660 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fde5c0cb5a0 msgr2=0x7fde5c156200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:13.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.236+0000 7fde5b7fe700 1 --2- 172.21.15.69:0/3109955660 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fde5c0cb5a0 0x7fde5c156200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.236+0000 7fde5b7fe700 1 -- 172.21.15.69:0/3109955660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde5c0ca000 msgr2=0x7fde5c0b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:13.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.236+0000 7fde5b7fe700 1 --2- 172.21.15.69:0/3109955660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde5c0ca000 0x7fde5c0b39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.236+0000 7fde5b7fe700 1 -- 172.21.15.69:0/3109955660 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde50009420 con 0x7fde5c0cd9e0 2023-10-06T01:40:13.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.236+0000 7fde5b7fe700 1 --2- 172.21.15.69:0/3109955660 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde5c0cd9e0 0x7fde5c0c9ac0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fde5c06ea60 tx=0x7fde50017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:13.242 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.237+0000 7fde43fff700 1 -- 172.21.15.69:0/3109955660 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde5000bbe0 con 0x7fde5c0cd9e0 2023-10-06T01:40:13.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.237+0000 7fde43fff700 1 -- 172.21.15.69:0/3109955660 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde50000cc0 con 0x7fde5c0cd9e0 2023-10-06T01:40:13.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.237+0000 7fde624c1700 1 -- 172.21.15.69:0/3109955660 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde5c0b4cd0 con 0x7fde5c0cd9e0 2023-10-06T01:40:13.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.237+0000 7fde43fff700 1 -- 172.21.15.69:0/3109955660 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde50011670 con 0x7fde5c0cd9e0 2023-10-06T01:40:13.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.237+0000 7fde624c1700 1 -- 172.21.15.69:0/3109955660 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde5c156740 con 0x7fde5c0cd9e0 2023-10-06T01:40:13.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.238+0000 7fde624c1700 1 -- 172.21.15.69:0/3109955660 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde5c04c3c0 con 0x7fde5c0cd9e0 2023-10-06T01:40:13.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.238+0000 7fde43fff700 1 -- 172.21.15.69:0/3109955660 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fde50011a60 con 0x7fde5c0cd9e0 2023-10-06T01:40:13.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.238+0000 7fde43fff700 1 --2- 172.21.15.69:0/3109955660 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fde480670e0 0x7fde48069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:13.243 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.238+0000 7fde43fff700 1 -- 172.21.15.69:0/3109955660 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fde50085ff0 con 0x7fde5c0cd9e0 2023-10-06T01:40:13.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.238+0000 7fde5bfff700 1 --2- 172.21.15.69:0/3109955660 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fde480670e0 0x7fde48069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:13.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.239+0000 7fde5bfff700 1 --2- 172.21.15.69:0/3109955660 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fde480670e0 0x7fde48069590 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fde4c00ac20 tx=0x7fde4c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:13.244 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.243+0000 7fde43fff700 1 -- 172.21.15.69:0/3109955660 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde50053180 con 0x7fde5c0cd9e0 2023-10-06T01:40:13.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.427+0000 7fde624c1700 1 -- 172.21.15.69:0/3109955660 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fde5c0cd1e0 con 0x7fde480670e0 2023-10-06T01:40:13.429 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.428+0000 7fde43fff700 1 -- 172.21.15.69:0/3109955660 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fde5c0cd1e0 con 0x7fde480670e0 2023-10-06T01:40:13.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.430+0000 7fde624c1700 1 -- 172.21.15.69:0/3109955660 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fde480670e0 msgr2=0x7fde48069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:13.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.430+0000 7fde624c1700 1 --2- 172.21.15.69:0/3109955660 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fde480670e0 0x7fde48069590 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fde4c00ac20 tx=0x7fde4c008040 comp rx=0 tx=0).stop 2023-10-06T01:40:13.431 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.430+0000 7fde624c1700 1 -- 172.21.15.69:0/3109955660 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde5c0cd9e0 msgr2=0x7fde5c0c9ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:13.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.430+0000 7fde624c1700 1 --2- 172.21.15.69:0/3109955660 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde5c0cd9e0 0x7fde5c0c9ac0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fde5c06ea60 tx=0x7fde50017000 comp rx=0 tx=0).stop 2023-10-06T01:40:13.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.430+0000 7fde624c1700 1 -- 172.21.15.69:0/3109955660 shutdown_connections 2023-10-06T01:40:13.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.430+0000 7fde624c1700 1 --2- 172.21.15.69:0/3109955660 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fde480670e0 0x7fde48069590 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.430+0000 7fde624c1700 1 --2- 172.21.15.69:0/3109955660 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fde5c0ca000 0x7fde5c0b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.430+0000 7fde624c1700 1 --2- 172.21.15.69:0/3109955660 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fde5c0cb5a0 0x7fde5c156200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.430+0000 7fde624c1700 1 --2- 172.21.15.69:0/3109955660 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fde5c0cd9e0 0x7fde5c0c9ac0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.430+0000 7fde624c1700 1 -- 172.21.15.69:0/3109955660 >> 172.21.15.69:0/3109955660 conn(0x7fde5c070e30 msgr2=0x7fde5c0b11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:13.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.430+0000 7fde624c1700 1 -- 172.21.15.69:0/3109955660 shutdown_connections 2023-10-06T01:40:13.432 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.430+0000 7fde624c1700 1 -- 172.21.15.69:0/3109955660 wait complete. 2023-10-06T01:40:13.433 INFO:teuthology.orchestra.run.smithi069.stderr:instructed osd(s) 4 to deep-scrub 2023-10-06T01:40:13.443 INFO:tasks.ceph:Scrubbing osd.5 2023-10-06T01:40:13.443 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-06T01:40:13.561 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.560+0000 7f19f3b35700 1 Processor -- start 2023-10-06T01:40:13.562 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.560+0000 7f19f3b35700 1 -- start start 2023-10-06T01:40:13.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.561+0000 7f19f3b35700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19ec0cb880 0x7f19ec0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:13.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.561+0000 7f19f3b35700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f19ec0b04f0 0x7f19ec0cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:13.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.561+0000 7f19f3b35700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19ec0cf330 con 0x7f19ec0cd5a0 2023-10-06T01:40:13.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.561+0000 7f19f3b35700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19ec0cead0 con 0x7f19ec0b04f0 2023-10-06T01:40:13.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.561+0000 7f19f3b35700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec0cddd0 con 0x7f19ec0cb880 2023-10-06T01:40:13.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.561+0000 7f19f10d0700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f19ec0b04f0 0x7f19ec0cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:13.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.561+0000 7f19f10d0700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f19ec0b04f0 0x7f19ec0cd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40260/0 (socket says 172.21.15.69:40260) 2023-10-06T01:40:13.564 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.561+0000 7f19f10d0700 1 -- 172.21.15.69:0/3548005714 learned_addr learned my addr 172.21.15.69:0/3548005714 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:13.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.561+0000 7f19f18d1700 1 --2- 172.21.15.69:0/3548005714 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19ec0cb880 0x7f19ec0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:13.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.561+0000 7f19f10d0700 1 -- 172.21.15.69:0/3548005714 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19ec0cb880 msgr2=0x7f19ec0cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:13.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.561+0000 7f19f10d0700 1 --2- 172.21.15.69:0/3548005714 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19ec0cb880 0x7f19ec0cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.561+0000 7f19f10d0700 1 -- 172.21.15.69:0/3548005714 >> v1:172.21.15.88:6789/0 conn(0x7f19ec0cd5a0 legacy=0x7f19ec1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:13.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.561+0000 7f19f10d0700 1 -- 172.21.15.69:0/3548005714 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19ec0cece0 con 0x7f19ec0b04f0 2023-10-06T01:40:13.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.561+0000 7f19f18d1700 1 --2- 172.21.15.69:0/3548005714 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19ec0cb880 0x7f19ec0cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:40:13.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.562+0000 7f19f10d0700 1 --2- 172.21.15.69:0/3548005714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19ec0b04f0 0x7f19ec0cd060 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f19e00099b0 tx=0x7f19e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77f2fd8c03fe76c server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:13.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.562+0000 7f19f08cf700 1 -- 172.21.15.69:0/3548005714 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e000b820 con 0x7f19ec0b04f0 2023-10-06T01:40:13.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.562+0000 7f19f08cf700 1 -- 172.21.15.69:0/3548005714 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19e000b980 con 0x7f19ec0b04f0 2023-10-06T01:40:13.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.562+0000 7f19f08cf700 1 -- 172.21.15.69:0/3548005714 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19e000bd20 con 0x7f19ec0b04f0 2023-10-06T01:40:13.565 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.562+0000 7f19f3b35700 1 -- 172.21.15.69:0/3548005714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19ec0b04f0 msgr2=0x7f19ec0cd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:13.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.562+0000 7f19f3b35700 1 --2- 172.21.15.69:0/3548005714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19ec0b04f0 0x7f19ec0cd060 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f19e00099b0 tx=0x7f19e0009250 comp rx=0 tx=0).stop 2023-10-06T01:40:13.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.562+0000 7f19f3b35700 1 -- 172.21.15.69:0/3548005714 shutdown_connections 2023-10-06T01:40:13.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.562+0000 7f19f3b35700 1 --2- 172.21.15.69:0/3548005714 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19ec0cb880 0x7f19ec0cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.562+0000 7f19f3b35700 1 --2- 172.21.15.69:0/3548005714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19ec0b04f0 0x7f19ec0cd060 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.562+0000 7f19f3b35700 1 -- 172.21.15.69:0/3548005714 >> 172.21.15.69:0/3548005714 conn(0x7f19ec0703a0 msgr2=0x7f19ec0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:13.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.562+0000 7f19f3b35700 1 -- 172.21.15.69:0/3548005714 shutdown_connections 2023-10-06T01:40:13.566 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.562+0000 7f19f3b35700 1 -- 172.21.15.69:0/3548005714 wait complete. 2023-10-06T01:40:13.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.563+0000 7f19f3b35700 1 Processor -- start 2023-10-06T01:40:13.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.563+0000 7f19f3b35700 1 -- start start 2023-10-06T01:40:13.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.564+0000 7f19f3b35700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19ec0b04f0 0x7f19ec0c9da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:13.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.564+0000 7f19f3b35700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19ec0cb880 0x7f19ec0c64e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:13.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.564+0000 7f19f3b35700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19ec0cd5a0 0x7f19ec0c6a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:13.569 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.564+0000 7f19f3b35700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec0c9910 con 0x7f19ec0b04f0 2023-10-06T01:40:13.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.564+0000 7f19f3b35700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec0c8a20 con 0x7f19ec0cd5a0 2023-10-06T01:40:13.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.564+0000 7f19f3b35700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19ec0c8d00 con 0x7f19ec0cb880 2023-10-06T01:40:13.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.564+0000 7f19f18d1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19ec0b04f0 0x7f19ec0c9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:13.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.564+0000 7f19f18d1700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19ec0b04f0 0x7f19ec0c9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40268/0 (socket says 172.21.15.69:40268) 2023-10-06T01:40:13.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.564+0000 7f19f18d1700 1 -- 172.21.15.69:0/2979744495 learned_addr learned my addr 172.21.15.69:0/2979744495 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:13.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.564+0000 7f19f10d0700 1 --2- 172.21.15.69:0/2979744495 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19ec0cb880 0x7f19ec0c64e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:13.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.564+0000 7f19f20d2700 1 --2- 172.21.15.69:0/2979744495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19ec0cd5a0 0x7f19ec0c6a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:13.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.565+0000 7f19f18d1700 1 -- 172.21.15.69:0/2979744495 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19ec0cb880 msgr2=0x7f19ec0c64e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:13.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.565+0000 7f19f18d1700 1 --2- 172.21.15.69:0/2979744495 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19ec0cb880 0x7f19ec0c64e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.570 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.565+0000 7f19f18d1700 1 -- 172.21.15.69:0/2979744495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19ec0cd5a0 msgr2=0x7f19ec0c6a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:13.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.565+0000 7f19f18d1700 1 --2- 172.21.15.69:0/2979744495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19ec0cd5a0 0x7f19ec0c6a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.565+0000 7f19f18d1700 1 -- 172.21.15.69:0/2979744495 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e00094f0 con 0x7f19ec0b04f0 2023-10-06T01:40:13.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.565+0000 7f19f20d2700 1 --2- 172.21.15.69:0/2979744495 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f19ec0cd5a0 0x7f19ec0c6a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:13.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.565+0000 7f19f10d0700 1 --2- 172.21.15.69:0/2979744495 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f19ec0cb880 0x7f19ec0c64e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:13.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.565+0000 7f19f18d1700 1 --2- 172.21.15.69:0/2979744495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19ec0b04f0 0x7f19ec0c9da0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f19dc00a400 tx=0x7f19dc007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:13.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.565+0000 7f19e9ffb700 1 -- 172.21.15.69:0/2979744495 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc00d650 con 0x7f19ec0b04f0 2023-10-06T01:40:13.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.565+0000 7f19e9ffb700 1 -- 172.21.15.69:0/2979744495 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19dc00d7b0 con 0x7f19ec0b04f0 2023-10-06T01:40:13.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.565+0000 7f19e9ffb700 1 -- 172.21.15.69:0/2979744495 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19dc00db50 con 0x7f19ec0b04f0 2023-10-06T01:40:13.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.565+0000 7f19f3b35700 1 -- 172.21.15.69:0/2979744495 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19ec0c8fe0 con 0x7f19ec0b04f0 2023-10-06T01:40:13.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.565+0000 7f19f3b35700 1 -- 172.21.15.69:0/2979744495 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19ec0c95a0 con 0x7f19ec0b04f0 2023-10-06T01:40:13.571 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.566+0000 7f19f3b35700 1 -- 172.21.15.69:0/2979744495 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f19ec04c3c0 con 0x7f19ec0b04f0 2023-10-06T01:40:13.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.566+0000 7f19e9ffb700 1 -- 172.21.15.69:0/2979744495 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f19dc015440 con 0x7f19ec0b04f0 2023-10-06T01:40:13.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.567+0000 7f19e9ffb700 1 --2- 172.21.15.69:0/2979744495 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f19d80670e0 0x7f19d8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:13.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.567+0000 7f19e9ffb700 1 -- 172.21.15.69:0/2979744495 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f19dc084f50 con 0x7f19ec0b04f0 2023-10-06T01:40:13.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.567+0000 7f19f10d0700 1 --2- 172.21.15.69:0/2979744495 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f19d80670e0 0x7f19d8069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:13.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.567+0000 7f19e9ffb700 1 --2- 172.21.15.69:0/2979744495 >> [v2:172.21.15.88:6800/90871,v1:172.21.15.88:6801/90871] conn(0x7f19d806d550 0x7f19d806f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:13.572 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.567+0000 7f19e9ffb700 1 -- 172.21.15.69:0/2979744495 --> [v2:172.21.15.88:6800/90871,v1:172.21.15.88:6801/90871] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f19d8070030 con 0x7f19d806d550 2023-10-06T01:40:13.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.567+0000 7f19e9ffb700 1 -- 172.21.15.69:0/2979744495 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f19dc087570 con 0x7f19ec0b04f0 2023-10-06T01:40:13.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.567+0000 7f19f20d2700 1 --2- 172.21.15.69:0/2979744495 >> [v2:172.21.15.88:6800/90871,v1:172.21.15.88:6801/90871] conn(0x7f19d806d550 0x7f19d806f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:13.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.567+0000 7f19f10d0700 1 --2- 172.21.15.69:0/2979744495 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f19d80670e0 0x7f19d8069590 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f19e00099b0 tx=0x7f19e0016000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:13.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.567+0000 7f19f20d2700 1 --2- 172.21.15.69:0/2979744495 >> [v2:172.21.15.88:6800/90871,v1:172.21.15.88:6801/90871] conn(0x7f19d806d550 0x7f19d806f960 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:13.573 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.568+0000 7f19e9ffb700 1 -- 172.21.15.69:0/2979744495 <== osd.5 v2:172.21.15.88:6800/90871 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f19d8070030 con 0x7f19d806d550 2023-10-06T01:40:13.583 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.582+0000 7f19f3b35700 1 -- 172.21.15.69:0/2979744495 --> [v2:172.21.15.88:6800/90871,v1:172.21.15.88:6801/90871] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f19ec0ce680 con 0x7f19d806d550 2023-10-06T01:40:13.584 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.582+0000 7f19e9ffb700 1 -- 172.21.15.69:0/2979744495 <== osd.5 v2:172.21.15.88:6800/90871 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f19ec0ce680 con 0x7f19d806d550 2023-10-06T01:40:13.584 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-10-06T01:40:13.584 INFO:teuthology.orchestra.run.smithi069.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T01:40:13.585 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-10-06T01:40:13.585 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.583+0000 7f19f3b35700 1 -- 172.21.15.69:0/2979744495 >> [v2:172.21.15.88:6800/90871,v1:172.21.15.88:6801/90871] conn(0x7f19d806d550 msgr2=0x7f19d806f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:13.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.583+0000 7f19f3b35700 1 --2- 172.21.15.69:0/2979744495 >> [v2:172.21.15.88:6800/90871,v1:172.21.15.88:6801/90871] conn(0x7f19d806d550 0x7f19d806f960 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.583+0000 7f19f3b35700 1 -- 172.21.15.69:0/2979744495 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f19d80670e0 msgr2=0x7f19d8069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:13.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.583+0000 7f19f3b35700 1 --2- 172.21.15.69:0/2979744495 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f19d80670e0 0x7f19d8069590 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f19e00099b0 tx=0x7f19e0016000 comp rx=0 tx=0).stop 2023-10-06T01:40:13.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.583+0000 7f19f3b35700 1 -- 172.21.15.69:0/2979744495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19ec0b04f0 msgr2=0x7f19ec0c9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:13.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.583+0000 7f19f3b35700 1 --2- 172.21.15.69:0/2979744495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f19ec0b04f0 0x7f19ec0c9da0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f19dc00a400 tx=0x7f19dc007910 comp rx=0 tx=0).stop 2023-10-06T01:40:13.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.583+0000 7f19f20d2700 1 -- 172.21.15.69:0/2979744495 reap_dead start 2023-10-06T01:40:13.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.583+0000 7f19f3b35700 1 -- 172.21.15.69:0/2979744495 shutdown_connections 2023-10-06T01:40:13.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.583+0000 7f19f3b35700 1 -- 172.21.15.69:0/2979744495 >> 172.21.15.69:0/2979744495 conn(0x7f19ec0703a0 msgr2=0x7f19ec0b1e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:13.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.583+0000 7f19f3b35700 1 -- 172.21.15.69:0/2979744495 shutdown_connections 2023-10-06T01:40:13.586 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.583+0000 7f19f3b35700 1 -- 172.21.15.69:0/2979744495 wait complete. 2023-10-06T01:40:13.596 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-06T01:40:13.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.710+0000 7fe536054700 1 Processor -- start 2023-10-06T01:40:13.711 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.710+0000 7fe536054700 1 -- start start 2023-10-06T01:40:13.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.711+0000 7fe536054700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe53015de50 0x7fe5300cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:13.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.711+0000 7fe536054700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5300cf3c0 con 0x7fe530153c30 2023-10-06T01:40:13.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.711+0000 7fe536054700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe53015afd0 con 0x7fe5300cef40 2023-10-06T01:40:13.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.711+0000 7fe536054700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe53015b2b0 con 0x7fe53015de50 2023-10-06T01:40:13.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.711+0000 7fe535052700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fe530153c30 0x7fe53015a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:60374/0 (socket says 172.21.15.69:60374) 2023-10-06T01:40:13.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.711+0000 7fe535052700 1 -- 172.21.15.69:0/831429509 learned_addr learned my addr 172.21.15.69:0/831429509 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:40:13.714 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.711+0000 7fe534851700 1 --2- 172.21.15.69:0/831429509 >> v2:172.21.15.88:3300/0 conn(0x7fe53015de50 0x7fe5300cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:13.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.711+0000 7fe527fff700 1 -- 172.21.15.69:0/831429509 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2010790975 0 0) 0x7fe5300cf3c0 con 0x7fe530153c30 2023-10-06T01:40:13.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.711+0000 7fe527fff700 1 -- 172.21.15.69:0/831429509 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe51c003570 con 0x7fe530153c30 2023-10-06T01:40:13.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.711+0000 7fe527fff700 1 -- 172.21.15.69:0/831429509 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1125595299 0 0) 0x7fe53015afd0 con 0x7fe5300cef40 2023-10-06T01:40:13.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.711+0000 7fe527fff700 1 -- 172.21.15.69:0/831429509 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5300cf3c0 con 0x7fe5300cef40 2023-10-06T01:40:13.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.711+0000 7fe527fff700 1 -- 172.21.15.69:0/831429509 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3977787522 0 0) 0x7fe51c003570 con 0x7fe530153c30 2023-10-06T01:40:13.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.712+0000 7fe534851700 1 -- 172.21.15.69:0/831429509 >> v1:172.21.15.88:6789/0 conn(0x7fe5300cef40 legacy=0x7fe53015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:13.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.712+0000 7fe534851700 1 -- 172.21.15.69:0/831429509 >> v1:172.21.15.69:6789/0 conn(0x7fe530153c30 legacy=0x7fe53015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:13.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.712+0000 7fe534851700 1 -- 172.21.15.69:0/831429509 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe53015b590 con 0x7fe53015de50 2023-10-06T01:40:13.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.712+0000 7fe534851700 1 --2- 172.21.15.69:0/831429509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe53015de50 0x7fe5300cea00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe5200098e0 tx=0x7fe5200091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=151b791328e60fcb server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:13.715 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.712+0000 7fe527fff700 1 -- 172.21.15.69:0/831429509 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52c001470 con 0x7fe53015de50 2023-10-06T01:40:13.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.712+0000 7fe527fff700 1 -- 172.21.15.69:0/831429509 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe520011420 con 0x7fe53015de50 2023-10-06T01:40:13.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.712+0000 7fe527fff700 1 -- 172.21.15.69:0/831429509 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5200117c0 con 0x7fe53015de50 2023-10-06T01:40:13.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.712+0000 7fe536054700 1 -- 172.21.15.69:0/831429509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe53015de50 msgr2=0x7fe5300cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:13.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.712+0000 7fe536054700 1 --2- 172.21.15.69:0/831429509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe53015de50 0x7fe5300cea00 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe5200098e0 tx=0x7fe5200091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.712+0000 7fe536054700 1 -- 172.21.15.69:0/831429509 shutdown_connections 2023-10-06T01:40:13.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.712+0000 7fe536054700 1 --2- 172.21.15.69:0/831429509 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe53015de50 0x7fe5300cea00 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.712+0000 7fe536054700 1 -- 172.21.15.69:0/831429509 >> 172.21.15.69:0/831429509 conn(0x7fe5300703a0 msgr2=0x7fe5300707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:13.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.712+0000 7fe536054700 1 -- 172.21.15.69:0/831429509 shutdown_connections 2023-10-06T01:40:13.716 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.713+0000 7fe536054700 1 -- 172.21.15.69:0/831429509 wait complete. 2023-10-06T01:40:13.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.713+0000 7fe536054700 1 Processor -- start 2023-10-06T01:40:13.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.714+0000 7fe536054700 1 -- start start 2023-10-06T01:40:13.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.714+0000 7fe536054700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5300cef40 0x7fe530152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:13.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.714+0000 7fe536054700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe530153c30 0x7fe5300d0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:13.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.714+0000 7fe536054700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe53015de50 0x7fe5300d0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:13.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.714+0000 7fe536054700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5300b4a20 con 0x7fe530153c30 2023-10-06T01:40:13.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.714+0000 7fe536054700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5300b5560 con 0x7fe5300cef40 2023-10-06T01:40:13.719 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.714+0000 7fe536054700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5300ca0d0 con 0x7fe53015de50 2023-10-06T01:40:13.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.714+0000 7fe534851700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe530153c30 0x7fe5300d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:13.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.714+0000 7fe534851700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe530153c30 0x7fe5300d0450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40284/0 (socket says 172.21.15.69:40284) 2023-10-06T01:40:13.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.714+0000 7fe534851700 1 -- 172.21.15.69:0/541974769 learned_addr learned my addr 172.21.15.69:0/541974769 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:13.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.715+0000 7fe534851700 1 -- 172.21.15.69:0/541974769 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe53015de50 msgr2=0x7fe5300d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:13.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.715+0000 7fe534851700 1 --2- 172.21.15.69:0/541974769 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe53015de50 0x7fe5300d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.715+0000 7fe534851700 1 -- 172.21.15.69:0/541974769 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5300cef40 msgr2=0x7fe530152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:13.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.715+0000 7fe534851700 1 --2- 172.21.15.69:0/541974769 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5300cef40 0x7fe530152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.715+0000 7fe534851700 1 -- 172.21.15.69:0/541974769 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe520009420 con 0x7fe530153c30 2023-10-06T01:40:13.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.715+0000 7fe534851700 1 --2- 172.21.15.69:0/541974769 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe530153c30 0x7fe5300d0450 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe520009ed0 tx=0x7fe520016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:13.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.715+0000 7fe5257fa700 1 -- 172.21.15.69:0/541974769 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52001cc80 con 0x7fe530153c30 2023-10-06T01:40:13.720 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.715+0000 7fe5257fa700 1 -- 172.21.15.69:0/541974769 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe52001cde0 con 0x7fe530153c30 2023-10-06T01:40:13.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.715+0000 7fe536054700 1 -- 172.21.15.69:0/541974769 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5300b4c30 con 0x7fe530153c30 2023-10-06T01:40:13.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.715+0000 7fe5257fa700 1 -- 172.21.15.69:0/541974769 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe52001a6a0 con 0x7fe530153c30 2023-10-06T01:40:13.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.715+0000 7fe536054700 1 -- 172.21.15.69:0/541974769 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5300b51f0 con 0x7fe530153c30 2023-10-06T01:40:13.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.716+0000 7fe536054700 1 -- 172.21.15.69:0/541974769 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe53004c3c0 con 0x7fe530153c30 2023-10-06T01:40:13.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.716+0000 7fe5257fa700 1 -- 172.21.15.69:0/541974769 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fe52001aa50 con 0x7fe530153c30 2023-10-06T01:40:13.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.717+0000 7fe5257fa700 1 --2- 172.21.15.69:0/541974769 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe5140670e0 0x7fe514069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:13.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.717+0000 7fe5257fa700 1 -- 172.21.15.69:0/541974769 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fe520086120 con 0x7fe530153c30 2023-10-06T01:40:13.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.717+0000 7fe535052700 1 --2- 172.21.15.69:0/541974769 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe5140670e0 0x7fe514069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:13.721 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.717+0000 7fe535052700 1 --2- 172.21.15.69:0/541974769 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe5140670e0 0x7fe514069590 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe52c0011e0 tx=0x7fe52c001340 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:13.722 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.721+0000 7fe5257fa700 1 -- 172.21.15.69:0/541974769 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5200532b0 con 0x7fe530153c30 2023-10-06T01:40:13.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.905+0000 7fe536054700 1 -- 172.21.15.69:0/541974769 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5300b6300 con 0x7fe5140670e0 2023-10-06T01:40:13.907 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.905+0000 7fe5257fa700 1 -- 172.21.15.69:0/541974769 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fe5300b6300 con 0x7fe5140670e0 2023-10-06T01:40:13.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.907+0000 7fe536054700 1 -- 172.21.15.69:0/541974769 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe5140670e0 msgr2=0x7fe514069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:13.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.907+0000 7fe536054700 1 --2- 172.21.15.69:0/541974769 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe5140670e0 0x7fe514069590 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fe52c0011e0 tx=0x7fe52c001340 comp rx=0 tx=0).stop 2023-10-06T01:40:13.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.907+0000 7fe536054700 1 -- 172.21.15.69:0/541974769 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe530153c30 msgr2=0x7fe5300d0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:13.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.907+0000 7fe536054700 1 --2- 172.21.15.69:0/541974769 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe530153c30 0x7fe5300d0450 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fe520009ed0 tx=0x7fe520016000 comp rx=0 tx=0).stop 2023-10-06T01:40:13.909 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.907+0000 7fe536054700 1 -- 172.21.15.69:0/541974769 shutdown_connections 2023-10-06T01:40:13.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.907+0000 7fe536054700 1 --2- 172.21.15.69:0/541974769 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe5140670e0 0x7fe514069590 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.907+0000 7fe536054700 1 --2- 172.21.15.69:0/541974769 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe53015de50 0x7fe5300d0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.907+0000 7fe536054700 1 --2- 172.21.15.69:0/541974769 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe5300cef40 0x7fe530152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.907+0000 7fe536054700 1 --2- 172.21.15.69:0/541974769 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe530153c30 0x7fe5300d0450 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:13.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.907+0000 7fe536054700 1 -- 172.21.15.69:0/541974769 >> 172.21.15.69:0/541974769 conn(0x7fe5300703a0 msgr2=0x7fe5300b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:13.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.907+0000 7fe536054700 1 -- 172.21.15.69:0/541974769 shutdown_connections 2023-10-06T01:40:13.910 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:13.907+0000 7fe536054700 1 -- 172.21.15.69:0/541974769 wait complete. 2023-10-06T01:40:13.911 INFO:teuthology.orchestra.run.smithi069.stderr:instructed osd(s) 5 to deep-scrub 2023-10-06T01:40:13.920 INFO:tasks.ceph:Scrubbing osd.6 2023-10-06T01:40:13.921 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-06T01:40:14.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.036+0000 7fa52b4ec700 1 Processor -- start 2023-10-06T01:40:14.038 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.037+0000 7fa52b4ec700 1 -- start start 2023-10-06T01:40:14.040 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.037+0000 7fa52b4ec700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fa524159fb0 0x7fa52415a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.037+0000 7fa52b4ec700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa52415d570 con 0x7fa5240cd5a0 2023-10-06T01:40:14.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.037+0000 7fa52b4ec700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa52415d850 con 0x7fa52415a8c0 2023-10-06T01:40:14.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.037+0000 7fa52b4ec700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa52415e180 con 0x7fa524159fb0 2023-10-06T01:40:14.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.038+0000 7fa52aceb700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fa5240cd5a0 0x7fa5240cb440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:60378/0 (socket says 172.21.15.69:60378) 2023-10-06T01:40:14.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.038+0000 7fa52aceb700 1 -- 172.21.15.69:0/800898926 learned_addr learned my addr 172.21.15.69:0/800898926 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:40:14.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.038+0000 7fa52a4ea700 1 --2- 172.21.15.69:0/800898926 >> v2:172.21.15.88:3300/0 conn(0x7fa524159fb0 0x7fa52415a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.038+0000 7fa5294e8700 1 -- 172.21.15.69:0/800898926 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073540186 0 0) 0x7fa52415d570 con 0x7fa5240cd5a0 2023-10-06T01:40:14.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.038+0000 7fa5294e8700 1 -- 172.21.15.69:0/800898926 --> v1:172.21.15.69:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa510003570 con 0x7fa5240cd5a0 2023-10-06T01:40:14.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.038+0000 7fa5294e8700 1 -- 172.21.15.69:0/800898926 <== mon.1 v1:172.21.15.88:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3220723810 0 0) 0x7fa52415d850 con 0x7fa52415a8c0 2023-10-06T01:40:14.041 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.038+0000 7fa5294e8700 1 -- 172.21.15.69:0/800898926 --> v1:172.21.15.88:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa52415d570 con 0x7fa52415a8c0 2023-10-06T01:40:14.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.038+0000 7fa52a4ea700 1 -- 172.21.15.69:0/800898926 >> v1:172.21.15.88:6789/0 conn(0x7fa52415a8c0 legacy=0x7fa5240cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.038+0000 7fa5294e8700 1 -- 172.21.15.69:0/800898926 <== mon.0 v1:172.21.15.69:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3252932763 0 0) 0x7fa510003570 con 0x7fa5240cd5a0 2023-10-06T01:40:14.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.038+0000 7fa52a4ea700 1 -- 172.21.15.69:0/800898926 >> v1:172.21.15.69:6789/0 conn(0x7fa5240cd5a0 legacy=0x7fa5240cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.038+0000 7fa52a4ea700 1 -- 172.21.15.69:0/800898926 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa52415db30 con 0x7fa524159fb0 2023-10-06T01:40:14.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.038+0000 7fa52a4ea700 1 --2- 172.21.15.69:0/800898926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa524159fb0 0x7fa52415a380 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa520009e60 tx=0x7fa520009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c4e3675747b64a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:14.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.038+0000 7fa5294e8700 1 -- 172.21.15.69:0/800898926 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa52000e070 con 0x7fa524159fb0 2023-10-06T01:40:14.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.039+0000 7fa5294e8700 1 -- 172.21.15.69:0/800898926 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa52000b7a0 con 0x7fa524159fb0 2023-10-06T01:40:14.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.039+0000 7fa5294e8700 1 -- 172.21.15.69:0/800898926 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c001470 con 0x7fa524159fb0 2023-10-06T01:40:14.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.039+0000 7fa52b4ec700 1 -- 172.21.15.69:0/800898926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa524159fb0 msgr2=0x7fa52415a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.042 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.039+0000 7fa52b4ec700 1 --2- 172.21.15.69:0/800898926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa524159fb0 0x7fa52415a380 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fa520009e60 tx=0x7fa520009780 comp rx=0 tx=0).stop 2023-10-06T01:40:14.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.039+0000 7fa52b4ec700 1 -- 172.21.15.69:0/800898926 shutdown_connections 2023-10-06T01:40:14.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.039+0000 7fa52b4ec700 1 --2- 172.21.15.69:0/800898926 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa524159fb0 0x7fa52415a380 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.039+0000 7fa52b4ec700 1 -- 172.21.15.69:0/800898926 >> 172.21.15.69:0/800898926 conn(0x7fa5240703a0 msgr2=0x7fa5240707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:14.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.039+0000 7fa52b4ec700 1 -- 172.21.15.69:0/800898926 shutdown_connections 2023-10-06T01:40:14.043 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.039+0000 7fa52b4ec700 1 -- 172.21.15.69:0/800898926 wait complete. 2023-10-06T01:40:14.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.040+0000 7fa52b4ec700 1 Processor -- start 2023-10-06T01:40:14.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.040+0000 7fa52b4ec700 1 -- start start 2023-10-06T01:40:14.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.041+0000 7fa52b4ec700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa5240cd5a0 0x7fa5240ceab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.041+0000 7fa52b4ec700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa524159fb0 0x7fa5240ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.041+0000 7fa52b4ec700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa52415a8c0 0x7fa5240c96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.046 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.041+0000 7fa52b4ec700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5241585d0 con 0x7fa52415a8c0 2023-10-06T01:40:14.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.041+0000 7fa52b4ec700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5240b32f0 con 0x7fa524159fb0 2023-10-06T01:40:14.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.041+0000 7fa52b4ec700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5240b0c40 con 0x7fa5240cd5a0 2023-10-06T01:40:14.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.041+0000 7fa52aceb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa52415a8c0 0x7fa5240c96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.041+0000 7fa52aceb700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa52415a8c0 0x7fa5240c96a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40292/0 (socket says 172.21.15.69:40292) 2023-10-06T01:40:14.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.041+0000 7fa52aceb700 1 -- 172.21.15.69:0/3108292666 learned_addr learned my addr 172.21.15.69:0/3108292666 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:14.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.041+0000 7fa529ce9700 1 --2- 172.21.15.69:0/3108292666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa524159fb0 0x7fa5240ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.041+0000 7fa52a4ea700 1 --2- 172.21.15.69:0/3108292666 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa5240cd5a0 0x7fa5240ceab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.041+0000 7fa52aceb700 1 -- 172.21.15.69:0/3108292666 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa5240cd5a0 msgr2=0x7fa5240ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.041+0000 7fa52aceb700 1 --2- 172.21.15.69:0/3108292666 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fa5240cd5a0 0x7fa5240ceab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.041+0000 7fa52aceb700 1 -- 172.21.15.69:0/3108292666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa524159fb0 msgr2=0x7fa5240ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.041+0000 7fa52aceb700 1 --2- 172.21.15.69:0/3108292666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa524159fb0 0x7fa5240ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.047 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.041+0000 7fa52aceb700 1 -- 172.21.15.69:0/3108292666 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa520009a20 con 0x7fa52415a8c0 2023-10-06T01:40:14.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.041+0000 7fa529ce9700 1 --2- 172.21.15.69:0/3108292666 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fa524159fb0 0x7fa5240ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:14.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.041+0000 7fa52aceb700 1 --2- 172.21.15.69:0/3108292666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa52415a8c0 0x7fa5240c96a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00c7f0 tx=0x7fa51c001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:14.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.042+0000 7fa51a7fc700 1 -- 172.21.15.69:0/3108292666 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c007360 con 0x7fa52415a8c0 2023-10-06T01:40:14.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.042+0000 7fa51a7fc700 1 -- 172.21.15.69:0/3108292666 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa51c0074e0 con 0x7fa52415a8c0 2023-10-06T01:40:14.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.042+0000 7fa52b4ec700 1 -- 172.21.15.69:0/3108292666 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5240ca380 con 0x7fa52415a8c0 2023-10-06T01:40:14.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.042+0000 7fa51a7fc700 1 -- 172.21.15.69:0/3108292666 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa51c004830 con 0x7fa52415a8c0 2023-10-06T01:40:14.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.042+0000 7fa52b4ec700 1 -- 172.21.15.69:0/3108292666 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5240b05f0 con 0x7fa52415a8c0 2023-10-06T01:40:14.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.042+0000 7fa52b4ec700 1 -- 172.21.15.69:0/3108292666 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa52404c3c0 con 0x7fa52415a8c0 2023-10-06T01:40:14.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.043+0000 7fa51a7fc700 1 -- 172.21.15.69:0/3108292666 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fa51c004c20 con 0x7fa52415a8c0 2023-10-06T01:40:14.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.043+0000 7fa51a7fc700 1 --2- 172.21.15.69:0/3108292666 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa5080670e0 0x7fa508069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.043+0000 7fa51a7fc700 1 -- 172.21.15.69:0/3108292666 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fa51c083d90 con 0x7fa52415a8c0 2023-10-06T01:40:14.048 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.043+0000 7fa52a4ea700 1 --2- 172.21.15.69:0/3108292666 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa5080670e0 0x7fa508069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.044+0000 7fa51a7fc700 1 --2- 172.21.15.69:0/3108292666 >> [v2:172.21.15.88:6817/90900,v1:172.21.15.88:6819/90900] conn(0x7fa50806d550 0x7fa50806f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.044+0000 7fa51a7fc700 1 -- 172.21.15.69:0/3108292666 --> [v2:172.21.15.88:6817/90900,v1:172.21.15.88:6819/90900] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa508070030 con 0x7fa50806d550 2023-10-06T01:40:14.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.044+0000 7fa51a7fc700 1 -- 172.21.15.69:0/3108292666 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa51c086290 con 0x7fa52415a8c0 2023-10-06T01:40:14.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.044+0000 7fa529ce9700 1 --2- 172.21.15.69:0/3108292666 >> [v2:172.21.15.88:6817/90900,v1:172.21.15.88:6819/90900] conn(0x7fa50806d550 0x7fa50806f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.044+0000 7fa52a4ea700 1 --2- 172.21.15.69:0/3108292666 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa5080670e0 0x7fa508069590 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa5200099f0 tx=0x7fa520017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:14.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.044+0000 7fa529ce9700 1 --2- 172.21.15.69:0/3108292666 >> [v2:172.21.15.88:6817/90900,v1:172.21.15.88:6819/90900] conn(0x7fa50806d550 0x7fa50806f960 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:14.049 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.045+0000 7fa51a7fc700 1 -- 172.21.15.69:0/3108292666 <== osd.6 v2:172.21.15.88:6817/90900 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fa508070030 con 0x7fa50806d550 2023-10-06T01:40:14.059 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.058+0000 7fa52b4ec700 1 -- 172.21.15.69:0/3108292666 --> [v2:172.21.15.88:6817/90900,v1:172.21.15.88:6819/90900] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fa5240b2440 con 0x7fa50806d550 2023-10-06T01:40:14.060 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.059+0000 7fa51a7fc700 1 -- 172.21.15.69:0/3108292666 <== osd.6 v2:172.21.15.88:6817/90900 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fa5240b2440 con 0x7fa50806d550 2023-10-06T01:40:14.060 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-10-06T01:40:14.060 INFO:teuthology.orchestra.run.smithi069.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T01:40:14.060 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-10-06T01:40:14.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.059+0000 7fa52b4ec700 1 -- 172.21.15.69:0/3108292666 >> [v2:172.21.15.88:6817/90900,v1:172.21.15.88:6819/90900] conn(0x7fa50806d550 msgr2=0x7fa50806f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.059+0000 7fa52b4ec700 1 --2- 172.21.15.69:0/3108292666 >> [v2:172.21.15.88:6817/90900,v1:172.21.15.88:6819/90900] conn(0x7fa50806d550 0x7fa50806f960 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.061 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.059+0000 7fa52b4ec700 1 -- 172.21.15.69:0/3108292666 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa5080670e0 msgr2=0x7fa508069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.059+0000 7fa52b4ec700 1 --2- 172.21.15.69:0/3108292666 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fa5080670e0 0x7fa508069590 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fa5200099f0 tx=0x7fa520017000 comp rx=0 tx=0).stop 2023-10-06T01:40:14.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.059+0000 7fa52b4ec700 1 -- 172.21.15.69:0/3108292666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa52415a8c0 msgr2=0x7fa5240c96a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.059+0000 7fa52b4ec700 1 --2- 172.21.15.69:0/3108292666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa52415a8c0 0x7fa5240c96a0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fa51c00c7f0 tx=0x7fa51c001a30 comp rx=0 tx=0).stop 2023-10-06T01:40:14.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.059+0000 7fa52aceb700 1 -- 172.21.15.69:0/3108292666 reap_dead start 2023-10-06T01:40:14.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.059+0000 7fa52b4ec700 1 -- 172.21.15.69:0/3108292666 shutdown_connections 2023-10-06T01:40:14.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.059+0000 7fa52b4ec700 1 -- 172.21.15.69:0/3108292666 >> 172.21.15.69:0/3108292666 conn(0x7fa5240703a0 msgr2=0x7fa52415b030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:14.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.059+0000 7fa52b4ec700 1 -- 172.21.15.69:0/3108292666 shutdown_connections 2023-10-06T01:40:14.062 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.059+0000 7fa52b4ec700 1 -- 172.21.15.69:0/3108292666 wait complete. 2023-10-06T01:40:14.072 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-06T01:40:14.187 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.186+0000 7fc897fff700 1 Processor -- start 2023-10-06T01:40:14.188 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.186+0000 7fc897fff700 1 -- start start 2023-10-06T01:40:14.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.187+0000 7fc897fff700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc8980c95c0 0x7fc8980aaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.187+0000 7fc897fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8981579a0 0x7fc8980c9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.187+0000 7fc897fff700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8980c3d00 con 0x7fc8980caa00 2023-10-06T01:40:14.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.187+0000 7fc897fff700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8980c3110 con 0x7fc8980c95c0 2023-10-06T01:40:14.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.187+0000 7fc897fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8980c33d0 con 0x7fc8981579a0 2023-10-06T01:40:14.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.187+0000 7fc896ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc8980c95c0 0x7fc8980aaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.187+0000 7fc8977fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8981579a0 0x7fc8980c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.187+0000 7fc8967fc700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7fc8980caa00 0x7fc898157290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.69:58530/0 (socket says 172.21.15.69:58530) 2023-10-06T01:40:14.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.187+0000 7fc896ffd700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fc8980c95c0 0x7fc8980aaec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.69:58734/0 (socket says 172.21.15.69:58734) 2023-10-06T01:40:14.190 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.187+0000 7fc8977fe700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8981579a0 0x7fc8980c9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3301/0 says I am v2:172.21.15.69:33058/0 (socket says 172.21.15.69:33058) 2023-10-06T01:40:14.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.187+0000 7fc8967fc700 1 -- 172.21.15.69:0/3193037228 learned_addr learned my addr 172.21.15.69:0/3193037228 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:40:14.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.187+0000 7fc896ffd700 1 -- 172.21.15.69:0/3193037228 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8981579a0 msgr2=0x7fc8980c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:14.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.187+0000 7fc896ffd700 1 --2- 172.21.15.69:0/3193037228 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8981579a0 0x7fc8980c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.187+0000 7fc896ffd700 1 -- 172.21.15.69:0/3193037228 >> v1:172.21.15.88:6789/0 conn(0x7fc8980caa00 legacy=0x7fc898157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.187+0000 7fc896ffd700 1 -- 172.21.15.69:0/3193037228 --> v2:172.21.15.88:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8980c36b0 con 0x7fc8980c95c0 2023-10-06T01:40:14.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.188+0000 7fc896ffd700 1 --2- 172.21.15.69:0/3193037228 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8980c95c0 0x7fc8980aaec0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc888009eb0 tx=0x7fc888009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=492ffe3136f3ded5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:14.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.188+0000 7fc895ffb700 1 -- 172.21.15.69:0/3193037228 <== mon.1 v2:172.21.15.88:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88800e070 con 0x7fc8980c95c0 2023-10-06T01:40:14.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.188+0000 7fc895ffb700 1 -- 172.21.15.69:0/3193037228 <== mon.1 v2:172.21.15.88:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88800bc30 con 0x7fc8980c95c0 2023-10-06T01:40:14.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.188+0000 7fc895ffb700 1 -- 172.21.15.69:0/3193037228 <== mon.1 v2:172.21.15.88:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc888012430 con 0x7fc8980c95c0 2023-10-06T01:40:14.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.188+0000 7fc897fff700 1 -- 172.21.15.69:0/3193037228 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8980c95c0 msgr2=0x7fc8980aaec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.188+0000 7fc897fff700 1 --2- 172.21.15.69:0/3193037228 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8980c95c0 0x7fc8980aaec0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc888009eb0 tx=0x7fc888009780 comp rx=0 tx=0).stop 2023-10-06T01:40:14.191 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.188+0000 7fc897fff700 1 -- 172.21.15.69:0/3193037228 shutdown_connections 2023-10-06T01:40:14.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.188+0000 7fc897fff700 1 --2- 172.21.15.69:0/3193037228 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8981579a0 0x7fc8980c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.188+0000 7fc897fff700 1 --2- 172.21.15.69:0/3193037228 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8980c95c0 0x7fc8980aaec0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.188+0000 7fc897fff700 1 -- 172.21.15.69:0/3193037228 >> 172.21.15.69:0/3193037228 conn(0x7fc898088000 msgr2=0x7fc8980ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:14.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.188+0000 7fc897fff700 1 -- 172.21.15.69:0/3193037228 shutdown_connections 2023-10-06T01:40:14.192 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.188+0000 7fc897fff700 1 -- 172.21.15.69:0/3193037228 wait complete. 2023-10-06T01:40:14.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.189+0000 7fc897fff700 1 Processor -- start 2023-10-06T01:40:14.194 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.189+0000 7fc897fff700 1 -- start start 2023-10-06T01:40:14.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.190+0000 7fc897fff700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8980c95c0 0x7fc898158b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.190+0000 7fc897fff700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8981579a0 0x7fc89814ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.190+0000 7fc897fff700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8981598e0 0x7fc898159d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.190+0000 7fc897fff700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8981586e0 con 0x7fc8980c95c0 2023-10-06T01:40:14.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.190+0000 7fc897fff700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89815a360 con 0x7fc8981579a0 2023-10-06T01:40:14.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.190+0000 7fc897fff700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc898158090 con 0x7fc8981598e0 2023-10-06T01:40:14.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.190+0000 7fc896ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8980c95c0 0x7fc898158b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.190+0000 7fc896ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8980c95c0 0x7fc898158b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40304/0 (socket says 172.21.15.69:40304) 2023-10-06T01:40:14.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.190+0000 7fc896ffd700 1 -- 172.21.15.69:0/2382839138 learned_addr learned my addr 172.21.15.69:0/2382839138 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:14.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.190+0000 7fc8977fe700 1 --2- 172.21.15.69:0/2382839138 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8981598e0 0x7fc898159d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.195 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.190+0000 7fc8967fc700 1 --2- 172.21.15.69:0/2382839138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8981579a0 0x7fc89814ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.191+0000 7fc896ffd700 1 -- 172.21.15.69:0/2382839138 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8981598e0 msgr2=0x7fc898159d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.191+0000 7fc896ffd700 1 --2- 172.21.15.69:0/2382839138 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8981598e0 0x7fc898159d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.191+0000 7fc896ffd700 1 -- 172.21.15.69:0/2382839138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8981579a0 msgr2=0x7fc89814ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.191+0000 7fc896ffd700 1 --2- 172.21.15.69:0/2382839138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8981579a0 0x7fc89814ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.191+0000 7fc896ffd700 1 -- 172.21.15.69:0/2382839138 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc888009a20 con 0x7fc8980c95c0 2023-10-06T01:40:14.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.191+0000 7fc8967fc700 1 --2- 172.21.15.69:0/2382839138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8981579a0 0x7fc89814ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:40:14.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.191+0000 7fc8977fe700 1 --2- 172.21.15.69:0/2382839138 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8981598e0 0x7fc898159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-06T01:40:14.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.191+0000 7fc896ffd700 1 --2- 172.21.15.69:0/2382839138 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8980c95c0 0x7fc898158b70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc89806fce0 tx=0x7fc888019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:14.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.191+0000 7fc87effd700 1 -- 172.21.15.69:0/2382839138 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc888027470 con 0x7fc8980c95c0 2023-10-06T01:40:14.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.191+0000 7fc87effd700 1 -- 172.21.15.69:0/2382839138 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc888027610 con 0x7fc8980c95c0 2023-10-06T01:40:14.196 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.191+0000 7fc897fff700 1 -- 172.21.15.69:0/2382839138 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc898158370 con 0x7fc8980c95c0 2023-10-06T01:40:14.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.191+0000 7fc87effd700 1 -- 172.21.15.69:0/2382839138 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8880279d0 con 0x7fc8980c95c0 2023-10-06T01:40:14.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.191+0000 7fc897fff700 1 -- 172.21.15.69:0/2382839138 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8981524c0 con 0x7fc8980c95c0 2023-10-06T01:40:14.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.192+0000 7fc897fff700 1 -- 172.21.15.69:0/2382839138 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc898157ef0 con 0x7fc8980c95c0 2023-10-06T01:40:14.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.192+0000 7fc87effd700 1 -- 172.21.15.69:0/2382839138 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fc888024070 con 0x7fc8980c95c0 2023-10-06T01:40:14.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.193+0000 7fc87effd700 1 --2- 172.21.15.69:0/2382839138 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc8840670e0 0x7fc884069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.193+0000 7fc87effd700 1 -- 172.21.15.69:0/2382839138 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fc888087090 con 0x7fc8980c95c0 2023-10-06T01:40:14.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.193+0000 7fc8967fc700 1 --2- 172.21.15.69:0/2382839138 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc8840670e0 0x7fc884069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.197 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.193+0000 7fc8967fc700 1 --2- 172.21.15.69:0/2382839138 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc8840670e0 0x7fc884069590 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc898151d90 tx=0x7fc88c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:14.198 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.197+0000 7fc87effd700 1 -- 172.21.15.69:0/2382839138 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc898157ef0 con 0x7fc8980c95c0 2023-10-06T01:40:14.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.384+0000 7fc897fff700 1 -- 172.21.15.69:0/2382839138 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fc898158820 con 0x7fc8840670e0 2023-10-06T01:40:14.385 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.384+0000 7fc87effd700 1 -- 172.21.15.69:0/2382839138 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc88c001490 con 0x7fc8840670e0 2023-10-06T01:40:14.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.386+0000 7fc897fff700 1 -- 172.21.15.69:0/2382839138 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc8840670e0 msgr2=0x7fc884069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.387 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.386+0000 7fc897fff700 1 --2- 172.21.15.69:0/2382839138 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc8840670e0 0x7fc884069590 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fc898151d90 tx=0x7fc88c009040 comp rx=0 tx=0).stop 2023-10-06T01:40:14.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.386+0000 7fc897fff700 1 -- 172.21.15.69:0/2382839138 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8980c95c0 msgr2=0x7fc898158b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.386+0000 7fc897fff700 1 --2- 172.21.15.69:0/2382839138 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8980c95c0 0x7fc898158b70 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fc89806fce0 tx=0x7fc888019000 comp rx=0 tx=0).stop 2023-10-06T01:40:14.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.386+0000 7fc897fff700 1 -- 172.21.15.69:0/2382839138 shutdown_connections 2023-10-06T01:40:14.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.386+0000 7fc897fff700 1 --2- 172.21.15.69:0/2382839138 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc8840670e0 0x7fc884069590 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.386+0000 7fc897fff700 1 --2- 172.21.15.69:0/2382839138 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc8981598e0 0x7fc898159d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.386+0000 7fc897fff700 1 --2- 172.21.15.69:0/2382839138 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc8980c95c0 0x7fc898158b70 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.386+0000 7fc897fff700 1 --2- 172.21.15.69:0/2382839138 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc8981579a0 0x7fc89814ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.386+0000 7fc897fff700 1 -- 172.21.15.69:0/2382839138 >> 172.21.15.69:0/2382839138 conn(0x7fc898088000 msgr2=0x7fc898154f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:14.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.386+0000 7fc897fff700 1 -- 172.21.15.69:0/2382839138 shutdown_connections 2023-10-06T01:40:14.388 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.386+0000 7fc897fff700 1 -- 172.21.15.69:0/2382839138 wait complete. 2023-10-06T01:40:14.389 INFO:teuthology.orchestra.run.smithi069.stderr:instructed osd(s) 6 to deep-scrub 2023-10-06T01:40:14.399 INFO:tasks.ceph:Scrubbing osd.7 2023-10-06T01:40:14.399 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-06T01:40:14.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.515+0000 7fd19cf62700 1 Processor -- start 2023-10-06T01:40:14.517 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.515+0000 7fd19cf62700 1 -- start start 2023-10-06T01:40:14.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.516+0000 7fd19cf62700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd198088400 0x7fd1980a9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.516+0000 7fd19cf62700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd1980cee40 0x7fd1980ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.516+0000 7fd19cf62700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1980cced0 con 0x7fd19806e2a0 2023-10-06T01:40:14.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.516+0000 7fd19cf62700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1980cd140 con 0x7fd198088400 2023-10-06T01:40:14.519 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.516+0000 7fd19cf62700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1980cd420 con 0x7fd1980cee40 2023-10-06T01:40:14.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.516+0000 7fd195d9b700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fd198088400 0x7fd1980a9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.516+0000 7fd19659c700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fd19806e2a0 0x7fd1980a8910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:60388/0 (socket says 172.21.15.69:60388) 2023-10-06T01:40:14.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.516+0000 7fd19659c700 1 -- 172.21.15.69:0/1660608906 learned_addr learned my addr 172.21.15.69:0/1660608906 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:40:14.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.517+0000 7fd195d9b700 1 -- 172.21.15.69:0/1660608906 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd1980cee40 msgr2=0x7fd1980ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:14.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.517+0000 7fd196d9d700 1 --2- 172.21.15.69:0/1660608906 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd1980cee40 0x7fd1980ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.517+0000 7fd19559a700 1 -- 172.21.15.69:0/1660608906 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2793787918 0 0) 0x7fd1980cced0 con 0x7fd19806e2a0 2023-10-06T01:40:14.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.517+0000 7fd195d9b700 1 --2- 172.21.15.69:0/1660608906 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd1980cee40 0x7fd1980ae4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.517+0000 7fd195d9b700 1 -- 172.21.15.69:0/1660608906 >> v1:172.21.15.69:6789/0 conn(0x7fd19806e2a0 legacy=0x7fd1980a8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.517+0000 7fd195d9b700 1 -- 172.21.15.69:0/1660608906 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1980cd700 con 0x7fd198088400 2023-10-06T01:40:14.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.517+0000 7fd195d9b700 1 --2- 172.21.15.69:0/1660608906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd198088400 0x7fd1980a9020 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0098e0 tx=0x7fd18c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9693d7502decd4c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:14.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.517+0000 7fd19559a700 1 -- 172.21.15.69:0/1660608906 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c009e80 con 0x7fd198088400 2023-10-06T01:40:14.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.517+0000 7fd19559a700 1 -- 172.21.15.69:0/1660608906 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd18c00b8f0 con 0x7fd198088400 2023-10-06T01:40:14.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.517+0000 7fd19559a700 1 -- 172.21.15.69:0/1660608906 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18c00bc70 con 0x7fd198088400 2023-10-06T01:40:14.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.518+0000 7fd19cf62700 1 -- 172.21.15.69:0/1660608906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd198088400 msgr2=0x7fd1980a9020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.518+0000 7fd19cf62700 1 --2- 172.21.15.69:0/1660608906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd198088400 0x7fd1980a9020 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0098e0 tx=0x7fd18c0091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.518+0000 7fd19cf62700 1 -- 172.21.15.69:0/1660608906 shutdown_connections 2023-10-06T01:40:14.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.518+0000 7fd19cf62700 1 --2- 172.21.15.69:0/1660608906 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd1980cee40 0x7fd1980ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.518+0000 7fd19cf62700 1 --2- 172.21.15.69:0/1660608906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd198088400 0x7fd1980a9020 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.518+0000 7fd19cf62700 1 -- 172.21.15.69:0/1660608906 >> 172.21.15.69:0/1660608906 conn(0x7fd198088000 msgr2=0x7fd1980ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:14.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.518+0000 7fd19cf62700 1 -- 172.21.15.69:0/1660608906 shutdown_connections 2023-10-06T01:40:14.521 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.518+0000 7fd19cf62700 1 -- 172.21.15.69:0/1660608906 wait complete. 2023-10-06T01:40:14.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.519+0000 7fd19cf62700 1 Processor -- start 2023-10-06T01:40:14.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.519+0000 7fd19cf62700 1 -- start start 2023-10-06T01:40:14.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.520+0000 7fd19cf62700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd19806e2a0 0x7fd1980b09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.520+0000 7fd19cf62700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd198088400 0x7fd1980b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.520+0000 7fd19cf62700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1980cee40 0x7fd1981533c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.524 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.520+0000 7fd19cf62700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1980b0510 con 0x7fd19806e2a0 2023-10-06T01:40:14.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.520+0000 7fd19cf62700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1980b40a0 con 0x7fd1980cee40 2023-10-06T01:40:14.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.520+0000 7fd19cf62700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1980af900 con 0x7fd198088400 2023-10-06T01:40:14.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.520+0000 7fd19659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd19806e2a0 0x7fd1980b09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.520+0000 7fd19659c700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd19806e2a0 0x7fd1980b09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40322/0 (socket says 172.21.15.69:40322) 2023-10-06T01:40:14.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.520+0000 7fd19659c700 1 -- 172.21.15.69:0/1364086896 learned_addr learned my addr 172.21.15.69:0/1364086896 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:14.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.520+0000 7fd195d9b700 1 --2- 172.21.15.69:0/1364086896 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd198088400 0x7fd1980b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.520+0000 7fd196d9d700 1 --2- 172.21.15.69:0/1364086896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1980cee40 0x7fd1981533c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.521+0000 7fd19659c700 1 -- 172.21.15.69:0/1364086896 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd198088400 msgr2=0x7fd1980b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.521+0000 7fd19659c700 1 --2- 172.21.15.69:0/1364086896 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fd198088400 0x7fd1980b3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.521+0000 7fd19659c700 1 -- 172.21.15.69:0/1364086896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1980cee40 msgr2=0x7fd1981533c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.521+0000 7fd19659c700 1 --2- 172.21.15.69:0/1364086896 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fd1980cee40 0x7fd1981533c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.521+0000 7fd19659c700 1 -- 172.21.15.69:0/1364086896 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd18c009420 con 0x7fd19806e2a0 2023-10-06T01:40:14.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.521+0000 7fd19659c700 1 --2- 172.21.15.69:0/1364086896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd19806e2a0 0x7fd1980b09a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd18800cb10 tx=0x7fd1880017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:14.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.521+0000 7fd1867fc700 1 -- 172.21.15.69:0/1364086896 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18800ce20 con 0x7fd19806e2a0 2023-10-06T01:40:14.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.521+0000 7fd1867fc700 1 -- 172.21.15.69:0/1364086896 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd188005d80 con 0x7fd19806e2a0 2023-10-06T01:40:14.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.521+0000 7fd1867fc700 1 -- 172.21.15.69:0/1364086896 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd18800a820 con 0x7fd19806e2a0 2023-10-06T01:40:14.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.521+0000 7fd19cf62700 1 -- 172.21.15.69:0/1364086896 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1980afbe0 con 0x7fd19806e2a0 2023-10-06T01:40:14.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.521+0000 7fd19cf62700 1 -- 172.21.15.69:0/1364086896 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1980b01a0 con 0x7fd19806e2a0 2023-10-06T01:40:14.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.522+0000 7fd19cf62700 1 -- 172.21.15.69:0/1364086896 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd19804c3c0 con 0x7fd19806e2a0 2023-10-06T01:40:14.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.522+0000 7fd1867fc700 1 -- 172.21.15.69:0/1364086896 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fd18800ac50 con 0x7fd19806e2a0 2023-10-06T01:40:14.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.522+0000 7fd1867fc700 1 --2- 172.21.15.69:0/1364086896 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd1780670e0 0x7fd178069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.523+0000 7fd1867fc700 1 -- 172.21.15.69:0/1364086896 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fd1880842a0 con 0x7fd19806e2a0 2023-10-06T01:40:14.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.523+0000 7fd195d9b700 1 --2- 172.21.15.69:0/1364086896 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd1780670e0 0x7fd178069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.523+0000 7fd1867fc700 1 --2- 172.21.15.69:0/1364086896 >> [v2:172.21.15.88:6816/90901,v1:172.21.15.88:6818/90901] conn(0x7fd17806d550 0x7fd17806f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.523+0000 7fd1867fc700 1 -- 172.21.15.69:0/1364086896 --> [v2:172.21.15.88:6816/90901,v1:172.21.15.88:6818/90901] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd178070030 con 0x7fd17806d550 2023-10-06T01:40:14.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.523+0000 7fd1867fc700 1 -- 172.21.15.69:0/1364086896 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1880868c0 con 0x7fd19806e2a0 2023-10-06T01:40:14.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.523+0000 7fd196d9d700 1 --2- 172.21.15.69:0/1364086896 >> [v2:172.21.15.88:6816/90901,v1:172.21.15.88:6818/90901] conn(0x7fd17806d550 0x7fd17806f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.523+0000 7fd195d9b700 1 --2- 172.21.15.69:0/1364086896 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd1780670e0 0x7fd178069590 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0091e0 tx=0x7fd18c017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:14.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.523+0000 7fd196d9d700 1 --2- 172.21.15.69:0/1364086896 >> [v2:172.21.15.88:6816/90901,v1:172.21.15.88:6818/90901] conn(0x7fd17806d550 0x7fd17806f960 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:14.527 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.524+0000 7fd1867fc700 1 -- 172.21.15.69:0/1364086896 <== osd.7 v2:172.21.15.88:6816/90901 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fd178070030 con 0x7fd17806d550 2023-10-06T01:40:14.539 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.538+0000 7fd19cf62700 1 -- 172.21.15.69:0/1364086896 --> [v2:172.21.15.88:6816/90901,v1:172.21.15.88:6818/90901] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fd198067b20 con 0x7fd17806d550 2023-10-06T01:40:14.540 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.539+0000 7fd1867fc700 1 -- 172.21.15.69:0/1364086896 <== osd.7 v2:172.21.15.88:6816/90901 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fd198067b20 con 0x7fd17806d550 2023-10-06T01:40:14.540 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2023-10-06T01:40:14.541 INFO:teuthology.orchestra.run.smithi069.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-06T01:40:14.541 INFO:teuthology.orchestra.run.smithi069.stdout:} 2023-10-06T01:40:14.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.539+0000 7fd19cf62700 1 -- 172.21.15.69:0/1364086896 >> [v2:172.21.15.88:6816/90901,v1:172.21.15.88:6818/90901] conn(0x7fd17806d550 msgr2=0x7fd17806f960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.539+0000 7fd19cf62700 1 --2- 172.21.15.69:0/1364086896 >> [v2:172.21.15.88:6816/90901,v1:172.21.15.88:6818/90901] conn(0x7fd17806d550 0x7fd17806f960 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.540+0000 7fd19cf62700 1 -- 172.21.15.69:0/1364086896 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd1780670e0 msgr2=0x7fd178069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.540+0000 7fd19cf62700 1 --2- 172.21.15.69:0/1364086896 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fd1780670e0 0x7fd178069590 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fd18c0091e0 tx=0x7fd18c017000 comp rx=0 tx=0).stop 2023-10-06T01:40:14.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.540+0000 7fd19cf62700 1 -- 172.21.15.69:0/1364086896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd19806e2a0 msgr2=0x7fd1980b09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.540+0000 7fd19cf62700 1 --2- 172.21.15.69:0/1364086896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd19806e2a0 0x7fd1980b09a0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fd18800cb10 tx=0x7fd1880017b0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.540+0000 7fd196d9d700 1 -- 172.21.15.69:0/1364086896 reap_dead start 2023-10-06T01:40:14.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.540+0000 7fd19cf62700 1 -- 172.21.15.69:0/1364086896 shutdown_connections 2023-10-06T01:40:14.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.540+0000 7fd19cf62700 1 -- 172.21.15.69:0/1364086896 >> 172.21.15.69:0/1364086896 conn(0x7fd198088000 msgr2=0x7fd198158bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:14.542 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.540+0000 7fd19cf62700 1 -- 172.21.15.69:0/1364086896 shutdown_connections 2023-10-06T01:40:14.543 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.540+0000 7fd19cf62700 1 -- 172.21.15.69:0/1364086896 wait complete. 2023-10-06T01:40:14.552 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-06T01:40:14.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.666+0000 7f5396420700 1 Processor -- start 2023-10-06T01:40:14.667 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.666+0000 7f5396420700 1 -- start start 2023-10-06T01:40:14.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.667+0000 7f5396420700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5390153c30 0x7f539015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.667+0000 7f5396420700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f539015de50 0x7f53900cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.667+0000 7f5396420700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f539015afd0 con 0x7f53900cef40 2023-10-06T01:40:14.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.667+0000 7f5396420700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f539015b2b0 con 0x7f5390153c30 2023-10-06T01:40:14.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.667+0000 7f5396420700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f539015b590 con 0x7f539015de50 2023-10-06T01:40:14.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.667+0000 7f539541e700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7f5390153c30 0x7f539015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.667+0000 7f5395c1f700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7f53900cef40 0x7f539006d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:60394/0 (socket says 172.21.15.69:60394) 2023-10-06T01:40:14.669 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.667+0000 7f5395c1f700 1 -- 172.21.15.69:0/3023890680 learned_addr learned my addr 172.21.15.69:0/3023890680 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:40:14.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.667+0000 7f5394c1d700 1 --2- 172.21.15.69:0/3023890680 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f539015de50 0x7f53900cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.667+0000 7f539541e700 1 -- 172.21.15.69:0/3023890680 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f539015de50 msgr2=0x7f53900cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:14.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.667+0000 7f539541e700 1 --2- 172.21.15.69:0/3023890680 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f539015de50 0x7f53900cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.667+0000 7f539541e700 1 -- 172.21.15.69:0/3023890680 >> v1:172.21.15.69:6789/0 conn(0x7f53900cef40 legacy=0x7f539006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.667+0000 7f539541e700 1 -- 172.21.15.69:0/3023890680 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f539015b870 con 0x7f5390153c30 2023-10-06T01:40:14.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.667+0000 7f5387fff700 1 -- 172.21.15.69:0/3023890680 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3969347284 0 0) 0x7f539015afd0 con 0x7f53900cef40 2023-10-06T01:40:14.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.667+0000 7f539541e700 1 --2- 172.21.15.69:0/3023890680 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5390153c30 0x7f539015a5e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5388009e60 tx=0x7f5388009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=579ba125f6746772 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:14.670 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.668+0000 7f5387fff700 1 -- 172.21.15.69:0/3023890680 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538800e070 con 0x7f5390153c30 2023-10-06T01:40:14.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.668+0000 7f5387fff700 1 -- 172.21.15.69:0/3023890680 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538800bc30 con 0x7f5390153c30 2023-10-06T01:40:14.671 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.668+0000 7f5387fff700 1 -- 172.21.15.69:0/3023890680 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5388012430 con 0x7f5390153c30 2023-10-06T01:40:14.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.668+0000 7f5396420700 1 -- 172.21.15.69:0/3023890680 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5390153c30 msgr2=0x7f539015a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.668+0000 7f5396420700 1 --2- 172.21.15.69:0/3023890680 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5390153c30 0x7f539015a5e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5388009e60 tx=0x7f5388009780 comp rx=0 tx=0).stop 2023-10-06T01:40:14.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.668+0000 7f5396420700 1 -- 172.21.15.69:0/3023890680 shutdown_connections 2023-10-06T01:40:14.674 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.668+0000 7f5396420700 1 --2- 172.21.15.69:0/3023890680 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5390153c30 0x7f539015a5e0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.668+0000 7f5396420700 1 --2- 172.21.15.69:0/3023890680 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f539015de50 0x7f53900cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.668+0000 7f5396420700 1 -- 172.21.15.69:0/3023890680 >> 172.21.15.69:0/3023890680 conn(0x7f53900703a0 msgr2=0x7f53900707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:14.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.668+0000 7f5396420700 1 -- 172.21.15.69:0/3023890680 shutdown_connections 2023-10-06T01:40:14.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.668+0000 7f5396420700 1 -- 172.21.15.69:0/3023890680 wait complete. 2023-10-06T01:40:14.675 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.669+0000 7f5396420700 1 Processor -- start 2023-10-06T01:40:14.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.669+0000 7f5396420700 1 -- start start 2023-10-06T01:40:14.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.670+0000 7f5396420700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f53900cef40 0x7f539014d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.670+0000 7f5396420700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5390153c30 0x7f53900b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.670+0000 7f5396420700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f539015de50 0x7f5390152090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.676 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.670+0000 7f5396420700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539014d910 con 0x7f539015de50 2023-10-06T01:40:14.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.670+0000 7f5396420700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53900b1d60 con 0x7f5390153c30 2023-10-06T01:40:14.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.670+0000 7f5396420700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53901525d0 con 0x7f53900cef40 2023-10-06T01:40:14.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.670+0000 7f5395c1f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f539015de50 0x7f5390152090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.670+0000 7f5395c1f700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f539015de50 0x7f5390152090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40336/0 (socket says 172.21.15.69:40336) 2023-10-06T01:40:14.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.670+0000 7f5395c1f700 1 -- 172.21.15.69:0/3123027412 learned_addr learned my addr 172.21.15.69:0/3123027412 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:14.677 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.670+0000 7f539541e700 1 --2- 172.21.15.69:0/3123027412 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f53900cef40 0x7f539014d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.670+0000 7f5394c1d700 1 --2- 172.21.15.69:0/3123027412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5390153c30 0x7f53900b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.670+0000 7f5395c1f700 1 -- 172.21.15.69:0/3123027412 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f53900cef40 msgr2=0x7f539014d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.670+0000 7f5395c1f700 1 --2- 172.21.15.69:0/3123027412 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f53900cef40 0x7f539014d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.678 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.670+0000 7f5395c1f700 1 -- 172.21.15.69:0/3123027412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5390153c30 msgr2=0x7f53900b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.670+0000 7f5395c1f700 1 --2- 172.21.15.69:0/3123027412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5390153c30 0x7f53900b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.670+0000 7f5395c1f700 1 -- 172.21.15.69:0/3123027412 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5388009a20 con 0x7f539015de50 2023-10-06T01:40:14.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.670+0000 7f539541e700 1 --2- 172.21.15.69:0/3123027412 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f53900cef40 0x7f539014d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-06T01:40:14.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.671+0000 7f5395c1f700 1 --2- 172.21.15.69:0/3123027412 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f539015de50 0x7f5390152090 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f538c00c560 tx=0x7f538c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:14.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.671+0000 7f53857fa700 1 -- 172.21.15.69:0/3123027412 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c005b30 con 0x7f539015de50 2023-10-06T01:40:14.679 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.671+0000 7f53857fa700 1 -- 172.21.15.69:0/3123027412 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f538c005c90 con 0x7f539015de50 2023-10-06T01:40:14.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.671+0000 7f5396420700 1 -- 172.21.15.69:0/3123027412 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53900c78a0 con 0x7f539015de50 2023-10-06T01:40:14.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.671+0000 7f53857fa700 1 -- 172.21.15.69:0/3123027412 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f538c007320 con 0x7f539015de50 2023-10-06T01:40:14.680 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.671+0000 7f5396420700 1 -- 172.21.15.69:0/3123027412 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53900b1f70 con 0x7f539015de50 2023-10-06T01:40:14.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.672+0000 7f5396420700 1 -- 172.21.15.69:0/3123027412 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f539004c3c0 con 0x7f539015de50 2023-10-06T01:40:14.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.672+0000 7f53857fa700 1 -- 172.21.15.69:0/3123027412 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7f538c01b3b0 con 0x7f539015de50 2023-10-06T01:40:14.681 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.673+0000 7f53857fa700 1 --2- 172.21.15.69:0/3123027412 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f53740670e0 0x7f5374069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.673+0000 7f539541e700 1 --2- 172.21.15.69:0/3123027412 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f53740670e0 0x7f5374069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.673+0000 7f53857fa700 1 -- 172.21.15.69:0/3123027412 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7f538c083bc0 con 0x7f539015de50 2023-10-06T01:40:14.682 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.673+0000 7f539541e700 1 --2- 172.21.15.69:0/3123027412 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f53740670e0 0x7f5374069590 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5388009e60 tx=0x7f5388019000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:14.683 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.677+0000 7f53857fa700 1 -- 172.21.15.69:0/3123027412 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f538c050d50 con 0x7f539015de50 2023-10-06T01:40:14.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.859+0000 7f5396420700 1 -- 172.21.15.69:0/3123027412 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f53900c6060 con 0x7f53740670e0 2023-10-06T01:40:14.860 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.859+0000 7f53857fa700 1 -- 172.21.15.69:0/3123027412 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f53900c6060 con 0x7f53740670e0 2023-10-06T01:40:14.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.861+0000 7f5396420700 1 -- 172.21.15.69:0/3123027412 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f53740670e0 msgr2=0x7f5374069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.862 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.861+0000 7f5396420700 1 --2- 172.21.15.69:0/3123027412 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f53740670e0 0x7f5374069590 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f5388009e60 tx=0x7f5388019000 comp rx=0 tx=0).stop 2023-10-06T01:40:14.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.861+0000 7f5396420700 1 -- 172.21.15.69:0/3123027412 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f539015de50 msgr2=0x7f5390152090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.861+0000 7f5396420700 1 --2- 172.21.15.69:0/3123027412 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f539015de50 0x7f5390152090 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f538c00c560 tx=0x7f538c007f90 comp rx=0 tx=0).stop 2023-10-06T01:40:14.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.861+0000 7f5396420700 1 -- 172.21.15.69:0/3123027412 shutdown_connections 2023-10-06T01:40:14.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.861+0000 7f5396420700 1 --2- 172.21.15.69:0/3123027412 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7f53740670e0 0x7f5374069590 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.861+0000 7f5396420700 1 --2- 172.21.15.69:0/3123027412 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f539015de50 0x7f5390152090 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.861+0000 7f5396420700 1 --2- 172.21.15.69:0/3123027412 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7f53900cef40 0x7f539014d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.861+0000 7f5396420700 1 --2- 172.21.15.69:0/3123027412 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7f5390153c30 0x7f53900b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.861+0000 7f5396420700 1 -- 172.21.15.69:0/3123027412 >> 172.21.15.69:0/3123027412 conn(0x7f53900703a0 msgr2=0x7f539015bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:14.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.861+0000 7f5396420700 1 -- 172.21.15.69:0/3123027412 shutdown_connections 2023-10-06T01:40:14.863 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.861+0000 7f5396420700 1 -- 172.21.15.69:0/3123027412 wait complete. 2023-10-06T01:40:14.864 INFO:teuthology.orchestra.run.smithi069.stderr:instructed osd(s) 7 to deep-scrub 2023-10-06T01:40:14.874 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:40:14.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.987+0000 7ff3e0fa8700 1 Processor -- start 2023-10-06T01:40:14.988 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.987+0000 7ff3e0fa8700 1 -- start start 2023-10-06T01:40:14.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.988+0000 7ff3e0fa8700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff3dc153c30 0x7ff3dc15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.988+0000 7ff3e0fa8700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3dc15afd0 con 0x7ff3dc0cf110 2023-10-06T01:40:14.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.988+0000 7ff3e0fa8700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3dc15b2b0 con 0x7ff3dc15de50 2023-10-06T01:40:14.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.988+0000 7ff3e0fa8700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3dc15b590 con 0x7ff3dc153c30 2023-10-06T01:40:14.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.988+0000 7ff3db7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff3dc153c30 0x7ff3dc15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.988+0000 7ff3db7fe700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7ff3dc153c30 0x7ff3dc15a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40346/0 (socket says 172.21.15.69:40346) 2023-10-06T01:40:14.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.988+0000 7ff3dbfff700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7ff3dc0cf110 0x7ff3dc15c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:60410/0 (socket says 172.21.15.69:60410) 2023-10-06T01:40:14.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.988+0000 7ff3db7fe700 1 -- 172.21.15.69:0/2446632449 learned_addr learned my addr 172.21.15.69:0/2446632449 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:14.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.988+0000 7ff3db7fe700 1 -- 172.21.15.69:0/2446632449 >> v1:172.21.15.88:6789/0 conn(0x7ff3dc15de50 legacy=0x7ff3dc0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:14.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.988+0000 7ff3db7fe700 1 -- 172.21.15.69:0/2446632449 >> v1:172.21.15.69:6789/0 conn(0x7ff3dc0cf110 legacy=0x7ff3dc15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.988+0000 7ff3db7fe700 1 -- 172.21.15.69:0/2446632449 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3dc15b870 con 0x7ff3dc153c30 2023-10-06T01:40:14.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.988+0000 7ff3da7fc700 1 -- 172.21.15.69:0/2446632449 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 917062206 0 0) 0x7ff3dc15afd0 con 0x7ff3dc0cf110 2023-10-06T01:40:14.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.988+0000 7ff3db7fe700 1 --2- 172.21.15.69:0/2446632449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3dc153c30 0x7ff3dc15a5e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40099b0 tx=0x7ff3d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb1de63ae3aeada server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:14.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.988+0000 7ff3da7fc700 1 -- 172.21.15.69:0/2446632449 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d400b820 con 0x7ff3dc153c30 2023-10-06T01:40:14.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.988+0000 7ff3da7fc700 1 -- 172.21.15.69:0/2446632449 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d400b980 con 0x7ff3dc153c30 2023-10-06T01:40:14.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.988+0000 7ff3da7fc700 1 -- 172.21.15.69:0/2446632449 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d400bd20 con 0x7ff3dc153c30 2023-10-06T01:40:14.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.989+0000 7ff3e0fa8700 1 -- 172.21.15.69:0/2446632449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3dc153c30 msgr2=0x7ff3dc15a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.989+0000 7ff3e0fa8700 1 --2- 172.21.15.69:0/2446632449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3dc153c30 0x7ff3dc15a5e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7ff3d40099b0 tx=0x7ff3d4009250 comp rx=0 tx=0).stop 2023-10-06T01:40:14.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.989+0000 7ff3e0fa8700 1 -- 172.21.15.69:0/2446632449 shutdown_connections 2023-10-06T01:40:14.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.989+0000 7ff3e0fa8700 1 --2- 172.21.15.69:0/2446632449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3dc153c30 0x7ff3dc15a5e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.989+0000 7ff3e0fa8700 1 -- 172.21.15.69:0/2446632449 >> 172.21.15.69:0/2446632449 conn(0x7ff3dc0703a0 msgr2=0x7ff3dc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:14.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.989+0000 7ff3e0fa8700 1 -- 172.21.15.69:0/2446632449 shutdown_connections 2023-10-06T01:40:14.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.989+0000 7ff3e0fa8700 1 -- 172.21.15.69:0/2446632449 wait complete. 2023-10-06T01:40:14.995 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.990+0000 7ff3e0fa8700 1 Processor -- start 2023-10-06T01:40:14.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.990+0000 7ff3e0fa8700 1 -- start start 2023-10-06T01:40:14.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.991+0000 7ff3e0fa8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3dc0cf110 0x7ff3dc169940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.991+0000 7ff3e0fa8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3dc153c30 0x7ff3dc0b4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.991+0000 7ff3e0fa8700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff3dc15de50 0x7ff3dc16cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.991+0000 7ff3e0fa8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc152160 con 0x7ff3dc0cf110 2023-10-06T01:40:14.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.991+0000 7ff3e0fa8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc0c8680 con 0x7ff3dc153c30 2023-10-06T01:40:14.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.991+0000 7ff3e0fa8700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3dc169e80 con 0x7ff3dc15de50 2023-10-06T01:40:14.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.991+0000 7ff3db7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3dc0cf110 0x7ff3dc169940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.991+0000 7ff3db7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3dc0cf110 0x7ff3dc169940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40358/0 (socket says 172.21.15.69:40358) 2023-10-06T01:40:14.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.991+0000 7ff3db7fe700 1 -- 172.21.15.69:0/3404595607 learned_addr learned my addr 172.21.15.69:0/3404595607 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:14.996 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.991+0000 7ff3dbfff700 1 --2- 172.21.15.69:0/3404595607 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff3dc15de50 0x7ff3dc16cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.991+0000 7ff3daffd700 1 --2- 172.21.15.69:0/3404595607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3dc153c30 0x7ff3dc0b4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.991+0000 7ff3db7fe700 1 -- 172.21.15.69:0/3404595607 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff3dc15de50 msgr2=0x7ff3dc16cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.991+0000 7ff3db7fe700 1 --2- 172.21.15.69:0/3404595607 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff3dc15de50 0x7ff3dc16cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.991+0000 7ff3db7fe700 1 -- 172.21.15.69:0/3404595607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3dc153c30 msgr2=0x7ff3dc0b4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:14.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.991+0000 7ff3db7fe700 1 --2- 172.21.15.69:0/3404595607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3dc153c30 0x7ff3dc0b4c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:14.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.991+0000 7ff3db7fe700 1 -- 172.21.15.69:0/3404595607 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3d40094f0 con 0x7ff3dc0cf110 2023-10-06T01:40:14.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.991+0000 7ff3db7fe700 1 --2- 172.21.15.69:0/3404595607 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3dc0cf110 0x7ff3dc169940 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4009290 tx=0x7ff3d4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:14.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.992+0000 7ff3c37fe700 1 -- 172.21.15.69:0/3404595607 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d400baf0 con 0x7ff3dc0cf110 2023-10-06T01:40:14.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.992+0000 7ff3c37fe700 1 -- 172.21.15.69:0/3404595607 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3d4020070 con 0x7ff3dc0cf110 2023-10-06T01:40:14.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.992+0000 7ff3e0fa8700 1 -- 172.21.15.69:0/3404595607 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3dc0b51d0 con 0x7ff3dc0cf110 2023-10-06T01:40:14.997 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.992+0000 7ff3c37fe700 1 -- 172.21.15.69:0/3404595607 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3d401b450 con 0x7ff3dc0cf110 2023-10-06T01:40:14.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.992+0000 7ff3e0fa8700 1 -- 172.21.15.69:0/3404595607 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3dc0c7d50 con 0x7ff3dc0cf110 2023-10-06T01:40:14.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.993+0000 7ff3e0fa8700 1 -- 172.21.15.69:0/3404595607 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3dc04c3c0 con 0x7ff3dc0cf110 2023-10-06T01:40:14.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.993+0000 7ff3c37fe700 1 -- 172.21.15.69:0/3404595607 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7ff3d4022030 con 0x7ff3dc0cf110 2023-10-06T01:40:14.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.993+0000 7ff3c37fe700 1 --2- 172.21.15.69:0/3404595607 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff3c80670e0 0x7ff3c8069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:14.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.993+0000 7ff3c37fe700 1 -- 172.21.15.69:0/3404595607 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7ff3d4086500 con 0x7ff3dc0cf110 2023-10-06T01:40:14.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.993+0000 7ff3daffd700 1 --2- 172.21.15.69:0/3404595607 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff3c80670e0 0x7ff3c8069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:14.998 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.994+0000 7ff3daffd700 1 --2- 172.21.15.69:0/3404595607 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff3c80670e0 0x7ff3c8069590 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc0cd830 tx=0x7ff3d0009780 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:14.999 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:14.998+0000 7ff3c37fe700 1 -- 172.21.15.69:0/3404595607 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff3d4053710 con 0x7ff3dc0cf110 2023-10-06T01:40:15.179 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:15.177+0000 7ff3e0fa8700 1 -- 172.21.15.69:0/3404595607 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff3dc04c3c0 con 0x7ff3c80670e0 2023-10-06T01:40:15.181 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:15.180+0000 7ff3c37fe700 1 -- 172.21.15.69:0/3404595607 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72114 (secure 0 0 0) 0x7ff3dc04c3c0 con 0x7ff3c80670e0 2023-10-06T01:40:15.182 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:40:15.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:15.182+0000 7ff3e0fa8700 1 -- 172.21.15.69:0/3404595607 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff3c80670e0 msgr2=0x7ff3c8069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:15.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:15.182+0000 7ff3e0fa8700 1 --2- 172.21.15.69:0/3404595607 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff3c80670e0 0x7ff3c8069590 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc0cd830 tx=0x7ff3d0009780 comp rx=0 tx=0).stop 2023-10-06T01:40:15.184 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:15.182+0000 7ff3e0fa8700 1 -- 172.21.15.69:0/3404595607 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3dc0cf110 msgr2=0x7ff3dc169940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:15.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:15.182+0000 7ff3e0fa8700 1 --2- 172.21.15.69:0/3404595607 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3dc0cf110 0x7ff3dc169940 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7ff3d4009290 tx=0x7ff3d4016000 comp rx=0 tx=0).stop 2023-10-06T01:40:15.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:15.183+0000 7ff3e0fa8700 1 -- 172.21.15.69:0/3404595607 shutdown_connections 2023-10-06T01:40:15.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:15.183+0000 7ff3e0fa8700 1 --2- 172.21.15.69:0/3404595607 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff3c80670e0 0x7ff3c8069590 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:15.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:15.183+0000 7ff3e0fa8700 1 --2- 172.21.15.69:0/3404595607 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff3dc15de50 0x7ff3dc16cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:15.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:15.183+0000 7ff3e0fa8700 1 --2- 172.21.15.69:0/3404595607 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff3dc0cf110 0x7ff3dc169940 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:15.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:15.183+0000 7ff3e0fa8700 1 --2- 172.21.15.69:0/3404595607 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff3dc153c30 0x7ff3dc0b4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:15.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:15.183+0000 7ff3e0fa8700 1 -- 172.21.15.69:0/3404595607 >> 172.21.15.69:0/3404595607 conn(0x7ff3dc0703a0 msgr2=0x7ff3dc152ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:15.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:15.183+0000 7ff3e0fa8700 1 -- 172.21.15.69:0/3404595607 shutdown_connections 2023-10-06T01:40:15.185 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:15.183+0000 7ff3e0fa8700 1 -- 172.21.15.69:0/3404595607 wait complete. 2023-10-06T01:40:15.186 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-10-06T01:40:15.196 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2023-10-06T01:40:14.276752+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2382920,"kb_used_data":4616,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591800,"statfs":{"total":773094113280,"available":770654003200,"internally_reserved":0,"allocated":4726784,"data_stored":2618808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.441231"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:40:04.781356+0000","last_change":"2023-10-06T01:38:44.533111+0000","last_active":"2023-10-06T01:40:04.781356+0000","last_peered":"2023-10-06T01:40:04.781356+0000","last_clean":"2023-10-06T01:40:04.781356+0000","last_became_active":"2023-10-06T01:38:44.532838+0000","last_became_peered":"2023-10-06T01:38:44.532838+0000","last_unstale":"2023-10-06T01:40:04.781356+0000","last_undegraded":"2023-10-06T01:40:04.781356+0000","last_fullsized":"2023-10-06T01:40:04.781356+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:02.833069+0000","last_change":"2023-10-06T01:38:44.533897+0000","last_active":"2023-10-06T01:40:02.833069+0000","last_peered":"2023-10-06T01:40:02.833069+0000","last_clean":"2023-10-06T01:40:02.833069+0000","last_became_active":"2023-10-06T01:38:44.533611+0000","last_became_peered":"2023-10-06T01:38:44.533611+0000","last_unstale":"2023-10-06T01:40:02.833069+0000","last_undegraded":"2023-10-06T01:40:02.833069+0000","last_fullsized":"2023-10-06T01:40:02.833069+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:09:24.411408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":25,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:02.831702+0000","last_change":"2023-10-06T01:38:45.307814+0000","last_active":"2023-10-06T01:40:02.831702+0000","last_peered":"2023-10-06T01:40:02.831702+0000","last_clean":"2023-10-06T01:40:02.831702+0000","last_became_active":"2023-10-06T01:38:45.307536+0000","last_became_peered":"2023-10-06T01:38:45.307536+0000","last_unstale":"2023-10-06T01:40:02.831702+0000","last_undegraded":"2023-10-06T01:40:02.831702+0000","last_fullsized":"2023-10-06T01:40:02.831702+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T10:24:09.503713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:02.834665+0000","last_change":"2023-10-06T01:38:44.534507+0000","last_active":"2023-10-06T01:40:02.834665+0000","last_peered":"2023-10-06T01:40:02.834665+0000","last_clean":"2023-10-06T01:40:02.834665+0000","last_became_active":"2023-10-06T01:38:44.534191+0000","last_became_peered":"2023-10-06T01:38:44.534191+0000","last_unstale":"2023-10-06T01:40:02.834665+0000","last_undegraded":"2023-10-06T01:40:02.834665+0000","last_fullsized":"2023-10-06T01:40:02.834665+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T11:18:10.987138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:02.834037+0000","last_change":"2023-10-06T01:38:40.115117+0000","last_active":"2023-10-06T01:40:02.834037+0000","last_peered":"2023-10-06T01:40:02.834037+0000","last_clean":"2023-10-06T01:40:02.834037+0000","last_became_active":"2023-10-06T01:38:40.114142+0000","last_became_peered":"2023-10-06T01:38:40.114142+0000","last_unstale":"2023-10-06T01:40:02.834037+0000","last_undegraded":"2023-10-06T01:40:02.834037+0000","last_fullsized":"2023-10-06T01:40:02.834037+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:38.338797+0000","last_clean_scrub_stamp":"2023-10-06T01:38:38.338797+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:52:52.870262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:02.834146+0000","last_change":"2023-10-06T01:38:44.531831+0000","last_active":"2023-10-06T01:40:02.834146+0000","last_peered":"2023-10-06T01:40:02.834146+0000","last_clean":"2023-10-06T01:40:02.834146+0000","last_became_active":"2023-10-06T01:38:44.531496+0000","last_became_peered":"2023-10-06T01:38:44.531496+0000","last_unstale":"2023-10-06T01:40:02.834146+0000","last_undegraded":"2023-10-06T01:40:02.834146+0000","last_fullsized":"2023-10-06T01:40:02.834146+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T04:24:28.730152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:02.833169+0000","last_change":"2023-10-06T01:38:44.531335+0000","last_active":"2023-10-06T01:40:02.833169+0000","last_peered":"2023-10-06T01:40:02.833169+0000","last_clean":"2023-10-06T01:40:02.833169+0000","last_became_active":"2023-10-06T01:38:44.530966+0000","last_became_peered":"2023-10-06T01:38:44.530966+0000","last_unstale":"2023-10-06T01:40:02.833169+0000","last_undegraded":"2023-10-06T01:40:02.833169+0000","last_fullsized":"2023-10-06T01:40:02.833169+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T12:49:33.926180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":25,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:40:04.780324+0000","last_change":"2023-10-06T01:38:44.533582+0000","last_active":"2023-10-06T01:40:04.780324+0000","last_peered":"2023-10-06T01:40:04.780324+0000","last_clean":"2023-10-06T01:40:04.780324+0000","last_became_active":"2023-10-06T01:38:44.533324+0000","last_became_peered":"2023-10-06T01:38:44.533324+0000","last_unstale":"2023-10-06T01:40:04.780324+0000","last_undegraded":"2023-10-06T01:40:04.780324+0000","last_fullsized":"2023-10-06T01:40:04.780324+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-10-06T01:40:03.625047+0000","last_change":"2023-10-06T01:38:44.533765+0000","last_active":"2023-10-06T01:40:03.625047+0000","last_peered":"2023-10-06T01:40:03.625047+0000","last_clean":"2023-10-06T01:40:03.625047+0000","last_became_active":"2023-10-06T01:38:44.533406+0000","last_became_peered":"2023-10-06T01:38:44.533406+0000","last_unstale":"2023-10-06T01:40:03.625047+0000","last_undegraded":"2023-10-06T01:40:03.625047+0000","last_fullsized":"2023-10-06T01:40:03.625047+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:38:43.516881+0000","last_clean_scrub_stamp":"2023-10-06T01:38:43.516881+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:17:42.132584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":1036288,"data_stored":770127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.621},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.50700000000000001}]},{"osd":1,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.57199999999999995}]},{"osd":2,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.54600000000000004}]},{"osd":3,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.60599999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.35799999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.44},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.38}]},{"osd":6,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.41299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.59999999999999998}]},{"osd":1,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.52800000000000002}]},{"osd":2,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.46200000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.55700000000000005}]},{"osd":4,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.42999999999999999}]},{"osd":5,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.54300000000000004}]},{"osd":7,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.58699999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.36099999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":0.433}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.38900000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.65800000000000003}]},{"osd":5,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.68700000000000006}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.60399999999999998}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.628}]}]},{"osd":0,"up_from":13,"seq":55834574872,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":1036288,"data_stored":770127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"last":0.29999999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.35599999999999998}]},{"osd":3,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.38100000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.39200000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.438},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.46600000000000003}]},{"osd":6,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.45400000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.47699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574872,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.193},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.247}]},{"osd":1,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.29599999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.311}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.5}]},{"osd":5,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":2.4430000000000001},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.41599999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.40100000000000002}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.48299999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.44800000000000001}]},{"osd":1,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.435},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.54500000000000004}]},{"osd":2,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.56699999999999995}]},{"osd":4,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.505}]},{"osd":5,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.64400000000000002}]},{"osd":6,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.63400000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.57499999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.4289999999999998,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.53500000000000003}]},{"osd":1,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":4.2270000000000003,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.2789999999999999,"5min":4.2789999999999999,"15min":4.2789999999999999},"last":0.51900000000000002}]},{"osd":2,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":12.359,"5min":12.359,"15min":12.359},"last":0.55000000000000004},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":12.326000000000001,"5min":12.326000000000001,"15min":12.326000000000001},"last":0.56100000000000005}]},{"osd":3,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":3.448,"5min":3.448,"15min":3.448},"last":0.57599999999999996},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":12.282,"5min":12.282,"15min":12.282},"last":0.58699999999999997}]},{"osd":5,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.49399999999999999}]},{"osd":6,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.37},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.437}]},{"osd":7,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.46400000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.64700000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.57799999999999996}]},{"osd":2,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.56000000000000005}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.60599999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.67200000000000004}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.63300000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.623},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.65700000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:40:15.200 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-10-06T01:38:43.516881+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=38, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=40, tm_sec=10, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T01:40:15.201 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-10-06T01:38:43.516881+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=38, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=40, tm_sec=10, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T01:40:15.201 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-10-06T01:38:43.516881+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=38, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=40, tm_sec=10, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T01:40:15.201 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-10-06T01:38:43.516881+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=38, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=40, tm_sec=10, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T01:40:15.201 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-06T01:38:38.338797+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=38, tm_sec=38, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=40, tm_sec=10, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T01:40:15.201 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-10-06T01:38:43.516881+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=38, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=40, tm_sec=10, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T01:40:15.201 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-10-06T01:38:43.516881+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=38, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=40, tm_sec=10, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T01:40:15.201 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-10-06T01:38:43.516881+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=38, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=40, tm_sec=10, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T01:40:15.202 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-10-06T01:38:43.516881+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=38, tm_sec=43, tm_wday=4, tm_yday=279, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=6, tm_hour=1, tm_min=40, tm_sec=10, tm_wday=4, tm_yday=279, tm_isdst=0) 2023-10-06T01:40:15.202 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-06T01:40:18.907 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:40:18.910 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:40:35.203 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-06T01:40:35.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.330+0000 7fc861bc8700 1 Processor -- start 2023-10-06T01:40:35.331 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.330+0000 7fc861bc8700 1 -- start start 2023-10-06T01:40:35.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.331+0000 7fc861bc8700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc85c0b0ba0 0x7fc85c0c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:35.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.331+0000 7fc861bc8700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85c15a280 con 0x7fc85c0cf200 2023-10-06T01:40:35.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.331+0000 7fc861bc8700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc85c06e180 con 0x7fc85c0b07d0 2023-10-06T01:40:35.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.331+0000 7fc861bc8700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc85c06d850 con 0x7fc85c0b0ba0 2023-10-06T01:40:35.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.331+0000 7fc85bfff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc85c0b0ba0 0x7fc85c0c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:35.333 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.331+0000 7fc85bfff700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fc85c0b0ba0 0x7fc85c0c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47282/0 (socket says 172.21.15.69:47282) 2023-10-06T01:40:35.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.331+0000 7fc85affd700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fc85c0cf200 0x7fc85c06e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:53980/0 (socket says 172.21.15.69:53980) 2023-10-06T01:40:35.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.331+0000 7fc85bfff700 1 -- 172.21.15.69:0/2153376745 learned_addr learned my addr 172.21.15.69:0/2153376745 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:35.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.332+0000 7fc85bfff700 1 -- 172.21.15.69:0/2153376745 >> v1:172.21.15.88:6789/0 conn(0x7fc85c0b07d0 legacy=0x7fc85c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:35.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.332+0000 7fc85bfff700 1 -- 172.21.15.69:0/2153376745 >> v1:172.21.15.69:6789/0 conn(0x7fc85c0cf200 legacy=0x7fc85c06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:35.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.332+0000 7fc85bfff700 1 -- 172.21.15.69:0/2153376745 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc85c06db30 con 0x7fc85c0b0ba0 2023-10-06T01:40:35.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.332+0000 7fc85a7fc700 1 -- 172.21.15.69:0/2153376745 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236921814 0 0) 0x7fc85c15a280 con 0x7fc85c0cf200 2023-10-06T01:40:35.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.332+0000 7fc85bfff700 1 --2- 172.21.15.69:0/2153376745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc85c0b0ba0 0x7fc85c0c42c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc8540099b0 tx=0x7fc854009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae45d4dc1c25032 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:35.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.332+0000 7fc85a7fc700 1 -- 172.21.15.69:0/2153376745 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85400b860 con 0x7fc85c0b0ba0 2023-10-06T01:40:35.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.332+0000 7fc85a7fc700 1 -- 172.21.15.69:0/2153376745 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc85400b9c0 con 0x7fc85c0b0ba0 2023-10-06T01:40:35.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.332+0000 7fc85a7fc700 1 -- 172.21.15.69:0/2153376745 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc85400bd60 con 0x7fc85c0b0ba0 2023-10-06T01:40:35.334 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.332+0000 7fc861bc8700 1 -- 172.21.15.69:0/2153376745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc85c0b0ba0 msgr2=0x7fc85c0c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:35.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.332+0000 7fc861bc8700 1 --2- 172.21.15.69:0/2153376745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc85c0b0ba0 0x7fc85c0c42c0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fc8540099b0 tx=0x7fc854009250 comp rx=0 tx=0).stop 2023-10-06T01:40:35.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.333+0000 7fc861bc8700 1 -- 172.21.15.69:0/2153376745 shutdown_connections 2023-10-06T01:40:35.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.333+0000 7fc861bc8700 1 --2- 172.21.15.69:0/2153376745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc85c0b0ba0 0x7fc85c0c42c0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:35.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.333+0000 7fc861bc8700 1 -- 172.21.15.69:0/2153376745 >> 172.21.15.69:0/2153376745 conn(0x7fc85c06ce80 msgr2=0x7fc85c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:35.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.333+0000 7fc861bc8700 1 -- 172.21.15.69:0/2153376745 shutdown_connections 2023-10-06T01:40:35.335 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.333+0000 7fc861bc8700 1 -- 172.21.15.69:0/2153376745 wait complete. 2023-10-06T01:40:35.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.334+0000 7fc861bc8700 1 Processor -- start 2023-10-06T01:40:35.337 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.334+0000 7fc861bc8700 1 -- start start 2023-10-06T01:40:35.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.335+0000 7fc861bc8700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc85c0b07d0 0x7fc85c14b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:35.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.335+0000 7fc861bc8700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc85c0b0ba0 0x7fc85c098b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:35.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.335+0000 7fc861bc8700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc85c0cf200 0x7fc85c0b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:35.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.335+0000 7fc861bc8700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c09a040 con 0x7fc85c0b07d0 2023-10-06T01:40:35.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.335+0000 7fc861bc8700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c099430 con 0x7fc85c0b0ba0 2023-10-06T01:40:35.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.335+0000 7fc861bc8700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc85c099710 con 0x7fc85c0cf200 2023-10-06T01:40:35.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.335+0000 7fc85b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc85c0b07d0 0x7fc85c14b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:35.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.335+0000 7fc85b7fe700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc85c0b07d0 0x7fc85c14b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47284/0 (socket says 172.21.15.69:47284) 2023-10-06T01:40:35.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.335+0000 7fc85b7fe700 1 -- 172.21.15.69:0/1935652356 learned_addr learned my addr 172.21.15.69:0/1935652356 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:35.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.335+0000 7fc85bfff700 1 --2- 172.21.15.69:0/1935652356 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc85c0cf200 0x7fc85c0b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:35.338 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.335+0000 7fc85affd700 1 --2- 172.21.15.69:0/1935652356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc85c0b0ba0 0x7fc85c098b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:35.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.335+0000 7fc85b7fe700 1 -- 172.21.15.69:0/1935652356 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc85c0cf200 msgr2=0x7fc85c0b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:35.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.335+0000 7fc85b7fe700 1 --2- 172.21.15.69:0/1935652356 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc85c0cf200 0x7fc85c0b3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:35.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.335+0000 7fc85b7fe700 1 -- 172.21.15.69:0/1935652356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc85c0b0ba0 msgr2=0x7fc85c098b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:35.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.335+0000 7fc85b7fe700 1 --2- 172.21.15.69:0/1935652356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc85c0b0ba0 0x7fc85c098b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:35.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.335+0000 7fc85b7fe700 1 -- 172.21.15.69:0/1935652356 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8540094f0 con 0x7fc85c0b07d0 2023-10-06T01:40:35.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.335+0000 7fc85b7fe700 1 --2- 172.21.15.69:0/1935652356 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc85c0b07d0 0x7fc85c14b570 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00cd30 tx=0x7fc84c001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:35.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.335+0000 7fc8437fe700 1 -- 172.21.15.69:0/1935652356 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c00ab70 con 0x7fc85c0b07d0 2023-10-06T01:40:35.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.335+0000 7fc8437fe700 1 -- 172.21.15.69:0/1935652356 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84c00acd0 con 0x7fc85c0b07d0 2023-10-06T01:40:35.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.335+0000 7fc861bc8700 1 -- 172.21.15.69:0/1935652356 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc85c0999f0 con 0x7fc85c0b07d0 2023-10-06T01:40:35.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.335+0000 7fc8437fe700 1 -- 172.21.15.69:0/1935652356 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84c012670 con 0x7fc85c0b07d0 2023-10-06T01:40:35.339 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.335+0000 7fc861bc8700 1 -- 172.21.15.69:0/1935652356 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc85c0990c0 con 0x7fc85c0b07d0 2023-10-06T01:40:35.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.336+0000 7fc861bc8700 1 -- 172.21.15.69:0/1935652356 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc85c04c3c0 con 0x7fc85c0b07d0 2023-10-06T01:40:35.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.337+0000 7fc8437fe700 1 -- 172.21.15.69:0/1935652356 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fc84c012a60 con 0x7fc85c0b07d0 2023-10-06T01:40:35.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.337+0000 7fc8437fe700 1 --2- 172.21.15.69:0/1935652356 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc8480670e0 0x7fc848069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:35.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.337+0000 7fc8437fe700 1 -- 172.21.15.69:0/1935652356 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fc84c084e50 con 0x7fc85c0b07d0 2023-10-06T01:40:35.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.337+0000 7fc85affd700 1 --2- 172.21.15.69:0/1935652356 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc8480670e0 0x7fc848069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:35.340 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.337+0000 7fc85affd700 1 --2- 172.21.15.69:0/1935652356 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc8480670e0 0x7fc848069590 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0b4310 tx=0x7fc850007bd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:35.341 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.341+0000 7fc8437fe700 1 -- 172.21.15.69:0/1935652356 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc84c051fe0 con 0x7fc85c0b07d0 2023-10-06T01:40:35.520 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.520+0000 7fc861bc8700 1 -- 172.21.15.69:0/1935652356 --> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc85c071230 con 0x7fc8480670e0 2023-10-06T01:40:35.523 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.522+0000 7fc8437fe700 1 -- 172.21.15.69:0/1935652356 <== mgr.4105 v2:172.21.15.69:6832/90441 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+72351 (secure 0 0 0) 0x7fc85c071230 con 0x7fc8480670e0 2023-10-06T01:40:35.524 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:40:35.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.525+0000 7fc861bc8700 1 -- 172.21.15.69:0/1935652356 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc8480670e0 msgr2=0x7fc848069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:35.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.525+0000 7fc861bc8700 1 --2- 172.21.15.69:0/1935652356 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc8480670e0 0x7fc848069590 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc85c0b4310 tx=0x7fc850007bd0 comp rx=0 tx=0).stop 2023-10-06T01:40:35.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.525+0000 7fc861bc8700 1 -- 172.21.15.69:0/1935652356 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc85c0b07d0 msgr2=0x7fc85c14b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:35.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.525+0000 7fc861bc8700 1 --2- 172.21.15.69:0/1935652356 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc85c0b07d0 0x7fc85c14b570 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fc84c00cd30 tx=0x7fc84c001b40 comp rx=0 tx=0).stop 2023-10-06T01:40:35.525 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.525+0000 7fc861bc8700 1 -- 172.21.15.69:0/1935652356 shutdown_connections 2023-10-06T01:40:35.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.525+0000 7fc861bc8700 1 --2- 172.21.15.69:0/1935652356 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fc8480670e0 0x7fc848069590 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:35.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.525+0000 7fc861bc8700 1 --2- 172.21.15.69:0/1935652356 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fc85c0cf200 0x7fc85c0b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:35.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.525+0000 7fc861bc8700 1 --2- 172.21.15.69:0/1935652356 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc85c0b07d0 0x7fc85c14b570 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:35.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.525+0000 7fc861bc8700 1 --2- 172.21.15.69:0/1935652356 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fc85c0b0ba0 0x7fc85c098b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:35.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.525+0000 7fc861bc8700 1 -- 172.21.15.69:0/1935652356 >> 172.21.15.69:0/1935652356 conn(0x7fc85c06ce80 msgr2=0x7fc85c0c32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:35.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.525+0000 7fc861bc8700 1 -- 172.21.15.69:0/1935652356 shutdown_connections 2023-10-06T01:40:35.526 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.525+0000 7fc861bc8700 1 -- 172.21.15.69:0/1935652356 wait complete. 2023-10-06T01:40:35.526 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2023-10-06T01:40:35.537 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2023-10-06T01:40:34.281077+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":2382920,"kb_used_data":4616,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752591800,"statfs":{"total":773094113280,"available":770654003200,"internally_reserved":0,"allocated":4726784,"data_stored":2618808,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002660"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:40:20.252026+0000","last_change":"2023-10-06T01:40:20.251990+0000","last_active":"2023-10-06T01:40:20.252026+0000","last_peered":"2023-10-06T01:40:20.252026+0000","last_clean":"2023-10-06T01:40:20.252026+0000","last_became_active":"2023-10-06T01:38:44.532838+0000","last_became_peered":"2023-10-06T01:38:44.532838+0000","last_unstale":"2023-10-06T01:40:20.252026+0000","last_undegraded":"2023-10-06T01:40:20.252026+0000","last_fullsized":"2023-10-06T01:40:20.252026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:20.251876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:20.251876+0000","last_clean_scrub_stamp":"2023-10-06T01:40:20.251876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T01:44:08.245188+0000","scrub_duration":0.0015147299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:40:15.526513+0000","last_change":"2023-10-06T01:40:15.526482+0000","last_active":"2023-10-06T01:40:15.526513+0000","last_peered":"2023-10-06T01:40:15.526513+0000","last_clean":"2023-10-06T01:40:15.526513+0000","last_became_active":"2023-10-06T01:38:44.533611+0000","last_became_peered":"2023-10-06T01:38:44.533611+0000","last_unstale":"2023-10-06T01:40:15.526513+0000","last_undegraded":"2023-10-06T01:40:15.526513+0000","last_fullsized":"2023-10-06T01:40:15.526513+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.526383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.526383+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.526383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:35:52.013982+0000","scrub_duration":0.001607296,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:40:16.590701+0000","last_change":"2023-10-06T01:40:16.590675+0000","last_active":"2023-10-06T01:40:16.590701+0000","last_peered":"2023-10-06T01:40:16.590701+0000","last_clean":"2023-10-06T01:40:16.590701+0000","last_became_active":"2023-10-06T01:38:45.307536+0000","last_became_peered":"2023-10-06T01:38:45.307536+0000","last_unstale":"2023-10-06T01:40:16.590701+0000","last_undegraded":"2023-10-06T01:40:16.590701+0000","last_fullsized":"2023-10-06T01:40:16.590701+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:16.590580+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:16.590580+0000","last_clean_scrub_stamp":"2023-10-06T01:40:16.590580+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T06:22:43.640428+0000","scrub_duration":0.0012891910000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:40:18.610408+0000","last_change":"2023-10-06T01:40:18.610378+0000","last_active":"2023-10-06T01:40:18.610408+0000","last_peered":"2023-10-06T01:40:18.610408+0000","last_clean":"2023-10-06T01:40:18.610408+0000","last_became_active":"2023-10-06T01:38:44.534191+0000","last_became_peered":"2023-10-06T01:38:44.534191+0000","last_unstale":"2023-10-06T01:40:18.610408+0000","last_undegraded":"2023-10-06T01:40:18.610408+0000","last_fullsized":"2023-10-06T01:40:18.610408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:18.610269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:18.610269+0000","last_clean_scrub_stamp":"2023-10-06T01:40:18.610269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:29.692415+0000","scrub_duration":0.002087439,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"38'119","reported_seq":193,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:40:16.196762+0000","last_change":"2023-10-06T01:40:16.196708+0000","last_active":"2023-10-06T01:40:16.196762+0000","last_peered":"2023-10-06T01:40:16.196762+0000","last_clean":"2023-10-06T01:40:16.196762+0000","last_became_active":"2023-10-06T01:38:40.114142+0000","last_became_peered":"2023-10-06T01:38:40.114142+0000","last_unstale":"2023-10-06T01:40:16.196762+0000","last_undegraded":"2023-10-06T01:40:16.196762+0000","last_fullsized":"2023-10-06T01:40:16.196762+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'119","last_scrub_stamp":"2023-10-06T01:40:16.196591+0000","last_deep_scrub":"38'119","last_deep_scrub_stamp":"2023-10-06T01:40:16.196591+0000","last_clean_scrub_stamp":"2023-10-06T01:40:16.196591+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:31:22.579382+0000","scrub_duration":0.0055157950000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:40:19.213414+0000","last_change":"2023-10-06T01:40:19.213387+0000","last_active":"2023-10-06T01:40:19.213414+0000","last_peered":"2023-10-06T01:40:19.213414+0000","last_clean":"2023-10-06T01:40:19.213414+0000","last_became_active":"2023-10-06T01:38:44.531496+0000","last_became_peered":"2023-10-06T01:38:44.531496+0000","last_unstale":"2023-10-06T01:40:19.213414+0000","last_undegraded":"2023-10-06T01:40:19.213414+0000","last_fullsized":"2023-10-06T01:40:19.213414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:19.213277+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:19.213277+0000","last_clean_scrub_stamp":"2023-10-06T01:40:19.213277+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:35:55.700876+0000","scrub_duration":0.0019304019999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:40:22.086161+0000","last_change":"2023-10-06T01:40:22.086096+0000","last_active":"2023-10-06T01:40:22.086161+0000","last_peered":"2023-10-06T01:40:22.086161+0000","last_clean":"2023-10-06T01:40:22.086161+0000","last_became_active":"2023-10-06T01:38:44.530966+0000","last_became_peered":"2023-10-06T01:38:44.530966+0000","last_unstale":"2023-10-06T01:40:22.086161+0000","last_undegraded":"2023-10-06T01:40:22.086161+0000","last_fullsized":"2023-10-06T01:40:22.086161+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:22.085966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:22.085966+0000","last_clean_scrub_stamp":"2023-10-06T01:40:22.085966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T05:47:33.168112+0000","scrub_duration":0.002221181,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:40:15.344213+0000","last_change":"2023-10-06T01:40:15.344190+0000","last_active":"2023-10-06T01:40:15.344213+0000","last_peered":"2023-10-06T01:40:15.344213+0000","last_clean":"2023-10-06T01:40:15.344213+0000","last_became_active":"2023-10-06T01:38:44.533324+0000","last_became_peered":"2023-10-06T01:38:44.533324+0000","last_unstale":"2023-10-06T01:40:15.344213+0000","last_undegraded":"2023-10-06T01:40:15.344213+0000","last_fullsized":"2023-10-06T01:40:15.344213+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:15.344089+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:15.344089+0000","last_clean_scrub_stamp":"2023-10-06T01:40:15.344089+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T08:56:08.616608+0000","scrub_duration":0.002068369,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-10-06T01:40:17.183895+0000","last_change":"2023-10-06T01:40:17.183861+0000","last_active":"2023-10-06T01:40:17.183895+0000","last_peered":"2023-10-06T01:40:17.183895+0000","last_clean":"2023-10-06T01:40:17.183895+0000","last_became_active":"2023-10-06T01:38:44.533406+0000","last_became_peered":"2023-10-06T01:38:44.533406+0000","last_unstale":"2023-10-06T01:40:17.183895+0000","last_undegraded":"2023-10-06T01:40:17.183895+0000","last_fullsized":"2023-10-06T01:40:17.183895+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-06T01:40:17.183739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-06T01:40:17.183739+0000","last_clean_scrub_stamp":"2023-10-06T01:40:17.183739+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-07T07:25:00.870070+0000","scrub_duration":0.0014898209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574875,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":1036288,"data_stored":770127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.621},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.60899999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.65000000000000002}]},{"osd":2,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.63700000000000001}]},{"osd":3,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.67400000000000004}]},{"osd":4,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.48799999999999999}]},{"osd":5,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.53500000000000003}]},{"osd":6,"last update":"Fri Oct 6 01:39:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.58099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574876,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.629}]},{"osd":1,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.503},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.66100000000000003}]},{"osd":2,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.61199999999999999}]},{"osd":3,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.62,"15min":0.62},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.64400000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":1.552,"5min":1.552,"15min":1.552},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":1.623,"5min":1.623,"15min":1.623},"last":0.36899999999999999}]},{"osd":5,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"min":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.46200000000000002}]},{"osd":7,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.629,"15min":0.629},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.433}]}]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":0.34200000000000003}]},{"osd":2,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":2.1949999999999998,"5min":2.1949999999999998,"15min":2.1949999999999998},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":1.988,"5min":1.988,"15min":1.988},"last":0.40200000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":2.0129999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"last":0.435},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":0.38800000000000001}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":2.2250000000000001,"5min":2.2250000000000001,"15min":2.2250000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":1.7589999999999999,"5min":1.7589999999999999,"15min":1.7589999999999999},"last":0.58999999999999997}]},{"osd":5,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":1.8180000000000001,"5min":1.8180000000000001,"15min":1.8180000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":2.25,"5min":2.25,"15min":2.25},"last":0.60399999999999998}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":1.9059999999999999,"5min":1.9059999999999999,"15min":1.9059999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.626,"5min":0.626,"15min":0.626},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":1.8420000000000001,"5min":1.8420000000000001,"15min":1.8420000000000001},"last":0.51300000000000001}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":1.9610000000000001,"5min":1.9610000000000001,"15min":1.9610000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.625,"5min":0.625,"15min":0.625},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.794,"5min":1.794,"15min":1.794},"last":0.56200000000000006}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298300,"kb_used_data":1012,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073540,"statfs":{"total":96636764160,"available":96331304960,"internally_reserved":0,"allocated":1036288,"data_stored":770127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.308,"5min":0.308,"15min":0.308},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.439,"5min":0.439,"15min":0.439},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.317,"5min":0.317,"15min":0.317},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"last":0.375}]},{"osd":2,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.31,"15min":0.31},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"last":0.26100000000000001},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.23799999999999999,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.33100000000000002}]},{"osd":3,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.35399999999999998}]},{"osd":4,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.624},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.52400000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.29099999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.54700000000000004}]},{"osd":6,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.95699999999999996,"5min":0.95699999999999996,"15min":0.95699999999999996},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.91300000000000003},"last":0.57199999999999995}]},{"osd":7,"last update":"Fri Oct 6 01:39:37 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.90100000000000002,"5min":0.90100000000000002,"15min":0.90100000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.99299999999999999},"last":0.67200000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574876,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.38},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.39700000000000002}]},{"osd":1,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.372,"15min":0.372},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.35099999999999998}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.373,"15min":0.373},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.52000000000000002}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.64600000000000002}]},{"osd":5,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.61499999999999999}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.56399999999999995}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"last":0.63200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.36099999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.33200000000000002}]},{"osd":2,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":1.546,"5min":1.546,"15min":1.546},"last":0.442},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.38}]},{"osd":4,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":1.347,"5min":1.347,"15min":1.347},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":1.4650000000000001,"5min":1.4650000000000001,"15min":1.4650000000000001},"last":0.47799999999999998}]},{"osd":5,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.4930000000000001,"5min":1.4930000000000001,"15min":1.4930000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.93200000000000005},"last":0.48799999999999999}]},{"osd":6,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.375,"5min":1.375,"15min":1.375},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.52,"5min":1.52,"15min":1.52},"last":0.55700000000000005}]},{"osd":7,"last update":"Fri Oct 6 01:39:40 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.63,"15min":0.63},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.399,"5min":1.399,"15min":1.399},"last":0.65500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":3.4289999999999998,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":0.49399999999999999}]},{"osd":1,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":4.2270000000000003,"5min":4.2270000000000003,"15min":4.2270000000000003},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":4.2789999999999999,"5min":4.2789999999999999,"15min":4.2789999999999999},"last":0.48399999999999999}]},{"osd":2,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":1.1339999999999999,"5min":1.1339999999999999,"15min":1.1339999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":12.359,"5min":12.359,"15min":12.359},"last":0.56599999999999995},{"interface":"front","average":{"1min":1.147,"5min":1.147,"15min":1.147},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":12.326000000000001,"5min":12.326000000000001,"15min":12.326000000000001},"last":0.50800000000000001}]},{"osd":3,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":3.448,"5min":3.448,"15min":3.448},"last":0.627},{"interface":"front","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":12.282,"5min":12.282,"15min":12.282},"last":0.64100000000000001}]},{"osd":5,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.028,"5min":1.028,"15min":1.028},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.40899999999999997}]},{"osd":6,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1,"5min":1,"15min":1},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.375}]},{"osd":7,"last update":"Fri Oct 6 01:39:42 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70799999999999996,"5min":0.70799999999999996,"15min":0.70799999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.39900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574874,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297720,"kb_used_data":432,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074120,"statfs":{"total":96636764160,"available":96331898880,"internally_reserved":0,"allocated":442368,"data_stored":179759,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"last":0.438}]},{"osd":1,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"last":0.58899999999999997}]},{"osd":2,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.51100000000000001}]},{"osd":3,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.503},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.61899999999999999}]},{"osd":4,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":1.204,"5min":1.204,"15min":1.204},"last":0.63}]},{"osd":6,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"last":0.68100000000000005}]},{"osd":7,"last update":"Fri Oct 6 01:39:36 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.64700000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-06T01:40:35.540 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-06T01:40:35.654 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.654+0000 7ff0f95ef700 1 Processor -- start 2023-10-06T01:40:35.690 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.654+0000 7ff0f95ef700 1 -- start start 2023-10-06T01:40:35.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.655+0000 7ff0f95ef700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff0f40ca2c0 0x7ff0f40ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:35.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.655+0000 7ff0f95ef700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff0f40ccba0 0x7ff0f40cd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:35.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.655+0000 7ff0f95ef700 1 -- --> v1:172.21.15.88:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f40c32a0 con 0x7ff0f4157930 2023-10-06T01:40:35.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.655+0000 7ff0f95ef700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f40c9730 con 0x7ff0f40ccba0 2023-10-06T01:40:35.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.655+0000 7ff0f95ef700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f40cd560 con 0x7ff0f40ca2c0 2023-10-06T01:40:35.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.655+0000 7ff0f37fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff0f40ccba0 0x7ff0f40cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:35.695 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.655+0000 7ff0f27fc700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff0f40ca2c0 0x7ff0f40ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:35.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.655+0000 7ff0f2ffd700 1 --1- >> v1:172.21.15.88:6789/0 conn(0x7ff0f4157930 0x7ff0f40ab070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.88:6789/0 says I am v1:172.21.15.69:36972/0 (socket says 172.21.15.69:36972) 2023-10-06T01:40:35.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.655+0000 7ff0f37fe700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7ff0f40ccba0 0x7ff0f40cd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.88:3300/0 says I am v2:172.21.15.69:35844/0 (socket says 172.21.15.69:35844) 2023-10-06T01:40:35.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.655+0000 7ff0f2ffd700 1 -- 172.21.15.69:0/1141841005 learned_addr learned my addr 172.21.15.69:0/1141841005 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:40:35.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.656+0000 7ff0f27fc700 1 -- 172.21.15.69:0/1141841005 >> v2:172.21.15.88:3300/0 conn(0x7ff0f40ccba0 msgr2=0x7ff0f40cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:35.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.656+0000 7ff0f27fc700 1 --2- 172.21.15.69:0/1141841005 >> v2:172.21.15.88:3300/0 conn(0x7ff0f40ccba0 0x7ff0f40cd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:35.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.656+0000 7ff0f27fc700 1 -- 172.21.15.69:0/1141841005 >> v1:172.21.15.88:6789/0 conn(0x7ff0f4157930 legacy=0x7ff0f40ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:35.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.656+0000 7ff0f27fc700 1 -- 172.21.15.69:0/1141841005 --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f40c4100 con 0x7ff0f40ca2c0 2023-10-06T01:40:35.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.656+0000 7ff0f37fe700 1 --2- 172.21.15.69:0/1141841005 >> v2:172.21.15.88:3300/0 conn(0x7ff0f40ccba0 0x7ff0f40cd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-06T01:40:35.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.656+0000 7ff0f27fc700 1 --2- 172.21.15.69:0/1141841005 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff0f40ca2c0 0x7ff0f40ca730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80098e0 tx=0x7ff0e80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f84edae320d1811a server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:35.696 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.656+0000 7ff0f1ffb700 1 -- 172.21.15.69:0/1141841005 <== mon.2 v2:172.21.15.88:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e800b640 con 0x7ff0f40ca2c0 2023-10-06T01:40:35.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.656+0000 7ff0f1ffb700 1 -- 172.21.15.69:0/1141841005 <== mon.2 v2:172.21.15.88:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e800b7a0 con 0x7ff0f40ca2c0 2023-10-06T01:40:35.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.656+0000 7ff0f1ffb700 1 -- 172.21.15.69:0/1141841005 <== mon.2 v2:172.21.15.88:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e800bb40 con 0x7ff0f40ca2c0 2023-10-06T01:40:35.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.656+0000 7ff0f95ef700 1 -- 172.21.15.69:0/1141841005 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff0f40ca2c0 msgr2=0x7ff0f40ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:35.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.656+0000 7ff0f95ef700 1 --2- 172.21.15.69:0/1141841005 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff0f40ca2c0 0x7ff0f40ca730 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80098e0 tx=0x7ff0e80091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:35.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.657+0000 7ff0f95ef700 1 -- 172.21.15.69:0/1141841005 shutdown_connections 2023-10-06T01:40:35.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.657+0000 7ff0f95ef700 1 --2- 172.21.15.69:0/1141841005 >> v2:172.21.15.88:3300/0 conn(0x7ff0f40ccba0 0x7ff0f40cd020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:35.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.657+0000 7ff0f95ef700 1 --2- 172.21.15.69:0/1141841005 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff0f40ca2c0 0x7ff0f40ca730 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:35.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.657+0000 7ff0f95ef700 1 -- 172.21.15.69:0/1141841005 >> 172.21.15.69:0/1141841005 conn(0x7ff0f4088000 msgr2=0x7ff0f40883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:35.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.657+0000 7ff0f95ef700 1 -- 172.21.15.69:0/1141841005 shutdown_connections 2023-10-06T01:40:35.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.657+0000 7ff0f95ef700 1 -- 172.21.15.69:0/1141841005 wait complete. 2023-10-06T01:40:35.697 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.658+0000 7ff0f95ef700 1 Processor -- start 2023-10-06T01:40:35.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.658+0000 7ff0f95ef700 1 -- start start 2023-10-06T01:40:35.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.658+0000 7ff0f95ef700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0f40ca2c0 0x7ff0f40b3bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:35.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.658+0000 7ff0f95ef700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff0f40ccba0 0x7ff0f4158f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:35.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.658+0000 7ff0f95ef700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0f4157930 0x7ff0f41594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:35.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.658+0000 7ff0f95ef700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f4168cb0 con 0x7ff0f40ca2c0 2023-10-06T01:40:35.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.658+0000 7ff0f95ef700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f40b1f20 con 0x7ff0f4157930 2023-10-06T01:40:35.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.658+0000 7ff0f95ef700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f4167ca0 con 0x7ff0f40ccba0 2023-10-06T01:40:35.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.659+0000 7ff0f2ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0f40ca2c0 0x7ff0f40b3bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:35.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.659+0000 7ff0f2ffd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0f40ca2c0 0x7ff0f40b3bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47290/0 (socket says 172.21.15.69:47290) 2023-10-06T01:40:35.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.659+0000 7ff0f2ffd700 1 -- 172.21.15.69:0/4128477893 learned_addr learned my addr 172.21.15.69:0/4128477893 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:35.698 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.659+0000 7ff0f27fc700 1 --2- 172.21.15.69:0/4128477893 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff0f40ccba0 0x7ff0f4158f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:35.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.659+0000 7ff0f37fe700 1 --2- 172.21.15.69:0/4128477893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0f4157930 0x7ff0f41594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:35.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.659+0000 7ff0f2ffd700 1 -- 172.21.15.69:0/4128477893 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff0f40ccba0 msgr2=0x7ff0f4158f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:35.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.659+0000 7ff0f2ffd700 1 --2- 172.21.15.69:0/4128477893 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff0f40ccba0 0x7ff0f4158f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:35.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.659+0000 7ff0f2ffd700 1 -- 172.21.15.69:0/4128477893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0f4157930 msgr2=0x7ff0f41594d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:35.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.659+0000 7ff0f2ffd700 1 --2- 172.21.15.69:0/4128477893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0f4157930 0x7ff0f41594d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:35.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.659+0000 7ff0f2ffd700 1 -- 172.21.15.69:0/4128477893 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ec009420 con 0x7ff0f40ca2c0 2023-10-06T01:40:35.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.659+0000 7ff0f2ffd700 1 --2- 172.21.15.69:0/4128477893 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0f40ca2c0 0x7ff0f40b3bf0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff0e400cc70 tx=0x7ff0e4001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:35.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.659+0000 7ff0daffd700 1 -- 172.21.15.69:0/4128477893 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e400ce80 con 0x7ff0f40ca2c0 2023-10-06T01:40:35.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.659+0000 7ff0daffd700 1 -- 172.21.15.69:0/4128477893 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e400ab10 con 0x7ff0f40ca2c0 2023-10-06T01:40:35.699 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.659+0000 7ff0f95ef700 1 -- 172.21.15.69:0/4128477893 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0e8009420 con 0x7ff0f40ca2c0 2023-10-06T01:40:35.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.659+0000 7ff0daffd700 1 -- 172.21.15.69:0/4128477893 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0e40070f0 con 0x7ff0f40ca2c0 2023-10-06T01:40:35.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.659+0000 7ff0f95ef700 1 -- 172.21.15.69:0/4128477893 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f4168820 con 0x7ff0f40ca2c0 2023-10-06T01:40:35.700 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.660+0000 7ff0f95ef700 1 -- 172.21.15.69:0/4128477893 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f40c9570 con 0x7ff0f40ca2c0 2023-10-06T01:40:35.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.661+0000 7ff0daffd700 1 -- 172.21.15.69:0/4128477893 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7ff0e4007520 con 0x7ff0f40ca2c0 2023-10-06T01:40:35.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.661+0000 7ff0daffd700 1 --2- 172.21.15.69:0/4128477893 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff0e00670e0 0x7ff0e0069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:35.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.661+0000 7ff0daffd700 1 -- 172.21.15.69:0/4128477893 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7ff0e4084b90 con 0x7ff0f40ca2c0 2023-10-06T01:40:35.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.661+0000 7ff0f27fc700 1 --2- 172.21.15.69:0/4128477893 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff0e00670e0 0x7ff0e0069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:35.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.661+0000 7ff0f27fc700 1 --2- 172.21.15.69:0/4128477893 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff0e00670e0 0x7ff0e0069590 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80091e0 tx=0x7ff0e8017000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:35.701 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.665+0000 7ff0daffd700 1 -- 172.21.15.69:0/4128477893 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0e4051c80 con 0x7ff0f40ca2c0 2023-10-06T01:40:35.849 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.849+0000 7ff0f95ef700 1 -- 172.21.15.69:0/4128477893 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7ff0f404c3c0 con 0x7ff0f40ca2c0 2023-10-06T01:40:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.853+0000 7ff0daffd700 1 -- 172.21.15.69:0/4128477893 <== mon.0 v2:172.21.15.69:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7ff0e4051c80 con 0x7ff0f40ca2c0 2023-10-06T01:40:35.853 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.853+0000 7ff0daffd700 1 -- 172.21.15.69:0/4128477893 <== mon.0 v2:172.21.15.69:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) v1 ==== 123+0+0 (secure 0 0 0) 0x7ff0e40552a0 con 0x7ff0f40ca2c0 2023-10-06T01:40:35.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.856+0000 7ff0f95ef700 1 -- 172.21.15.69:0/4128477893 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff0e00670e0 msgr2=0x7ff0e0069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:35.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.856+0000 7ff0f95ef700 1 --2- 172.21.15.69:0/4128477893 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff0e00670e0 0x7ff0e0069590 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff0e80091e0 tx=0x7ff0e8017000 comp rx=0 tx=0).stop 2023-10-06T01:40:35.856 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.856+0000 7ff0f95ef700 1 -- 172.21.15.69:0/4128477893 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0f40ca2c0 msgr2=0x7ff0f40b3bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:35.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.856+0000 7ff0f95ef700 1 --2- 172.21.15.69:0/4128477893 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0f40ca2c0 0x7ff0f40b3bf0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7ff0e400cc70 tx=0x7ff0e4001a30 comp rx=0 tx=0).stop 2023-10-06T01:40:35.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.856+0000 7ff0f95ef700 1 -- 172.21.15.69:0/4128477893 shutdown_connections 2023-10-06T01:40:35.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.856+0000 7ff0f95ef700 1 --2- 172.21.15.69:0/4128477893 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7ff0e00670e0 0x7ff0e0069590 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:35.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.856+0000 7ff0f95ef700 1 --2- 172.21.15.69:0/4128477893 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7ff0f4157930 0x7ff0f41594d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:35.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.856+0000 7ff0f95ef700 1 --2- 172.21.15.69:0/4128477893 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff0f40ca2c0 0x7ff0f40b3bf0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:35.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.856+0000 7ff0f95ef700 1 --2- 172.21.15.69:0/4128477893 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7ff0f40ccba0 0x7ff0f4158f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:35.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.856+0000 7ff0f95ef700 1 -- 172.21.15.69:0/4128477893 >> 172.21.15.69:0/4128477893 conn(0x7ff0f4088000 msgr2=0x7ff0f4154480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:35.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.856+0000 7ff0f95ef700 1 -- 172.21.15.69:0/4128477893 shutdown_connections 2023-10-06T01:40:35.857 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.856+0000 7ff0f95ef700 1 -- 172.21.15.69:0/4128477893 wait complete. 2023-10-06T01:40:35.868 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-06T01:40:35.868 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-06T01:40:35.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.981+0000 7fe6352cf700 1 Processor -- start 2023-10-06T01:40:35.982 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.981+0000 7fe6352cf700 1 -- start start 2023-10-06T01:40:35.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.982+0000 7fe6352cf700 1 --2- >> v2:172.21.15.69:3300/0 conn(0x7fe6300cb970 0x7fe630159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:35.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.982+0000 7fe6352cf700 1 --2- >> v2:172.21.15.88:3300/0 conn(0x7fe63015a400 0x7fe630156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:35.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.982+0000 7fe6352cf700 1 -- --> v1:172.21.15.69:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe63015ae40 con 0x7fe6300cb5a0 2023-10-06T01:40:35.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.982+0000 7fe6352cf700 1 -- --> v2:172.21.15.69:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6300ce0f0 con 0x7fe6300cb970 2023-10-06T01:40:35.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.982+0000 7fe6352cf700 1 -- --> v2:172.21.15.88:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6300d13f0 con 0x7fe63015a400 2023-10-06T01:40:35.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.982+0000 7fe62effd700 1 --1- >> v1:172.21.15.69:6789/0 conn(0x7fe6300cb5a0 0x7fe6300cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.69:6789/0 says I am v1:172.21.15.69:53988/0 (socket says 172.21.15.69:53988) 2023-10-06T01:40:35.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.982+0000 7fe62effd700 1 -- 172.21.15.69:0/2534996134 learned_addr learned my addr 172.21.15.69:0/2534996134 (peer_addr_for_me v1:172.21.15.69:0/0) 2023-10-06T01:40:35.984 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.982+0000 7fe62e7fc700 1 --2- 172.21.15.69:0/2534996134 >> v2:172.21.15.69:3300/0 conn(0x7fe6300cb970 0x7fe630159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:35.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.983+0000 7fe62e7fc700 1 -- 172.21.15.69:0/2534996134 >> v2:172.21.15.88:3300/0 conn(0x7fe63015a400 msgr2=0x7fe630156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-06T01:40:35.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.983+0000 7fe62f7fe700 1 --2- 172.21.15.69:0/2534996134 >> v2:172.21.15.88:3300/0 conn(0x7fe63015a400 0x7fe630156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:35.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.983+0000 7fe62e7fc700 1 --2- 172.21.15.69:0/2534996134 >> v2:172.21.15.88:3300/0 conn(0x7fe63015a400 0x7fe630156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:35.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.983+0000 7fe62e7fc700 1 -- 172.21.15.69:0/2534996134 >> v1:172.21.15.69:6789/0 conn(0x7fe6300cb5a0 legacy=0x7fe6300cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:35.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.983+0000 7fe62dffb700 1 -- 172.21.15.69:0/2534996134 <== mon.0 v1:172.21.15.69:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4005766070 0 0) 0x7fe63015ae40 con 0x7fe6300cb5a0 2023-10-06T01:40:35.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.983+0000 7fe62e7fc700 1 -- 172.21.15.69:0/2534996134 --> v2:172.21.15.69:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63015ab60 con 0x7fe6300cb970 2023-10-06T01:40:35.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.983+0000 7fe62e7fc700 1 --2- 172.21.15.69:0/2534996134 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6300cb970 0x7fe630159ec0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fe6300ccdf0 tx=0x7fe6180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff7bf4b0c80f265d server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:35.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.983+0000 7fe62dffb700 1 -- 172.21.15.69:0/2534996134 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61800b6b0 con 0x7fe6300cb970 2023-10-06T01:40:35.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.983+0000 7fe62dffb700 1 -- 172.21.15.69:0/2534996134 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe61800b810 con 0x7fe6300cb970 2023-10-06T01:40:35.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.983+0000 7fe62dffb700 1 -- 172.21.15.69:0/2534996134 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe61800bbd0 con 0x7fe6300cb970 2023-10-06T01:40:35.985 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.983+0000 7fe6352cf700 1 -- 172.21.15.69:0/2534996134 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6300cb970 msgr2=0x7fe630159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:35.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.983+0000 7fe6352cf700 1 --2- 172.21.15.69:0/2534996134 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6300cb970 0x7fe630159ec0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fe6300ccdf0 tx=0x7fe6180091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:35.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.983+0000 7fe6352cf700 1 -- 172.21.15.69:0/2534996134 shutdown_connections 2023-10-06T01:40:35.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.983+0000 7fe6352cf700 1 --2- 172.21.15.69:0/2534996134 >> v2:172.21.15.88:3300/0 conn(0x7fe63015a400 0x7fe630156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:35.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.983+0000 7fe6352cf700 1 --2- 172.21.15.69:0/2534996134 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6300cb970 0x7fe630159ec0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:35.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.983+0000 7fe6352cf700 1 -- 172.21.15.69:0/2534996134 >> 172.21.15.69:0/2534996134 conn(0x7fe630070e30 msgr2=0x7fe6300d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:35.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.983+0000 7fe6352cf700 1 -- 172.21.15.69:0/2534996134 shutdown_connections 2023-10-06T01:40:35.986 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.983+0000 7fe6352cf700 1 -- 172.21.15.69:0/2534996134 wait complete. 2023-10-06T01:40:35.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.985+0000 7fe6352cf700 1 Processor -- start 2023-10-06T01:40:35.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.985+0000 7fe6352cf700 1 -- start start 2023-10-06T01:40:35.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.985+0000 7fe6352cf700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6300cb5a0 0x7fe6300b5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:35.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.985+0000 7fe6352cf700 1 --2- >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6300cb970 0x7fe6301531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:35.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.985+0000 7fe6352cf700 1 --2- >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe63015a400 0x7fe63014e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:35.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.985+0000 7fe6352cf700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6300c5b00 con 0x7fe6300cb5a0 2023-10-06T01:40:35.989 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.985+0000 7fe6352cf700 1 -- --> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe630153a00 con 0x7fe6300cb970 2023-10-06T01:40:35.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.985+0000 7fe6352cf700 1 -- --> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe630153ce0 con 0x7fe63015a400 2023-10-06T01:40:35.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.985+0000 7fe62effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6300cb5a0 0x7fe6300b5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:35.990 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.985+0000 7fe62effd700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6300cb5a0 0x7fe6300b5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47302/0 (socket says 172.21.15.69:47302) 2023-10-06T01:40:35.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.985+0000 7fe62effd700 1 -- 172.21.15.69:0/558676028 learned_addr learned my addr 172.21.15.69:0/558676028 (peer_addr_for_me v2:172.21.15.69:0/0) 2023-10-06T01:40:35.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.986+0000 7fe62f7fe700 1 --2- 172.21.15.69:0/558676028 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe63015a400 0x7fe63014e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:35.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.986+0000 7fe62effd700 1 -- 172.21.15.69:0/558676028 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe63015a400 msgr2=0x7fe63014e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:35.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.986+0000 7fe62effd700 1 --2- 172.21.15.69:0/558676028 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe63015a400 0x7fe63014e310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:35.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.986+0000 7fe62e7fc700 1 --2- 172.21.15.69:0/558676028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6300cb970 0x7fe6301531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:35.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.986+0000 7fe62effd700 1 -- 172.21.15.69:0/558676028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6300cb970 msgr2=0x7fe6301531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:35.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.986+0000 7fe62effd700 1 --2- 172.21.15.69:0/558676028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6300cb970 0x7fe6301531b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:35.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.986+0000 7fe62effd700 1 -- 172.21.15.69:0/558676028 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe618009420 con 0x7fe6300cb5a0 2023-10-06T01:40:35.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.986+0000 7fe62effd700 1 --2- 172.21.15.69:0/558676028 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6300cb5a0 0x7fe6300b5ab0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe62000cc70 tx=0x7fe620001a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:35.991 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.986+0000 7fe626ffd700 1 -- 172.21.15.69:0/558676028 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe62000ce80 con 0x7fe6300cb5a0 2023-10-06T01:40:35.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.986+0000 7fe626ffd700 1 -- 172.21.15.69:0/558676028 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fe62000ab70 con 0x7fe6300cb5a0 2023-10-06T01:40:35.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.986+0000 7fe6352cf700 1 -- 172.21.15.69:0/558676028 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6300c54b0 con 0x7fe6300cb5a0 2023-10-06T01:40:35.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.986+0000 7fe626ffd700 1 -- 172.21.15.69:0/558676028 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6200070f0 con 0x7fe6300cb5a0 2023-10-06T01:40:35.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.986+0000 7fe6352cf700 1 -- 172.21.15.69:0/558676028 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6301536f0 con 0x7fe6300cb5a0 2023-10-06T01:40:35.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.987+0000 7fe6352cf700 1 -- 172.21.15.69:0/558676028 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe63004c3c0 con 0x7fe6300cb5a0 2023-10-06T01:40:35.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.987+0000 7fe626ffd700 1 -- 172.21.15.69:0/558676028 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 7) v1 ==== 84893+0+0 (secure 0 0 0) 0x7fe6200074e0 con 0x7fe6300cb5a0 2023-10-06T01:40:35.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.988+0000 7fe626ffd700 1 --2- 172.21.15.69:0/558676028 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe6100670e0 0x7fe610069590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-06T01:40:35.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.988+0000 7fe626ffd700 1 -- 172.21.15.69:0/558676028 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 5292+0+0 (secure 0 0 0) 0x7fe620084b80 con 0x7fe6300cb5a0 2023-10-06T01:40:35.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.988+0000 7fe62e7fc700 1 --2- 172.21.15.69:0/558676028 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe6100670e0 0x7fe610069590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-06T01:40:35.992 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.988+0000 7fe62e7fc700 1 --2- 172.21.15.69:0/558676028 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe6100670e0 0x7fe610069590 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe6300b0b30 tx=0x7fe6180091a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-06T01:40:35.993 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:35.992+0000 7fe626ffd700 1 -- 172.21.15.69:0/558676028 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe620051d70 con 0x7fe6300cb5a0 2023-10-06T01:40:36.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:36.224+0000 7fe6352cf700 1 -- 172.21.15.69:0/558676028 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe630154020 con 0x7fe6300cb5a0 2023-10-06T01:40:36.224 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:36.224+0000 7fe626ffd700 1 -- 172.21.15.69:0/558676028 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3529 (secure 0 0 0) 0x7fe620084e60 con 0x7fe6300cb5a0 2023-10-06T01:40:36.225 INFO:teuthology.orchestra.run.smithi069.stdout: 2023-10-06T01:40:36.225 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":20,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4837,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6835/2963206981","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6833","nonce":2963206981},{"type":"v1","addr":"172.21.15.88:6835","nonce":2963206981}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5028,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6836/1958085129","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":1958085129},{"type":"v1","addr":"172.21.15.69:6836","nonce":1958085129}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":12},{"gid":5031,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/1745977228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6835","nonce":1745977228},{"type":"v1","addr":"172.21.15.69:6837","nonce":1745977228}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5134,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.88:6834/2434780943","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":2434780943},{"type":"v1","addr":"172.21.15.88:6834","nonce":2434780943}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20}],"filesystems":[]} 2023-10-06T01:40:36.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:36.226+0000 7fe6352cf700 1 -- 172.21.15.69:0/558676028 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe6100670e0 msgr2=0x7fe610069590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:36.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:36.226+0000 7fe6352cf700 1 --2- 172.21.15.69:0/558676028 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe6100670e0 0x7fe610069590 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fe6300b0b30 tx=0x7fe6180091a0 comp rx=0 tx=0).stop 2023-10-06T01:40:36.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:36.226+0000 7fe6352cf700 1 -- 172.21.15.69:0/558676028 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6300cb5a0 msgr2=0x7fe6300b5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-06T01:40:36.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:36.226+0000 7fe6352cf700 1 --2- 172.21.15.69:0/558676028 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6300cb5a0 0x7fe6300b5ab0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe62000cc70 tx=0x7fe620001a30 comp rx=0 tx=0).stop 2023-10-06T01:40:36.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:36.226+0000 7fe6352cf700 1 -- 172.21.15.69:0/558676028 shutdown_connections 2023-10-06T01:40:36.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:36.226+0000 7fe6352cf700 1 --2- 172.21.15.69:0/558676028 >> [v2:172.21.15.69:6832/90441,v1:172.21.15.69:6833/90441] conn(0x7fe6100670e0 0x7fe610069590 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:36.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:36.226+0000 7fe6352cf700 1 --2- 172.21.15.69:0/558676028 >> [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] conn(0x7fe63015a400 0x7fe63014e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:36.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:36.226+0000 7fe6352cf700 1 --2- 172.21.15.69:0/558676028 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6300cb5a0 0x7fe6300b5ab0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:36.227 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:36.226+0000 7fe6352cf700 1 --2- 172.21.15.69:0/558676028 >> [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] conn(0x7fe6300cb970 0x7fe6301531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-06T01:40:36.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:36.226+0000 7fe6352cf700 1 -- 172.21.15.69:0/558676028 >> 172.21.15.69:0/558676028 conn(0x7fe630070e30 msgr2=0x7fe630155fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-06T01:40:36.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:36.226+0000 7fe6352cf700 1 -- 172.21.15.69:0/558676028 shutdown_connections 2023-10-06T01:40:36.228 INFO:teuthology.orchestra.run.smithi069.stderr:2023-10-06T01:40:36.226+0000 7fe6352cf700 1 -- 172.21.15.69:0/558676028 wait complete. 2023-10-06T01:40:36.228 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 20 2023-10-06T01:40:36.238 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-06T01:40:36.238 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-06T01:40:36.239 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-06T01:40:36.239 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:40:36.247 INFO:tasks.ceph.mds.a:Stopped 2023-10-06T01:40:36.247 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-06T01:40:36.247 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:40:36.296 INFO:tasks.ceph.mds.c:Stopped 2023-10-06T01:40:36.296 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-06T01:40:36.296 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:40:36.309 INFO:tasks.ceph.mds.b:Stopped 2023-10-06T01:40:36.309 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-06T01:40:36.309 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:40:36.358 INFO:tasks.ceph.mds.d:Stopped 2023-10-06T01:40:36.359 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-06T01:40:36.359 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-06T01:40:36.359 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:40:36.387 INFO:tasks.ceph.osd.0:Stopped 2023-10-06T01:40:36.388 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-06T01:40:36.388 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:40:36.459 INFO:tasks.ceph.osd.1:Stopped 2023-10-06T01:40:36.459 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-06T01:40:36.459 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:40:36.528 INFO:tasks.ceph.osd.2:Stopped 2023-10-06T01:40:36.528 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-06T01:40:36.529 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:40:36.594 INFO:tasks.ceph.osd.3:Stopped 2023-10-06T01:40:36.595 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-06T01:40:36.595 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:40:36.622 INFO:tasks.ceph.osd.4:Stopped 2023-10-06T01:40:36.622 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-06T01:40:36.622 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:40:36.693 INFO:tasks.ceph.osd.5:Stopped 2023-10-06T01:40:36.693 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-06T01:40:36.693 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:40:36.768 INFO:tasks.ceph.osd.6:Stopped 2023-10-06T01:40:36.769 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-06T01:40:36.769 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:40:36.837 INFO:tasks.ceph.osd.7:Stopped 2023-10-06T01:40:36.837 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-06T01:40:36.837 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-06T01:40:36.837 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:40:36.863 INFO:tasks.ceph.mgr.y:Stopped 2023-10-06T01:40:36.863 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-06T01:40:36.863 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:40:36.903 INFO:tasks.ceph.mgr.x:Stopped 2023-10-06T01:40:36.903 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-06T01:40:36.904 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-06T01:40:36.904 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:40:36.914 INFO:tasks.ceph.mon.a:Stopped 2023-10-06T01:40:36.914 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-06T01:40:36.914 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:40:36.955 INFO:tasks.ceph.mon.b:Stopped 2023-10-06T01:40:36.955 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-06T01:40:36.955 INFO:teuthology.orchestra.run:waiting for 300 2023-10-06T01:40:37.007 INFO:tasks.ceph.mon.c:Stopped 2023-10-06T01:40:37.007 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-06T01:40:37.007 DEBUG:teuthology.orchestra.run.smithi069:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-10-06T01:40:37.037 INFO:teuthology.orchestra.run.smithi069.stdout:1696556324.5213823 mon.a (mon.0) 197 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T01:40:37.037 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-10-06T01:40:37.037 DEBUG:teuthology.orchestra.run.smithi069:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-10-06T01:40:37.106 DEBUG:teuthology.orchestra.run.smithi069:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-10-06T01:40:37.175 DEBUG:teuthology.orchestra.run.smithi069:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-10-06T01:40:37.243 INFO:teuthology.orchestra.run.smithi069.stdout:1696556324.5213823 mon.a (mon.0) 197 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2023-10-06T01:40:37.244 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi069.front.sepia.ceph.com 2023-10-06T01:40:37.244 DEBUG:teuthology.orchestra.run.smithi069:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-06T01:40:37.477 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi069.front.sepia.ceph.com 2023-10-06T01:40:37.477 DEBUG:teuthology.orchestra.run.smithi069:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-06T01:40:37.552 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi069.front.sepia.ceph.com 2023-10-06T01:40:37.552 DEBUG:teuthology.orchestra.run.smithi069:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-06T01:40:37.611 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi069.front.sepia.ceph.com 2023-10-06T01:40:37.612 DEBUG:teuthology.orchestra.run.smithi069:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-06T01:40:37.698 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi088.front.sepia.ceph.com 2023-10-06T01:40:37.699 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-06T01:40:37.897 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi088.front.sepia.ceph.com 2023-10-06T01:40:37.897 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-06T01:40:37.970 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi088.front.sepia.ceph.com 2023-10-06T01:40:37.970 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-06T01:40:38.038 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi088.front.sepia.ceph.com 2023-10-06T01:40:38.038 DEBUG:teuthology.orchestra.run.smithi088:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-06T01:40:38.087 INFO:tasks.ceph:Archiving mon data... 2023-10-06T01:40:38.088 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412094/data/mon.a.tgz 2023-10-06T01:40:38.088 DEBUG:teuthology.orchestra.run.smithi069:> mktemp 2023-10-06T01:40:38.104 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/tmp.r3rHBkdjBU 2023-10-06T01:40:38.104 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.r3rHBkdjBU 2023-10-06T01:40:38.232 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0666 /tmp/tmp.r3rHBkdjBU 2023-10-06T01:40:38.313 DEBUG:teuthology.orchestra.remote:smithi069:/tmp/tmp.r3rHBkdjBU is 342KB 2023-10-06T01:40:38.409 DEBUG:teuthology.orchestra.run.smithi069:> rm -fr /tmp/tmp.r3rHBkdjBU 2023-10-06T01:40:38.423 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412094/data/mon.b.tgz 2023-10-06T01:40:38.423 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2023-10-06T01:40:38.439 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.wx3vwVpTOp 2023-10-06T01:40:38.439 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.wx3vwVpTOp 2023-10-06T01:40:38.596 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.wx3vwVpTOp 2023-10-06T01:40:38.677 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.wx3vwVpTOp is 464KB 2023-10-06T01:40:38.773 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.wx3vwVpTOp 2023-10-06T01:40:38.787 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412094/data/mon.c.tgz 2023-10-06T01:40:38.787 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2023-10-06T01:40:38.840 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.5HO0mWope0 2023-10-06T01:40:38.840 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.5HO0mWope0 2023-10-06T01:40:38.981 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.5HO0mWope0 2023-10-06T01:40:39.061 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.5HO0mWope0 is 464KB 2023-10-06T01:40:39.158 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.5HO0mWope0 2023-10-06T01:40:39.172 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-06T01:40:39.172 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T01:40:39.175 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-06T01:40:39.235 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-06T01:40:39.236 DEBUG:teuthology.orchestra.run.smithi069:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T01:40:39.242 DEBUG:teuthology.orchestra.run.smithi088:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-06T01:40:39.265 INFO:teuthology.orchestra.run.smithi069.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T01:40:39.300 INFO:teuthology.orchestra.run.smithi088.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-06T01:40:39.305 INFO:tasks.ceph:Archiving crash dumps... 2023-10-06T01:40:39.307 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412094/remote/smithi069/crash 2023-10-06T01:40:39.308 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T01:40:39.335 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412094/remote/smithi088/crash 2023-10-06T01:40:39.336 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-06T01:40:39.369 INFO:tasks.ceph:Shutting down logrotate 2023-10-06T01:40:39.369 DEBUG:teuthology.orchestra.run.smithi069:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:40:39.381 DEBUG:teuthology.orchestra.run.smithi088:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-06T01:40:39.459 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T01:40:39.483 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-06T01:40:39.507 INFO:tasks.ceph:Compressing logs... 2023-10-06T01:40:39.507 DEBUG:teuthology.orchestra.run.smithi069:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T01:40:39.526 DEBUG:teuthology.orchestra.run.smithi088:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T01:40:40.278 INFO:tasks.ceph:Archiving logs... 2023-10-06T01:40:40.279 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412094/remote/smithi069/log 2023-10-06T01:40:40.280 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T01:40:40.559 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412094/remote/smithi088/log 2023-10-06T01:40:40.560 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-06T01:40:40.692 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-06T01:40:40.708 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-06T01:40:40.708 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T01:40:40.711 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-06T01:40:40.786 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-06T01:40:40.808 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-06T01:40:40.809 DEBUG:teuthology.orchestra.run.smithi069:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T01:40:40.815 DEBUG:teuthology.orchestra.run.smithi088:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-06T01:40:40.827 INFO:teuthology.orchestra.run.smithi069.stderr:bash: ntpq: command not found 2023-10-06T01:40:40.830 INFO:teuthology.orchestra.run.smithi088.stderr:bash: ntpq: command not found 2023-10-06T01:40:40.831 INFO:teuthology.orchestra.run.smithi069.stdout:210 Number of sources = 4 2023-10-06T01:40:40.831 INFO:teuthology.orchestra.run.smithi069.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T01:40:40.831 INFO:teuthology.orchestra.run.smithi069.stdout:=============================================================================== 2023-10-06T01:40:40.831 INFO:teuthology.orchestra.run.smithi069.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 25 +29us[ +29us] +/- 75ms 2023-10-06T01:40:40.831 INFO:teuthology.orchestra.run.smithi069.stdout:^* hv02.front.sepia.ceph.com 3 6 377 26 -432us[ -429us] +/- 62ms 2023-10-06T01:40:40.831 INFO:teuthology.orchestra.run.smithi069.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 27 +446us[ +449us] +/- 70ms 2023-10-06T01:40:40.832 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:40:40.832 INFO:teuthology.orchestra.run.smithi088.stdout:210 Number of sources = 4 2023-10-06T01:40:40.832 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-06T01:40:40.833 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2023-10-06T01:40:40.833 INFO:teuthology.orchestra.run.smithi088.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 25 +46us[ +46us] +/- 75ms 2023-10-06T01:40:40.833 INFO:teuthology.orchestra.run.smithi088.stdout:^* hv02.front.sepia.ceph.com 3 6 377 26 -425us[ -424us] +/- 62ms 2023-10-06T01:40:40.833 INFO:teuthology.orchestra.run.smithi088.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 26 +441us[ +441us] +/- 70ms 2023-10-06T01:40:40.833 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-06T01:40:40.834 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-06T01:40:40.852 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-06T01:40:40.852 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-06T01:40:40.865 DEBUG:teuthology.orchestra.run.smithi069:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T01:40:40.969 DEBUG:teuthology.orchestra.run.smithi088:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-06T01:40:41.058 DEBUG:teuthology.orchestra.run.smithi069:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T01:40:41.088 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:40:41.089 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-06T01:40:41.118 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:40:41.119 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-06T01:40:41.129 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-06T01:40:41.200 INFO:teuthology.task.internal:Duration was 780.309841 seconds 2023-10-06T01:40:41.201 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-06T01:40:41.279 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-06T01:40:41.279 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T01:40:41.281 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-06T01:40:41.323 INFO:teuthology.orchestra.run.smithi069.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T01:40:41.326 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-06T01:40:41.631 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-06T01:40:41.631 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi069.front.sepia.ceph.com 2023-10-06T01:40:41.631 DEBUG:teuthology.orchestra.run.smithi069:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T01:40:41.650 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi088.front.sepia.ceph.com 2023-10-06T01:40:41.651 DEBUG:teuthology.orchestra.run.smithi088:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-06T01:40:41.669 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-06T01:40:41.670 DEBUG:teuthology.orchestra.run.smithi069:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T01:40:41.693 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-06T01:40:41.747 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-06T01:40:41.747 DEBUG:teuthology.orchestra.run.smithi069:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T01:40:41.773 DEBUG:teuthology.orchestra.run.smithi088:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-06T01:40:41.859 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-06T01:40:41.871 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-06T01:40:41.871 DEBUG:teuthology.orchestra.run.smithi069:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T01:40:41.895 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-06T01:40:41.919 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-06T01:40:41.929 DEBUG:teuthology.orchestra.run.smithi069:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T01:40:41.937 DEBUG:teuthology.orchestra.run.smithi088:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-06T01:40:41.959 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern = core 2023-10-06T01:40:41.983 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = core 2023-10-06T01:40:41.996 DEBUG:teuthology.orchestra.run.smithi069:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T01:40:42.025 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:40:42.026 DEBUG:teuthology.orchestra.run.smithi088:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-06T01:40:42.050 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-06T01:40:42.050 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-06T01:40:42.078 INFO:teuthology.task.internal:Transferring archived files... 2023-10-06T01:40:42.079 DEBUG:teuthology.misc:Transferring archived files from smithi069:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412094/remote/smithi069 2023-10-06T01:40:42.079 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T01:40:42.115 DEBUG:teuthology.misc:Transferring archived files from smithi088:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412094/remote/smithi088 2023-10-06T01:40:42.115 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-06T01:40:42.149 INFO:teuthology.task.internal:Removing archive directory... 2023-10-06T01:40:42.149 DEBUG:teuthology.orchestra.run.smithi069:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T01:40:42.152 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-06T01:40:42.198 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-06T01:40:42.210 INFO:teuthology.task.internal:Not uploading archives. 2023-10-06T01:40:42.210 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-06T01:40:42.235 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-06T01:40:42.235 DEBUG:teuthology.orchestra.run.smithi069:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T01:40:42.238 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-06T01:40:42.249 INFO:teuthology.orchestra.run.smithi069.stdout: 262153 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 01:40 /home/ubuntu/cephtest 2023-10-06T01:40:42.252 INFO:teuthology.orchestra.run.smithi088.stdout: 262176 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 6 01:40 /home/ubuntu/cephtest 2023-10-06T01:40:42.253 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-06T01:40:42.282 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-06T01:40:42.303 INFO:teuthology.nuke:Checking targets against current locks 2023-10-06T01:40:42.331 DEBUG:teuthology.nuke:shortname: smithi069 2023-10-06T01:40:42.332 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T01:40:42.356 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412094', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 01:19:34.315778', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBowBKOLIpyipqFpD3/v7Yj0n5BMVMwAyKP5FFD/+0wS7K/ftkOtxWGpWHhdt032Y7/PG9/qTK4oKf9dlL8Pe7U='} 2023-10-06T01:40:42.357 DEBUG:teuthology.nuke:shortname: smithi088 2023-10-06T01:40:42.357 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-06T01:40:42.381 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-10-05_23:52:50-fs-wip-yuri-testing-2023-10-05-0730-quincy-distro-default-smithi/7412094', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-06 01:19:34.317380', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE0WqH0gRmlxyp8SlhsxOCEwnRt2oa83IfsFqZYkOxEWUH0tdXtupPuhn7MMwD/PxOS4dZhixw1qoUf9f++llto='} 2023-10-06T01:40:42.411 INFO:teuthology.orchestra.console.smithi069:Power off 2023-10-06T01:40:42.411 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T01:40:42.433 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2023-10-06T01:40:42.434 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T01:40:42.448 INFO:teuthology.orchestra.console.smithi088:Power off 2023-10-06T01:40:42.448 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-06T01:40:42.458 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-10-06T01:40:42.470 DEBUG:teuthology.orchestra.console.smithi088:power off output: Chassis Power Control: Down/Off 2023-10-06T01:40:42.470 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T01:40:42.497 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-10-06T01:40:46.459 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T01:40:46.498 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T01:40:46.569 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-10-06T01:40:46.607 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-10-06T01:40:50.570 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T01:40:50.608 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T01:40:50.681 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2023-10-06T01:40:50.719 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is on 2023-10-06T01:40:54.682 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T01:40:54.720 DEBUG:teuthology.orchestra.console.smithi088:pexpect command: ipmitool -H smithi088.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-06T01:40:54.792 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2023-10-06T01:40:54.830 DEBUG:teuthology.orchestra.console.smithi088:check power output: Chassis Power is off 2023-10-06T01:40:54.892 INFO:teuthology.orchestra.console.smithi069:Power off completed 2023-10-06T01:40:54.931 INFO:teuthology.orchestra.console.smithi088:Power off completed 2023-10-06T01:40:55.036 INFO:teuthology.run:Summary data: description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_8} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/finisher_per_module}} duration: 780.3098411560059 failure_reason: '"1696556324.5213823 mon.a (mon.0) 197 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED)" in cluster log' flavor: default owner: scheduled_yuriw@teuthology success: false 2023-10-06T01:40:55.037 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-06T01:40:55.121 INFO:teuthology.run:FAIL